Fentanyl Patch

I have been taking oxycodone for years I think I started taking it in 2007 maybe in 2008 something like yhat. Before the pain doctors tried me on the fentanyl patch and I tryed alot of pain meds. This 1 was good. Now because of people on the strrets abusing it. My new doctor wants to take me off it. I dont think its fair. I have chronic back pain it will never get better. I have a new doctor. Now I dont know what to do