32 wks prego and still taking subs w/o a dr prescription...will they take my baby away?

Im 23 and have been struggling with opiate addiction since i was 14. I sought help for it about 14 mos ago and was put on suboxone(24mgs). However, about 10 mos ago i was discharged from my dr who was prescribing them for me because I messed up and was honest and instead of giving me another chance, he kicked me off completley. There are not many drs in my area who prescribe suboxone and even less who take medicaid which is the insurance i have. I continued taking subs because I was scared of going back to using opiates, but I was getting them off other people who I met in tretment who were also on them. I found out I was pregnant in May and when i found out, i went back to the dr who was prescribing them just to ask his advice on what I should do. He told me not to go off them cold turkey because whatever w/d i feel, the baby will also go thru and the stress on the baby could cause a misscarige. He suggested I wein myself down as much as possible until i was comfortable comming off them completley. Im down to about 2mgs a day but cant seem to take the jump completley. I recently tried to stop and was unsuccessful. It was a lot harder than I thought. My ob knows that ive been taking them but doesnt exactly know that i didnt have a dr prescribing them. Im 32 wks now and i realld expected myself to be off by now. Im scared that im gonna go into labor and the baby is gonna test positive for subs and their gonna take him away from me. Im not a bad mother. I have a 3yr old son and my life revolves around my kids, but this whole situation has made me feel really guilty. Has anybody been thru this?? Im scared to death. I dont want my baby to get taken away from me. I could really use some advice if anyone knows anything about this. Thank you