Im taking suboxone while Im pregnant, will the baby have eff

I have been addicted to pain medication for almost seven years now and i became clean about a year ago by going to a clinic. I was put on suboxone and it has saved my life and i havent takin pills since. But when i found out i was pregnant i still was taking them and stoped but then had withdraws from them and i know the risks and didnt want to have a miscarriage. So im now eight months pregnant and have been taking them but only at a bare minumum or if i really need it. I didnt tell my doctor cuz he is a family friend and i feel ashamed and no one knows i have been on them for this long, my family, friends think i stoped taking them after a couple weeks and the withdraws were over. Im just scared that my son may come out and have withdraws or birth defects, and i will for sure have to step up and tell them i was taking it, so i can help my baby in the right way if something needs to be done. But so far my check ups have all looked great so do i still need to be concerned?