How long do you have to be on the pill before unprotected sex is safe?

Hello!

I am 18 years old and my boyfriend is 21. We have been dating for over three years and sexually active for about two. We have always been as safe as possible, using a condom every single time and even with a condom on he always pulled out and never came in me in case the condom failed.

Almost three months ago I started birth control. It's not the one where you only get your period every three months, I still get mine monthly. 

When I first got on it we still used a condom with the birth control because my doctor told me to wait at least a month after starting before having unprotected sex, and I still wanted to be doubly safe.

However, the last two times we had sex we did not use a condom. He still did not come in me, though he did pull out at the last second the first time (I KNOW for a fact he didn't come in me though, he has too much respect for me to lie about something like that).

I am pretty good at taking my pill at the same time. I have an alarm set on my phone so I can't forget. The only time I took it late was within the first month, and it was only by an hour. I also took it about 45 minute early about a month ago because I was going somewhere and wouldn't have been able to take it when I normally do (I take it every night at 9)

My question is, based on this information, how protected from pregnancy am I even though we did not use a condom? This is not a regular occurrence and will not be in the future. Like I said, I prefer to be doubly protected.