Protected intercourse, but should I be worried? Condom never broke

Me and my bf had sex last week and we did it twice with condoms obviously, first time we did it we used condom and i gave him a bj and he came in my mouth, we still checked the condom and it didnt broke, second time we did it with a condom he couldnt come, i tried giving him a bj and a hand job and he couldnt come, we checked the condom and it didnt break either. but my boyfriend told me that he was worried because he thought that maybe the 2 time he couldve came insidme me but i told him that if he wouldve came then he couldnt still be hard and continue having sex, right? and it wouldve been obvious if he wouldve came but he says he really doesnt remember, if he did and we pour water into condoms at the end to see if something broke and i never saw something inside the condom. So he couldnt come because maybe its hard for guys come again during the 2 round right? should i be worried about something? i know the condom never broke and i really dont think he came inside me but still im a little nervous, please share what you guys think!!!!