When he took it off he got some "stuff" on his fingers

If he wiped them off first it's highly unlikely that you would be pregnant. First off you would have to be ovulating. Second when when he ejaculates there are like a million sperm in the ejaculate but by the time it gets all the way up there are only a few left becuse the vagina, uterus sees the sperm as not belonging there and attacks them in turn killing them. So lets say he had a few on his fingers how likely do you think it is that they would survive? But if you are really really worried there is always the plan b pill, kinda pricey for one pill if you ask me. You could wait and take a test, cheaper than the plan b pill but will make you nervous to wait. I would also recommend that you try to get on the pill(that does not mean that he should not wear a condom) that way if it happens again you wont have to worry.