I was punched on the right side of my head, it's been three days and my head still hurts

I got into a fight and was punched on the side of my head. I believe I was hit in my temple. It's been 3 days and my head still hurts, should I be worried?