I have a lump in my neck since years ago, now is like the size of quarter

I have a lump in my neck since years ago, now is like the size of quarter, i went to the emergency room and the doctor said it wasnt nothing serious that i can live with that in my neck. Its really painful, and what i am nervous about my vein, what should i do, should i go back to the doctor to check to it and remove it. Or leaving it in there and wont cause any damage... It already start to bother me