I've been plucking my beard hairs for about 5 years now.
The hairs on my chin were course and women said it was very 'pokey'.
I would get very itchy along my jawline and one day I decided to pluck out a hair that was on top of an itchy spot with my fingernails... and it felt amazing. After a short while I begin to notice a few strands that would come from one root, some thicker hairs would slide right out with no resistance, and that some of the more 'pokey' hairs were real tough to pull out, and they would end up being 4-5x thicker and completely round (i could poke them through a piece of paper... as opposed to other thinner flatter hairs). The thicker hairs felt grounded right into my jawbone, and would offer a great deal of relief when pulled out from the root.. In fact if I pulled one out and it broke leaving the root in place i could feel a small amount of discomfort as it grew back. Then one day, I was struggling with one of these thicker hairs that had been bothering me- I jerk my head back and I get the sucker out, and right away I could tell that it was the last crazy thick hair, the weird feeling in my face was totally gone.. and since I have not found any more hairs like that... I still pick my hairs constantly tho.
My story echoes yours. I've been doing it for about 10 years. It's true about the facial hairs not growing back but I can't stop...