little small bumbs under my armpits beneath the skin a little itch sometimes

I suppose these are ingrown hairs bit it is quite possible that they got infected by skin bacteria or fungul. Both of these infections would cause itching and I would suggest you saw a dermatologist for a proper evaluations. The sooner you have it checked, the sooner you will get rid of them. It takes usually a lot of time for them to disapper if not treated and yeast infection may even persist.