What are your weights made out of?
It's possible you are allergic to the weights. I'm allergic to certain types of plastic (in grocery bags for example). Carrying some types of them makes my skin on my hands inflamed where the plastic has come into contact with my skin.
You might be buying a new set of weights. If so, I'd go for something solid, made out of metal only.