Like A Rubber

Listen up, buttercup! The joke is that the person feels like they are being used like a rubber (eraser) because they are constantly getting hit by people. They are saying they cannot feel the emotional or physical impact, just like a rubber.