As mentioned above, pull out a little on the straps or edge of the helmet so that it doesn't drag across your ears.
I use an HJC IS-16 helmet and have no issues with my earbuds. I think I spent $15 at Walmart on them. They are noise-cancelling and angled to fit closer into your ear. Been...