Is it normal to get headaches and dull aching after wearing earmuffs after a few hours?

As to the earmuffs, how many styles have you tried? The most obvious answer is that the muffs you’re wearing are too tight or ridged and you should try another style. Even the tube that is like a sock hat with no top closure.

I’ve never been a fan of earphones. They can’t possibly be good on your hearing, long term. But again, if you like earphones, try different styles until you get a style that suits you. Wearing any style for ‘a few hours’ is, again, a bad idea, IMO.

Yeah, it is normal. It’s commonly associated with ear fatigue.

Try ear muffs with more padding or not as tight. As for headphones, try using studio grade headphones as they are made to be worn several hours with minimal ear fatigue.