Like, very freaking hard, if not outright impossible. They're just...so wall and ear penetrating and they mess up my internal rhythm and ugh.
I swear no one will get this because no one else lives in the same house as a drummer.
I don't live with a drummer either, but I too find them irritating at times. However, I live near a high school, and their drum line can be heard from here when the band is practicing in the early hours in the morning.
So yeah, I understand how you feel.