Towards the end of their visit both my mother and one of my sisters (not at the same time or together) asked me if it didn't stress me out. It didn't. In fact, my mother caused more of a headache for me by getting stressed out. The next question was "Why doesn't it bother you?". The answer was pretty easy. I lived in South Korea.
I spent 10 years living and working in South Korea. Confusion, noise, last minute changes, and lateness is par for the course in life there. You learn over time to ignore it to a degree or you go insane. You find ways to vent, like blogging, so you don't explode. Compared to what I put up with in Korea it didn't rate very high on the stress or bullshit scale.
Living and working in Korea also helped me to deal with my Sister-in-law. She is deaf and has a lot of the same trouble that students learning English have when speaking. Vocabulary, pronunciation, and talking speed at times. You have to pay attention when she speaks and when you reply you have to watch your speed and vocabulary. It was a lot like talking with students. Which meant I had no problems, or stress, talking with her and understanding her. And she was able to understand me.
My 10 years in South Korea pretty much prepared me for my brother's visit. :)