I tend to have a problem with clutter, too, and I find that I do feel calmer when there's less clutter. It's like there's a certain level beyond which I start to feel anxious.
I think this also goes back to posts I've made about not having many friends - fewer friends means fewer people making demands on my time and energy. It seems my own obligations to my my own family, running my household, taking care of my pets, and my job, are enough for me. I've tried to explain this to my husband - that those things are enough for me without being obligated to spend hours on the phone chatting, and entertaining houseguests. Those things send me into overload very quickly.
I often go to bed early so I can read, do a crossword puzzle, or watch a TV show I like without having to do anything else at the same time. Since I have to multitask a good part of the day, that's my chance to just do one thing at a time.
I find that making lists sometimes helps, too, because sometimes I'll forget important things while I'm running around doing other things. My mind gets cluttered, and like my house, there's a point beyond which I don't function so well...