I read the whole thread to make sure I saw your follow-up comments to the first post.
And now I have to say, you are way overreacting. Maybe it's because of your home move, but I think you have lost your perspective. Not that you have to be happy about it, but your reaction is over the top. If you can't accept it, at least do yourself a favor and don't make an issue over it at work.
If he wants you to move because he thinks you aren't doing any work, being upset is only going to convince him he was right.
If he wants you to move because he thinks it will improve the group, being upset is only going to make him think you can't get along with your co-workers.
If he wants you to move because he has other plans for your current spot, being upset is only going to make him think you are a PITA prima donna who thinks he's deserving of special treatment.
I have had to move people who didn't want to move, and they thought they could concoct some lame excuses to get me to "see the whole story". Here was one attempt, by a person who was sitting in the middle of an aisle, and was being moved to another spot which was on the end of an aisle: "I think it will hurt my work to sit there, because the noise made by people going up and down the hall all day will keep distracting me from my work. So if my work suffers, don't blame me because I've already told you that was going to happen." My answer was to suggest that he give it his best shot, and as long as I never catch him loafing I will accept his explanation. But if I did catch him, then I would know he wasn't making his best effort, and none of that would matter. And since it's not all that tough to catch someone loafing if you are intent on doing it, that was that. It definitely hurt his career, though, except he'll never know it because no one is going to tell him.
Those attempts are so transparent and all they did was convince me they are slackers who thought I was so dumb that their BS would fool me.