If what we could call a soul, was to be nothing more, than our perspective of things - you being here and now, reading world through your senses in that or another body - would simply switching those "souls" with another person be anyhow noticable?
Here you are, just minding your own business, while suddenly, you as you know it, just changes lives, changes perspective of things, inherits all past, present and - to some extent - deterministic future. All memories, feelings, everything that makes you "you" and not "him" or "her".
Nothing really happens in the grand scheme of things - for you or anything in the universe, really. Unless you come up with some beyond briliant idea on how to test such suspects with at least a grain of success.

So, if the answer to aforementioned question was a simple "no", then what would people in such universe be truly - the body or the soul? The means or the matter? What did versus whatever just happened to be around while it happened.
Keep in mind, that without such "soul" you are as good as dead - in the most literal sense.

Also, holy fugg, spring is here and it's heccin' beautiful, I kid you not. Kinda sucks cuz muh pollen, but whatev, often rains fix it in a jiffy.