Turning a RWD car without power steering is not difficult.
Removing it should be as simple as taking off the belt and removing the pump... You'll also have to loop the lines together as the PS fluid keeps the steering rack lubricated.
And yeah, removing simple things like PS and A/C helps to free up HP as they drain power. Many, many RX-7 people take both of these things out.
I've driven a few cars without PS and it's no big deal at all. It's actually nicer in some cases because you can really feel the road.