Well, I guess we were all (kinda) wrong. I disconnected my exhaust past the small downpipe today before we got some more of this wretched snow to see if my exhaust was the limiting factor and perhaps causing too much backpressure/choking the engine at high rpms. Turns out it was.
Before, it'd hit 10 psi and gradually wane to 6.5 psi past 5k rpm/Today, it hit 10 psi and stayed there till 6k rpm. By the time I was at 6k rpm in third, I was accelerating a bit too quickly for the road I was on, and I cant do this in second because the wheels spin.
It felt a LOT quicker today with just the downpipe + a 160 pound passenger + 40 more pounds of gas than it did a week ago, same weather, weighing 200 pounds less...too bad it's just too damn loud

You can hear the turbo spooling from soo far away, it sounds like a jet engine
I guess my exhaust is so restrictive because of my downpipe(s). The first one is 2.5" and is a 90 degree elbow that goes right past the transmission, and he second one is another 90 degree elbow that goes to the rest of my exhaust, including my cat. The problem is, the place I got to make up the downpipe said they'd "mandrel bend" the pipes, and indeed they didnt. That, coupled with a catalytic converter (even though it IS a high flow-one) is robbing me of quite a bit of boost. The rest of my 2.5" exhaust is VERY straight and mandrel bent.
So, I want to not only fabricate a new downpipe from the turbo all the way to the catalytic converter that is ALL mandrel bent, but I want to have a test-pipe made replicating the cat in length/size with 2 flanges at the end. Then, I'll just leave the straight pipe in there all the time, and when I have to go through emissions, I'll pop the cat back in...
I was also thinking of perhaps making some y-type exhaust fitting right past the downpipe--each port having a standard flange, with one port blocked up and the rest of the exhaust gasses goingthrough the regular exhaust, etc, for when I know I'm going to be going in populated (cop-populated) areas/through emissions, and then the port blocked up that goes to the rest of the exhaust and the other one opened to the environment when I'm feeling "racey." I think it'd be fairly easily made. My question is, because it is a Y pipe (actually, think of an upside down Y), would the extra "stem" on the Y that is not being used, either for when the Y is opened up to the whole exhaust or just opened up past the downpipe cause a hindrance in flow/turbulent air?!? Anyway..looks like it's time for a new downpipe for me. The problem will be finding someone who can ACTUALLY mandrel bend pipes, ie, keep the piping the exact same diameter all the way around, as in the piping you can order from JC whitney. If this can't be done, then I'll be forced to order parts from JC whitney, cut them int he right angle, and have them welded together....
Damn...and I'm right in the middle of trying to find a JWT ecu/370 cc injectors. I'm gonna be busy this winter