It's been a while since I've been able to really look at this problem, but it seems to be intermittent and is not happening constantly.
The balancer being the problem makes sense, especially considering the intermittent nature of the problem. I can't find a part number for the balancer in FAST. I'm assuming that means I have to replace the entire pulley, correct?
What tools will I need to remove and replace the crank pulley?
I picked up a 20-250 ft-lb torque wrench on sale from Canadian tire for $54.99 before tax

(I figure I can torque it to 250 and then tighten a bit further with a breaker bar). One of the local auto parts chains does a tool loan program so I can get my hands on a puller for the pulley. OwnerCS, I see you used a chain wrench to hold the pulley. Is this the only way to hold the pulley and keep it from rotating while you tighten the bolt?
As far as installing the pulley onto the crank and aligning it for the balancer, is the crankshaft keyed so it can only be installed one way or are there markings that need to be lined up?