No sweat. Yeah, the joint just allows for some movement, but it's really just a damper. There's actually another one on the lower steering link, too. Like the upper link, the lower link also doesn't see any flex except during turning. The material is about 1/4" thick, and a fairly dense material.

(ignore the green circle...unless you're removing the joint, then make sure you completely remove that bolt to fully collapse the link)
If the bushings checked out, then yeah, consider an alignment. Since alignments aren't cheap, though, there are a few ways to do a poor man's alignment check to see if you'll benefit from it (or a way to DIY). (Google "poor man's alignment" or "string alignment" and you'll see what I mean).
Beyond that, if the TREs are also good, other susceptible places include wheel bearings and a worn steering rack. If your truck is lifted, that could also be the problem...it can put the TREs at an angle that less efficient at resisting left-right feedback from the tires.