Ok so I just replaced my front sway bar bushings and was working on doing the rear sway bar bushings and rear end link bushings as well. Bushings are from energy suspension and I was having issues with the rear end link bushings because they're not an exact fit. So I just left the car without the rear sway bar because its also my daily driver and i needed to move it. Well now I have this vibration when going 15 mph or less. Would no rear sway bar cause that vibration or would it be in issue with the front sway bar.

Not having a sway bar shouldn't impact vibration at all really.
Are you sure nothing is hitting/rubbing against anything?