I'd start by hooking up some compressed air to the line to verify the actuator is actually working. If you disconnect it completely and keep it wide open yourself, does it still do it? If that's the case, then your wastegate is too damn small, or your turbine is too efficient

AKA Boost creep.
One way to combat that is to increase the backpressure in your exhaust... so if you have straight pipe/dump, add a muffler. If you have 3" exhaust, step it down to 2.5.