Nope, it was a metal slot that fit into another metal tab right at the striker part of the door.
And oh yes, you can take the panel off (pretty much) without taking off the door. Thats how I fixed it

Its something called violent force. Door panel is still in 1 piece so its all gravy