Thank you centralcoaster33 for your reply
In case anyone else has this issue and need a replacement guide:
I received the replacement part last week in the mail - took a week to ship to Canada; purchased it on eBay (search for 32005-AX000 which is Renault's equivalent to 32005-00QAE, and is cheaper - further inspection, it actually was the exact same part as the OEM one that came with the car) for 16USD.
To test if it was really the switch problem, I first took off the wiring connector from the old switch, and connected it to the new switch and tested the reverse lights. It works with the new one when the switch is pressed in! Time to replace the old one!
So for easier access, I took off the battery, and the battery holder since the switch is right on top of the transmission and right below the battery to the left. I then stuck my arm into really tight and weird angle and used a 24mm wrench to loosen the old switch. Then, it' s as easy as taking it off by hand and screwing the new one in. I didn't bother torquing it back to spec... hope it doesn't come back to bite me down the road...
P.S. no M/T fluid came out as expected (thank you again centralcoaster33) since it was on the top of the tranny.
Pic of where it is, from top down:
And yay, reverse lights work!