On mine there's a small white puller mounted on the corner of the box. You pull that out, push it over the fuse, and pull. If you don't have one of those, some needle nose pliers will do the trick.
It's just a small brown fuse that has 7.5 stamped on the end like the third down on the left, correct?
If not, can you post a picture of what you're looking at?