Noise when I let off the accelerator in my 02 V6

[realmc1969]

I have a 2002 V6 manual. Whenever I'm driving and accelerating or maintaining speed its fine, but when i let off of the accelerator and its in gear it makes this noise like something is scrubbing. It does it every time regardless of what gear I'm in. It shifts absolutely perfect, smooth as glass, it just makes that noise. Any ideas????

[realmc1969]

OK to update my own question. I jacked up my car and got the front wheels off the ground and cranked it up. I noticed that the noise i hear when i lift the accelerator is there when its just running and not in gear at all. Its not as loud but is lightly there. The only time its not there at all is when i press the clutch in. When i put the car in gear its there when i mash the gas and its louder when i take my foot off the gas. I crawled under the car and let someone else do it and its coming from where the transmission and clutch are. I thought originally it was the clutch so I had it replaced and it did need replacing, however this problems remains. I just don't see how its the clutch or transmission when it makes the noise when its not in gear. PLEASE HELP MEEEEEE!!!!!!