If you really want to start working on your car yourself, then it would be a great idea to get a chiltons manual ,
http://www.themotorbookstore.com/altima.html, which you can purchase at your local parts store) that will give you clear step by step instructions with detailed pictures. Definitely sounds like your heater core is leaking...http://shop.advanceautoparts.c...36___Get a new one, I also recommend flushing your coolant system, Stop leak can mess up alot of stuff.
http://www.240sx.org/faq/articles/coolant.htm
After you have done this it might be a good idea to get a compression test of the coolant system, If you don't have one or don't know anyone with one then your local mechanics shop should do this for very cheap, it takes maybe fifteen minutes including waiting for the car to cool down.