Before you trek down the path that I mistakenly wandered down years ago, I just want to say there is definitely good reason to learn kanji.
Basically, once you get to a certain point with Japanese (and it's not that far down the road), you'll know tons of words that are pronounced the same way, but have no clue from the meaning aside from context, unless you know kanji. Yes, there are words with a single kanji that have multiple meanings, but kanji definitely clears things up. Also, once you get the kanji you can generally understand the idea behind words much better, and get the gist of words made up of combinations of kanji you know even if you're not sure of the reading.
Otherwise, getting started in the language, the internet's the only way to do it cheap, so basically replace any costly-looking option with an internet alternative:
pick up movies & tv shows in Japanese- anime is a deep wellspring for this if you're into it, but sometimes the japanese it uses is a little bit unusual
pick up books & magazines - again, anime/manga is a good place
pick up music - not sure if you can stand jpop, jrap, or jrock, but there are a lot of options out there; I listen to Okinawan music myself.
make friends - join a local japanese society to take up language, drumming, koto, or origami lessons.
get a good dictionary - I'm going to go out on a limb and say pick up a strong electronic dictionary from Cannon Wordtank, Seiko, Casio XD-GW9600, or Sharp. I've got a Seiko SR-E10000 and I love the thing. It was labeled as "translators only" when I got it and it's really helped to bring up my level, i use it everyday.
get a good kanji learning book - you can use the pdfs from this site as a start, there are tons of kanji out there. The Basic Kanji books from Bonjinsha would be a good start. Don't forget the Kanji Practice pads either.
get a good grammar book - you could probably use a good textbook for this: Nakama, Minna no nihongo, Japanese for Everyone, Japanese for Busy People, Genki, yookoso, the UNICOM JLPT study guides, or others. Personally I think Japanese for Everyone might be the best starter book out there for self study- it's 1 volume and covers a lot. Pure grammar books include: A Dictionary of Basic Japanese Grammar, A Dictionary of Intermediate Japanese Grammar, and Making Sense of Japanese- all 3 are highly recommended.
penpals - join a penpal site, to force yourself to write sentences in japanese. sites for finding penpals include places like the hiragana times website and forums like here. in order to write japanese on a windows computer install IME from control panel - regional settings.
internet resources:
http://www.guidetojapanese.org/
http://www.thejapanesepage.com/news.php
http://www.kanji-a-day.com/index.php
http://japanese.about.com/library/blbeginkanji.htm
http://www.jlptstudy.com/forum/
http://www.jgram.org/index.php
http://mixi.jp/home.pl
The idea behind all of this is to flood yourself with exposure- even if you don't understand any of it, you'll get practice at discerning what you do understand. Plus, if you see/hear situational examples it will expand your vocabulary & understanding.
Be warned though, it takes a long time to really get what they're saying on TV.