I looked into it a long time ago, just wanted to get enough equipment to make some fixed blade knives I could be proud of. And then I discovered the same thing you did.
Much like any other hobby, it's the acquisition of all the
tools that really kills your wallet. I hear that many people make do quite nicely with
a short section of rail as their anvil (for smaller projects). I even went so far as to acquire a piece, but never did anything with it, and believe I discarded it long ago.
If you decide to the the full-on anvil route, don't forget about the
other kinds of fun you can have with them.
--Patrick