Speaking of web servers, I tend to prefer
Lighty over the others because of its speed and small footprint.
Web hosting really doesn't have to cost a whole lot though. Take a look at
NearlyFreeSpeech. It's pay for what you use, so you can get by on a low-traffic site with $5 a year or even less. Shell access and Haskell CGI are cool too.