You don't even actually need webspace to try it out. Go ahead and download
XAMPP. It'll give you all the tools you need to run PHP locally--including PHP, MySQL, phpMyAdmin, and of course apache.
I *highly* recommend
tizag.com for learning PHP (and MySQL). I learned just about everything I know from that website--it's nice and easy to follow.