Unless you're really doing some hardcore stuff, I don't think a gumstix is necessary. Look at the Atmel AVR series, specifically the ATMegas. An STK500 development kit can be had for $80 and includes
everything to get started. Someone likened it to a Swiss Army knife for microcontrollers, and I agree.
Atmel STK500