I'm just a couple months into college, so maybe I shouldn't say anything, but I will. In the past I've always done more than I had to, challenged myself, and achieved great things (this is as big is my ego gets!). Whenever I talk about one of my crazy intentions, reaction are always "wow" "that's a lot of work" or "that can't be done" - something along those lines. When I decided I wanted to start a team, I kept hearing (these are not exagerations) "It can't be done at this school," "someone already tried that and it won't work," and "it sounds cool, but..." I didn't listen to them. Instead, I founded 1020. Now all those people who said those things can't even look me in the eyes today.
I normally laugh at those kinds of reactions, but coming to college I kept hearing so many people say that I needed to take it slow that I actually listened for once. And now I regret it. I'm paying paying big bucks and I'm not really challenged. So next semester will be different.
John makes a good point. If you can't handle your classes, how are you going to handle FIRST? However, my advice is that if you want to do something (i.e. start a FIRST team) and
you think you can do it: don't ask "can I?" or "should I?" I'm not judging others' views (because they are valid and from a wise perspective - and I may join them after next semseter) however my pet peeve is defeatism simply because it discourages people. Especially when they are defeatist about themselves. If you try and fail - you can say you tried. If you don't try all you can say is the weak statement "I thought about it."
And remember - you have homework as a freshman!

Dean's homework directed to seniors in high school was to make sure their college has a team. But again, if you can't handle it, you should hold out. However, if you think you can do it, but everyone's got you nervous...I wouldn't listen to them.
My two cents for now - maybe I'll add a nickel or two after next semester.