Go to Post You can take the man out of FIRST, but you can't take FIRST out of the man. - George1902 [more]
Home
Go Back   Chief Delphi > CD-Media > White Papers
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

photos

papers

everything



Stop the Stop Build - Counterpoint

John.Antilla

By: John.Antilla
New: 08-09-2016 23:32
Updated: 08-09-2016 23:32
Total downloads: 417 times


A discussion on Jim Zondag's proposal "Stop the Stop Build".

This paper offers a critical analysis of the original posting by Jim Zondag point-for-point.

Attached Files

  • pdf Stop the Stop Build - Counterpoint

    Stop the Stop Build - Counterpoint.pdf

    downloaddownload file

    uploaded: 08-09-2016 23:32
    filetype: pdf
    filesize: 720.57kb
    downloads: 415



Recent Downloaders

  • Guest

Discussion

view entire thread

Reply

09-09-2016 12:46

BMiller2559


Unread Re: paper: Stop the Stop Build - Counterpoint

I am not sure this is actually a counter point. True, you do address his comments point by point and somewhat disagree but in the end you basically agree that some sort of modification would be helpful especially to lower resource teams that cannot build twin robots.

I really liked your questions at the end and wish something like them had been in the poll. Things like; Does you team build right up to bag day with little practice driving time? Does you team often finish their robot at their fist competition? Does your team build a twin robot to continue to prototype and practice after bag day? These would have all been questions to gain insight into how teams at different levels operate.



09-09-2016 14:38

John.Antilla


Unread Re: paper: Stop the Stop Build - Counterpoint

I see your point. I thought the speculation that teams will develop the behavior of not competing until late in the season to take advantage of the extra time WAS the counterpoint. Maybe I wasn't clear enough. Thanks for the feedback.



09-09-2016 15:02

AllenGregoryIV


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by John.Antilla View Post
I see your point. I thought the speculation that teams will develop the behavior of not competing until late in the season to take advantage of the extra time WAS the counterpoint. Maybe I wasn't clear enough. Thanks for the feedback.
That can't happen, there aren't enough events in enough areas for that to happen. How many events each year don't fill? I'll try to pull the data together this weekend, but I'm sure it's not enough to matter. Most areas are struggling to add enough spots to fill demand.



09-09-2016 16:16

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

I like what you have written, but I personally would have finished with a differnt, perhaps more sharply contrasting counterpoint.

The on-the-field performance of teams/robots is not the central focus of the FRC program described on FIRST's website, nor is it the thread tying together the many descriptions offered by FRC's founders and current leaders. However, in the day-to-day operation of many FRC teams, and in the minds of many participants, on-the-field performance becomes the tail that wags the dog. With that in mind, and wanting to reduce the amount of dog-wagging done by that tail ...

A) I believe that having (recreating?) an actual 45-day build season would be (restore?) an excellent part of the foundation of wise compromises that FRC rests upon. FRC should push in this direction.

B) I think that the the on-the-field performance exhibited by the teams that are already doing well (in that part of FIRST), is good enough. I don't mean to say that better performance would be harmful; but if I'm right, I do mean that across the globe, for the teams that aren't struggling, improving the on-the-field part of FRC should not be pulling time, attention, and other resources away from the other parts of FRC.

Now, to get to the heart of it:

For the teams that are not doing well, and are consequently exhibiting the trouble-on-the-field symptom, giving them an 8 hour out-of-bag period each week (or not) seems to be a relatively small item a big picture. I think that properly preparing them to make good use of their 45 days will make the 8 hours unnecessary (the extra time won't hurt, but it won't be *necessary*). If a team makes good use of those first 45 days, they will be ready to do well enough when they roll into their first event. If instead they are currently using the 45 days poorly, it seems intuitive to me to expect that after a year-or-two transition they will be using added 8-hour windows poorly too.

So ... Please don't let a post-stop-build-day weekly unbag period rise to the top of the list of ways to assist struggling teams. Instead let's focus on helping them with project management, and everything that is tied to that subject; along with helping them with the soft skills of recruiting students and mentors, finding funding, having effective meetings, etc.

I know the original paper's author isn't focused so strongly on the 8-hour unbag topic that he is ignoring other ways to help struggling teams. I also know he is part of a large, deeply-caring and highly-motivated FiM team that wants all students to succeed.

But, reading this paper, a reader can get the impression that the OPR tail ought to (and will) wag the FRC dog. Instead I think OPRs and similar symptoms/metrics won't change for the long haul until the dogs are healthy. A few unbagging periods will help a little, but still won't make the dogs healthy. The root causes for struggling will still be there.

Given my beliefs, I'm personally led to believe FRC shouldn't be churning its ranks with debates about ways to extend/expand build seasons. There are much more important fish to fry.

Sure, ask permission to try a handful of small well-designed unbag experiments, but worry about them only after getting permission to carry out pre-build-season experiments that will attack likely root causes, before attacking what is likely to be only a symptom. If that is what is already happening, the paper does itself a disservice by not mentioning building on or amplifying those efforts.

Blake



09-09-2016 16:22

Richard Wallace


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AllenGregoryIV View Post
That can't happen, there aren't enough events in enough areas for that to happen. How many events each year don't fill? I'll try to pull the data together this weekend, but I'm sure it's not enough to matter. Most areas are struggling to add enough spots to fill demand.
Certainly there will not be enough available late-season slots for all the teams that would prefer them, if John's speculation is valid. Lack of availability does not refute the speculation, though. If playing late really is an advantage, then how will FIRST decide which teams get that advantage?

My own (FiM) team prefers playing one district early and another late; e.g. Week 2 and Week 5 in 2016. The early one is an advantage for teams that work hard and finish the robot(s) so they can practice. The late one is an opportunity for improvement. So, for us, John's speculation is not an issue.

For a one-and-done Regional team, I think that John's speculation is valid.



09-09-2016 16:37

JB987


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by gblake View Post
I like what you have written, but I personally would have finished with a differnt, perhaps more sharply contrasting counterpoint.

The on-the-field performance of teams/robots is not the central focus of the FRC program described on FIRST's website, nor is it the thread tying together the many descriptions offered by FRC's founders and current leaders. However, in the day-to-day operation of many FRC teams, and in the minds of many participants, on-the-field performance becomes the tail that wags the dog. With that in mind, and wanting to reduce the amount of dog-wagging done by that tail ...

A) I believe that having (recreating?) an actual 45-day build season would be (restore?) an excellent part of the foundation of wise compromises that FRC rests upon. FRC should push in this direction.

B) I think that the the on-the-field performance exhibited by the teams that are already doing well (in that part of FIRST), is good enough. I don't mean to say that better performance would be harmful; but if I'm right, I do mean that across the globe, for the teams that aren't struggling, improving the on-the-field part of FRC should not be pulling time, attention, and other resources away from the other parts of FRC.

Now, to get to the heart of it:

For the teams that are not doing well, and are consequently exhibiting the trouble-on-the-field symptom, giving them an 8 hour out-of-bag period each week (or not) seems to be a relatively small item a big picture. I think that properly preparing them to make good use of their 45 days will make the 8 hours unnecessary (the extra time won't hurt, but it won't be *necessary*). If a team makes good use of those first 45 days, they will be ready to do well enough when they roll into their first event. If instead they are currently using the 45 days poorly, it seems intuitive to me to expect that after a year-or-two transition they will be using added 8-hour windows poorly too.

So ... Please don't let a post-stop-build-day weekly unbag period rise to the top of the list of ways to assist struggling teams. Instead let's focus on helping them with project management, and everything that is tied to that subject; along with helping them with the soft skills of recruiting students and mentors, finding funding, having effective meetings, etc.

I know the original paper's author isn't focused so strongly on the 8-hour unbag topic that he is ignoring other ways to help struggling teams. I also know he is part of a large, deeply-caring and highly-motivated FiM team that wants all students to succeed.

But, reading this paper, a reader can get the impression that the OPR tail ought to (and will) wag the FRC dog. Instead I think OPRs and similar symptoms/metrics won't change for the long haul until the dogs are healthy. A few unbagging periods will help a little, but still won't make the dogs healthy. The root causes for struggling will still be there.

Given my beliefs, I'm personally led to believe FRC shouldn't be churning its ranks with debates about ways to extend/expand build seasons. There are much more important fish to fry.

Sure, ask permission to try a handful of small well-designed unbag experiments, but worry about them only after getting permission to carry out pre-build-season experiments that will attack likely root causes, before attacking what is likely to be only a symptom. If that is what is already happening, the paper does itself a disservice by not mentioning building on or amplifying those efforts.

Blake
Blake,
Much of your point here is based on the attribution of poor choice/time management on the part of struggling teams. In many cases, teams are limited in time they can spend each week and are limited as far as access to build facilities by school or district fiat. Additional weeks to work directly on their robot could help them better deal with time limitations...who knows, maybe even give them time to add an autonomous element to their performance



09-09-2016 18:02

Brandon Holley


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by John.Antilla View Post
I see your point. I thought the speculation that teams will develop the behavior of not competing until late in the season to take advantage of the extra time WAS the counterpoint. Maybe I wasn't clear enough. Thanks for the feedback.
This is where an experiment (or targeted data collection) can be pretty helpful I think. Is it simply time with the robot that is making teams better later in the season? Or is the act of executing on a field, with tighter constraints and against real competition forcing iteration/evolution that bumps performance later in the season?

FWIW, my personal starting guess is that its probably 80% the latter, and 20% the former.

With my above viewpoint noted, I don't view competing later as an automatic advantage. You may be potentially gaining more time with your robot, but at the same time, so is everyone else. Per Jim's data, you would need to come out of the gate with a stronger performance if your first event was week 5 versus week 1. This also totally passes the eye test I see each season. You get more time with your robot, but that time comes at the expense of HAVING to be better to reach the same end performance.

-Brando



09-09-2016 18:07

Siri


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Richard Wallace View Post
Certainly there will not be enough available late-season slots for all the teams that would prefer them, if John's speculation is valid. Lack of availability does not refute the speculation, though. If playing late really is an advantage, then how will FIRST decide which teams get that advantage?

My own (FiM) team prefers playing one district early and another late; e.g. Week 2 and Week 5 in 2016. The early one is an advantage for teams that work hard and finish the robot(s) so they can practice. The late one is an opportunity for improvement. So, for us, John's speculation is not an issue.

For a one-and-done Regional team, I think that John's speculation is valid.
It's certainly a reasonable question, so let's examine the dissausive factors. District teams would (and are) put in a position to trade off playing late versus the amount of time they have to improve and recoup between events. They also shoulder the same tradeoff as a one-and-done Regional team, below.

A one-and-done Regional team, unless they are somehow in a regional that's all one-and-dones*, is at a disadvantage with that cohort in terms of actual competition experience. Unfortunately, we can't have any data on the exact value of this alone without dropping SBD. Nonetheless, one could speculate that a one-and-done has to choose which week to attend based on their own Performance vs. Week curve. They need to map and decide beforehand which week they're likely to be above the largest number of other teams they would play. Teams already do this, of course, though it's certainly a difficult calculation and not likely even to be undertaken by all, much less calculated correctly.
  • We can surmise that N teams won't follow this impetus, either because they can't themselves logistically, the events aren't available, they don't realize it, or they don't want to.
  • There will also be M teams that calculate incorrectly, wanting to go late and finding out that they're outmatched.
  • P teams will calculate incorrectly the other way, thinking they should go early when everyone is still weak and realizing they'd personally do better at a late event.
  • Some set of N-P are likely to adjust next year's calculus based on their experience.
  • And then of course there are those that do or will calculate correctly, and we'll get Qs that routinely choose to go early when no one has competition experience and they can play others who have not yet hit their stride. Certainly this also already happens (actually all of these do).
  • And we'll get Rs that successfully give themselves more time to improve, copy successful systems, etc, and can correctly sacrifice whatever actual competition does for performance curves.

Overall, I can certainly agree that the ratio of N-Rs is likely to change based on whether there's an SBD, and that an individual team's set is also likely to change. I don't see why this is a negative, however. It's possible the number of teams who don't get their preferred event may even go up, at least until long-term event planning and team densities catch up. On the other hand, it may also go down. I see no good way to set odds on this. The forces and counterbalances on all sides look robust enough, and I'd expect the league to reach an equilibrium of event distribution with or without SBD. Is there a different reason to think these forces will be overmatched?



09-09-2016 18:10

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by JB987 View Post
Blake,
Much of your point here is based on the attribution of poor choice/time management on the part of struggling teams. In many cases, teams are limited in time they can spend each week and are limited as far as access to build facilities by school or district fiat. Additional weeks to work directly on their robot could help them better deal with time limitations...who knows, maybe even give them time to add an autonomous element to their performance
I understand.

However, there are skilled and experienced FRC people (who are excellent teachers/mentors) and teams that can show other teams how to turn one long, hard weekend into a decently-sophisticated, working robot.

If instead of using skilled /experienced people and a long, hard weekend, a team that has been struggling learns project management skills, plans and executes pre-season preparation/practice; then during the season, thinks up, designs, and executes a robot (including simple autonomy ) that is within their abilities and that fits comfortably within the 45 days; I predict success.

What will make or break them (for this part of being a team) is whether they can learn to set very modest goals initially, and only incrementally-increase the sophistication of their goals AFTER they have proven they can handle the modest goals.

With that in mind, unless they are simply limited by outsiders to truly ridiculously small amounts of time per week, I'll bet a very nice dinner that any *motivated* team that has learned to manage a project well, can build a good-enough FRC robot in 45-days (and build a better one the next season).

Basically, the struggling team needs to learn to accomplish (on average) in each of the 45 days (on a simple robot+controls), roughly what the fast-and-furious folks accomplish in each hour (on a reasonably sophisticated robot) during their 48 hour sprints. OBTW, to help the struggling team, they can get detailed design/implementation info for previous-season robots and controls from several sources.

If a struggling team's time-available-to-work is so tightly constrained that they can't accomplish what I described, regardless of how well they manage their project/time; then it would be a *good* idea (not a bad idea) to rethink the entire subject of competing in FRC. FTC, VRC, etc. are almost certainly better choices for them in that situation.

Bottom line: How to build an FRC robot+controls in under one week is well known. With preparation, building a rugged, dependable, allies-like-to-see-you, cookbook-ish, simple bot built in 6 weeks (with time set aside for practicing) for a given season has got to be do-able, unless the team is in a situation that is simply incompatible with FRC. The next season they can adjust their goals.

Blake
PS: Again, all of this is in the context of not letting the tail wag the dog. A simple robot that easily understood and altered is an excellent robot, if the team uses it, and the competitions, to inspire people to consider looking into STEM(ish) careers seriously. The team doesn't have make people into STEM graduates, or overwhelm audiences with the FRC equivalent of a space shuttle. Instead they just need to open peers' eyes to the fact that a STEM career can be rewarding, is worth considering, and is within their grasp.



09-09-2016 18:19

AllenGregoryIV


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Richard Wallace View Post
Certainly there will not be enough available late-season slots for all the teams that would prefer them, if John's speculation is valid. Lack of availability does not refute the speculation, though. If playing late really is an advantage, then how will FIRST decide which teams get that advantage?

My own (FiM) team prefers playing one district early and another late; e.g. Week 2 and Week 5 in 2016. The early one is an advantage for teams that work hard and finish the robot(s) so they can practice. The late one is an opportunity for improvement. So, for us, John's speculation is not an issue.

For a one-and-done Regional team, I think that John's speculation is valid.
It't not an advantage though as you just said competing early is often an advantage. Everyone at each event has the same amount of time. Teams competing at late regional if it is their first regional will still be at a slight disadvantage from the teams that may have been able to get more experience at earlier events. Abolishing SBD or giving more robot access time is only designed to improve the lower and mid tier preforming teams not level the playing field.

More money, skill, people, resources will always be an advantage in this sport (and most sports) but we can at least do everything we can to make it easier to feel accomplished and be inspired.

Each event is scheduled mostly on venue availability. FIRST HQ isn't deciding much anything.



09-09-2016 18:21

AdamHeard


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by gblake View Post
I understand.

However, there are skilled and experienced people (who are excellent teachers/mentors) and teams that can show teams how to turn one long, hard weekend into a decently-sophisticated, working robot.

If instead of a using skilled /experienced people and a long, hard weekend, a team that has been struggling learns project management skills, plans and executes pre-season preparation/preactice; then during the season, thinks up, designs, and executes a robot that is within their abilities and that fits comfortably within the 45 days; I predict success.

What will make or break them (for this part of being a team) is whether they can learn to set very modest goals initially, and only incrementally-increase the sophistication of their goals AFTER they have proven they can handle the modest goals.

A unless they are simply limited by outsiders to truly ridiculously small amounts of time per week, I'll bet a very nice dinner that any team that has learned to manage a project well, can build a good-enough FRC robot in 45-days (and build a better one the next season).

Basically, the struggling team needs to learn to accomplish in each of the 45 days (on a simple robot+controls), roughly what the fast-and-furious folks accomplish in each hour (on a reasonably sophisticated robot) during their 48 hour sprints. OBTW, to help the struggling team, they can get detailed design/implementation info for previous season robots and controls from several sources.

If their time-available-to-work is so tightly constrained that the struggling team can't accomplish what I described, regardless of how well they manage their project/time; then it would be a good idea (not a bad idea) to rethink the entire subject of competing in FRC. FTC, VRC, etc. are almost certainly better choices in that situation.

Bottom line: How to build an FRC robot+controls in under one week is well known. With preparation, getting a cookbook simple bot built in 6 weeks for one season has got to be do-able, unless the team in a situation that is simply incompatible with FRC. The next season they can adjust their goals.

Blake
The thing is, it takes teams a while to learn this lesson (if ever). No amount of external mentoring, help, etc... will cause the shift until the leadership of the team is ready for it.

Once bag day happens, there is no time machine to go back.

However, if after competing once (at a low level) they see teams they can copy some details from (and perhaps receive from advice from others), they can take their robot that isn't scoring points at all and have it contribute at their second event.

I'm absolutely certain that kids prefer scoring points to not scoring points, and ideally greater inspiration will follow.

Potentially that greater inspiration will lead to them wanting a better plan for season, to get done sooner, to realize those benefits etc... but we can't just state from our high horse that kids should just do it right the first time.

We don't need to get rid of the bag, we just need to allow unbagging windows for all teams all weeks.



09-09-2016 18:50

Oblarg


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AdamHeard View Post
We don't need to get rid of the bag, we just need to allow unbagging windows for all teams all weeks.
Why is this supposedly better than just getting rid of the bag?

This is still regressive, it's just marginally less-regressive than the current policy.



09-09-2016 18:53

AdamHeard


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Oblarg View Post
Why is this supposedly better than just getting rid of the bag?

This is still regressive, it's just marginally less-regressive than the current policy.
It's a more likely compromise.



09-09-2016 19:01

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

deleted by gblake



09-09-2016 19:03

AdamHeard


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by gblake View Post
If I'm understanding you, and if I use somewhat prejudicial wordings ...

In the season when the team flails, they will get to flail for a few extra hours per week after flailing for 45 days.

In the next season (or two), once they learn, they will understand how to do well-enough during the 45 days, and won't require the extra hours.

Furthermore, offering any number of possible methods (that give struggling teams per-season exemptions) to stave off the flailing in the first place sounds like a great thing to focus more attention on, instead of churning ourselves over the unbag time.

If FIRST HQ does implement a weekly unbag period, after a brief transition period, unless struggling teams are simultaneously taught (and willing to learn) project management skills, teams that have eyes/plans bigger then their 45-day abilities now, will very quickly become teams with eyes/plans bigger than 45-days plus Nx8 hours. We will be right back where we started (I predict).

If I didn't also believe that the 45-day building period has value, I would say, "Who cares? Build 365 days per year."; but I think a reasonably-long, limited, build season (a true one, not a fictional one) is a valuable part of the program. I know other reasonable people disagree about that. Thereby hang some tales.

Blake
You're completely missing the point about having acccess to your robot after having competed once, and before having competed again.

From some combination of outside help and seeing what others teams have done, 2-8 hours in this time can be far more valuable than 2 weeks during the build portion for a team that isn't capable of finishing on time currently.



09-09-2016 19:08

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AdamHeard View Post
You're completely missing the point about having acccess to your robot after having competed once, and before having competed again.

From some combination of outside help and seeing what others teams have done, 2-8 hours in this time can be far more valuable than 2 weeks during the build portion for a team that isn't capable of finishing on time currently.
You are right - I did blow right past that. I apologize. Ima deleting my earlier post.



09-09-2016 19:22

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AdamHeard View Post
The thing is, it takes teams a while to learn this lesson (if ever). No amount of external mentoring, help, etc... will cause the shift until the leadership of the team is ready for it.

Once bag day happens, there is no time machine to go back.

However, if after competing once (at a low level) they see teams they can copy some details from (and perhaps receive from advice from others), they can take their robot that isn't scoring points at all and have it contribute at their second event.

I'm absolutely certain that kids prefer scoring points to not scoring points, and ideally greater inspiration will follow.

Potentially that greater inspiration will lead to them wanting a better plan for season, to get done sooner, to realize those benefits etc... but we can't just state from our high horse that kids should just do it right the first time.

We don't need to get rid of the bag, we just need to allow unbagging windows for all teams all weeks.
A semi-nitpick is that I think the process I'm hypothesizing for a struggling/rebuilding team will produce a robot that will score points (FIRST designs the games that way); and what is often equally important, it will be rugged and dependable, and will score those points reliably/consistently.

For that reason the teams with the simpler bots might be envious of the (successful) more sophisticated bots, but they shouldn't be uninspired - In a rebuilding/struggling period, they did what they set out to do, and did it well. They stopped struggling (in the robot-building part of being a team). Next year they can be a little more ambitious.

More to your point, if, in addition to the 45 days they give teams before the teams initial competitions, FIRST HQ decides to offer all teams (or maybe just the recovering teams???) a few hours of use-what-you-learned time AFTER each competition a team attends, I think that would be consistent (consistent enough) with what I am urging. I wouldn't lose any sleep over that.

However, to minimize (legit?) wingeing by teams whose initial/only competition includes opponents who have already competed once, the extra time might need to be something teams can use whenever they like, but not be big enough (seductive enough) to significantly exacerbate poor management (wishful thinking) during the original 45 days.



09-09-2016 19:32

Siri


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AdamHeard View Post
The thing is, it takes teams a while to learn this lesson (if ever). No amount of external mentoring, help, etc... will cause the shift until the leadership of the team is ready for it.

Once bag day happens, there is no time machine to go back.

However, if after competing once (at a low level) they see teams they can copy some details from (and perhaps receive from advice from others), they can take their robot that isn't scoring points at all and have it contribute at their second event.

I'm absolutely certain that kids prefer scoring points to not scoring points, and ideally greater inspiration will follow.

Potentially that greater inspiration will lead to them wanting a better plan for season, to get done sooner, to realize those benefits etc... but we can't just state from our high horse that kids should just do it right the first time.

We don't need to get rid of the bag, we just need to allow unbagging windows for all teams all weeks.
Having been on this team as a student, I can say absolutely yes. We really weren't aiming too high, and we weren't procrastinating (any more than we do now). We just had no idea what we were doing. We had no reference for what too complicated or poor design was. We didn't shortchange our drivetrain; we just thought 2wd would be a good idea. We figured it out belatedly, but that regional was not so inspirational. Another year we didn't try to do multiple tasks or end effectors; we just really thought an 80/20 arm that weighed more than the robot base was a really good plan. We actually realized that error later in build season and slap-dashed an alternative thing on before ship. Should we have realized sooner? Duh (I say now from my high horse). And we learned that lesson for next year. But having it sit in the crate that year really sucked. We did so terribly at that event and it was so uninspirational and damaging to the team that people literally started fighting and I sobbed and tried to quit (I was like 14). Fortunately, that year we actually had two events, and we wised up and reached out and borrowed another simple (but much better) end effector design from someone, and...well it still wasn't such a great experience because our drivetrain was also pretty terrible and we didn't have the opportunity to fix other issues we'd found, but I definitely would've preferred to substitute it for our first event. And if we'd been able to get hands-on time and fix more stuff? I don't know how well we would've done, but man, that would've been a really great learning and inspirational experience for me.

It's hard for me to explain in retrospect how ridiculously clueless we were. It wasn't time or task management. Our teachers were pretty good with that (as much as when we did better, at least). It wasn't that we refused modest goals. We just didn't know how to convert modest strategic goals into modest engineering goals. We didn't understand how difficult things actually were. We downright couldn't visualize simple engineering solutions and distinguish them from complex ones. We didn't think we were shortchanging anything; we thought it'd work. And we really didn't understand that whole 'incremental testing, fail early fail often' thing. This isn't the same as procrastination; it's just that we were 15 years old and we thought we were right.

Would making build season last until our first event have helped that? I guess some teams would spread out their mistakes and not catch any more. We checked and caught some of our blunders back in those days, though, and I suspect we'd've caught more as we went. I won't claim a proportional increase, but more. Would we have ended up relatively better as the entire league moved? I'm guessing not. But I'd probably have cried less. And would some more teams than do now get free time from RIs to do pre-event inspection, get other teams to visit and play with? I'd bet some would. All of them? No. But some more is better.

And the real crux for me is being out of bag between events. I see this potential all the time inspecting for districts. It's not that every team who's non-functional on the field has some big mechanical contraption they wasted all their time on. I've inspected a lot of very modest bots that just don't understand that whole good electrical practices thing. They don't assemble the kitbot right. They don't understand chain tensioning or basic mechanical construction. Maybe they want to be creative, even a little bit, and screw up that whole center of gravity issue. Maybe they tried for the low goal but couldn't visualize a simple solution. Should we as a league be able to fix this all in six weeks? Should they all have made mistakes that are fixable in 6 hours of unbag time? Or should we all be on our game enough to spare time for teams like this in six weeks instead of in the multiple weeks they spend staring at their robot in a bag? Okay, sure. But that's not their fault.



09-09-2016 20:10

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Siri View Post
Having been on this team as a student, I can say absolutely yes. We really weren't aiming too high, and we weren't procrastinating (any more than we do now). We just had no idea what we were doing. We had no reference for what too complicated or poor design was. We didn't shortchange our drivetrain; we just thought 2wd would be a good idea. We figured it out belatedly, but that regional was not so inspirational.
...
Should we as a league be able to fix this all in six weeks? Should they all have made mistakes that are fixable in 6 hours of unbag time? Or should we all be on our game enough to spare time for teams like this in six weeks instead of in the multiple weeks they spend staring at their robot in a bag? Okay, sure. But that's not their fault.
Hmmm, Not their fault? Agreed!

I don't think Adam or I intended "fault". There are lots of things I have the potential to do, and can't do yet; but not because it's my fault. Instead, it's because I haven't yet learned to do them. I would say the same applies to what you described.

Appreciating what you describe, and being fully sympathetic (I remember a robot lurching rather drunkenly around a field), in a thread on team sustainability, I made some suggestions that I think would apply almost as well to rookie teams as they would to struggling teams (maybe those two situations would get modestly different treatment?) (maybe the Rookie All-Star award would become the Sophomore All-Star award?).

If you care to review that other discussion, I would interested in your take on the ideas everyone floated there. I think the posts linked below cover the gist of what I eventually decided was my best idea at the time. Other people offered other good ideas.

The whole thread

I offered these, among other posts:
One, Two, Three, Four, and Five

Blake
PS: What I posted here is both a little off-topic, and a little on-topic. It's on-topic in the sense that a few ounces of pre-build preventative education that teaches important skills, and transfers a bit of wisdom, is worth a pound of post-build cure. Regardless of where any of us stand on the "hows" or "whys" of post-build bagging, that is no surprise to anyone.



09-09-2016 22:10

Siri


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by gblake View Post
I don't think Adam or I intended "fault". There are lots of things I have the potential to do, and can't do yet; but not because it's my fault. Instead, it's because I haven't yet learned to do them. I would say the same applies to what you described.
Sorry if I implied you did. I wasn't even quoting you; I just intended to tie into the whole 'high horse' thing Adam had going.

Quote:
Originally Posted by gblake View Post
Appreciating what you describe, and being fully sympathetic (I remember a robot lurching rather drunkenly around a field), in a thread on team sustainability, I made some suggestions that I think would apply almost as well to rookie teams as they would to struggling teams (maybe those two situations would get modestly different treatment?) (maybe the Rookie All-Star award would become the Sophomore All-Star award?). <snipped links>
Ah yes, I remember this thread. I'm all for the concept of providing better year-round training and program alternatives. It doesn't change my stance on SBD. (In fact, if it succeeded in retraining the teams that do struggle with planning and time management, it would erase the last negative I have about dropping SBD.) In terms of the specifics of the system, there's a lot to work out there. For this thread, my relevant takeaway that we're in a reality where it's just not on FIRST's drawing board. This is an HQ that doesn't even have an official a VEX-like curriculum, much less this kind of system. That's not to say community organizations shouldn't--we should and do and will continue to--but effectively and efficiently reaching the teams who need it most takes an official change to the league. It's not even a setup I can imagine, putting on my 15-year-old student hat. And it's just not something FIRST is currently designed to do. I'd love it if they were, would like to help them if I can, and don't blame them that they aren't.

I think where we differ is that in my book, dropping SBD / using a Zondag proposal is a clear improvement to similar ends. It doesn't obviate or assist or do much of anything to a year-round system as well, but it helps complementarily and cleans clock on the 'currently realistically implementable' metric.



09-09-2016 23:40

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Siri View Post
...
I understand.
And, I worry about the camel's nose (the tail wagging the dog) pressing ever further into the tent.

HQ, and/or a team, or group of teams, that want(s) a World Championship Chairman's will create the curriculum and designs new/struggling teams need, or won't.



10-09-2016 01:04

Fusion_Clint


Unread Re: paper: Stop the Stop Build - Counterpoint

Gblake,

After reading a ton of your posts and your signature line; curiosity has gotten the better of me and I have to ask: "Are you currently associated with a FRC team or event?"



10-09-2016 20:40

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by Fusion_Clint View Post
Gblake,

After reading a ton of your posts and your signature line; curiosity has gotten the better of me and I have to ask: "Are you currently associated with a FRC team or event?"
I gave Clint the long answer in a PM. The shortened version is that the pendulum is swinging.

A decade ago I began by diving headfirst into FRC and related programs. I spent a few thousands of hours over several years. A big chunk of those hours were with an FRC team or FRC events.

Fast-forward to now

So far the pendulum hasn't swung far enough to (re)connect me with any specific FRC team among the several nearby; but who knows, by the time this next summer rolls around, maybe 10-12 kids in the area and will want to pony up about $1500 apiece to learn and practice for 9-12 months, then register as a rookie team in the Chesapeake district.



10-09-2016 21:46

mathking


Unread Re: paper: Stop the Stop Build - Counterpoint

The two papers got me thinking a little bit differently than I had been about this issue. Some of those thoughts have given me enough clarity to want to post them.

The reference to the Olympics got me thinking about the ways in which FRC is like a sport. I am a track and field coach, and one of the things track coaches have learned over the past couple of decades is how too much competition can lead to poorer performance. Because it gets you thinking about how to get better in the short term rather than the long term. In track and field long term performance is almost always the key to objective success. Whether you are coaching elite athletes who have to wait two years for another World Championship or four for another Olympics, or you are coaching high school athletes who have one meet to decide their conference championship and then maybe one or two qualifying meets to their state championship. It used to be that world class athletes would run a dozen or more races in the summer leading to the Olympics, and high schoolers would race two or three times a week all spring. Now elite athletes may only run four or five races leading up to a championship, and high schoolers are much more likely to only run in one meet a week.

None of this is directly applicable to analyzing performance for FRC, but it got me thinking about another idea. Much of the debate about stop build day seems to be of the "getting rid of it will lead to better robot performance" versus "robot performance shouldn't be the metric we use to measure the success of an FRC team." I know this is an oversimplification, but bear with me. Thinking about FRC in the context of track coaching made me think "Maybe getting rid of stop build day won't actually lead to better robot performance in the long run?"

I am pretty sure that my own team would have better robot performance on the average in any given season. Largely because the three lead mentors are all teachers, and for two of us the robot is/can be something we do in class. So we would be able to keep building and adapting. I even think the students in my class would benefit from seeing other robots and copying/adapting to improve ours. I am also pretty sure that my team would be a fair amount smaller. I would actually be surprised if getting rid of stop build day didn't have a noticeable impact on the total number of students participating in FRC. As well as an impact on the number of mentors.

So we would have fewer kids spending more time making tweaks and improvements to that year's competition robot. Which means less time available for general improvement like learning new skills. In coaching that is focusing on improving your strengths rather than focusing on improving your weaknesses. This has a very seductive pull for coaches. Because it often means winning more games that season. When you take classes on coaching they caution you against it because it often means a worse experience for the athletes as well as fewer wins for them in the long run.

One of the beauties of FRC is that it only takes a few (or sometimes even one) kid developing a skill to make that skill part of a team's repertoire. We use the spring, when some of the kids are really fired up about FRC, to get the kids to stretch themselves and learn new skills. I worry that we would end up with better robots but fewer new skills.



10-09-2016 22:07

gblake


Unread Re: paper: Stop the Stop Build - Counterpoint

While looking for something else, I stumbled upon this interesting thread: Best simple robots based on kit chassis?



11-09-2016 08:41

Richard Wallace


Unread Re: paper: Stop the Stop Build - Counterpoint

There is a spotlighted post I recall seeing here that says (my paraphrase from memory), "The secret to this whole thing is that robot builds the team."

You don't have to build a winning robot to build a team, but you won't build a great team unless they are striving to build a winning robot.



11-09-2016 09:46

Rich Kressly


Unread Re: paper: Stop the Stop Build - Counterpoint

Lots of folks in this conversation I respect deeply and I know I'm the old head that doesn't spend much time here any more. However, with the escalation of this conversation and the growth of the district model, I can't resist making a few obvious (at least to me) points:
1. The overall goal here is about the type of person that is produced from the program, nothing else.
2. Until these type of conversations are centered around real historical and current data on graduates (not on-field play, points, or trophies), it's all just noise - sorry.
3. My personal history and experience would indicate blue banners have very little (if anything) to do with producing graduates with certain qualities.
4. While I understand certain other arguments I've heard, anything that leads to more work, more days with a team, "more" of anything is going to reduce the number of willing adult and student participants globally. Locally, there may be some exceptions where you see exceptional people and support, but globally it's a loss.
5. I get the idea for wanting better robots on the field, but does that ACTUALLY produce more of the graduates we desire? If so, where's the data?
6. If the overall vision were to be, "Let's make FRC the elite program only for the top end" then I'd be willing to scrap most of my thinking for 1-5 above. Of course, to do that, then FULLY embracing, pushing, and supporting intermediate programs (regardless of logo) like VRC and FTC as the way to engage and create MOST of those future graduates we are trying to create has to be part of the plan.

I really don't mean to pop anyone's balloon. I really do "see" the arguments being presented, but my 16 years of experience around this stuff says that, in large part, we may be entirely missing the point.



11-09-2016 13:31

Siri


Unread Re: paper: Stop the Stop Build - Counterpoint

So FTC kickoff was yesterday. This is the FTC season setup. Granted, it's stretched out more than FRC would be even without SBD, but I really don't understand this argument that every team is going to do more and push harder longer or worse. The counterarguments to SBD seem to be both:
- People will procrastinate and end up rushing as much as they do now over a short time at the end.
- People will not procrastinate and will push as hard for the entire season as the do for the 6 week SBD version.

I don't get that. I don't buy this idea that the net is 'more'. Is it longer? Yes. Will that make some teams struggle with the transition? Yes. But I find it much more likely that:
- Some teams will procrastinate and rush to finish at the end. People do this now, and they do it in every aspect of their lives. No rule can save it; no rule does. Some subset will catch on and fix themselves every year/between years, some not. I'll posit SBD won't fix this, and I can't predict the rate as more less than historically, both at the transition and at the new steady state.
- Some teams will go whole-hog for the entire season. These are likely to be teams that already go whole-hog for the entire season plus teams that think they can and rapidly realize they can't. I'd expect most in the latter will just stop doing that rather than quit, because this also happens now. But again, I'll posit some loss. (What I can't posit is this confidence that the net will absolutely be worse than now. I don't get how you know this.)
- Some teams will slow down their schedule. I don't understand why this seems so weird to people. Our FTC program does not have an FRC schedule. Our VEX kids don't. Our FLL kids don't. Our sports programs don't. That hypothetical year-round official FRC training system doesn't. Nobody does. People know how to do this stuff. Do they procrastinate? Of course, we're human, and mostly teenagers at that. But do they procrastinate entirely to the point where the time to distribute their workload is not valuable? I guess there's one in every barrel, but I haven't seen it. This net retention rate--though I'm happy to admit all of the cohort sizes are unknown--is likely to improve.

The goal of dropping SBD is not to make every team elite or even relatively* better. That's not what this is about. It's to let teams run their FRC lives the way they run the rest of their lives, sans arbitrary deadlines (but not sans real ones) and activation energies. This does not force anyone to do more; it just removes the activation energy for improvement to join those who already do do more. Does this mean the elite have it 'easier' and will get better? Likely. But (in the nicest possible way) who cares? It's not zero-sum; they're increasing their lead above the league average, not forcing everyone else down. Does it mean that some teams will overexert without that activation energy to stop them? Yes, some. And some will learn from it and some will leave. Does it mean that some will treat FRC like it's not an overwhelming N-week-crunch that sucks up our lives and then tries to make us stare at our failures with no way to fix them and inhibited room to learn from our experiences? I'm going with yes.


*Relatively better. The debate about whether overall quality matters and is affected by SBD has a different set of arguments, mostly 'there's already enough time for anyone to be good' versus 'it's a looong learning curve and no SBD means more inter-event improvement and community support'. The debate about whether overall quality affects inspiration is yet another debate entirely, centered around 'it's not about the robot' and 'sitting dead is really discouraging'. Still, the schedule control can be address independently as well to some extent.

EDIT:
I think I need to clarify what I mean by separating the debates: If someone agreed on the schedule impacts above but posited that quality or inspiration from it didn't change, the conclusion would be that dropping SBD is marginally good or a wash. (Marginally good because teams ability to time-manage 6 weeks versus N similarly doesn't excuse the imposition of an arbitrary deadline any more than it would elsewhere in life.) This isn't to say I don't have strong opinions about quality and inspiration or that these don't need to be addressed before a conclusion. I just want to call out the schedule separately because I get the impression that I expect an order of magnitude less positive change than I think pro-SBDers expect in the negative from burnout or mass procrastination.



11-09-2016 18:23

mathking


Unread Re: paper: Stop the Stop Build - Counterpoint

Rich Kressly, you hit the nail on the head. (As an aside, congrats on 1712's excellent season last year.) For me the central question is how does any change affect the quality and quantity of students who experience the program. If means better robots and better robots means more kids or better experiences for kids, then we should do it. But I don't think that relationship is at all clear.

Siri, here is my perspective on the schedule. Which is based mostly on my experience with my team. I don't buy that there is any significantly large exodus of people from FRC because of the stop build day deadline. A well constructed survey could convince me otherwise, but in particular I don't believe that getting rid of stop build day will cause a lot of students to stay in FRC. I have had over 300 different kids in FRC over the past 15 years and while we haven't had many who quit, none have ever said the schedule being so short made them leave. On the other hand, we have a lot of kids who if the schedule extended build time into the spring would deepen conflicts with other activities. We already have a little over 40% of our students who don't go to our regional competitions because of conflicts with sports, plays or other events. There is no way a change like this would not cause us to lose more of those kids.

And as I said in my previous post, I am not convinced that ending stop build day would in fact produce better robots in the long run.

In spite of this I am fairly ambivalent on the schedule. If they ended stop build day we would adapt, the team would go on. It would personally change some of what I do, and my own schedule (born out of 15 years of this schedule) would mean I wouldn't be as available, but I would adapt too. If they found a middle ground, such as giving every team some number of hours of limited out of bag time, we would adapt. We are still going to strive to provide the best experience we can to the most people we can.



11-09-2016 20:27

ddg258


Unread Re: paper: Stop the Stop Build - Counterpoint

We already have a default stop build day, we need to ship our crate within a week of stop build day. We attend a week 1 or 2 regional in California, then our home regional in Hawaii week 5. The crate is shipped right after the California regional directly to Oahu. We wouldn't be able to use the un-bag time between our events for improvements. A second robot is a stretch for us, but it may be the only way to get more practice in.

Our home regional is on another island, Oahu, we are based on Maui. I don't think we have enough teams for a district model, but even if we had districts, we would still need to crate and ship because we need to fly to Oahu, twice, three times if we make district championships.

We are trying to become more competitive, hence two regionals. Being competitive helps us get the word out(PR) and helps with student and sponsor recruitment. Which in turn leads to sustainability, which leads to program improvement. We run year round with FRC, Vex EDR and we also mentor a Vex IQ team at one of our elementary schools. We are trying to improve STEM education in our school community and robotics has given us a great conduit.

One thing that came up is, if they eliminate stop build day, maybe just go to our home regional. We could work on our robot until week 4, practice driving and make improvements and we may be better then if we went to another regional. I will be pushing for us to continue to attend two regionals.

I don't mind stop build day, but we will adjust to whatever happens, just wanted to share in the discussion.



12-09-2016 10:21

bobbysq


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by AdamHeard View Post
I'm absolutely certain that kids prefer scoring points to not scoring points
https://www.thebluealliance.com/match/2010cur_qm100



12-09-2016 10:41

FrankJ


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by ddg258 View Post
...One thing that came up is, if they eliminate stop build day, maybe just go to our home regional. We could work on our robot until week 4, practice driving and make improvements and we may be better then if we went to another regional. I will be pushing for us to continue to attend two regionals...
Another solution would be to build two robots. Not a lot of cost difference than building a practice robot. Probably close to to a wash if you attend worlds and keep one robot land side rather than a priority shipment back to Hawaii.

Admittedly not a perfect solution.



12-09-2016 14:19

Rangel(kf7fdb)


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by bobbysq View Post
Based on the ranking system for that year, the students from both alliances are essentially still scoring points.



12-09-2016 14:41

Chris is me


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by bobbysq View Post
In this example, all six robots on the alliance are scoring as many ranking points as possible. They are achieving the competitive objectives of this game. What's confusing is the way the real time score displayed conflicts with the way ranking points are calculated. The match isn't being thrown to deliberately make the teams perform worse than optimal - they are genuinely trying to increase the score as much as possible. It's just that in 2010, if you were going to lose the match, scoring on the goals your alliance is "supposed to" score in only helps your opponents.



12-09-2016 14:43

AdamHeard


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by bobbysq View Post
This is a strategy choice, not a complete lack of robot functionality.

Choosing to not score as part of a strategy is one thing, being completely unable to score regardless of choice is what I was commenting on.



12-09-2016 14:52

Brian Maher


Unread Re: paper: Stop the Stop Build - Counterpoint

Quote:
Originally Posted by bobbysq View Post
In this match, 1114's alliance does prefer scoring points over not scoring points, but they are prioritizing seeding points over game points.

<tangent>

For anyone curious how this works, in 2010, ranking points were awarded for each match as follows:

Winner: 5 + (Winner's Score) + 2 * Loser's score
Loser: (Winner's Score)

Seeding points from that match, if blue tried to win and the final score was, for example, 20-10:
Red (469, 111, 888): 5 + 20 + 2*10 = 45
Blue (1114, 231, 288): 20 = 20
Top two ranked teams and seeding scores:
1) 111 296 (251 + 45)
2) 1114 291 (271 + 20)


Seeding points from that match as it happened (30-0):
Red (469, 111, 888): 5 + 30 + 2*0 = 35
Blue (1114, 231, 288): 30 = 30
Top two ranked teams and seeding scores:
1) 1114 301 (271 + 30)
2) 111 286 (251 + 35)


By playing a 6v0 match, the blue alliance was able to claim ten additional seeding points and deny their opponents ten points compared to a hypothetical losing 3v3 match.

1114 and 111 had been going back and forth for the #1 seed, and this match gave the Simbots the ability to earn that coveted first opportunity to pick. Whichever alliance had 469, in all their game-breaking-ness that year (watch the match if you don't know what I mean), would be nearly unstoppable at the division level and a powerful contender to win Einstein. Essentially, this match and its strategy won 1114 the division.

This is my go-to example of how important it is to analyze the ranking system each year and that the best strategy may not always be the most intuitive one.

</tangent>



view entire thread

Reply

Tags

loading ...



All times are GMT -5. The time now is 04:43.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi