![]() |
[FRC Blog] Stop Build Day Survey Results
Posted on the FRC Blog, 10/21/16: http://www.firstinspires.org/robotic...survey-results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Is Hallry alive?
|
Re: [FRC Blog] Stop Build Day Survey Results
I would be interested in seeing the results of the survey of time in the program vs the keep vs stop data similar to how they did team age vs the data. I wonder if it is still as evenly distributed.
|
Re: [FRC Blog] Stop Build Day Survey Results
This survey was clearly rigged.
It'd be interesting to see how metrics such as OPR or BBQ influenced survey responses. |
Re: [FRC Blog] Stop Build Day Survey Results
The results seem to lean toward keeping a stop build day, but I would be curious to see the results of each survey question. Mind you, many of the questions did seem to be biased towards removing it.
Results aside, that looks like a very good turnout of responses! |
Re: [FRC Blog] Stop Build Day Survey Results
Well... the results are definitely interesting.
I'm not a statistics wizard by any measurement so I'll leave others to nitpick the results. I would love to see the data broken down by team locations as well as by team age though. I still have my opinion that Stop Build Day should disappear like so many outdated things with FRC but for now it appears as though I'm in the minority. :cool: EDIT: Linked report has some of the data I wanted actually. I skimmed it and missed it on first pass. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Keeping or eliminating "stop" build day was a bit simplistic.
There should have been multiple choices, ranked by preference:
But just dealing with this one questions is sure to cause them huge headaches. |
Re: [FRC Blog] Stop Build Day Survey Results
This is at the top of the report:
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
I would call it half, not a majority.
4 teams out of 2196 isn't statistically significant. |
Re: [FRC Blog] Stop Build Day Survey Results
You can say that the plurality-winning opinion is keeping sbd, but you will also have to point out that a supermajority of respondents think there should be some kind of change to the existing rules.
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
My take is most people don't want it to change much or at all (4 & 5 = 52.6%) Most people however want it to change at least a little (1-4 = 65.9%).
Edit: ugh... |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
If I'm reading this correctly, there is a somewhat significant portion of respondents in most categories who think that stopping bag day would be "best for ensuring equity and inclusion of students and schools in the FIRST
Robotics Competition program", but for some reason don't think that it would be "Best for the FIRST Robotics Competition program". Is the equality and inclusion of students and schools undervalued or is there some other priority? |
Re: [FRC Blog] Stop Build Day Survey Results
Even if the survey had said everyone was in favor of eliminating SBD, I wouldn't trust the results.
The survey phrasing was pretty darn awful in terms of phrasing. It also would have been helpful to have a panel of consulting mentors or something present 3-5 options to FIRST. FIRST would critique these, then present them to the masses with some education of their details. I bet everyone had different interpretations of what their answers mean. Weekly unbag windows seems like a pretty darn good compromise. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Even if you have gripes with the survey methodology and put large error bars on each bar in the graph, I'd wager that ~90% of those in the "1: Eliminate Stop Build Day" camp would think this is an improvement on the status quo, and probably 1/3 to 1/2 of those in the "5: Keep Stop Build Day" category would agree. Even if the survey is biased by a factor of 2x in either direction, it adds up to consensus. |
Re: [FRC Blog] Stop Build Day Survey Results
Spin city :)
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
The wording on the survey was not great, and any detailed survey like this is obviously trying to do a more nuanced evaluation than simply "eliminate or don't eliminate." One thing that strikes me as a statistician is that there is likely more motivation on the part of those favoring getting rid of stop build day. First because the motivation level for "change" events is generally higher than for "remain the same" events. So in a survey like this, I would bet that all other things being equal, the 1s are likely overrepresented compared to the 5s relative to the entire FRC population.
|
Re: [FRC Blog] Stop Build Day Survey Results
I'm pretty against getting rid of Stop Build Day, but like mathking says above, I would have expected a larger turnout from those in favor of getting rid of it.
Nonetheless, I answered all of the questions truthfully and some could be considered contradictory to my stance, like "managing unexpected events.. drive time... last minute needed parts." I'm not surprised to see that those indeed have a large percentage calling it a disadvantage. I wonder if we ever see the full data, how many "contradictory" answers we might possibly see. |
Re: [FRC Blog] Stop Build Day Survey Results
Here's a visual representation of some of the breakdowns they provided but didn't graph (build one/multiple robots, in regionals/districts, rookie year).
I find it very interesting (and very weird) that teams who build multiple robots are more in favor of keeping bag day. ![]() |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
TL;DR High-resource teams in general favor the status quo which is understandable. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
I cannot agree with you here Ed.
The middle choice, a 3 in this type of survey is typically the "I don't care either way" or "no opinion" choice. Only 1 & 2 can be counted towards the eliminate bag day or sort of eliminate bag day attitude. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
It is interesting to note that CD is over-representative of people on teams that build practice robots as well as those who prefer to end bag and tag. Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
If you were to estimate the results by the tone of the discussion in here, I'd put it at 90% want to eliminate Stop Build Day. My takeaway from the survey results is that those on Chief Delphi are a very vocal minority.
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
I can see that going over like a FIRST survey. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Also, you know, data trumps opinion, and I think there data is pretty clear that bag day is harmful. |
Re: [FRC Blog] Stop Build Day Survey Results
Taking my best hack at future predictions...
1) I suspect that the Zondag System won't be in play in 2017. That would most likely class as a "major change" at HQ. 2) After the 2017 season wraps up, HQ will look more closely. Given that there's a fair number of folks on the Stop Building side, more than the Don't Stop Building side, I rather suspect that Stop Build will stay in place for some time yet. I realize that that's going to be unpopular with the local vocals. But here's the thing. There seems to be a fair amount of support for Don't Stop Building--getting up towards a decent tipping point, I suspect within the next few years. I don't think this issue will go away. At a best guess, there will be a change for 2018, and I would really strongly suspect that the Zondag System will be the original basis, but there will be some major changes that teams won't like. There is, in fact, a precedent for the Zondag System. It's the FIX-IT Window, '05-'07ish, and it allowed teams to work on robot parts to be brought to their events even when other work was technically banned (and that was enforced by the robots being in a crate out of the teams' hands). There were a number of elements that teams didn't like, for a variety of reasons. Now taking bets on that system returning, with robot access instead of legal spare parts from after build as the primary benefit. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
You're right, I have no hard data. What I do have is that the discussions on the topic have had a nice uptick in more recent years--time was, Ship Day was an absolute. Ship, or don't compete (without a waiver). Nowadays, I'd say for the last 2-3 years especially, there's been a decided move towards "Hey, so why do we have to be totally hands-off the competition robot again?" I don't think that started before districts and their bags (and out-of bag time--yeah, I'm lookin' at you, MI!) in '09, and I'm still pretty sure that it didn't start before the regionals started using bags a couple years later. I don't think there was much of any serious discussion for a couple years even then. So there's a bit of an uptick in the discussion activity. I would say that that means increased awareness. (HQ just sending out the survey probably meant that they'd become aware of the discussions, which means they're getting bigger, too--or else somebody asked directly.) Increased awareness will generate some discussion and some thinking. I suspect that several people will change their minds--or have changed them--during the discussions. |
Re: [FRC Blog] Stop Build Day Survey Results
Increased discussion where? I think one of the key things people should be taking away from this data is that discussions on CD do not reflect the larger FRC community.
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
The thing is that CD tends to attract the mid-to-upper tier teams. And the vocal ones. The teams that tend to be at the forefront of testing out and thinking out new ideas.* You can bet that an awful lot of teams and team members that got the survey went "Huh?" Does that mean that discussion is not increasing? NO. On CD, discussion increased--witness the 2-3 threads besides this one on the topic. As a result of the survey, I'd be willing to bet that a lot of teams are going to be wondering "what was that about?" If enough teams ask questions, things start happening. I don't see the discussion being fully revived until May, at this point, but I do think that HQ will be processing the results, and maybe asking better questions later on in a followup. I'd give it about 4-5 years before there's some sort of tipping point. Seems like that's how long it takes to make major changes like that. Now starting a pool on which happens first (officially): video review, ending stop build day in some form, or moving Kickoff... Now, this post does come with a bit of a reminder: If the top X% of teams are able to drive a solution that works for them, without consideration of the rest of the teams--teams that maybe can barely play the game, in a good year--then I do not see that solution as being a good one. With all the discussion of "stacked events", those not-so-highly-performing teams are often overlooked pretty thoroughly. 6 powerhouses and a dozen mid-upper-tier teams don't make a regional... What about the other half to two-thirds of the teams? *Did you know? The card system wasn't developed by HQ. IRI used it for years; FIRST HQ adopted it during 2010's soccer game. Districts were developed largely by teams in MI, at least initially--and so was bag-and-tag. Just something to ponder... |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
My own feelings, expressed more than once here, is that I agree that there would be a higher percentage of "good" robots at competition if we got rid of stop build. There just doesn't seem to be any question, because the extra time is not going to hurt anyone on the average (sure there will be an occasional team that breaks something) because on the average more time will yield better robots. There is no down side to getting rid of stop build in terms of the quality of robots.
I also think it is pretty clear that getting rid of stop build day will lead to decreased participation. I don't buy that there are a lot of people out there who would participate but can't stand the time constraints and so they choose not to. But there will be lots of students and some mentors for whom the increased time commitment will be a deal breaker. My team will keep doing FRC for the foreseeable future. I have at one time or another been involved in just about every big educational robotics competition in some way, and FRC is the one that generates the most interest and excitement. It is also the one that allows for the biggest team in terms of giving more kids what to do. If we got rid of stop build, however, I would have to find someone else to lead the team. And we would lose a lot of our members. So my preference is to keep stop build. Side Note: My ultimate (pipe??) dream would be that almost every school has a robotics team, like they have a basketball team, a soccer team, a band, a track team... FIRST could become the national organization that sets the rules, and they could host the Championship level event(s). Each state or region has its own governing body, like they do for athletics, and hosts its own tournaments. I won't lie, I would love to win an Ohio Capital Conference Robotics title before I retire. I think we have 8 teams now representing 16 high schools total, so we are getting to where that might be feasible. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
One thing I want to bring up, again, is if the schedule for competition can be changed so that Week 1 starts on the 46th day of build season (or as close as possible). This way, teams that want that hard deadline at six weeks can just go to a Week 1 event, and teams that don't can go to later events. Stop Build Day or not, teams work hard to be mostly done by their first event, and most teams won't completely rebuild their robot after this event (but I hope many will make improvements). This won't make build season any longer, really.
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Side note: I find it really interesting to consider architectures for FRC beyond the regionals/districts systems. I don't think districts is the end of the road if we ever truly want to get to an FRC team in every high school. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
FRC is a very massive structure; I would suspect that having an FRC team in every high school isn't ever going to happen. (FRC student, maybe. See also "community team".) But the "smaller" competitions that are more accessible can get into schools more easily. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Also, by future architectures, I'm not really talking next five years, but next twenty or more. Not exactly practical, but fun to think about. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
One of the things that drives me nuts about the "FRC is too expensive for schools" argument is that fielding an FRC team is not intrinsically more expensive than fielding a lot of sports teams or other activities. If a school has a band that goes to competitions the odds are that its budget dwarfs that of the FRC team. Our FRC team would be in the mid range (we have between 60 and 80 most years) of team/activity sizes at our school, and in the mid range of cost. But it is expected that the school will field a football team, a band, a soccer team and track team. So they do it. I want to get FRC there. As I have said, I have been involved in form or another in most competitive robotics programs at one time or another. In my experience FRC is the one that generates the most excitement. It is the one that best scales up for larger teams. (For example, we have FTC. Two teams. If we didn't have FRC and most of the kids who did FRC decided to do FTC, we would need 7 - 10 teams. And it would not be cheaper than FRC.) And I think I will stop here because I don't want to pull the thread too far sideways. |
Re: [FRC Blog] Stop Build Day Survey Results
Not entirely sure why FIRST insists on doing these surveys in this style. Do the survey where votes are 1 per team. If FRC wants to be a "sport" it needs to adopt a sport's style approach to voting on the rules. Team owners only.
|
Re: [FRC Blog] Stop Build Day Survey Results
Part of the problem is that if they want volunteers' input, they can't do 1/team.
The other part is that they may be trying to decipher if there's a disconnect between students and mentors. And there's also the "I mentor multiple teams" option, as some mentors have 2 or 3 teams. And you also have the problem of how many people actually TAKE the surveys! This one's actually relatively high participation: 9K people (not all of whom finished), 2100+ teams (offhand, that's about 2/3 of active teams). |
Re: [FRC Blog] Stop Build Day Survey Results
Also, the "owners only" is the model for pro sports rules. It is not the model for high school sports. In HS sports there is generally a national federation that establishes the general "game rules" and a state association may make some minor changes. Any changes or adaptations of those rules tends to only be done after they survey coaches, administrators and players.
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
So they're using the House elections to do the Senate's voting... |
[FRC Blog] Stop Build Day Survey Results
Quote:
We were talking about how rules were set, not how competition was divided up. In HS sports the rules are not set by schools at all. There is no voting. Like there is no voting here. A governing body sets them. Changes are generally considered by surveying coaches. Or coaches, administrators and athletes. |
Re: [FRC Blog] Stop Build Day Survey Results
I see it more of a question of limiting reactants. If your limiting reactant is resources than stop build day is disadvantageous, because you aren't working on the second robot. So it helps well-established teams, but it appears less well-funded teams like it. And I personally like it. And a longer build season would not help and only stretch the gap between teams.
I Have two suggestions: Increase the out-of-bag time to 12 hours. Out-of-bag time is not like normal build time because there is so much extra time to get things and is more even than just letting the second robot builders practice. Let drivers practice as long as no mechanical changes are made this would include fixing it. If this decreases the value of a second robot your closing the gap between teams. Unforeseen consequences aside.Keep the stop build day. Side note: My feeling about the Un-even stop build time was that on average it helped with the gap. Given that on average east coast has more money than west. Also I loved ending at midnight. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
By that stance if you build a kit-bot on wheels to test programming or a spare arm and use that to test shooting angles, those both count as "second robots" per that question |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
I'm curious to hear from teams that build significant or full practice robots that wish to keep bag day. That's probably where I'll learn the most about this perspective. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
As I said before, I have no doubt that on the average the robots would be better if there were no stop build day. At least in the short term. There is no reason that adding more time to work on the robot would make robots worse (excepting every once in a while where there is a catastrophic accident) and reasons that at least some robots would be better. Using the same logic I do not doubt there would not be as many participants in FRC, because I don't believe there are lots of people out there not participating because of the limited build season. So for me it is a question of better robots for fewer kids or not quite as good robots for more kids. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
My follow up is, if we kept the bag system, and added access windows, what do you feel would be the right amount of time to allow, such that teams like yours did not have to build a second robot, but the system of a soft deadline and more limited after-build work is preserved? I feel this kind of compromise is a step forward that more people can agree on than just ripping off the Band-Aid of Stop Build Day right away, and this is where people should focus their efforts on finding common ground. My gut says... 10 hours a week without competition, 2 hours a week with competition, in addition to any unbag windows provided to District teams already. But maybe that's too much? |
Re: [FRC Blog] Stop Build Day Survey Results
The way that question about 2nd robots was worded doesn't equate with teams necessarily working on them past bag day.
Teams simply strapping a prototype arm to last year's robot during week 2 would be answering "yes" to that question. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
I am not saying that teams might not use them to for post bag development but with the way the question was worded we can not infer that that is the purpose of these "second robots". |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Meh. Build season is a myth! Pop the bag! :D |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
Just to be clear, I am not advocating for an un-bagging period as way to ease into getting rid of Stop Build Day. I think it is a reasonable middle ground instead of getting rid of it. I still think that if we get rid of Stop Build Day we will reduce the number of students who participate. (As a side note, we will also reduce the chances for those who opt to stay with FRC to do other things.) I think reducing the participation rate is a bad idea. |
Re: [FRC Blog] Stop Build Day Survey Results
Quote:
|
| All times are GMT -5. The time now is 20:07. |
Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi