|
|
|
![]() |
|
|||||||
|
||||||||
This paper is an analytical summary of some of the many reasons why the FRC Stop Build process has negative impacts FIRST teams, and suggestions for potential improvements
This paper is an analytical summary of some of the many reasons why the FRC Stop Build process has negative impacts FIRST teams, and suggestions for potential improvements. Analytics from 2015 and 2016 were used from several sources. Trends outlined here have been more or less constant in the FRC since I began tracking these things back in 2005.
Stop_the_Stop_Build.pdf
07-09-2016 11:21
Jim ZondagTeams, In response to the Stop Build survey circulated yesterday, I finished this paper I was already working on. In this paper I share some analytics on the realities of the Stop Build process and my opinions on possible future changes.
07-09-2016 11:40
Sperkowsky
I really hope you linked this at the end of your survey. If someone from FIRST reads through this we may actually have a chance in getting rid of this.
07-09-2016 11:47
jwfossJim, your 8 hours of unbag every week for every team would be the perfect first step. Thank you for your well thought out analysis.
07-09-2016 11:48
marshall|
Jim, your 8 hours of unbag every week for every team would be the perfect first step. Thank you for your well thought out analysis.
|
07-09-2016 11:49
TDav540This is basically the ultimate paper regarding anything bag day.
Frank, we know you're there.
07-09-2016 11:53
adam the greatAwesome paper, and love how many points of interest you touched based on with reasonable data points and comparisons. This could be a really good paper to share with many teams that believe that their season is only "6 weeks long"
07-09-2016 12:01
StAxisA fantastic compromise. I am glad to see a take on this from one of the greatest FRC statisticians out there.
I have been very supportive of the retention of bag day for the reasons listed at the end of the paper. It is difficult with no data to support them, but they are very present and if they occur to the levels feared by some, though unlikely, would be detrimental to FRC.
After all things considered I cannot see any reason not to fully support this 8 hour per week period. It is about equal to one Thursday of work at an event, which is most of the time many teams are able to spend really WORKING on their robot.
Until there is a larger cultural shift in the community towards FRC as a sport it will be difficult to eliminate bag day, but adding hours to unbagging per year might be a good way to ease into that mindset, and help us bring the playing field up, and outsiders in.
07-09-2016 12:07
EricLeifermannFantastic write up/proposal Jim.
Lots of people, my self included, have touted this type of info with out having the data and charts behind us to really show the truth for several years now. Hopefully this is something that Frank and the others at HQ see soon and implement for this coming year.
It isn't anything that they would have to change on their end can just be an added rule to the rule book.
07-09-2016 12:15
Joe Johnson
Jim,
Really amazing work. Thanks.
I love that you specifically called out that "6 weeks is a myth." It has been a myth for 2 decades.
I also love the data showing that basically a lot of teams are going to suck the first week they compete, whether that's Week 1 or Week 5, they are going to have a bad weekend. And the longer they wait to complete, the badder that weekend is going to get because the rest of the field is making progress (by going to competitions).
The time has come. Let's rip off the band-aide. End Stop Build Day. Let teams keep their robots for the full FIRST Season.
Will some teams build a completely new robot after Week 1? Sure maybe. But really, who cares? A lot of those teams will just put themselves into a deeper hole trying to copy Poofs or Symbotics or Robotnauts or whomever. They won't discover the problems that are not obvious until it's too late. And even if they are successful at knocking off one or two features from another team, I'd rather live in that world than the current world where so many teams bring less than functional robots to their first competition.
Dr. Joe J.
07-09-2016 12:46
Brian SelleAwesome work. Thanks for putting this together!
07-09-2016 13:01
marshall|
Jim,
Really amazing work. Thanks. I love that you specifically called out that "6 weeks is a myth." It has been a myth for 2 decades. I also love the data showing that basically a lot of teams are going to suck the first week they compete, whether that's Week 1 or Week 5, they are going to have a bad weekend. And the longer they wait to complete, the badder that weekend is going to get because the rest of the field is making progress (by going to competitions). The time has come. Let's rip off the band-aide. End Stop Build Day. Let teams keep their robots for the full FIRST Season. Will some teams build a completely new robot after Week 1? Sure maybe. But really, who cares? A lot of those teams will just put themselves into a deeper hole trying to copy Poofs or Symbotics or Robotnauts or whomever. They won't discover the problems that are not obvious until it's too late. And even if they are successful at knocking off one or two features from another team, I'd rather live in that world than the current world where so many teams bring less than functional robots to their first competition. Dr. Joe J. |
07-09-2016 13:02
nuclearnerdExcellent report. Thanks for putting forward such a strong argument Jim. Hopefully it helps sway FIRST's decision.
07-09-2016 13:20
Chris is meThe compromise solution presented here is brilliant, and is something that could be implemented immediately without any logistical changes on FIRST's end. 8 hours of unbag time a week for all teams would be a huge improvement over the current system, and I suspect it would eliminate the need for practice robots for many mid tier teams. Upper level teams may still choose to build one, but the advantage gained over everyone else would be reduced.
Unbag time in your own shop is one of the biggest reasons District teams improve so rapidly and play at such a higher level. Give this advantage to everyone, every week, and everyone is satisfied. The people who want to rest, can rest, with just one or two meetings a week they can work on the robot tops. The people who want to work can carefully budget their time and use their competition robot extensively during the period after Stop Build.
07-09-2016 13:23
FrankJ
07-09-2016 13:32
marshall|
If you are thinking Joe's attitude has changed... I don't know. I am not Joe.
![]() I think the general idea of building a support robot for one of the elite teams. (Or having the elite team provide you a support bot to take to an event) is problematic. Not having a bag day will still make it problematic only more so. No disrespect intended for 900 or the others involved in the topic of Joe's post. |
07-09-2016 13:45
nuclearnerd|
The compromise solution presented here is brilliant, and is something that could be implemented immediately without any logistical changes on FIRST's end. 8 hours of unbag time a week for all teams would be a huge improvement over the current system, and I suspect it would eliminate the need for practice robots for many mid tier teams. Upper level teams may still choose to build one, but the advantage gained over everyone else would be reduced.
|
07-09-2016 13:59
FrankJ|
+1.
The only question I have with the compromise (and this applies to existing district rules) is: Doesn't unbag time become an unlimited withholding allowance? What is stopping teams from tying a bunch of spare parts to the robot before re-bagging it? If that's not really a concern, is there any point in keeping a 30lb withholding allowance? |
07-09-2016 14:03
Chris is me|
+1.
The only question I have with the compromise (and this applies to existing district rules) is: Doesn't unbag time become an unlimited withholding allowance? What is stopping teams from tying a bunch of spare parts to the robot before re-bagging it? If that's not really a concern, is there any point in keeping a 30lb withholding allowance? |
07-09-2016 14:14
jee7s|
Unbag time in your own shop is one of the biggest reasons District teams improve so rapidly and play at such a higher level. Give this advantage to everyone, every week, and everyone is satisfied.
|
07-09-2016 14:16
Joe Johnson
This is my main argument for just ripping the band-aide off rather than going with the 8 hour per week window: The rules around withholding are already a hot mess, I can see how this 8 hour per week rule could make this situation worse.
If the only way I can get rid of the stop build rule is to make this half step happen for a few years, then I'll take it and be happy but I would much rather just make a clean break. Kill the bags, kill the tags, kill the entire withholding rules...
Dr. Joe J.
07-09-2016 14:17
Allison K|
The withholding allowance rules also apply during unbag windows. You cannot introduce more than 30 pounds of non-COTS parts machined outside of the window, during the unbag window. You also get just one withholdling allowance for both the unbag window and the district event the same week as the window (District unbag times are tied to competing at events) - so it's not like you can put 30 pounds on at the shop and 30 pounds more at the event.
You can introduce as many parts as you want that were machined during the unbag window, into the bag. |
07-09-2016 14:29
Joe Johnson
07-09-2016 14:31
Rangel(kf7fdb)|
This, in my humble opinion, this is why Zondag's proposal won't fly for Regional teams. FIRST wants everyone to move to Districts. Being able to highlight the work time out of the bag in your shop to teams is a substantial motivator to get people moving toward the district model. Particularly for Texas, where we are so large that the travel logistics are a big headache for teams, removing this distinction will further push teams here to stay with the Regional model. In my conversations with Texas teams, having the time out of the bag was consistently a top 3 reason for interest in districts. And, more often than not, that was enough of a reason to get a team to work through the hassle of planning the extra trips.
Don't get me wrong, I love the idea of having time to work out of the bag. But, I think that numbers wise, there are a lot of teams that like the idea that the commitment expected of students is well defined and time limited. Doing away with the bag entirely would present a lot of headaches for teams with students that are attracted to many other activities. I think Jim's compromise is a great one, but I also suspect it is not something we will see implemented. |
07-09-2016 14:37
marshall|
I am not seeing the disconnect that others see. I believe that I can be FOR removing the stop build rules and still be AGAINST having the top teams cheesecake the soul out of a lower tier team.
I have a yardstick. It has inspiration tick marks along its length. I take the controversial position that it is more inspirational to have a team compete with a working robot of their own creation that can accomplish a game objective they set out to achieve. I don't like excessive cheesecaking because I believe it has bad long term effects on inspiration. I don't like stop build rules because they significantly disadvantage teams with low resources and while wasting resources of high resource teams, both of which adversely affect the inspirational impact of FIRST. You can disagree with my views but I don't understand how they are incompatible views to have. What am I missing? Dr. Joe J. |
07-09-2016 14:47
ratdude747|
This, in my humble opinion, this is why Zondag's proposal won't fly for Regional teams. FIRST wants everyone to move to Districts. Being able to highlight the work time out of the bag in your shop to teams is a substantial motivator to get people moving toward the district model. Particularly for Texas, where we are so large that the travel logistics are a big headache for teams, removing this distinction will further push teams here to stay with the Regional model. In my conversations with Texas teams, having the time out of the bag was consistently a top 3 reason for interest in districts. And, more often than not, that was enough of a reason to get a team to work through the hassle of planning the extra trips.
|
07-09-2016 14:52
Joe Johnson
|
I think it comes down to a very fundamental difference that I see. You see it as a top tier team taking advantage of a lower tier team. I don't. I see it as two teams collaborating on a set of goals and a common design.
One of the reasons being given, even by myself, is that ending stop build will allow top tier teams to better assist lower tier teams prior to events. What's to stop them from collaborating on alliance strategies or a better design? How is that different than doing it at an event? What if you bring your robot into our shop and we machine parts for you? What if we come up with a plan that is practically unbeatable and have a plan to transform one of our two robots for eliminations? To me, these ideas are very much related. But hey, as a wise man once said, you don't have to take my word for it. |
07-09-2016 15:00
Tim Sharp|
excessive cheesecaking was bad for the sport. The typical team in the future will not have a great experience having their hard work (for 6 weeks ;-) being pushed to the side so that a top team can cheesecake the snot out of them.
Dr. Joe J. |
07-09-2016 15:03
Michael Corsetto
Random thought on cheesecaking.
Would teams cheesecake less if they were allowed to enter multiple robots for less-than-ridiculous costs? We would probably enter 3-4 robots if it didn't cost an arm and a leg. The amount of time we could commit to cheesecaking would definitely taper off at that point.
I think a lot of FRC's issues boil down to program cost actually. Hmmm...
-Mike
07-09-2016 15:03
marshall|
To me the idea of helping another team is completely okay. Help away. But suppose that Team A helped Team B before an upcoming competition but Team B could only use the improvements IF they were on alliances that included Team A. Doesn't seem right. Also, before a competition, Team B seems to be in the driver's seat. They can accept the changes or not. It is up to them. But once an alliance is formed, Team B is under much more pressure to accept the cheesecake proposals of their alliance captain whether they like them or not.
I know, I know, Zebracorns feel that they were not taken advantage of. I hear you. And I don't care. Well that is too strong of a statement. I care, in fact, I am happy for Team 900. It was a good experience for you. But I STILL think that such excessive cheesecaking was bad for the sport. The typical team in the future will not have a great experience having their hard work (for 6 weeks ;-) being pushed to the side so that a top team can cheesecake the snot out of them. Dr. Joe J. |
07-09-2016 15:04
marshall|
I think a lot of FRC's issues boil down to program cost actually. Hmmm... -Mike |
07-09-2016 15:12
FrankJ|
So prior to an alliance being formed, it's acceptable to you to offer to help make a team as competitive as possible but once the alliance is formed it isn't?
![]() |
07-09-2016 15:15
OblargI don't see the need for half-measures here. Don't give everyone an unbagging time slot, just get rid of the bag entirely. The current policy is regressive and unfair, and lessened version of it is still going to be regressive and unfair, only somewhat less-so.
|
Random thought on cheesecaking.
Would teams cheesecake less if they were allowed to enter multiple robots for less-than-ridiculous costs? We would probably enter 3-4 robots if it didn't cost an arm and a leg. |
07-09-2016 15:25
Joe G.
|
I agree. One of the strongest motivational factors that sustains a team (IMO) is the sense of ownership the students have in their machine. Win or lose, being able to watch your robot on the field and knowing that part of it exists due to your hard work and effort is a powerful thing.
|
07-09-2016 15:26
Joe Johnson
|
So prior to an alliance being formed, it's acceptable to you to offer to help make a team as competitive as possible but once the alliance is formed it isn't?
Tell you what, forget I brought it up. I'm good without the public display of mental gymnastics that is someone coming to terms with their own cognitive dissonance. |
07-09-2016 15:28
Cory
|
Random thought on cheesecaking.
Would teams cheesecake less if they were allowed to enter multiple robots for less-than-ridiculous costs? We would probably enter 3-4 robots if it didn't cost an arm and a leg. The amount of time we could commit to cheesecaking would definitely taper off at that point. I think a lot of FRC's issues boil down to program cost actually. Hmmm... -Mike |
07-09-2016 15:28
Oblarg|
Which brings up the logical questions: What stops teams, many of whom are already building multiple robots, from bringing in pre-built "Cake-bots," ready to roll as-is with different team numbers slapped on (or Cake-tops that can bolt on top of a kitbot, if FIRST adopts VRC-style definition of a robot)? Would the hypothetical gains in performance of the average team be enough to erase an elite team's motivation to do this? Would we want to stop this at all, or would it be a positive thing to a degree?
|
07-09-2016 15:51
nuclearnerd|
Originally Posted by Joe G. View Post
Which brings up the logical questions: What stops teams, many of whom are already building multiple robots, from bringing in pre-built "Cake-bots," ready to roll as-is with different team numbers slapped on (or Cake-tops that can bolt on top of a kitbot, if FIRST adopts VRC-style definition of a robot)? ... Hopefully, ethical sense on the part of both hypothetical teams? I don't see this as ever becoming widespread as I don't think there are that many teams who would ever consider this as an acceptable way to participate in FRC, especially on the part of the receiving team. |
07-09-2016 15:54
Greg WoelkiGreat read, thanks for posting!
Minor stats comment: Fig (5) is a little concerning because each curve represents a different population of teams, so it isn't a very clear way to show the trend of increasing performance as teams have attended more and more events. It is unclear to what degree teams from the left-hand side are moving rightwards as they attend more events or if most of those teams simply aren't included in the next curve. While it can be surmised by looking at the right-hand bounds of the distributions there are some performance increases, the graph would more directly support your point if a single population of teams (perhaps the 304 that competed at 4 events or the 765 that competed at 3) were tracked across their multiple events instead.
Edit: Please disregard the second part, I had misinterpreted the next figure 
07-09-2016 16:02
natejo99That was fantastic. The paper did an excellent job of pointing out the flaws with the current system and proposing new changes to rectify some of those. I think many teams would benefit from a weekly 8 hours of unbag time and I would love to see FIRST make this change. Thanks for writing this, Jim!
07-09-2016 16:07
Nate Laverdure
|
...the graph would more directly support your point if a single population of teams (perhaps the 304 that competed at 4 events or the 765 that competed at 3) were tracked across their multiple events instead.
|
07-09-2016 16:17
IKEJim,
It is really neat to see these thoughts put into a cohesive piece. I know you have been working on and off on this for at least since 2010 talking about ideas and discussing possible formats.
I am a big advocate of the "transition" method. One piece missing from Jim's paper is the propensity of procrastination from some teams. If you have a stop build day, it sets a deadline and the procrastinators will miss that. If you get rid of stop build, the procrastinators will just procrastinate until the event, which can be incredibly detrimental to the week of their first competition.
The "transition" model of a stop build, but weekly test/train/tune/repair sessions give teams some development experience without completing loosing a lot of the intended meaning from the stop build.
As long as there is a stop build day and some limit to access, teams with the drive and resources will continue to build a second robot. Even with no more bag day, many of the highest performers will still build two robots so that one can be used for programming team, and one for training/testing.
My only ask out of this would be that every team get that every week. Please do not give 6 hours for competition unbag week vs. 8 hours for "other" weeks as that would get very confusing.
8 hours each week will be very beneficial though will be a bit of B&T nightmare. If FRC keeps the 2 hour blocks, that would be 4 sessions per week by 6 regional weeks or an additional 24 potential sessions not including displays. We may want to re-think the tag portion of the B&T.
07-09-2016 16:18
Jim Zondag|
Great read, thanks for posting!
Minor stats comment: Fig (5) is a little concerning because each curve represents a different population of teams, so it isn't a very clear way to show the trend of increasing performance as teams have attended more and more events. It is unclear to what degree teams from the left-hand side are moving rightwards as they attend more events or if most of those teams simply aren't included in the next curve. While it can be surmised by looking at the right-hand bounds of the distributions there are some performance increases, the graph would more directly support your point if a single population of teams (perhaps the 304 that competed at 4 events or the 765 that competed at 3) were tracked across their multiple events instead. |


07-09-2016 16:34
efoote868|
So, in a nutshell, if you choose to play late, odds are there are more experienced teams in the house who have progressed in skill while you have been waiting.
|
07-09-2016 16:36
techtiger1#Zondag4President
I really like the points people are making about withholding rules and B & T with the 8 hr time limit. Seems like Dr. Joe might have a point about just ripping the band aid off quickly and doing away with all of it. 
07-09-2016 16:55
FrankJThe teams that are playing 4 and five event are likely influenced by being mostly district teams progressing to worlds or well funded regional teams. In either case likely high performing teams. It seems that would skew the graphs.
07-09-2016 17:09
D.AllredJim,
Thanks for the analysis and interim proposal. I submitted the following comment in the survey since it seemed to lean toward an all-or-nothing approach.
You left out the option of out-of-bag time between competitions. At a minimum, we need time to practice and do some maintenance. Modifications and upgrades could still be done at competitions.
My hope was to lessen tendencies for teams to join the arms race by not eliminating regional withholding rules. Stop-build-day or something like it is still a good schedule milestone. Extra time and the hard stop of competition day will not make people better time managers.
In my opinion, teams will see most performance gains through practice and small improvements. Performing well with your existing robot will hopefully help with team retention.
Now we need a decent place for teams to practice…
David
P.S. Just to be clear to the other readers, I voted for no bagging requirements. It may simply be too large of a culture shock for FIRST. However, the teams need some type of relief. What other “sport” does not allow practice between events? "Sport for the Mind?"
07-09-2016 18:08
JB987|
I am not seeing the disconnect that others see. I believe that I can be FOR removing the stop build rules and still be AGAINST having the top teams cheesecake the soul out of a lower tier team.
I have a yardstick. It has inspiration tick marks along its length. I take the controversial position that it is more inspirational to have a team compete with a working robot of their own creation that can accomplish a game objective they set out to achieve. I don't like excessive cheesecaking because I believe it has bad long term effects on inspiration. I don't like stop build rules because they significantly disadvantage teams with low resources and while wasting resources of high resource teams, both of which adversely affect the inspirational impact of FIRST. You can disagree with my views but I don't understand how they are incompatible views to have. What am I missing? Dr. Joe J. |
07-09-2016 18:22
Richard Wallace
The Average Joes built a practice robot this year, because we knew (from our last two years) that the way to be competitive* is to practice. More access to our competition robot would have been a better solution.
IMHO, the issues of robot access and cheesecake can be separated. The motivation to offer or accept cheesecake is more dependent on game design.
I'm with Jim, Andy and Dr. Joe on robot access. How will we get there? I like Jim's proposal as a first step.
-------
*Like the way to Carnegie Hall, or the Olympics, or MIT.
07-09-2016 19:14
kaliken|
The Average Joes built a practice robot this year, because we knew (from our last two years) that the way to be competitive* is to practice. More access to our competition robot would have been a better solution.
|
07-09-2016 19:15
AdamHeard
|
So I am curious. If you had no bag and tag would you still build a practice bot?
Actually for the entire CD would you still build a practice bot if there was no bag and tag? I just am curious in which way the community is leaning (especially from some of the powerhouse teams) |
07-09-2016 19:37
Karthik
|
So I am curious. If you had no bag and tag would you still build a practice bot?
|
07-09-2016 19:52
ThaddeusMaximus|
Yes. For the following reasons:
3. Wear and tear. Our competition robot is usually at the end of its life span by the end of Championship. Our practice robot always in much worse shape than the competition robot. I can't imagine putting that many hours of drive time into one robot. |
07-09-2016 20:05
kaliken|
Yes. For the following reasons:
1. The practice robot usually often serves as a "beta edition" of the competition robot. Developing one helps you catch issues that can be entirely circumvented in a clean manner on the competition robot. 2. There's only room for so many hands on a robot at one time. Having a practice robot allows for software and mechanical development to happen in parallel. Even with a true 16 week build season, there would still be time crunches where having to development platforms would be an asset. 3. Wear and tear. Our competition robot is usually at the end of its life span by the end of Championship. Our practice robot always in much worse shape than the competition robot. I can't imagine putting that many hours of drive time into one robot. This probably doesn't apply for most teams. But for a team who has the resources to comfortably complete two robots, it's easy for me to see why they would continue to do so, even with the potential abandonment of the bag. |
07-09-2016 20:06
Lil' Lavery
Great working gathering and presenting this data. It was really an eye opening read in many ways.
However, I am given pause by some of the leaps taken when discussing the presented statistics in this paper. As engineers, I think we've all heard the oft repeated phrase "Correlation does not equal causation." There are some pretty dramatic leaps taken in the analysis of points 3 and 5 that ignore a host of other factors.
On point 3, to me Fig(2) isn't as clear as the proceeding paragraph claims it to be. The highest portions of the lost teams curve correspond with the high portions of the 2015 teams OPR distribution. That is to say, the most teams are lost from the OPR brackets that have the most teams total. That is obviously to be expected. Admittedly the skew shifts between the two plots, but I would like to see the actual loss ratios for each bucket rather than just raw totals.
Further still, while it's obvious from the tails of the plots that extremely poor performers are more likely to fail than extremely strong performers, there are a plethora of factors that could potentially explain that, rather than the teams failing because of their poor performance. Are these poor performing teams particularly inexperienced, underfunded, under resourced, or under mentored? FiM clearly has some degree of feedback on this, but the dynamic and culture of FiM varies greatly when compared to the rest of FRC given the levels of state sponsorship and funding. If FIRST HQ has similar surveying of teams lost to attrition, I would be very eager to see it. Given the other potential stressor on team retention among these extremely poor performers, I would be very cautious about making any leaps that a stronger on-field performance would result in them surviving to future seasons.
On point 5, I would like to echo the previous concern voiced by Greg Woelki. Each population in point 5 is a subset of the previous, but not a uniform sampling of the previous population. By removing 1-event teams from the 2nd even population, you're narrowing the sample to the teams that had the resources to compete twice and introducing a selection bias. There are even stronger selection biases with multiple event teams once you start factoring in teams that attended their district championships and/or FRC championship.
This selection bias is demonstrated in fig(6). Teams playing 1 event have a lower OPR at their first event than teams playing 2 events. That suggests that teams capable of competing multiple times are already at a higher level than those without the resources to compete multiple times. The upwards trends of all five groupings does mitigates the concerns of the selection bias to an extent, as it shows repeated plays do in fact help teams improve their performance, but the raw totals of the average OPRs mirror much of what is argued in point 6 (the better performing teams are already better and remain better). The average of the "Teams Playing 2" sample fails to reach the "Teams Playing 3" sample's beginning of season OPR, even after their 2nd event.
Most of all, both figures in point 3 are arguing that teams with more plays improve as the season progresses. There is a distinct difference between more plays (competition matches) and purely more robot access. While more competitions does mean more access, it also means a plethora of other factors, namely driver experience and competition field access. It's hard to say if more robot access alone would achieve the same levels of positive trends (or even if the gaps that already exist in point 6 could potentially be increased further). I'd be willing to wager that access to competition fields is a huge resource and a giant factor in the improved performance of teams that get repeat plays. I'd also argue that fig(6) even suggests this, as the steepest positive slopes in all four repeated play samples is between event 1 and event 2 (as teams get to test their robot on a real field for the first time).
Do not take this post to be a criticism of the concepts proposed in this paper or the elimination of bag day. Neither of those issues I have formed a strong opinion on to this point, as I see very valid arguments on both sides. Also do not take this as a criticism of Jim Zondag or the paper as a whole. I love the effort and dedicated to the program Jim has and the passion put into writing such a paper with the goal of moving FRC in a direction Jim feels is best for the program.
07-09-2016 21:05
GeeTwo
Jim,
Thanks for all the great data analysis, tied together with great commentary! I have been a bit on the #keepthebag side, mostly from a "devil you know" philosophy. After a first quick read, I'm now squarely #onthefence, moving towards #banthebag.
Sean,
Thanks for pointing out all of the weak points I'd noticed as I read, and a couple more. Even given those, there can be no reasonable doubt that more time with hands on the robot and more drive practice (not necessarily in that order) means increased ability for a team to perform game functions and be competitive.
All,
Since reading about the poll this morning, I've been pondering the question of whether we'd still do a second robot if there is no bag, or (later), 8 hours of access per week.
As background info: we're competing in the regional model, and this part of the country is still several years away from the team density to support districts. For the foreseeable future, we're looking at district registration and full team travel and hotel costs for a second event. We managed to binge-fund a trip to CMP in 2015, and drew in a few more sponsors, but unless we get a mentor or student with a better talent (or at least drive) to draw funding, we'll probably be able to afford a second regional about the same time we transition to districts.
At 8 hours per week, we would probably expand our Saturday build (currently six hours) to eight or nine, and do a single unbagging each week where we did fabrication, drive practice, pit crew practice, and robot upgrades in a rush, and used our much shorter weekday evening schedules for planning, CADding, and working with a practice robot that we would definitely still build.
At 20-168 hours of unbag per week, the question becomes a bit murkier, but I still think we would do two robots. Two robots are already part of our pre-bag processes (swapping robots off between project groups, including chassis, manipulators, programming, and drive team), so unless we lose a significant amount of resources (which could be money, facilities, mentors, or students), we would probably tweak the second robot processes, but not cancel them.
The thing that excites me about a protracted unbagging each week is the possibility of a scrimmage. Currently, teams who do not build a second robot cannot even think about competing at a scrimmage, so there is no point in doing it in our area; I believe we are one of a very few. With an 8-hour unbagging window each week, I could definitely see enough teams to support a 3-6 hour scrimmage every week or two between "initial bag" and Bayou Regional, if we can identify a facility and carpet large enough to host the event.
07-09-2016 21:51
Siri|
[Figure 2]...I would like to see the actual loss ratios for each bucket rather than just raw totals.
[Figure 5]...By removing 1-event teams from the 2nd even population, you're narrowing the sample to the teams that had the resources to compete twice and introducing a selection bias. There are even stronger selection biases with multiple event teams once you start factoring in teams that attended their district championships and/or FRC championship. [Figure 6] This selection bias is demonstrated in fig(6). Teams playing 1 event have a lower OPR at their first event than teams playing 2 events... |
08-09-2016 08:40
R2D2DOCAll,
I may have missed this point in the great number of thoughtful responses: If the B&T is modified, what impacts/advantages can be realized for the competition season schedule?
Just Wonderin'
08-09-2016 09:29
Mike Schreiber|
orrrrrrrrrr get rid of 120lb weight limit so parts can be designed for infinite fatigue life and still be viable?
![]() |
|
Originally Posted by The National Institute for Occupational Safety and Health (NIOSH)
...the maximum weight to be lifted with two hands, under ideal conditions, is 51 pounds
|
08-09-2016 19:39
AllenGregoryIV
First off, Jim thank you for putting this together, it's an excellent read.
The middle ground proposal is a very good step in the right direction. The only thing it doesn't easily allow for is teams to hold scrimmages on weekends when they aren't competing. In this proposal it is still advantageous to compete more often during the season. This becomes less of a problem once all areas are in districts as competing additional times is less expensive and you are already competing more often. For teams that are not in a district system I could see how having more than 8 hours of ROBOT ACCESS time would be needed to get the full benefits of what a practice bot currently allows.
At that point we are just changing a single variable, I do strongly agree with the plan in general.
08-09-2016 20:45
NShep98|
For teams that are not in a district system I could see how having more than 8 hours of ROBOT ACCESS time would be needed to get the full benefits of what a practice bot currently allows.
|
08-09-2016 21:09
Collin Fultz
|
This is actually where my confusion came in as to how this would interact with the current District Access Period, because the point of districts getting extra time is to offset the additional day regionals get.
|
08-09-2016 21:41
EricH
|
Perhaps with this proposal Regional Events could start their matches after lunch on Thursday, allowing more time for more matches.
|
08-09-2016 21:45
PayneTrain|
Someone just made that suggestion in the other thread. We can do that, provided that we get a district schedule as far as load-in/inspection. That is, we start load-in/inspection at 5 PM Wednesday, practice Thursday morning, and pray that enough refs make it by noon to start.
Sound reasonable? |
| Now do that with a 40-team regional. You're only adding another half-day of matches, so that regional now gets about 16 matches/team, more than any district, before elims. What was that about district events giving more plays than a regional? (Or else you add massive downtime/slow cycles.) Oh, you don't like that part of it. So you're going to have two regional schedules, one for large and one for small. How confusing will that be? |
08-09-2016 21:53
PayneTrainI also want to add that while I do not speak for Collin, I believe he is a former FRC Team Advocate at FIRST HQ and the current president of IndianaFIRST. I imagine he would like whatever we can try out to improve the team experience.
08-09-2016 22:02
Collin Fultz
|
Now do that with a 40-team regional. You're only adding another half-day of matches, so that regional now gets about 16 matches/team, more than any district, before elims.
|
08-09-2016 22:04
EricH
08-09-2016 22:08
PayneTrain|
Your Wednesday "inspection" at a regional is "Here's the green tag saying you can open the bag tomorrow morning, be safe setting up your pit". (Or you get the dreaded "red tag": See the LRI to clear the lockup form, withholding, or other "oops".) Same as the Thursday "early load".
Districts are doing inspection on load-in night. Champs is doing inspection at uncrate. Regionals? Sign form, check withholding and bag integrity, and make sure that no work is done on the robot. |
08-09-2016 22:24
EricH
|
I occasionally use the word "region" to describe an area in district events. Regionals are independent of a region.
Let me amend: events in FIRST at a size equivalent to a regional already do what you have described. |
09-09-2016 03:44
Cothron Theiss-snip-
I mistook that "Page 2 of 5" for "Page 5 of 5." Please disregard.
21-10-2016 15:34
chapman1I oppose the elimination of Stop Build Day for two reasons:
1) One of the many benefits of FRC that I have touted is that kids are given a nearly impossible deadline of six weeks in which a robot must be envisioned, prototyped, built, tested and made ready for competition. "Nearly impossible" is the deadline that most often exists in real life. It's good practice.
2) From the perspective of a small, underfunded rural school team, eliminating the Stop Build Day would be one more way of favoring the larger, better funded urban teams:
2a) Our team has only a handful of mentors, and all are actively employed. Some have to take vacation time in order to attend after-school work sessions or to participate in weekday events. Further, when the competition season finally ends, we have to spend the next several months catching up with our personal and professional lives. Extending the build season would make it nearly impossible for us to ever catch up. We would lose mentors.
Similarly, students at our school are more often than not involved in multiple sports, drama, Business Professionals of America (BPA) and other activities - because there isn't enough kids to go around. They too do not need more time commitment.
2b) The larger, urban teams, with ready access to large corporate sponsorship already have an advantage by virtue of funding and resources. We drool at many of the machines we see, all CAD-designed and with parts cut by sponsors' waterjets. Larger teams can accomplish more in a day than can small teams - even without the funding & technology gaps.
Yet, smaller teams can still compete today - despite the "head start" the larger teams have - because their advantage is held to a specific period of time. If the amount of build days is extended any more, FRC might as well plan on an "elite" team-only competition - the gap between elites and the rest of the field would become so wide that smaller teams would have little hope of successfully competing.
__________________
21-10-2016 15:40
marshall|
I oppose the elimination of Stop Build Day for two reasons:
1) One of the many benefits of FRC that I have touted is that kids are given a nearly impossible deadline of six weeks in which a robot must be envisioned, prototyped, built, tested and made ready for competition. "Nearly impossible" is the deadline that most often exists in real life. It's good practice. 2) From the perspective of a small, underfunded rural school team, eliminating the Stop Build Day would be one more way of favoring the larger, better funded urban teams: 2a) Our team has only a handful of mentors, and all are actively employed. Some have to take vacation time in order to attend after-school work sessions or to participate in weekday events. Further, when the competition season finally ends, we have to spend the next several months catching up with our personal and professional lives. Extending the build season would make it nearly impossible for us to ever catch up. We would lose mentors. Similarly, students at our school are more often than not involved in multiple sports, drama, Business Professionals of America (BPA) and other activities - because there isn't enough kids to go around. They too do not need more time commitment. 2b) The larger, urban teams, with ready access to large corporate sponsorship already have an advantage by virtue of funding and resources. We drool at many of the machines we see, all CAD-designed and with parts cut by sponsors' waterjets. Larger teams can accomplish more in a day than can small teams - even without the funding & technology gaps. Yet, smaller teams can still compete today - despite the "head start" the larger teams have - because their advantage is held to a specific period of time. If the amount of build days is extended any more, FRC might as well plan on an "elite" team-only competition - the gap between elites and the rest of the field would become so wide that smaller teams would have little hope of successfully competing. __________________ |
21-10-2016 16:08
Chris is me|
Yet, smaller teams can still compete today - despite the "head start" the larger teams have - because their advantage is held to a specific period of time. If the amount of build days is extended any more, FRC might as well plan on an "elite" team-only competition - the gap between elites and the rest of the field would become so wide that smaller teams would have little hope of successfully competing.
|
21-10-2016 17:51
chapman1
21-10-2016 18:45
marshall|
Yep. I get it that many teams build two robots to get around the time limit. I get it that many will show up with 29.9 lbs. of improvements at every competition.
Did you take more than 10 seconds to actually consider my points and perspective? |
21-10-2016 18:57
FarmerJohn|
Yep. I get it that many teams build two robots to get around the time limit. I get it that many will show up with 29.9 lbs. of improvements at every competition.
Did you take more than 10 seconds to actually consider my points and perspective? |
21-10-2016 19:41
gblake
21-10-2016 19:48
Rachel Lim|
I beg to disagree.
FRC isn't a competition. FRC *includes* a competition. |
21-10-2016 20:00
Chris is me|
I beg to disagree.
FRC isn't an on-the-field competition. FRC *includes* an on-the-field competition. |
21-10-2016 23:14
gblake|
I know what you're trying to say, but I think this is a bit pedantic and derailing. We are discussing a change to the rules of the robotics competition, so we are of course focused on the impact this competition rules change has to the robotics competition.
|
22-10-2016 11:51
Knufire|
...that anything less than single-mindedly dedicating a team to winning FRC's competition is a mistake.
... If I was derailing, please give me credit for trying to derail us onto a set of tracks that takes us to our destination, not past it. Blake |
22-10-2016 14:05
Jared Russell
|
Our team has only a handful of mentors, and all are actively employed. Some have to take vacation time in order to attend after-school work sessions or to participate in weekday events.
|
|
Further, when the competition season finally ends, we have to spend the next several months catching up with our personal and professional lives. Extending the build season would make it nearly impossible for us to ever catch up.
|
22-10-2016 14:38
Mark McLeod
The argument that every team should be like 254 is weak...
Hubris is blinding.
22-10-2016 14:47
Chris is me|
The argument that every team should be like 254 is weak...
Hubris is blinding. |
22-10-2016 14:51
Mark McLeod
|
I agree with your point in general, that often teams don't have a good picture of other team's situations when giving advice, but I genuinely think reducing meeting times and being strategic about it is actually in the long term a competitive advantage and a great piece of advice for all levels. Team member burnout is a constraint and resource to manage, just like any other.
|
22-10-2016 15:33
marshall|
The hubris is making the assumption that other teams haven't already thought of and dealt with this. Every team has already decided how they are going to schedule their meeting times.
|
22-10-2016 16:20
nobrakes8
22-10-2016 16:35
jman4747So it seems one disagreement we have lies with the question of whether or not meeting more often over a short period of time is more stressful than meeting less often over a longer period of time.
I would assume most people who want to keep the bag beleve the latter is more stressful?
22-10-2016 16:56
marshall|
Then, I think FRC needs to look at historical performance of teams and maybe put restrictions on teams that win 80-90% of their regionals/districts (maybe only allow a 100lb robot and limit motors, sensors or envelop size compared to the rest of the teams).
|
|
Originally Posted by jman4747
So it seems one disagreement we have lies with the question of whether or not meeting more often over a short period of time is more stressful than meeting less often over a longer period of time.
|
22-10-2016 17:15
Mark Sheridan|
After years of 7 day weeks and long nights, 254 finally switched to a time-boxed* evening and weekend schedule last season, and as far as I'm concerned there's no turning back. It gives students time to do homework, mentors days off to work and be with family, and everyone the precious sleep they need. When we made this switch, we realized how ~40% of the time we were spending at build while exhausted and frustrated was wasted, and that a more spread-out schedule allows everyone to catch their breath, parts to arrive, and work sessions to be more focused
|
22-10-2016 18:11
EricH
|
So it seems one disagreement we have lies with the question of whether or not meeting more often over a short period of time is more stressful than meeting less often over a longer period of time.
I would assume most people who want to keep the bag beleve the latter is more stressful? |
|
Kinda cherry picking with the quote but this will definitely create two different classifications for teams. I'm torn on the idea of different classes for teams within FRC... part of me thinks it could be a good thing but part of me also thinks it's going to create unforeseen problems worse than the championshplit.
|
22-10-2016 19:36
D.Allred|
So it seems one disagreement we have lies with the question of whether or not meeting more often over a short period of time is more stressful than meeting less often over a longer period of time.
I would assume most people who want to keep the bag beleve the latter is more stressful? |
23-10-2016 03:32
Jared Russell
|
Every team has already decided how they are going to schedule their meeting times.
|
23-10-2016 22:29
jman4747|
I've seen a lot more concerns around the following points.
- More time available will drive more time to meet increasing total commitment. - Open build allows all teams to continue iterating. You will need to do the same to remain competitive. - Open build will provide more opportunities for design convergence. |
26-10-2016 12:48
Daria WingActually, this finally went to FIRST official and around the world. They have the survey online now, discussing the pros and cons of Stop Build Day. I honestly don't think that they will get rid of it, nor do I think that they should, but they might be extending it another week or two, which could be a hail mary for a lot of teams.
26-10-2016 13:07
Brian Maher|
but they might be extending it another week or two, which could be a hail mary for a lot of teams.
|
26-10-2016 13:18
rtfgnow
|
Actually, this finally went to FIRST official and around the world. They have the survey online now, discussing the pros and cons of Stop Build Day. I honestly don't think that they will get rid of it, nor do I think that they should, but they might be extending it another week or two, which could be a hail mary for a lot of teams.
|
26-10-2016 15:07
Cory
|
Actually, this finally went to FIRST official and around the world. They have the survey online now, discussing the pros and cons of Stop Build Day. I honestly don't think that they will get rid of it, nor do I think that they should, but they might be extending it another week or two, which could be a hail mary for a lot of teams.
|