Go to Post it seems to have all the basic food groups: liquid, sugar, sauce, and robotics components. - ChrisMcK2186 [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
 
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 15-03-2016, 01:53
Cory's Avatar
Cory Cory is offline
Registered User
AKA: Cory McBride
FRC #0254 (The Cheesy Poofs)
Team Role: Engineer
 
Join Date: May 2002
Rookie Year: 2001
Location: Redwood City, CA
Posts: 6,807
Cory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond reputeCory has a reputation beyond repute
Send a message via AIM to Cory
Re: Real Week 2 update

Quote:
Originally Posted by Boltman View Post
As a follow up to my scheduling observations from CVR here are the key matches where "top teams" met on the same field of play as partners or as opponents. Of course there were many good teams but these tend to be the best by historic achievements. 179 peaked my interest to look a bit deeper. My definition of top teams are those I noted going in based on achievement. Forgive me if I missed someone.

as of now, every team # in picture identified is less than number 1679

What I did was only extracted every game in which top teams crossed paths or partnered up and the results are seemingly not random at first glance of the same field games.

Three matches the top teams faced against each other BUT there were SIX matches where they were also alliance partners

I did our matches and got TWO such pairings whereas 5136 had more (they also made WC) and we are within one Team# of them.

So I think the algorithm may weight previous WC pairings more favorably than head to heads. Again I only looked at games where giants crossed paths in qualification.

It can seem random (about two three games per, probably that way for most teams) but one would think that Head to head versus Side by Side alliance members would be more even. Not off by a about a factor of two.

I get what 179 is saying also about game scheduling and time between matches also one regional is not enough sample size but it is curious to look at. Like I said I noticed this last year, I see patterns quite well my job as scout/strategy mentor and it carries on into this year. Perhaps with more years I will see it start to even out. For now it doesn't really matter other than to satisfy my curiosity on how match scheduling really occurs.

The colors have nothing to do with my personal ranking of individual teams. Rather its just so I can identify the different top teams with different shades of green to better visualize it.

I'll run similar test next year to see if it is similar or balances it out assuming we go to one the powerhouse regional's again..they are fun. Hard to miss them around CA.

In the end I would not doubt this is done for entertainment value, as a bunch of 50 point games is not real exciting (140 is) however its not the most efficient way of getting as 179 calls it the "next generation" to show up regularly at worlds . They seem to have an uphill swim and scheduling in regional's could explain some of it. Perhaps it can be a reason why some don't make it for quite a while. But occasionally they do punch through. In no way did this affect us we got what we earned in both regional's and could not ask for more than that this season.
Whatever you think you're seeing here, you're wrong. There is nothing about the algorithm that weights whether a team has made it to Champs. You're grasping at straws.
__________________
2001-2004: Team 100
2006-Present: Team 254
Reply With Quote
  #2   Spotlight this post!  
Unread 15-03-2016, 02:28
wireties's Avatar
wireties wireties is offline
Principal Engineer
AKA: Keith Buchanan
FRC #1296 (Full Metal Jackets)
Team Role: Mentor
 
Join Date: Jan 2006
Rookie Year: 2004
Location: Rockwall, TX
Posts: 1,170
wireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond reputewireties has a reputation beyond repute
Send a message via AIM to wireties
Re: Real Week 2 update

Quote:
Originally Posted by Cory View Post
Whatever you think you're seeing here, you're wrong. There is nothing about the algorithm that weights whether a team has made it to Champs. You're grasping at straws.
QFT - The algorithm (at least a few years ago) does not include team numbers or any kind of history. It starts with team #1 (attending that regional) and goes through team X (attending that regional). It is randomized a bit but it has nothing do with the FRC team number until it fills in that the nth team to register was team ABCD for the report they feed to pit admin.

With respect you are way out in left field on this topic.
__________________
Fast, cheap or working - pick any two!

Last edited by wireties : 15-03-2016 at 02:30.
Reply With Quote
  #3   Spotlight this post!  
Unread 15-03-2016, 08:36
Boltman Boltman is offline
Registered User
FRC #5137 (Iron Kodiaks)
Team Role: Mentor
 
Join Date: Apr 2014
Rookie Year: 2014
Location: San Diego
Posts: 858
Boltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud of
Re: Real Week 2 update

Quote:
Originally Posted by wireties View Post
QFT - The algorithm (at least a few years ago) does not include team numbers or any kind of history. It starts with team #1 (attending that regional) and goes through team X (attending that regional). It is randomized a bit but it has nothing do with the FRC team number until it fills in that the nth team to register was team ABCD for the report they feed to pit admin.

With respect you are way out in left field on this topic.
I may be "in left field" a simple check will either prove a trend or not.
__________________

Iron Kodiaks Team #5137 San Marcos, CA

2016 Semi-Finalist | Central Valley Alliance Captain #2
2016 Semi-Finalist | San Diego 2nd bot alliance #8
2015 Semi-Finalist | Ventura 3rd bot alliance #3
2015 Quarter-Finalist| San Diego 2nd bot alliance #5
2014 Rookie All-Star | #21 San Diego | Galileo Division #91

Last edited by Boltman : 15-03-2016 at 08:41.
Reply With Quote
  #4   Spotlight this post!  
Unread 15-03-2016, 08:42
matthewdenny's Avatar
matthewdenny matthewdenny is offline
Registered User
FRC #6054 (Dukes)
Team Role: Mentor
 
Join Date: Jan 2012
Rookie Year: 2012
Location: United States
Posts: 310
matthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant futurematthewdenny has a brilliant future
Re: Real Week 2 update

I would like to note that with small sample sizes it is statistically likely to see patterns that aren't actually there.
Reply With Quote
  #5   Spotlight this post!  
Unread 15-03-2016, 08:43
Boltman Boltman is offline
Registered User
FRC #5137 (Iron Kodiaks)
Team Role: Mentor
 
Join Date: Apr 2014
Rookie Year: 2014
Location: San Diego
Posts: 858
Boltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud of
Re: Real Week 2 update

Quote:
Originally Posted by matthewdenny View Post
I would like to note that with small sample sizes it is statistically likely to see patterns that aren't actually there.
I know that is just one regional, I am not drawing a conclusive statement just what I noticed in two years of actually analyzing stuff. Just presenting limited data in one regional here.

It did not affect us one bit. Neither did losing 2 RP in San Diego. We were good enough to get what we deserved either way.
__________________

Iron Kodiaks Team #5137 San Marcos, CA

2016 Semi-Finalist | Central Valley Alliance Captain #2
2016 Semi-Finalist | San Diego 2nd bot alliance #8
2015 Semi-Finalist | Ventura 3rd bot alliance #3
2015 Quarter-Finalist| San Diego 2nd bot alliance #5
2014 Rookie All-Star | #21 San Diego | Galileo Division #91

Last edited by Boltman : 15-03-2016 at 09:00.
Reply With Quote
  #6   Spotlight this post!  
Unread 15-03-2016, 08:46
Boltman Boltman is offline
Registered User
FRC #5137 (Iron Kodiaks)
Team Role: Mentor
 
Join Date: Apr 2014
Rookie Year: 2014
Location: San Diego
Posts: 858
Boltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud of
Re: Real Week 2 update

Quote:
Originally Posted by Cory View Post
Whatever you think you're seeing here, you're wrong. There is nothing about the algorithm that weights whether a team has made it to Champs. You're grasping at straws.
Perhaps, anyhow we had a ton of fun playing with all the great teams up in
NoCal. Good luck 254 your bot rocks.
__________________

Iron Kodiaks Team #5137 San Marcos, CA

2016 Semi-Finalist | Central Valley Alliance Captain #2
2016 Semi-Finalist | San Diego 2nd bot alliance #8
2015 Semi-Finalist | Ventura 3rd bot alliance #3
2015 Quarter-Finalist| San Diego 2nd bot alliance #5
2014 Rookie All-Star | #21 San Diego | Galileo Division #91
Reply With Quote
  #7   Spotlight this post!  
Unread 15-03-2016, 08:52
Lil' Lavery Lil' Lavery is offline
TSIMFD
AKA: Sean Lavery
FRC #1712 (DAWGMA)
Team Role: Mentor
 
Join Date: Nov 2003
Rookie Year: 2003
Location: Philadelphia, PA
Posts: 6,606
Lil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond reputeLil' Lavery has a reputation beyond repute
Send a message via AIM to Lil' Lavery
Re: Real Week 2 update

There is no "perhaps" here. The algorithm does not factor in team numbers or team history. Rather than pontificate here, consider talking with an FTA or reading up on the matchmaking algorithm to understand how it works.

http://www.idleloop.com/matchmaker/
__________________
Being correct doesn't mean you don't have to explain yourself.
Reply With Quote
  #8   Spotlight this post!  
Unread 15-03-2016, 11:48
Boltman Boltman is offline
Registered User
FRC #5137 (Iron Kodiaks)
Team Role: Mentor
 
Join Date: Apr 2014
Rookie Year: 2014
Location: San Diego
Posts: 858
Boltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud of
Re: Real Week 2 update

Quote:
Originally Posted by Lil' Lavery View Post
There is no "perhaps" here. The algorithm does not factor in team numbers or team history. Rather than pontificate here, consider talking with an FTA or reading up on the matchmaking algorithm to understand how it works.

http://www.idleloop.com/matchmaker/
Thanks for the link! I like having more info.

"it's desirable to minimize duplicates so that teams see as many different teams as possible. It's especially desirable for a given team not to have the same team as a partner more than once, nor as an opponent more than once."

I think they could have split 1678's second match against us to another match just sayin'. Its not really ideal for any team to face consensus #1 twice in qualifications or 20% of their matches.

I'm sure the algorithm tries to be unbiased however as we know it can be imperfect (as the above link states) a human FTA should look for duplicates and adjust as necessary. Just flip teams above or below any "peculiarity" a one game switch in the schedule is doable.

I am not pontificating (you chose to read a post in my week 2 update thread), just pointing out the realities of a single regional's scheduling that happened to have 4 World Champions everyone in FRC knows.

Also I disagree with this statement "This is not only a scheduling algorithm issue, but a simple matter of not knowing in advance which teams will turn out to be more effective than others."

I believe "Class" has a lot to do with year to year success in a 20 year organization of 4000 or so teams... just like in horse racing. So to say that 254 or 1678 or 973 or 1323 are all the sudden not going to be good is a false statement. they will likely be very good because of their programs and their history. They would not accept anything less. Same here we are not going to fall off the face of FRC either every year we will iterate better. You can assume certain things from how teams have done in the past. Just look at their year over year results its all there.

I think to really do scheduling "correctly" some unbiased FTA needs to "adjust" when the computer prints out what it thinks is optimal based on some algorithm. The FTA knows or should know the perennial teams and could easily see the duplicates or inordinate amount of powerhouse pairings with a single highlighter . They could adjust anytime up to when its posted. It can be done and I think it improves the game play as well if instituted correctly.

The main problem is.. teams only get maybe 20 matches in two regionals so scheduling draw is huge just like "missed RP's" as a high order ranking metric.

I'm not afraid to point things out to improve the game hopefully for every team. FRC is great yet can still improve and tweak. Its good to be questioned and not accept always the status quo. I may just have a fresh view on an older institution. Things can always improve.

This is not why we are not in St Louis. All I'm sayin' it could be done better...and perhaps it makes a smidgen of difference if they actually tweak the way schedules are made. Might take a half hour or less at each regional to flip a few teams a few spots with the analytic help.

-----------------------------------------------

Attached is the way I do schedules lets pretend its a different season and in this scenario 3495 is a super powerhouse and consensus #1 or won 4 WC divisions and its our second match with them on our side. Great for us but seemingly "unfair" for having #1 twice on our side (or against us)

I mark partners in green and opponents in red for my scouts. Whites we do not play.

So if an FTA wanted to by switching 5137 for 2135 a one game switch a second powerhouse pairing match is avoided then all they have to do is make sure the other 5 teams did not play that team on same side or not. There are plenty of white spaces to switch teams around IF the goal is to be more random and possibly more fair to all teams.

If that does not work then there are two other "blue" teams that could make the switch.

We could have probably used the extra game in between as well there...in that scenario.

Just like with instant replay, changes can be made that are fairly simple and don't open a can of worms.... what might actually happen is all the sudden more teams get super good alliance partners and avoid facing powerhouses too much until eliminations. Schedules are always pretty late anyhow.

I think a human eye on it could easily sort out inconsistencies, much easier than trying to program some algorithm..its not rocket science. Let the algorithm do the sort.. then highlight several inconsistencies and move things around slightly.
Attached Thumbnails
Click image for larger version

Name:	capture43.PNG
Views:	28
Size:	78.0 KB
ID:	20362  
__________________

Iron Kodiaks Team #5137 San Marcos, CA

2016 Semi-Finalist | Central Valley Alliance Captain #2
2016 Semi-Finalist | San Diego 2nd bot alliance #8
2015 Semi-Finalist | Ventura 3rd bot alliance #3
2015 Quarter-Finalist| San Diego 2nd bot alliance #5
2014 Rookie All-Star | #21 San Diego | Galileo Division #91

Last edited by Boltman : 15-03-2016 at 13:27.
Reply With Quote
  #9   Spotlight this post!  
Unread 15-03-2016, 12:58
Chris is me's Avatar
Chris is me Chris is me is offline
no bag, vex only, final destination
AKA: Pinecone
FRC #0228 (GUS Robotics); FRC #2170 (Titanium Tomahawks)
Team Role: Mentor
 
Join Date: Dec 2008
Rookie Year: 2006
Location: Glastonbury, CT
Posts: 7,656
Chris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond reputeChris is me has a reputation beyond repute
Send a message via AIM to Chris is me
Re: Real Week 2 update

Quote:
Originally Posted by Boltman View Post
I think to really do scheduling "correctly" some unbiased FTA needs to "adjust" when the computer prints out what it thinks is optimal based on some algorithm. The FTA knows or should know the perennial teams and could easily see the duplicates or inordinate amount of powerhouse pairings with a single highlighter . They could adjust anytime up to when its posted. It can be done and I think it improves the game play as well if instituted correctly.
This proposition is inherently contradictory. You are asking for an "unbiased" volunteer to introduce bias into the schedule based on their perception of historical robot / team quality. No matter how you slice it, that is biasing the results even farther from random than what they are, and there isn't even a chance of a volunteer doing this "fairly".

Changing the algorithm to try and pair teams of different ages with each other was tried once, in 2007, with generally disastrous results. The match making generator is already far from random when you consider all of the constraints on it - adding more constraints to make schedules "fairer" all but requires loosening one of the other constraints. In 2007, this meant matches had a consistent mix of young teams, old teams, and middle aged teams... at the cost of having to play with and against the same robots over and over again. It was almost universally disliked.

My advice? Get over the fact that schedules won't ever be "fair" however you see it, and work on becoming a team that isn't dependent on a perfect schedule to play well into Saturday / Sunday afternoon.
__________________
Mentor / Drive Coach: 228 (2016-?)
...2016 Waterbury SFs (with 3314, 3719), RIDE #2 Seed / Winners (with 1058, 6153), Carver QFs (with 503, 359, 4607)
Mentor / Consultant Person: 2170 (2017-?)
---
College Mentor: 2791 (2010-2015)
...2015 TVR Motorola Quality, FLR GM Industrial Design
...2014 FLR Motorola Quality / SFs (with 341, 4930)
...2013 BAE Motorola Quality, WPI Regional #1 Seed / Delphi Excellence in Engineering / Finalists (with 20, 3182)
...2012 BAE Imagery / Finalists (with 1519, 885), CT Xerox Creativity / SFs (with 2168, 118)
Student: 1714 (2009) - 2009 Minnesota 10,000 Lakes Regional Winners (with 2826, 2470)
2791 Build Season Photo Gallery - Look here for mechanism photos My Robotics Blog (Updated April 11 2014)
Reply With Quote
  #10   Spotlight this post!  
Unread 15-03-2016, 13:07
1493kd's Avatar
1493kd 1493kd is offline
kd
FRC #1493 (FALCONS)
Team Role: Teacher
 
Join Date: Mar 2006
Rookie Year: 2005
Location: Albany, NY
Posts: 142
1493kd will become famous soon enough
Re: Real Week 2 update

Quote:
Originally Posted by Chris is me View Post

Changing the algorithm to try and pair teams of different ages with each other was tried once, in 2007, with generally disastrous results.
I will agree 100% with the 2007 system of scheduling being a mess. It was my second year on the team and we ended up being ranked 2nd at UTC with a robot that never hung a tube once (maybe 2) and was complete garbage. We were lucky and got paired up with 25 twice and many other great teams to push up to being ranked 2nd.

I felt guilty ranking so high with such a poor performing robot. I refuse to even count it as our highest ranking ever at an event.
Reply With Quote
  #11   Spotlight this post!  
Unread 15-03-2016, 13:35
Boltman Boltman is offline
Registered User
FRC #5137 (Iron Kodiaks)
Team Role: Mentor
 
Join Date: Apr 2014
Rookie Year: 2014
Location: San Diego
Posts: 858
Boltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud ofBoltman has much to be proud of
Re: Real Week 2 update

Quote:
Originally Posted by Chris is me View Post
This proposition is inherently contradictory. You are asking for an "unbiased" volunteer to introduce bias into the schedule based on their perception of historical robot / team quality. No matter how you slice it, that is biasing the results even farther from random than what they are, and there isn't even a chance of a volunteer doing this "fairly".

Changing the algorithm to try and pair teams of different ages with each other was tried once, in 2007, with generally disastrous results. The match making generator is already far from random when you consider all of the constraints on it - adding more constraints to make schedules "fairer" all but requires loosening one of the other constraints. In 2007, this meant matches had a consistent mix of young teams, old teams, and middle aged teams... at the cost of having to play with and against the same robots over and over again. It was almost universally disliked.

My advice? Get over the fact that schedules won't ever be "fair" however you see it, and work on becoming a team that isn't dependent on a perfect schedule to play well into Saturday / Sunday afternoon.
Been there done that already as I repeatedly said this did not affect us (but may affect others).... we held our own in CV and Ventura last year both days . I think that small changes could be made though to benefit all teams and saying that's "just the way it is" is not really acceptable.

I foresee maybe about three glaring inconsistencies that may need to be adjusted per "powerhouse" event... an hour of work maybe just making sure it does not mess another team up. The system is decent I believe it can be improved. Just like missed defense crossings that also can improve. Pretty sad when Portcullis crossings are missed especially the way we did them
__________________

Iron Kodiaks Team #5137 San Marcos, CA

2016 Semi-Finalist | Central Valley Alliance Captain #2
2016 Semi-Finalist | San Diego 2nd bot alliance #8
2015 Semi-Finalist | Ventura 3rd bot alliance #3
2015 Quarter-Finalist| San Diego 2nd bot alliance #5
2014 Rookie All-Star | #21 San Diego | Galileo Division #91

Last edited by Boltman : 15-03-2016 at 14:18.
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 07:05.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi