Go to Post Has FIRST ever made a game that was easy to do? - Koko Ed [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Reply
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 13-03-2016, 22:26
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
2016 match data


For the benefit of those who would like to analyze the scoring data but don't know how to access the API and/or parse the XML/JSON responses, I've posted Excel CSV files here, so you don't have to "scrape" web pages to get the data you need.


Reply With Quote
  #2   Spotlight this post!  
Unread 13-03-2016, 23:06
Cothron Theiss's Avatar
Cothron Theiss Cothron Theiss is online now
Registered Muser
FRC #4462 (Full Metal Jackets)
Team Role: College Student
 
Join Date: Feb 2016
Rookie Year: 2013
Location: Kingston, Tennessee
Posts: 569
Cothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond reputeCothron Theiss has a reputation beyond repute
Re: 2016 match data

You're a gift, thank you.
Reply With Quote
  #3   Spotlight this post!  
Unread 14-03-2016, 14:49
antillies85 antillies85 is offline
Registered User
FRC #4680
 
Join Date: Jan 2016
Location: Detroit, MI
Posts: 2
antillies85 is an unknown quantity at this point
Re: 2016 match data

This is amazing! But I have a very newbie question for you. So looking at say MIKE's qualification match data, how would you use data to build a profile of which matches a team was involved with and the scores from that particular match? Would it be a pretty complicated set of vlookups to build that profile?

Thanks so much for compiling this! And we've been trying to look for ways to learn how to interact with the API but the tutorials are pretty thin. If you have any suggestions, that would be awesome.
Reply With Quote
  #4   Spotlight this post!  
Unread 14-03-2016, 15:31
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data

Quote:
Originally Posted by antillies85 View Post
So looking at say MIKE's qualification match data, how would you use data to build a profile of which matches a team was involved with and the scores from that particular match?
In the qual match CSV, Columns E thru J contain the Team Numbers r1,r2,r3,b1,b2,b3.

Say you want to find all of Team 469's matches in Week2 MIKE2 event.

Insert a new column right after Column J. Now you will have a new blank column K.

Put the heading "Team469" in cell K1.

Put the following formula in cell K2:

=IF(COUNTIF(E2:J2,"469"),1,0)

Copy cell K2 all the way down.

Now each cell in column K contains the value "1" if 469 played in that match, or a "0" if they did not.

Select all the cells in the spreadsheet, and sort by column K descending. All the matches that 469 played in will be displayed at the top of the spreadsheet.

Is that what you were asking?


Reply With Quote
  #5   Spotlight this post!  
Unread 14-03-2016, 15:57
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data


There was an error in the original "Week1 Matches raw data". That file attachment has been removed, and a corrected version uploaded. Sorry for any confusion or inconvenience.


Reply With Quote
  #6   Spotlight this post!  
Unread 14-03-2016, 16:06
antillies85 antillies85 is offline
Registered User
FRC #4680
 
Join Date: Jan 2016
Location: Detroit, MI
Posts: 2
antillies85 is an unknown quantity at this point
Re: 2016 match data

Thank you! Yes, my brother mentioned doing that as well. Thank you for confirming that this is a good way to go about this. I'm trying to use Tableau to compile data and visualize it all.

Thank you for your help!
Reply With Quote
  #7   Spotlight this post!  
Unread 14-03-2016, 16:29
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data

Quote:
Originally Posted by antillies85 View Post
Thank you! Yes, my brother mentioned doing that as well. Thank you for confirming that this is a good way to go about this.
I'm not so sure it's a "good" way, but it's an quick-n-easy way.

In Excel, a better way would be to write a simple macro to pick each match that 469 played in, and copy it to a new sheet.


Quote:
I'm trying to use Tableau to compile data and visualize it all.
I've never used Tableau. Does it have a macro language? If so, you might want to investigate that.

Quote:
Thank you for your help!
You're welcome. Feel free to ask questions any time.


Reply With Quote
  #8   Spotlight this post!  
Unread 14-03-2016, 17:11
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data


I should have mentioned in the OP:

Hat tip to Phil Lopreiato and Alex Herreid for their patient help.


Reply With Quote
  #9   Spotlight this post!  
Unread 14-03-2016, 17:30
Firgreen Firgreen is offline
Kevin Zheng
FRC #2834
 
Join Date: Nov 2013
Rookie Year: 2012
Location: West Bloomfield, MI
Posts: 4
Firgreen is an unknown quantity at this point
Re: 2016 match data

Quote:
I'm trying to use Tableau to compile data and visualize it all
There's no equivalent of macro calculations to VBA in Excel, though it does have some kind of data blending between different CSV sheets, as well as some flexibility in their table calculations.
But I've found the best way is to blend the data in Excel and then import into Tableau, which does require calculations and possibly macros.
Reply With Quote
  #10   Spotlight this post!  
Unread 14-03-2016, 17:43
Caleb Sykes's Avatar
Caleb Sykes Caleb Sykes is offline
Registered User
FRC #4536 (MinuteBots)
Team Role: Mentor
 
Join Date: Feb 2011
Rookie Year: 2009
Location: St. Paul, Minnesota
Posts: 1,062
Caleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond reputeCaleb Sykes has a reputation beyond repute
Re: 2016 match data

Quote:
Originally Posted by Ether View Post

For the benefit of those who would like to analyze the scoring data but don't know how to access the API and/or parse the XML/JSON responses, I've posted Excel CSV files here, so you don't have to "scrape" web pages to get the data you need.


Thank you very much.
Reply With Quote
  #11   Spotlight this post!  
Unread 14-03-2016, 20:38
plnyyanks's Avatar
plnyyanks plnyyanks is offline
Data wins arguments.
AKA: Phil Lopreiato
FRC #1124 (The ÜberBots), FRC #2900 (The Mighty Penguins)
Team Role: College Student
 
Join Date: Apr 2010
Rookie Year: 2010
Location: NYC/Washington, DC
Posts: 1,114
plnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond reputeplnyyanks has a reputation beyond repute
Re: 2016 match data

Quote:
Originally Posted by Ether View Post

For the benefit of those who would like to analyze the scoring data but don't know how to access the API and/or parse the XML/JSON responses, I've posted Excel CSV files here, so you don't have to "scrape" web pages to get the data you need.
Nice results! I've always appreciated your love of data and am always a fan of more numbers

Quote:
Originally Posted by Ether View Post

I should have mentioned in the OP:

Hat tip to Phil Lopreiato and Alex Herreid for their patient help.
Not a problem - I'm always happy to help! Glad you were able to find a solution that worked for you!
__________________
Phil Lopreiato - "It's a hardware problem"
Team 1124 (2010 - 2013), Team 1418 (2014), Team 2900 (2016)
FRC Notebook The Blue Alliance for Android
Reply With Quote
  #12   Spotlight this post!  
Unread 18-03-2016, 13:46
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data


Just to let you all know:

I will be posting the complete Week3 raw data* in CSV format within 18 hours after the last playoff match has been completed.



*qual match schedule with surrogates; qual match final, foul, and auto scores; qual match scoring details; qual match team rankings with wins, losses, ties, and DQ; alliance selection with substitutions; playoff match schedule; playoff match scoring details; and awards
Reply With Quote
  #13   Spotlight this post!  
Unread 20-03-2016, 16:33
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data


I wrote a script to scan through all the Scoring Details data (component scores) and pick out the high value in each category for week1 and week2. See attached.

I've not manually vetted this yet but I thought I'd post it for review by anyone interested.
Attached Files
File Type: xls week1hi.xls (15.5 KB, 43 views)
File Type: xls week2hi.xls (15.0 KB, 87 views)
Reply With Quote
  #14   Spotlight this post!  
Unread 20-03-2016, 20:11
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data

Quote:
Originally Posted by Ether View Post

Just to let you all know:

I will be posting the complete Week3 raw data in CSV format within 18 hours after the last playoff match has been completed.
Week3 Raw Data CSV files have been compiled and posted here:

http://www.chiefdelphi.com/media/papers/3243



EDIT: attached is a compilation of hi component scores for week3.
Attached Thumbnails
Click image for larger version

Name:	week3hi.png
Views:	129
Size:	71.2 KB
ID:	20401  

Last edited by Ether : 20-03-2016 at 20:14.
Reply With Quote
  #15   Spotlight this post!  
Unread 23-03-2016, 00:40
Ether's Avatar
Ether Ether is offline
systems engineer (retired)
no team
 
Join Date: Nov 2009
Rookie Year: 1969
Location: US
Posts: 8,102
Ether has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond reputeEther has a reputation beyond repute
Re: 2016 match data



Just posted Week3 District Rankings CSV files here.


Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 22:48.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi