Pulling a List of Teams into Excel

[Eugene Fang]

Originally Posted by stingray27

I believe it is just for the team lists. I didn't have a problem with my standing and match result queries either...

Anything with a my.usfirst URL is affected.

[Ed Law]

I have another spreadsheet that gets the team lists from usfirst website directly and it still works. How do we access through the my.usfirst for team list? I must not have used it that way.

[Eugene Fang]

Originally Posted by Ed Law

I have another spreadsheet that gets the team lists from usfirst website directly and it still works. How do we access through the my.usfirst for team list? I must not have used it that way.

Team list for CASJ here: http://frclinks.com/e/casj

You can't directly navigate to https://my.usfirst.org/myarea/index....014&event=casj due to the reason Pat mentioned above. FRCLinks has a redirect hack that makes it work.

What page do you use to get team lists that's not a my.usfirst page?

[Christopher149]

If you need only current data (and not anything historical):

https://my.usfirst.org/frc/scoring/i...page=eventlist contains and ID_event column, which you can use like https://my.usfirst.org/frc/scoring/i...ID_event=10837 (for Traverse City). Is this good enough?

[ttldomination]

Originally Posted by Eugene Fang

What page do you use to get team lists that's not a my.usfirst page?

Looks like Ed pulls his information from the event pages (www2.usfirst.org) and not from the event listing.

Originally Posted by Christopher149

https://my.usfirst.org/frc/scoring/i...page=eventlist contains and ID_event column, which you can use like https://my.usfirst.org/frc/scoring/i...ID_event=10837 (for Traverse City). Is this good enough?

This actually works pretty well. I'm wondering (a) where do we get event ids and (b) why this data pulling isn't using an HTTP referrer check.

Interesting,
- Sunny G.

[Ed Law]

Originally Posted by Christopher149

If you need only current data (and not anything historical):

https://my.usfirst.org/frc/scoring/i...page=eventlist contains and ID_event column, which you can use like https://my.usfirst.org/frc/scoring/i...ID_event=10837 (for Traverse City). Is this good enough?

This is interesting. It works well.

I was tired last night and got confused. I thought I was pulling team list data from another place. It turns out my other spreadsheet pulls in match schedule and determine the team list that way. It is only useful after match schedule is out and before matches begin.

[stingray27]

Originally Posted by Eugene Fang

Anything with a my.usfirst URL is affected.

Oh I was using the www2.usfirst URLs so I didn't realize it. Thanks for the info

[Pat Fairbank]

The referrer check is just on https://my.usfirst.org/myarea URLs. The https://my.usfirst.org/frc/scoring URLs are used by FMS to download team lists when setting up at an event. They're tab-separated tables, so they're easier to parse but uglier to look at which is why I implemented the hack in FRCLinks instead of redirecting to them.

You can get the event IDs by looking at the list of all events: https://my.usfirst.org/frc/scoring/index.lasso

I'm guessing there's no referrer check on them because then FMS would have had to add that header in its data download requests.

[Andrew Schreiber]

Originally Posted by Pat Fairbank

The referrer check is just on https://my.usfirst.org/myarea URLs. The https://my.usfirst.org/frc/scoring URLs are used by FMS to download team lists when setting up at an event. They're tab-separated tables, so they're easier to parse but uglier to look at which is why I implemented the hack in FRCLinks instead of redirecting to them.

You can get the event IDs by looking at the list of all events: https://my.usfirst.org/frc/scoring/index.lasso

I'm guessing there's no referrer check on them because then FMS would have had to add that header in its data download requests.

Didn't FRCLinks previously have a link to these more ugly events? I use them for a lot of my analysis as the data is easier to parse but I always have to search for the links.

[Pat Fairbank]

Originally Posted by Andrew Schreiber

Didn't FRCLinks previously have a link to these more ugly events? I use them for a lot of my analysis as the data is easier to parse but I always have to search for the links.

I had a link to them for a very brief period of time one year when divisions were posted there but not on the regular team listings, but not apart from that.

[Andrew Schreiber]

Originally Posted by Pat Fairbank

I had a link to them for a very brief period of time one year when divisions were posted there but not on the regular team listings, but not apart from that.

Any chance we could get a flag for it? (Sorry to add work)

[Eugene Fang]

Also, it turns out some my.usfirst pages not only check for the Referer header, but also a Cookie header.

See https://github.com/the-blue-alliance...cbafc41df67abc