Go to Post If people really want to see "better" refereeing, they should see what they can do to help FIRST make better. - petek [more]
Home
Go Back   Chief Delphi > FIRST > General Forum
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
View Poll Results: Should FIRST allow referees to use Video Replay to review matches?
Yes 174 50.43%
No 147 42.61%
No Opinion 24 6.96%
Voters: 345. You may not vote on this poll

Reply
Thread Tools Rate Thread Display Modes
  #31   Spotlight this post!  
Unread 18-03-2016, 14:35
gblake's Avatar
gblake gblake is offline
6th Gear Developer; Mentor
AKA: Blake Ross
no team (6th Gear)
Team Role: Mentor
 
Join Date: May 2006
Rookie Year: 2006
Location: Virginia
Posts: 1,935
gblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond reputegblake has a reputation beyond repute
Re: Poll-Video Replay

Ryan - Whether or not they are creating the right mental model(s), here is why I think most folks bring the big sports comparisons into the discussion.

They are following a thought process that takes them down this path:
  1. Some people want to be able to answer questions about match events after-the-fact
  2. The types of questions they want answered are similar to the questions big sports leagues try to answer (contact between players/objects, player/object location, when an event occurred, etc)
  3. The player/object speeds, traffic jams, and chances for obstructed views are similar to big sports league scenarios
  4. The action is less "interruptable" than most big league sports (this places burdens on the playback system's ease-of-use).
  5. Because of the similarities between FRC and big league sports, getting the answers people want (see item #1) will probably require using a recording and playback set-up similar (in some respects) to the ones big league sports use.
    • Without an explanation of why they should think otherwise, I think that for most readers, a "drastically simplified" replay system sounds like something that would answer a drastically small subset of the questions people/teams want answered.
To get them thinking differently you need to interrupt that 5 step process, and insert something different that puts trains of thought onto a different set of tracks. You might insert statements like these:
  • The system won't answer all questions. It will answer ___, ___, and ___.
  • The system will have blind spots (X% of the total field, Y% of the high traffic areas of the field). Teams will know those spots in advance, and teams will know mistakes occurring in those spots can't be corrected using video replays.
  • Depending on line-of-sight angles and distances, the system will determine locations with accuracies between +/-X and +/-Y. Teams will know this in advance and may plan gameplay and review-requests accordingly.
  • A time-and-motion style analysis of the activities that will be involved in processing a review request predicts that processing each will add N seconds to the time between matches, so ...

Bottom line: In the absence of specific descriptions of why/how FRC questions are different from big sports questions, or need to be answered using different methods than the big sports methods, or are going to be limited to a subset of all the possible FRC questions, or are going to be answered well-enough (give metrics) using low-fidelity (give numbers) systems, or ... I think the "big sports" yardstick is going to be the one most people instinctively choose to use.

Blake
__________________
Blake Ross, For emailing me, in the verizon.net domain, I am blake
VRC Team Mentor, FTC volunteer, 5th Gear Developer, Husband, Father, Triangle Fraternity Alumnus (ky 76), U Ky BSEE, Tau Beta Pi, Eta Kappa Nu, Kentucky Colonel
Words/phrases I avoid: basis, mitigate, leveraging, transitioning, impact (instead of affect/effect), facilitate, programmatic, problematic, issue (instead of problem), latency (instead of delay), dependency (instead of prerequisite), connectivity, usage & utilize (instead of use), downed, functionality, functional, power on, descore, alumni (instead of alumnus/alumna), the enterprise, methodology, nomenclature, form factor (instead of size or shape), competency, modality, provided(with), provision(ing), irregardless/irrespective, signage, colorized, pulsating, ideate

Last edited by gblake : 18-03-2016 at 16:19.
Reply With Quote
  #32   Spotlight this post!  
Unread 18-03-2016, 16:33
ceb515's Avatar
ceb515 ceb515 is offline
Registered User
AKA: Charlie
FRC #2607 (Robovikings)
 
Join Date: Jan 2015
Rookie Year: 2012
Location: Pennsylvania, United States
Posts: 17
ceb515 is an unknown quantity at this point
Re: Poll-Video Replay

There should be another option, "During Quarter-, Semi-, and Finals Matches"
__________________

2015 - MAR Championship 3rd Place, Qualified for CMP
Blue Banners: 2010 Philadelphia Reigonal, 2014 Virginia Reigonal, 2015 Hatboro-Horsham, 2015 Upper Darby
SEE US AT THESE COMPETITONS:
Hatboro-Horsham District Event 2016, Westtown District Event 2016, MAR Reigonal 2016

Electrical Lead, Programmer, Designer, Pneumatics, Prototyping, All-Out-Geek




Reply With Quote
  #33   Spotlight this post!  
Unread 19-03-2016, 18:06
Wayne Doenges's Avatar
Wayne Doenges Wayne Doenges is offline
We Build Robots......and Careers
AKA: Warthog
FRC #1501 (Team T.H.R.U.S.T.)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 2000
Location: Huntington, Indiana
Posts: 6,323
Wayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond reputeWayne Doenges has a reputation beyond repute
Re: Poll-Video Replay

I'm missing something here. You mention wasting time. Do you think that EVERY team will ask for a video review of EACH match? I don't think that would happen.
If a team comes up and ask for a video review because they think there was a mistake made, the Head Ref should deny the request. If a team says that a crossing was missed and can give you an approximate time the crossing was made, than the Head Ref should consider the request.
We had one of the defenses come loose during a match (I won't say which match) and I feel it cost us the match. I could see it move every time a robot crossed it. That would also be a good time for a review.
But, just like in the NFL, you could maybe have a consequence for falsely asking for a review. I think this would limit to the ones that really occurred.
Just my $.05.
*puts on flame proof under garments
__________________
We Build Robots and Careers
World's - #1 seeded in Archimedes, WON Archimedes and made it to Einstein
2016 NC District - Guilford County. #13 seeded, Finalist. Won Quality award.
IN District - Tippecanoe. #4 seeded. Won Innovation in Control award.
IN District - Perry Meridian. #3 seeded. Finalist. Won Excellence in Engineering award.
IN District - State Championship. #1 seeded. Finalist. Won Excellence inn Engineering award.



Reply With Quote
  #34   Spotlight this post!  
Unread 19-03-2016, 19:08
christheman200's Avatar
christheman200 christheman200 is offline
Chris Lansdale, Programmer
AKA: Chris Lansdale
FRC #0854 (Iron Bears)
Team Role: Programmer
 
Join Date: Mar 2015
Rookie Year: 2014
Location: Toronto, Ontario
Posts: 31
christheman200 is an unknown quantity at this point
Re: Poll-Video Replay

After losing on a foul point tie breaker in quarters in GTRC, a video review would have been nice. Is it practical? I don't think so. The delays between matches were already long enough. However, if implemented it should be consistent from event to event, in other words fool proof. I like the idea of testing this at offseason events for a few years, and seeing where it goes.
Reply With Quote
  #35   Spotlight this post!  
Unread 19-03-2016, 19:20
EricH's Avatar
EricH EricH is offline
New year, new team
FRC #1197 (Torbots)
Team Role: Engineer
 
Join Date: Jan 2005
Rookie Year: 2003
Location: SoCal
Posts: 19,774
EricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond reputeEricH has a reputation beyond repute
Re: Poll-Video Replay

Quote:
Originally Posted by christheman200 View Post
However, if implemented it should be consistent from event to event, in other words fool proof.
I think something got lost in translation.

For one thing, "fool proof" doesn't exist. There's "fool resistant", but nothing is EVER fool proof. Anybody who thinks something is fool proof severely underestimates the ingenuity of the common fool (and the uncommon fool on top of that).

And for another, "fool proof" means that it's hard to mess up. Consistent from event to event means that it's the same in multiple places (within a certain degree of tolerance). Now, something that's consistent is likely to be MORE difficult to mess up the setup on, but they aren't the same thing. Example: If you want to be consistent, you use the same type of connector on all your wiring. If you want to be foolproof, you make sure that any given connector side can only go into it's matching one, and not into any others!


I think that for the initial rounds of testing (AKA, offseason events), variation--intentional variation--is good. This is called "exploring the alternatives". For example, will any old video work? That's one possible way to cut the costs down. Or camera variety A vs. camera variety B. Various locations can be checked (food for thought, if you've got a driver-cam, you probably can't tell if you actually got a Crossing on it unless it's a pole-mounted one).

After those initial rounds, everybody compares notes (publishes) and then the "standardization" work can begin. Run a couple rounds of checks on what's been shown to work decently, compare notes, repeat until you have a process.
__________________
Past teams:
2003-2007: FRC0330 BeachBots
2008: FRC1135 Shmoebotics
2012: FRC4046 Schroedinger's Dragons

"Rockets are tricky..."--Elon Musk

Reply With Quote
  #36   Spotlight this post!  
Unread 19-03-2016, 23:41
Tom Line's Avatar
Tom Line Tom Line is offline
Raptors can't turn doorknobs.
FRC #1718 (The Fighting Pi)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 1999
Location: Armada, Michigan
Posts: 2,514
Tom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond repute
Re: Poll-Video Replay

Quote:
Originally Posted by Ryan Dognaux View Post
Here's what we use for our setup in case anyone needs to see a diagram of how this works. It's painfully easy to setup, spent maybe an hour setting it up by myself for St. Louis. We didn't even have a volunteer to run it, I would just occasionally check up on it. Having 1 dedicated volunteer or a couple to swap out means you can do fancier stuff, but it's really not required to sit at the laptop constantly all day. A field reset person could hang out there while taking a break just to make sure it still looks good.

We have banned the term "it's easy" from our team. It SHOULD be relatively easy to configure your laptop and radio to connect to the field... and yet that doesn't seem to be the case for many teams each year - even teams that already connected at a prior event. Put this in the hands of a hundred individuals at a hundred different regionals and watch total chaos commence.

Let me put this a different way. You would think mounting a go-pro on a pole and recording matches at an event would be fairly easy. Yet many regionals don't do it. Now take a step beyond that - it takes technical skills to turn that simple recording into a replay. Skills that 95% of folks that are volunteering at FIRST events don't have.

The funny thing here is that I'm arguing against something that I would actually like to have. We've had matches go for us, and against us, when they shouldn't have. I can show you a couple years ago where we should have moved on into the semifinals on our championship field but didn't because of a scoring error.
Reply With Quote
  #37   Spotlight this post!  
Unread 20-03-2016, 13:20
Ryan Dognaux's Avatar
Ryan Dognaux Ryan Dognaux is offline
Back Home in Indiana
FRC #4329 (Lutheran Roboteers)
Team Role: Coach
 
Join Date: Apr 2002
Rookie Year: 2001
Location: Indianapolis, IN
Posts: 2,673
Ryan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond reputeRyan Dognaux has a reputation beyond repute
Send a message via AIM to Ryan Dognaux
Re: Poll-Video Replay

Quote:
Originally Posted by Tom Line View Post
Let me put this a different way. You would think mounting a go-pro on a pole and recording matches at an event would be fairly easy. Yet many regionals don't do it. Now take a step beyond that - it takes technical skills to turn that simple recording into a replay. Skills that 95% of folks that are volunteering at FIRST events don't have.
That's because a lot of regionals don't already own the equipment and view it as lower priority in the grand scheme of things. If the equipment traveled with the field and was part of the venue setup, I think you'd quickly see high quality video recording at every event (and in turn high quality webcasts assuming they have internet access.)

If we can set up a full size FRC field and get all of that working with FMS, surely each event can handle setting up an additional laptop, a camera on a pole and running a few connections cables. A bit more work? Sure. But c'mon, not really. A 2-3 page setup tip sheet is all that would be needed.

Also - it really doesn't take any additional skill to 'turn that simple recording into a replay' - you just stop live recording and go open up the video file that was saved.

Question to the volunteer - 'Can you open a file on a PC?' Congratulations you have the job!
__________________
Ryan Dognaux :: Last Name Pronounced 'Doane Yo'
Team 234 Alum: 2002 - 2005 :: Purdue FIRST Member: 2006 - 2009
Team 1646 Mentor: 2007 - 2009 :: Team 357 Mentor: 2009 - 2012
Team 4329 Mentor: Current
STL Off-Season Event: www.gatewayroboticschallenge.com
Reply With Quote
Reply


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 03:40.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi