![]() |
Best way to estimate the best defense bot
Im sprucing up our scouting system for our next event and would really like do work defense into it.
As of now, we have 6 scouts (+ a head scout but he/she does different things), and they all watch every match. I have heard of DPR, and have a crude understanding that its basically the same calc as OPR but using the opponents score, but Ive heard this is inaccurate. I could give each scout a slider of 1 - 5 in "How well does robot play defense", but this is purely objective. How does your team do it? Is DPR actually useful? |
Re: Best way to estimate the best defense bot
We don't use DPR (or OPR, for that matter), but our experienced scouts do rank defensive teams. During our scouting meeting the night before eliminations, we then use those rankings and look back at our match footage (with every match recorded), to see how those teams perform and how consistent they are.
|
Re: Best way to estimate the best defense bot
We have considered implementing the following into our scouting database and haven't but might get around to it for Championships:
For reference, the main goal of our scouting is to record exactly how many points a robot scores in a match. The advantage this has over OPR is that robots can not be 'carried' to a higher position than they deserve, it is literally exactly how many points they individually scored that match. The concept for a true DPR is to create a marker in this system that notates if a robot plays defense and upon whom they played it. We would then compare the amount a robot 'should score' aka their score in matches without defense to the score in their match where defense was played. A number would then be assigned to the defending robot for how many points or percentage of points a defender shut down. |
Re: Best way to estimate the best defense bot
We look at several things:
* What sort of drive train does the bot have? * What sort of traction are on the wheels? * How fast is the robot? * How well does it turn? * Has the robot done well in pushing matches? * How smart is the drive team? (i.e. do they commit fouls?) They key is to scout the pits just as well as the games. Often the best defensive bots play no defense during qualifying matches. |
Re: Best way to estimate the best defense bot
The idea behind DPR makes sense, however when used in practice it's wildly inaccurate and I would recommend not using it. Our team's defensive ranking system so far has proven to be extremely successful so far. We have 4 purely subjective categories pertaining to a robots ability to play defense and their actual defensive performance, and 2 defense scouts (one per alliance) to rate each individual robot. At the end of qualifications we compile the data into a spreadsheet with predetermined weighting for each category and it spits out a couple of numbers that tell us exactly how good every robot is at doing the things we are interested in. The most important part of our system however is that you need experienced people who know what to look for in a robot to be able to adequately judge their performance otherwise your numbers are worthless.
Edit: the person above me basically covered most of the categories we use to judge robots. We use: -Drive train speed -Driver ability -Height (< 30") -Blocking performance Only the last category is actually affected by robots playing defense, the rest are affected by their apparent ability to play defense if we need it. |
Re: Best way to estimate the best defense bot
themccannman & MrJohnston, I'm the lead mentor and drive team coach for a defense-oriented team. If you have time, I'd be interested in your opinions on some match footage to tell me what you think about our team! I agree that OPR and DPR aren't helpful or accurate, and I've also used a more qualitative system for making defense strategy decisions.
Out of curiosity, why do you think the best defensive robots don't play defense during quals? |
Re: Best way to estimate the best defense bot
Quote:
Team 2013's robot uses a 6 CIM motor drive in a 6-wheel skid-steer configuration, rolling on custom aluminum rims wrapped with 2.5" wide roughtop conveyor belting. The machine weighs in at 117.3 lbs. By all standards, a very defense-capable machine. However, the real reason for having a strong drive this year is that if we can't get to and from the feeder station and pyramid, then it doesn't matter how good the shooter and climber are. During gameplay, the only times we have played defensively are if one or both of the other systems are down and we have no other way to contribute to the alliance, or if we deem defensive play necessary, such as if the other alliance has us out-gunned. Hence a very defense-capable team which very rarely uses it. |
Re: Best way to estimate the best defense bot
You can't objectively do it. Don't even try.
The best you can do is a Defense option on your scouting sheet. "None" / "Ineffective" / "Somewhat Effective" / "Strong" / "Complete Shutdown" should be your scale (1-5 is too vague), and that isn't so much to quantify it as much as it is so you can know on Friday night which teams tried to play defense and *roughly* how good they are at it. Pit scout a little and determine which robots are 4 CIMs (minimum) and have traction drives. Also, be sure to scout Saturday to see who shows up to play excellent D. All that said, more likely than not you'll find 1-3 excellent defenders at a regional, maybe a dozen (if you're lucky) average defenders, and then a bunch of teams limping around, trying to score or something and really just not doing much. You'll probably have to use other offensive features (10 point hang, any autonomous functionality) as your main decision maker. You are going to need smart people sitting there on Saturday morning watching matches and looking for diamonds in the rough. That's how you find them. |
Re: Best way to estimate the best defense bot
You guys are almost all overlooking one thing (I've seen one mention so far). And this one thing could lose you the event.
Penalties. Does the potential defense robot in question (whichever robot it happens to be) rack up their opponents' points from fouls or their alliances' points from fouls? If you have a potential defender that is constantly getting penalties, particularly "stupid" penalties, then they should probably not be very high on your list. Back when I was scouting, penalty points were given a weighting of -1 in our metrics to deduct "score" from that robot. Now, if the robot takes a smart penalty, then you also want to note that. It means that they know that a 20-point foul is better than letting their opponent potentially get 50 points, for example. |
Re: Best way to estimate the best defense bot
I agree with fox46's answer...
The strong drivetrain and grippy wheels mean that the robot can push most anybody around. Certainly, this is a huge benefit offensively, allowing such tasks as forcing itself to a feeder station or to an ideal place to maek a shot. However, used defensively, it can make it very difficutl for a full-court shooter to get to its feederstation or a little shuttlebot to blitz back-and-forth between the pyramid and feeder.... Or, a really tall blocker can be attached mid-compeititon to it to deal with a full-court shooter as it would be nearly impossible to move. Often teams with the where-with-all to build such a strong drivetrain, realize that many teams can't score. So, they need to have some scoring ability (a shooter, for instance). If the team is good enough to do this, their shooter will work well. So.. even though they are thinking "defense" they might must be the best offensive robot on the field in a qualification match. |
Re: Best way to estimate the best defense bot
Quote:
|
Re: Best way to estimate the best defense bot
Quote:
Quote:
Quote:
Good to know DPR is no good. Any other Ideas? |
Re: Best way to estimate the best defense bot
Case in point:
Quote:
|
Re: Best way to estimate the best defense bot
Quote:
Quote:
Quote:
|
Re: Best way to estimate the best defense bot
Quote:
Anything else? |
Re: Best way to estimate the best defense bot
It's probably not the best method, but I had our scouts watching for collisions between robots. Give a point for a collision won, take a point away for a collision lost. Find the ratio between the two.
While this has it's imperfections, it gave us a pretty good idea of which robots had the ability to play valuable enough defense and which would just get pushed out of the way. It's not easy to quantify defense and this year it's really just best to figure out who has a defensive strategy, then watch to see if they are actually any good at it. IMO, picking a robot to play defense in elims over one that can score is a bad strategy unless it is clearly a strong defender (strong enough where you don't need numbers to realize it can play defense). |
Re: Best way to estimate the best defense bot
We view defense from an offensive slow down of the opposing alliance. We log all defense events that happen (blocking movement, nudging while shooting, etc.) and correlate back to the offensive team. We then display those statistics as shooting percentage and shooting percentage while defended. We also look at the cycle time from pickup to shoot, to pickup and compare defended vs. undefended. Because we logged the event who was defending we can show who caused the offense to decrease. All ties back to our real-time scouting effort.
|
Re: Best way to estimate the best defense bot
Quote:
|
Re: Best way to estimate the best defense bot
We've found that generally speaking, scouting for a 'good' defensive team is a factor of a couple things.
Obviously, the first thing you require is a good drive train. Next in our experience is how well that team has worked with us. We get a chance to be with most teams in the qualification matches, and we know most other teams from previous experience. How receptive their drive-coach and drive team is, and how well they can carry out a plan, is immensely important to us. This year, modifying any robot to block is fairly easy while keeping a low cg. That plus a smart drive team and coach, plus a nice 10 point hang will get you on just about every defensive pick-list out there. |
Re: Best way to estimate the best defense bot
Quote:
|
Re: Best way to estimate the best defense bot
Our robot played defense these year at STL regional because our climber broke and we couldn't feed :( we never scored a single point in teleop and were ranked 28th, but even still we were the second pick in the whole regional!!! We thought that it might even be the first time a robot that has never scored a teleop point was picked so high. Anyways here's some videos of our robot defending with our 6wd pneumatic, 2 cim, toughbox drivetrain
1) http://www.thebluealliance.com/match/2013mosl_qm75 the full court shooter usally put up around 120pts, they were second seeded team. Also their shooter would shatter lexan at 80% power so we had to have something beffier to defend them with. and yes i did commit a foul by running across field after them :( heat of the moment thing and the only foul we got the whole regional 2) http://www.thebluealliance.com/match/2013mosl_qf3m2 we are robot that starts on left for red alliance 3) http://www.thebluealliance.com/match/2013mosl_qm81 we are robot that starts on left of blue alliance Rate me please? |
Re: Best way to estimate the best defense bot
I'm one of the scouting mentors for FRC 2789 and I've been recently brainstorming new ways to analyze our data to pull out the effects of defense so our team can illustrate what we do best. We currently have a system that's good at gathering quantitative data to rate offensive bots and qualitative data to help our drive team play effective defense. We don't have a system in place that can use quantitative data to rate defensive teams because we're looking for our counterparts this year and we primarily playing defense.
It's been a big headache to find methods that work because so many variables impact individual and alliance scoring and because defender bots can play different roles that impact these stats. Depending on the match dynamics, a defender may be expected to play zone defense, man-to-man defense, to set picks for other shooters, or various combos of the above. I'm so glad that there are teams going to Champs that have systems that are sophisticated enough to take this problem seriously so I can stop worrying about this and trust that you will find us. However, because it's fun to geek out, here's what I'd do if I really had to find out who were the best defenders on the field with a small scout team. [ Full disclosure: a lot of what I'm going to say is informed by changes our team has implemented that have improved our defensive play from good to great - so if you do these things, you may just find us ;) ] YOLO WAY TO FIND GREAT DEFENDERS:
|
Re: Best way to estimate the best defense bot
Quote:
And it's not just defense, but also counter-defense that we look for. That was key when we selected 295 in Madera. They protected our FCS 840 who emptied the magazine several times. 295 wasn't playing much defense in qualifications, but showed excellent driving skills. Send the video--it would be fun to look at! |
Re: Best way to estimate the best defense bot
Quote:
|
Re: Best way to estimate the best defense bot
Quote:
For next year, it might not be. There are some years where OPR works well, and other years where it's as bad as the W-L-T seeding system with too few matches (like 8!). |
Re: Best way to estimate the best defense bot
To keep track of defensive bots this year, we used both pit scouting and match scouting. We rated the drive train's speed, pushing power (torque), and manueverability on a 1 to 5 scale. Then we also kept track of the number of times the robot pushed another robot, blocked another robot, pushed a robot while it was shooting, and blocked shots to see what kind of defense it played.
While we didn't get to pick partners at any regionals this year, but it seemed to work fairly well. Except for two easily fixable major problems (the 1 to 5 scale's default was 1, making many average robots look bad and in pushing matches back and forth it was hard to decide the number of pushes to award the robot), the system could tell us how good a robot was at blocking full court shooters, or if it tried to push robots frequently, but was just too slow to catch them, etc. I wouldn't recommend using a system exactly like ours was this year, but hopefully an idea or two from it would be helpful to you. |
| All times are GMT -5. The time now is 16:13. |
Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi