Chief Delphi

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)
-   Technical Discussion (http://www.chiefdelphi.com/forums/forumdisplay.php?f=22)
-   -   Electronic scouting using 7 laptops and a little mysql (http://www.chiefdelphi.com/forums/showthread.php?t=131211)

Monitrech 22-11-2014 01:50

Electronic scouting using 7 laptops and a little mysql
 
Our team is currently exploring some ways of doing scouting electronically. I have an idea I would like to get your opinions/tips on.

Here is how it would work:

7 total laptops all wired to a switch or router (1 server laptop and 6 data entry laptops).

The server laptop runs xxamp and the data entry laptops would send data to server laptop(via php post method) to be stored in a mysql table that we could later export as a spreadsheet for analysis.

saikiranra 22-11-2014 05:14

Re: Electronic scouting using 7 laptops and a little mysql
 
Many teams have used this method in the past with sucess. Running a local server allows for some pretty cool ways for multiple people to view and interpret data. You might find that JS/PHP data interpretation is more useful than exporting to a spreadsheet.

Additionally, at events, it's sometimes hard to find a reliable source of electricity to power the electronics. You might want a few batteries and a power inverter.

Keep in mind that a computerized system adds a layer of complexity. Keep the input system simple, back up databases, and allow for error management (like ways to edit previous data) and you should be good to go!

yash101 22-11-2014 14:33

Re: Electronic scouting using 7 laptops and a little mysql
 
Couldn't you run the server on one of the laptops being used for scouting? You could get by with 6 laptops and a little MySQL, I'm sure!

Also, as of what I've seen is that computers can be extremely reliable. My latest applications are threaded to the point where they crash every once in a while when under load (sending 900 requests at a time). I've never had any database corruption or even binary corruption.
Of course, sending 900 requests at a time to the server will be very unlikely as it is neither internet connected (spammers) and you only have 7 users.

The magic of electronic scouting systems is when you put together a ton of HTML and CSS to make a spectacular interface and add some JS/AJAX to make the entire page work without page loads or latency!
Doing something like this will make it possible to sync realtime data between all of the computers!

EricH 22-11-2014 17:53

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1409557)
Couldn't you run the server on one of the laptops being used for scouting? You could get by with 6 laptops and a little MySQL, I'm sure!

Not if you want immediate output, which many teams do. You run the server on Laptop #7, and use that one if someone needs to get to the data during a match.

AdamStockton 22-11-2014 18:04

Re: Electronic scouting using 7 laptops and a little mysql
 
2 Attachment(s)
Quote:

Originally Posted by yash101 (Post 1409557)
Couldn't you run the server on one of the laptops being used for scouting? You could get by with 6 laptops and a little MySQL, I'm sure!

You could very well use on of the 6 laptops as the server machine. With only 6 users, it is extremely unlikely that you will need a dedicated server machine. Also, this should reduce the amount of power your setup will draw (especially important if you are using batteries).

My team has been using an Apache/MySQL/PHP setup for the past 3 years now. We have found it to be fairly reliable and much easier than our old paper system. Of course, our electronic system requires much more work on our part prior to our competition (programming, setup, thorough testing and training), but its well worth it for the added speed and functionality. If you are going to implement a computer based system, I can't stress enough how important it is to test your system and train your users. You want to be able to iron out any bugs in your code, and make sure everyone knows what they are doing well before you get to the competition.

As mentioned before, you might want to experiment with data manipulation with PHP. All of our team's reports have been customized to our teams needs, and are generated with PHP directly from MySQL database. This saves you from having to export data to excel and update it every time the database changes. I've attached examples of 2 of the many different reports we have created over the years.

yash101 22-11-2014 18:25

Re: Electronic scouting using 7 laptops and a little mysql
 
That is very true. However, for just a server, that's kind of wasteful.

EricH 22-11-2014 18:30

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1409580)
That is very true. However, for just a server, that's kind of wasteful.

Think about it this way: Your drive coach texts the scouting lead right as a match starts, saying he needs some data on one team or another, can he get it right away. Do you: wait until the match ends (delay in getting data) or kick a scout off of data entry so you can pull the data? Add in another computer to act as a server, and that one is available as a place to get data from that just can't wait. Plus it's a spare unit available for transitioning fresh scouts in or swapping out a broken one on short notice.

yash101 22-11-2014 18:34

Re: Electronic scouting using 7 laptops and a little mysql
 
Or maybe you could plug in another computer temporarily. It's web-based. I have written web-applications that can disconnect from the server when it is unavailable and reconnect immediately after it is back up!

saikiranra 22-11-2014 18:38

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by EricH (Post 1409581)
Think about it this way: Your drive coach texts the scouting lead right as a match starts, saying he needs some data on one team or another, can he get it right away. Do you: wait until the match ends (delay in getting data) or kick a scout off of data entry so you can pull the data? Add in another computer to act as a server, and that one is available as a place to get data from that just can't wait. Plus it's a spare unit available for transitioning fresh scouts in or swapping out a broken one on short notice.

That is especially important. More often than not, some other scouting management needs to be done, like reporting data or editing previous false data. A 7th computer is vital to keep electronic scouting seamless.

tickspe15 23-11-2014 12:29

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by saikiranra (Post 1409583)
That is especially important. More often than not, some other scouting management needs to be done, like reporting data or editing previous false data. A 7th computer is vital to keep electronic scouting seamless.

Our team used to run our scouting system on laptops. We would borrow 7 laptops from people on the team and give them back at the end of each day. Our problem with that setup, other than that laptops take a lot of power and our inverter went thru batteries very quickly, was that laptops are big and expensive. At each competition some scout would get tired or distracted and either drop the laptop or yank the cable out of the Ethernet port resulting in broken laptops. In 2014 we switched to nexus 7s, that we borrowed from the computer science teacher at school, on a USB network. Tablets are cheeper and less cumbersome and none of them broke.

As the drive coach I was given a tablet with updated data after every match.

Toa Circuit 23-11-2014 12:44

Re: Electronic scouting using 7 laptops and a little mysql
 
I'm currently working on a server system like that for our scouting. Run web.py on a machine's port 80 (It's simple. It's python. It works on pretty much any system out of the box. And for an application like this, who needs MySQL when you have Sqlite3? Just use python's builtin support for it. ;) ). A bunch of machines connect to it over a web interface, make POST/GET requests to only POST/GET the data they need, and voila: No data corruption since you've neatly wrapped everything. No multiple copies of things (hopefully). No messy excel sheets. It would be cross-platform (since you're just using HTML/CSS/JS), and you could even set the server up remotely and use 4G connection to access it if you prefer that to lugging your system around on laptops which need LAN (since WiFi isn't allowed at competition).

On the topic of networking, could you use a Bluetooth PAN to do this?

IceStorm 23-11-2014 13:37

Re: Electronic scouting using 7 laptops and a little mysql
 
Use a raspberry pi as your server. Linux based. Easy to setup MySQL, php, and apache on. Very low power.

yash101 23-11-2014 13:52

Re: Electronic scouting using 7 laptops and a little mysql
 
I am looking towards a PPTP bridge over serial :D. You only have one ethernet port, but maybe 3-6 USB ports! Bluetooth would be a great technology to use, however, I haven't found a way to create a PAN network from a computer so that tablets can connect. However, a touch screen might be a powerful weapon against the ghost of scouting! ;)

A RasPi is a perfect choice. If you write your server in a fast language such as C++, there's no need for anything more powerful!

saikiranra 23-11-2014 14:11

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by tickspe15 (Post 1409652)
In 2014 we switched to nexus 7s, that we borrowed from the computer science teacher at school, on a USB network. Tablets are cheeper and less cumbersome and none of them broke.

As the drive coach I was given a tablet with updated data after every match.

This is the ideal set up. Tablets take scouting to the next level because it simplifies UI(It's easier to tap than click in a fast paced match). The only problem is that 7 computers are more accessible than 7 tablets to most teams.

Another way to get data down to the drive coach is by having some sort of data syncing system using mobile Internet. You can either run the scouting server off a website and keep a constant connection (Ideal, so drive coach has up to date information on phone at all times) or have an export SQL script that syncs every few matches to an external source.

AdamStockton 23-11-2014 14:33

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by saikiranra (Post 1409663)
This is the ideal set up. Tablets take scouting to the next level because it simplifies UI(It's easier to tap than click in a fast paced match). The only problem is that 7 computers are more accessible than 7 tablets to most teams.

Agreed. Having a touch screen really allows you to get creative with the user interface. For example, our 2012 screen had 3 baskets corresponding to a high, medium, and low basket on the field. Scouts simply tapped the corresponding basket when the robot they were scouting made a basket. There was also a counter next to each basket with a decrement button to allow a scout to correct any mistakes. This was very easy for the scouts to learn, and resulted in better scouting data.

For our first year with an electronic scouting method, we actually borrowed 20 tablets from our schools library for competition. Over that previous summer, the district purchased hundreds of tablets for use in classrooms. Since the tablets weren't very popular with the teachers at the time, we were able to borrow quite a few of them that were pretty much unused. It might be worth checking with your school district to see if they have any tablets that you can borrow.

themccannman 23-11-2014 14:35

Re: Electronic scouting using 7 laptops and a little mysql
 
Here's out latest white paper on the electronic scouting system we have. http://www.chiefdelphi.com/media/papers/3037

We use tablets instead of laptops because they are considerably cheaper, smaller, and lighter. Be sure to get a high quality switch and cables if you're going to have everything wired together, we used a hardwired system in our first iteration two years ago and had constant problems with disconnecting. Using the tablet's bluetooth has been much easier and much more reliable and now people don't trip over our spider web while trying to get to the bathroom. Also, unless you tether with someone's cell phone having an offline server doesn't allow for any real time data analysis. We purchased a cheap data plan for two of our tablets which upload the data from the 6 other tablets to a virtual server. Then we can do live calculations on that server which makes the data available to be pulled down by a smart phone app made for our drive coach so that he can check team stats in real time before matches.

Most of this stuff came after a year of working on our system though so don't bite off more than you can chew, get a simple system that works well going first then start adding features.

notmattlythgoe 24-11-2014 10:38

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Another way to get data down to the drive coach is by having some sort of data syncing system using mobile Internet.
You might want to be careful with this, this technically could be against the rules.

Quote:

4.15 SITE RESTRICTIONS
Please read the following common site restrictions and adhere to them in order to promote an orderly, safe, pleasant and exciting competition. Please refer to Administrative Manual - Section 4.2 FIRST Safety for additional site restrictions at your event.

Do not bring food to the site. If you bring food, do not bring it onto the property.
Do not use noisy devices, such as floor stompers, whistles and/or air horns.
Do not arrange for Internet access or phone lines on the site or attempt to connect to the Internet.
Do not sell any products. This includes food, hats, shirts or any promotional products.
Do not distribute any food products, such as candy, water, soft drinks or fruit.
Do not sell raffle tickets.
Do not bring bottled gas tanks (e.g. helium). This is a safety concern.
Do not use walkie-talkies.
Do not invite or bring live bands to play in the audience. This dilutes the presentation on the playing field and is too loud and confusing for the audience.
Do not play loud music in the Pit because it interferes with important announcements. If a team receives more than a warning or two, the power to the team Pit will be shut off and/or the music confiscated.
Do not form "tunnels" during the Awards Ceremony. This can cause discomfort to those traveling through them and creates safety issues.

sanddrag 24-11-2014 11:03

Re: Electronic scouting using 7 laptops and a little mysql
 
So what are you going to start collecting cell phones at the door?

notmattlythgoe 24-11-2014 11:06

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by sanddrag (Post 1409786)
So what are you going to start collecting cell phones at the door?

No, but I can see where people might have an issue with teams using online databases to access data wherever they need it. Our team has not moved to online scouting storage for this reason.

However, I also see where the rule is a bit general and might not be intended to limit this type of scouting system.

AdamStockton 24-11-2014 16:34

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by notmattlythgoe (Post 1409789)
No, but I can see where people might have an issue with teams using online databases to access data wherever they need it.

Why would having an online database for scouting cause an issue? The blue alliance, FRC Spyder, and the FIRST FMS event pages are essentially online databases.

Quote:

Originally Posted by notmattlythgoe (Post 1409789)
However, I also see where the rule is a bit general and might not be intended to limit this type of scouting system.

I'm not entirely sure, but I believe that this rule came about after teams actually leased phone lines for internet access at a competition many years ago. This rule has been in the manual since at least 2009 (when I started FRC), and probably didn't account for internet enabled smartphones.

jvriezen 24-11-2014 17:16

Re: Electronic scouting using 7 laptops and a little mysql
 
All our students are issued iPads (wifi, no cellular, not sure about bluetooth-- I would think so). Are there any existing scouting applications out there that would take advantage of this?

EricH 24-11-2014 17:38

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by AdamStockton (Post 1409853)
The blue alliance, FRC Spyder, and the FIRST FMS event pages are essentially online databases.

FMS has a dedicated line that FIRST (at some level) pays for. TBA scrapes FMS data from the FIRST site. Spyder, same thing. The FMS line is actually pretty critical for the field to have.


That being said, I would say this: If you need to use the Internet, and you work with existing venue infrastructure (say, the venue wireless, or using a cell phone's data plan), I don't think anybody will give you too hard of a time about it. However, if you happen to be broadcasting a WiFi hotspot, you can expect a visit from the FTA, FTAA, a CSA, or the LRI. They'll be there to tell you to shut if off.

silverD 24-11-2014 17:52

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by jvriezen (Post 1409863)
All our students are issued iPads (wifi, no cellular, not sure about bluetooth-- I would think so). Are there any existing scouting applications out there that would take advantage of this?

John,
525 Swartdogs have an apple scouting app: Aerial Scout

KnightKrawler built and maintains their own android scouting app: FRCKrawler

Nate

yash101 26-11-2014 19:23

Re: Electronic scouting using 7 laptops and a little mysql
 
It is quite difficult to use tablets, specifically Apple tablets in the field as you are not allowed to use WiFi and Bluetooth. Some Android tablets, however, have the ability to connect an ethernet cable. I believe that e-scouting is quite reserved to laptops, which have some unbeatable features:
  • Ethernet Ports
  • USB Ports (for PPTP over serial if necessary)
  • Full desktop OS makes it easier to develop and deploy servers

cjl2625 26-11-2014 19:46

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1410241)
It is quite difficult to use tablets, specifically Apple tablets in the field as you are not allowed to use WiFi and Bluetooth

Not allowed to use bluetooth? I thought there was nothing in the rules prohibiting bluetooth use.

yash101 26-11-2014 22:20

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by cjl2625 (Post 1410245)
Not allowed to use bluetooth? I thought there was nothing in the rules prohibiting bluetooth use.

It's not safe to use Bluetooth. It runs at 2.4GHz so the staff can prohibit Bluetooth if they think it is necessary!

Gregor 26-11-2014 22:26

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1410264)
It's not safe to use Bluetooth. It runs at 2.4GHz so the staff can prohibit Bluetooth if they think it is necessary!

Source?

Chris_Ely 26-11-2014 22:33

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101
field as you are not allowed to use WiFi and Bluetooth

Quote:

Originally Posted by yash101 (Post 1410264)
It's not safe to use Bluetooth. It runs at 2.4GHz so the staff can prohibit Bluetooth if they think it is necessary!

Emphasis mine.

False.
See
Quote:

Originally Posted by 2014 FRC Game Manual
5.5.1.4 T4
Teams may not set up their own 802.11a/b/g/n/ac (2.4GHz or 5GHz) wireless communication (e.g. access points or
ad-hoc networks) in the venue.

Bluetooth is 802.15.1

Obligatory disclaimer: 2015 rules may differ.

yash101 26-11-2014 22:37

Re: Electronic scouting using 7 laptops and a little mysql
 
http://en.wikipedia.org/wiki/Bluetooth.
Bluetooth runs at the same spectrum as WiFi, the communications used by the FMS. You can guess that there will be some sort of interference that will occur.

http://en.wikipedia.org/wiki/Electro...nce_at_2.4_GHz

cgmv123 26-11-2014 22:44

Re: Electronic scouting using 7 laptops and a little mysql
 
Relevant Q&A from last year:

Quote:

Q. I would like to make a scouting app for my team that would sync data across tablets, but there is a rule against 802.11a/b/g/n/ac networks. I was planning on using bluetooth, which is 802.15, but would that be considered a violation of the rule?

A. There are no rules explicitly prohibiting this. If the Bluetooth network traffic is found to be interfering with game play, the team will be asked to disable the system. However, please remember that rules for 2014 do not apply to future seasons.

EricH 26-11-2014 22:52

Re: Electronic scouting using 7 laptops and a little mysql
 
On top of the response you just got, I point you to the following threads from within the last year.

http://www.chiefdelphi.com/forums/sh...d.php?t=129261
http://www.chiefdelphi.com/forums/sh...d.php?t=127877 (briefly)
http://www.chiefdelphi.com/forums/sh...d.php?t=126509 (I thought the same, though was less set in opinion)
http://www.chiefdelphi.com/forums/sh...d.php?t=124721 (and this one is calling you, Yash, because not only does it cover tablets, but you made post #7. :cool: )

AdamStockton 26-11-2014 22:56

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1410268)
http://en.wikipedia.org/wiki/Bluetooth.
Bluetooth runs at the same spectrum as WiFi, the communications used by the FMS. You can guess that there will be some sort of interference that will occur.

http://en.wikipedia.org/wiki/Electro...nce_at_2.4_GHz

Bluetooth may run off the same frequency as WiFi, however it uses the IEEE 802.15 specification (instead of WiFi's IEEE 802.11 specification). This difference makes bluetooth legal under the current rule, since only 802.11 is explicitly mentioned in the rule.

Of course there are technicalities and ethical reasons against using bluetooth, but none are explicitly stated in the rule itself.

*Note* 2014 and prior rules have no bearing on the 2015 rules and are subject to change by FIRST

daniel12997 28-11-2014 23:09

If you are worried about power consumption then take a look at a raspberry pi

Alan Anderson 30-11-2014 09:55

Re: Electronic scouting using 7 laptops and a little mysql
 
Quote:

Originally Posted by yash101 (Post 1410268)
Bluetooth runs at the same spectrum as WiFi, the communications used by the FMS. You can guess that there will be some sort of interference that will occur.

You can guess, but unless you have special knowledge you aren't likely to guess correctly. The critical FMS wireless communication takes place on the 5 GHz WiFi band, and won't even notice 2.4 GHz signals unless they are unreasonably powerful. Bluetooth is a low-power, short-range system that typically doesn't disrupt WiFi on 2.4 GHz anyway.

jdcardwell 27-01-2015 19:59

Re: Electronic scouting using 7 laptops and a little mysql
 
FRC Team 1741 (Greenwoood, IN) does Scouting using a Raspberry Pi running as a LAMP server;
Linux (Raspbian), Apache, MySQL, and PHP(/Javascript/html).

It has worked out pretty well for us in the 2014 season.

Due to the FIRST rules-restriction of not being able to setup a Wifi hotspot
in the stands, we use an 8-port network switch to connect 7 mini-laptops
to the scouting subnet.

We are in the process of redoing the architecture the underlying MySQL relational database for the
2015 Recycle Rush Challenge.

We have a 'Team Rankings Parameters' MySQL table, which the scouters can
edit (add/edit) a set of 'named' weighting coefficients for computing Team Rankings based on the selected
coefficients 'vector' - and rankings can be computed at any time during scouting. For 2015, the database
has changed to allow any scouter to compute rankings independent of other scouters.

I would be glad to ZIP up and send (or put onto an internet/ftp server) last year's complete code on request.

Jon Cardwell
Red Alert Robotics 1741 Mentor


All times are GMT -5. The time now is 19:55.

Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi