This made me think of the
Mario AI Competition that had been held for the last couple of years. It's in Java instead of LabVIEW, obviously Mario's a bit more of a challenge than Bejeweled, and the deadline had passed, but maybe we could hold a CD-version of something like that.
Back in the day, I used to make calls to the Windows API in LabVIEW using the Library Call node, which would make it pretty easy to move the mouse around and click (assuming you're using Windows). There's also ways to capture screenshots, but then you'd have to do the requisite machine vision on the captured image (but it should be pretty easy with a couple of Threshold Color -> Particle Filter -> Extract Particles). Search for 'windows api labview' on Google and it should turn up some resources, but it would probably be helpful to have some knowledge of C/C++ (or ask a mentor
).
Sounds like a fun project.
--Ryan
__________________
FRC 2046, 2007-2008, Student member
FRC 1708, 2009-2012, College mentor; 2013-2014, Mentor
FRC 766, 2015-, Mentor