Go to Post Mentor-built (adj.): A term describing a robot that is better than your own, and / or a robot with paint on it. - Chris is me [more]
Home
Go Back   Chief Delphi > Technical > Pneumatics
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 14-02-2010, 10:11
nick1023 nick1023 is offline
Registered User
FRC #1023
 
Join Date: Dec 2008
Location: Toledo, Ohio
Posts: 19
nick1023 will become famous soon enough
NI Pneumatics Module "sputtering"

We've been experiencing an intermittent problem with our NI pneumatics module and or our cRio. Our module will randomly start "sputtering"; turning the engerized solenoids off and on quickly (250ms or so).

We first suspected a short somewhere in the system so we started unplugging things until we were left with only the cRio loaded with only the pneumatics module tethered to the driver station via a network cable.

I'm comfortable with Labview and the use of the solenoid vis. To be sure I was not doing something weird in programming I used the example program for testing. Using Labview and the solenoid example I can light up one light on the solenoid module when I set the front panel control to true. Since no changes have been made to the example (except the cRio IP) I'm confident the problem is not programming logic.

When the program runs, the solenoid light on the module that I have energized will light up and "flicker" intermittantly. Sometimes it goes minutes with no flicker. Sometimes it will "flicker" repeatedly over a short period. This "flicker" is whats causing our sputtering on the solenoids when we have them hooked up.

I've re-imaged the cRio. From the steps I've taken I believe the solenoid module to be flakey.

I'll be starting a support call with NI on monday morning. In the mean time...

Anyone seen similar behavior with their module or have further troubleshooting ideas?
__________________
1023 Bedford Express
  #2   Spotlight this post!  
Unread 14-02-2010, 10:26
MrForbes's Avatar
MrForbes MrForbes is online now
Registered User
AKA: Jim
FRC #1726 (N.E.R.D.S.)
Team Role: Mentor
 
Join Date: Feb 2006
Rookie Year: 2006
Location: Sierra Vista AZ
Posts: 6,033
MrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond reputeMrForbes has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

In the meantime...replace the power wires to the solenoid module. Just for something to do.
  #3   Spotlight this post!  
Unread 14-02-2010, 10:33
Unsung FIRST Hero
Al Skierkiewicz Al Skierkiewicz is offline
Broadcast Eng/Chief Robot Inspector
AKA: Big Al WFFA 2005
FRC #0111 (WildStang)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 1996
Location: Wheeling, IL
Posts: 10,798
Al Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Nick,
Are you using 24 volt solenoids? Are they powered from the 24 volt output of the Power Distribution Board? Have you followed the Power Distribution diagram Rev A and checked out Team Update #2?
__________________
Good Luck All. Learn something new, everyday!
Al
WB9UVJ
www.wildstang.org
________________________
Storming the Tower since 1996.
  #4   Spotlight this post!  
Unread 14-02-2010, 11:10
nick1023 nick1023 is offline
Registered User
FRC #1023
 
Join Date: Dec 2008
Location: Toledo, Ohio
Posts: 19
nick1023 will become famous soon enough
Re: NI Pneumatics Module "sputtering"

Thanks for the quick replies guys!

We are using all 12v solenoids on the bot and power to the solenoid bumper is wired according to the 12v solenoid diagram.

I did suspect the power to the solenoid breakout module bumper. We swapped the wiring and the wago connector to the breakout module bumper.

To be clear, the sputtering still happens when I have only the cRio with only the pneumatics module hooked up running the Labview solenoid example. Nothing else is hooked up to the cRio including the pneumatics bumper. The module lights that indicate what solenoids should be energized still flutter.
__________________
1023 Bedford Express
  #5   Spotlight this post!  
Unread 14-02-2010, 11:51
Unsung FIRST Hero
Al Skierkiewicz Al Skierkiewicz is offline
Broadcast Eng/Chief Robot Inspector
AKA: Big Al WFFA 2005
FRC #0111 (WildStang)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 1996
Location: Wheeling, IL
Posts: 10,798
Al Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond reputeAl Skierkiewicz has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

This may be a programming issue. You may also have an unusual electrical issue. Have you tried replacing the breaker that feeds the solenoids? These sometimes have a manufacturing defect that causes them to be intermittent. Also double check the wires in the Wago on the PD. They should be stripped 1/2=5/8" in order to fully insert in the connector.
__________________
Good Luck All. Learn something new, everyday!
Al
WB9UVJ
www.wildstang.org
________________________
Storming the Tower since 1996.
  #6   Spotlight this post!  
Unread 14-02-2010, 11:57
Joe Ross's Avatar Unsung FIRST Hero
Joe Ross Joe Ross is offline
Registered User
FRC #0330 (Beachbots)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 1997
Location: Los Angeles, CA
Posts: 8,600
Joe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Does this also happen on other outputs? If so, this could also be a system watchdog issue. Install the new DS update released 2 days ago and see if it fixes the issue.
  #7   Spotlight this post!  
Unread 14-02-2010, 13:01
nick1023 nick1023 is offline
Registered User
FRC #1023
 
Join Date: Dec 2008
Location: Toledo, Ohio
Posts: 19
nick1023 will become famous soon enough
Re: NI Pneumatics Module "sputtering"

Team member last night during troubleshooting "whats this watchdog error.."

Me - known issue, ignore it.

Watchdog error happens, my sputtering happens.

No watchdog error, no problem.

Installing the update now. Will post if it comes back again.

Thanks to all!
__________________
1023 Bedford Express
  #8   Spotlight this post!  
Unread 14-02-2010, 13:03
waialua359's Avatar
waialua359 waialua359 is offline
Mentor
AKA: Glenn
FRC #0359 (Hawaiian Kids)
Team Role: Mentor
 
Join Date: Apr 2003
Rookie Year: 2000
Location: Waialua, HI
Posts: 3,316
waialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

We had the EXACT same issues for a couple of weeks which was a watchdog issue.
I kept suspecting it was a hardware thing because the symptoms seemed like poor connections somewhere. We rechecked everything 10 times over and the problem would occur sometimes more often than others.

I'll let our programmer tell you what he did exactly, but basically it was a programming fix, cleaning up a few things.
__________________

2016 Hawaii Regional #1 seed, IDesign, Safety Award
2016 NY Tech Valley Regional Champions, #1 seed, Innovation in Controls Award
2016 Lake Superior Regional Champions, #1 seed, Quality Award, Dean's List
2015 FRC Worlds-Carver Division Champions
2015 Hawaii Regional Champions, #1 seed.
2015 Australia Regional Champions, #2 seed, Engineering Excellence Award
2015 Inland Empire Regional Champions, #1 seed, Industrial Design Award
2014 OZARK Mountain Brawl Champions, #1 seed.
2014 Hawaii Regional Champions, #1 seed, UL Safety Award
2014 Dallas Regional Champions, #1 seed, Engineering Excellence Award
2014 Northern Lights Regional Champions, #1 seed, Entrepreneurship Award
2013 Championship Dean's List Winner
2013 Utah Regional Champion, #1 seed, KP&B Award, Deans List
2013 Boilermaker Regional Champion, #1 seed, Motorola Quality Award
2012 Lone Star Regional Champion, #1 seed, Motorola Quality Award
2012 Hawaii Regional Champions #1 seed, Motorola Quality Award
  #9   Spotlight this post!  
Unread 14-02-2010, 17:12
Merle Merle is offline
FRC Mentor, FLL Coach
FRC #3146 (GRUNTS)
Team Role: Engineer
 
Join Date: Jan 2003
Rookie Year: 2002
Location: Granby, CT
Posts: 42
Merle has a spectacular aura aboutMerle has a spectacular aura aboutMerle has a spectacular aura about
Re: NI Pneumatics Module "sputtering"

Quote:
Originally Posted by Joe Ross View Post
Does this also happen on other outputs? If so, this could also be a system watchdog issue. Install the new DS update released 2 days ago and see if it fixes the issue.
Has anyone seen the latest updates eliminate their watchdog timer issues? We are using LabView, and after updating the cRIO and dashboard we still have the intermittent watchdog issue that we saw before the latest updates.


Merle Yoder
Programming/Electrical Mentor
GRUNTS Team #3146
  #10   Spotlight this post!  
Unread 14-02-2010, 21:43
Greg McKaskle Greg McKaskle is offline
Registered User
FRC #2468 (Team NI & Appreciate)
 
Join Date: Apr 2008
Rookie Year: 2008
Location: Austin, TX
Posts: 4,756
Greg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Just before kickoff, the Comm thread and FPGA were changed to update the Diagnostic with counts of even the smallest glitches. The latest DS definitely makes changes to improve the timing and eliminate many of the glitches.

At this point, it would be helpful if details of how to reproduce the glitches were posted. Before we go there, here are some things to consider.

The print statements do not differentiate between user induced disables and watchdog timeouts. Therefore, some of the diagnostics print statements will occur naturally.

If the dashboard runs on the same computer as the DS and is misbehaving, it is feasible that it could starve the DS thread enough to cause watchdog glitches. If the robot code misbehaves, it may be able to cause occasional glitches. Some teams have also noticed a .NET conversion tool that seems to get caught in a loop comsuming lots of CPU.

If you have a repeatable situation, please post the details. It may also be useful to notice the classmate CPU usage and cRIO CPU usage.

Greg McKaskle
  #11   Spotlight this post!  
Unread 14-02-2010, 22:07
waialua359's Avatar
waialua359 waialua359 is offline
Mentor
AKA: Glenn
FRC #0359 (Hawaiian Kids)
Team Role: Mentor
 
Join Date: Apr 2003
Rookie Year: 2000
Location: Waialua, HI
Posts: 3,316
waialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Ok,
I just called our programmer who is out for today.
We never had that problem again after he made some changes and did some troubleshooting.
The main problem was that the dashboard was running on the classmate. We think that was the majority of it as we moved it onto our second laptop. Seems that its possible the classmate's CPU was on overload.
We also moved the functions for robot out of teleop and into the periodic functions, getting as much things out of teleop as possible.
The problem was fixed before the latest update came out.
Hope that helps for what its worth.
__________________

2016 Hawaii Regional #1 seed, IDesign, Safety Award
2016 NY Tech Valley Regional Champions, #1 seed, Innovation in Controls Award
2016 Lake Superior Regional Champions, #1 seed, Quality Award, Dean's List
2015 FRC Worlds-Carver Division Champions
2015 Hawaii Regional Champions, #1 seed.
2015 Australia Regional Champions, #2 seed, Engineering Excellence Award
2015 Inland Empire Regional Champions, #1 seed, Industrial Design Award
2014 OZARK Mountain Brawl Champions, #1 seed.
2014 Hawaii Regional Champions, #1 seed, UL Safety Award
2014 Dallas Regional Champions, #1 seed, Engineering Excellence Award
2014 Northern Lights Regional Champions, #1 seed, Entrepreneurship Award
2013 Championship Dean's List Winner
2013 Utah Regional Champion, #1 seed, KP&B Award, Deans List
2013 Boilermaker Regional Champion, #1 seed, Motorola Quality Award
2012 Lone Star Regional Champion, #1 seed, Motorola Quality Award
2012 Hawaii Regional Champions #1 seed, Motorola Quality Award
  #12   Spotlight this post!  
Unread 14-02-2010, 22:35
apalrd's Avatar
apalrd apalrd is offline
More Torque!
AKA: Andrew Palardy (Most people call me Palardy)
VRC #3333
Team Role: College Student
 
Join Date: Mar 2009
Rookie Year: 2009
Location: Auburn Hills, MI
Posts: 1,347
apalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond reputeapalrd has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

We have never had a Watchdog issue, at all. The DashBoard has no effect whatsoever on the Watchdog, since it runs on the Classmate not the cRio. The classmate has plenty of power for DriverStation and DashBoard.

You are not confined to Teleop and Periodic Tasks, you can put code in Main. We have a separate VI for each main function called from Main, each VI handles its own loop timing and such. This puts almost nothing in Teleop, allowing it to run and feed the watchdog.
__________________
Kettering University - Computer Engineering
Kettering Motorsports
Williams International - Commercial Engines - Controls and Accessories
FRC 33 - The Killer Bees - 2009-2012 Student, 2013-2014 Advisor
VEX IQ 3333 - The Bumble Bees - 2014+ Mentor

"Sometimes, the elegant implementation is a function. Not a method. Not a class. Not a framework. Just a function." ~ John Carmack
  #13   Spotlight this post!  
Unread 14-02-2010, 22:51
waialua359's Avatar
waialua359 waialua359 is offline
Mentor
AKA: Glenn
FRC #0359 (Hawaiian Kids)
Team Role: Mentor
 
Join Date: Apr 2003
Rookie Year: 2000
Location: Waialua, HI
Posts: 3,316
waialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond reputewaialua359 has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Quote:
Originally Posted by apalrd View Post
We have never had a Watchdog issue, at all. The DashBoard has no effect whatsoever on the Watchdog, since it runs on the Classmate not the cRio. The classmate has plenty of power for DriverStation and DashBoard.

You are not confined to Teleop and Periodic Tasks, you can put code in Main. We have a separate VI for each main function called from Main, each VI handles its own loop timing and such. This puts almost nothing in Teleop, allowing it to run and feed the watchdog.
You're probably right.
We did both fixes at the same time and couldnt correlate whether it was due to either one or both.
__________________

2016 Hawaii Regional #1 seed, IDesign, Safety Award
2016 NY Tech Valley Regional Champions, #1 seed, Innovation in Controls Award
2016 Lake Superior Regional Champions, #1 seed, Quality Award, Dean's List
2015 FRC Worlds-Carver Division Champions
2015 Hawaii Regional Champions, #1 seed.
2015 Australia Regional Champions, #2 seed, Engineering Excellence Award
2015 Inland Empire Regional Champions, #1 seed, Industrial Design Award
2014 OZARK Mountain Brawl Champions, #1 seed.
2014 Hawaii Regional Champions, #1 seed, UL Safety Award
2014 Dallas Regional Champions, #1 seed, Engineering Excellence Award
2014 Northern Lights Regional Champions, #1 seed, Entrepreneurship Award
2013 Championship Dean's List Winner
2013 Utah Regional Champion, #1 seed, KP&B Award, Deans List
2013 Boilermaker Regional Champion, #1 seed, Motorola Quality Award
2012 Lone Star Regional Champion, #1 seed, Motorola Quality Award
2012 Hawaii Regional Champions #1 seed, Motorola Quality Award
  #14   Spotlight this post!  
Unread 14-02-2010, 23:11
Joe Ross's Avatar Unsung FIRST Hero
Joe Ross Joe Ross is offline
Registered User
FRC #0330 (Beachbots)
Team Role: Engineer
 
Join Date: Jun 2001
Rookie Year: 1997
Location: Los Angeles, CA
Posts: 8,600
Joe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond reputeJoe Ross has a reputation beyond repute
Re: NI Pneumatics Module "sputtering"

Quote:
Originally Posted by apalrd View Post
We have never had a Watchdog issue, at all. The DashBoard has no effect whatsoever on the Watchdog, since it runs on the Classmate not the cRio. The classmate has plenty of power for DriverStation and DashBoard.
There are two watchdogs. The first is the user watchdog which is entirely contained in the cRIO and controlled by the the watchdog class/vis. I think that is what you are referring too. The second is the system watchdog which is handled by the "behind the scenes" code and is dependent on the network communication with the driver station. If the driver station doesn't send data quickly enough (because it was overloaded), it would trigger the system watchdog.
  #15   Spotlight this post!  
Unread 16-02-2010, 12:48
ilmondo ilmondo is offline
Team 0759 - Mentor
AKA: Ben Temple-Heald
FRC #0759 (Systemetric)
Team Role: Mentor
 
Join Date: Feb 2010
Rookie Year: 2009
Location: United Kingdom
Posts: 2
ilmondo is an unknown quantity at this point
Re: NI Pneumatics Module "sputtering"

We are having the exact same problem, we have done all the updates and have minimal code in our main loop, the only thing it calls is our defined function that keep the solenoid "armed" so that we can fire.

Is there any fix for this, to get around the watch dog.

Thanks in advance

Ben
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
"Allocating channel or module that is out of range" Parthenon Programming 14 11-01-2012 07:23
Championship Event - Where the "Random" Match Sorting Really "Shines" Travis Hoffman Championship Event 57 19-04-2007 08:06
New NEMO White Papers! "Creating a Killer Packet" and "25 Ways to Sponsor" Jessica Boucher Team Organization 0 10-08-2005 10:55
"Thunderbirds" Vs. "Team America" Which one will rule the box office? Elgin Clock Chit-Chat 3 07-09-2004 19:53
how tall is the ramp when in "up" and "balanced" position??? archiver 2001 1 24-06-2002 00:54


All times are GMT -5. The time now is 22:31.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi