Go to Post This is a pure blooded, man and machine versus man and machine, brain versus brain, driving skill challenge. - Andy Grady [more]
Home
Go Back   Chief Delphi > Technical > Programming
CD-Media   CD-Spy  
portal register members calendar search Today's Posts Mark Forums Read FAQ rules

 
Closed Thread
Thread Tools Rate Thread Display Modes
  #1   Spotlight this post!  
Unread 02-02-2010, 19:52
lollypop2020 lollypop2020 is offline
Registered User
FRC #2733 (Pigmice)
Team Role: Programmer
 
Join Date: Jan 2009
Rookie Year: 2003
Location: Portland, OR
Posts: 19
lollypop2020 is an unknown quantity at this point
Hundreds of "Watchdog Expiration: System X" Errors

Just a few days ago, our cRIO started giving tons of "Watchdog Expiration: System X, User 0" whenever we enable the robot (it doesn't happen when disabled.) It averages out of about 4 or 5 additional system watchdog expirations per second. If left on long enough, the counter gets up to the thousands. I have tried everything I can think of to fix it, I've re imaged and re-updated everything (I'm 100% positive all the updates have worked), and tried using unchanged new project code. It isn't the wireless(I've tried it with an Ethernet cable directly from the DS to the cRIO) Does anyone know what this is caused by or how to fix it? The robot still works, we can use the camera and motors, but it is slightly noticeable that the jaguars stop communicating very quickly and then start again.
__________________
  #2   Spotlight this post!  
Unread 02-02-2010, 20:56
Tom Line's Avatar
Tom Line Tom Line is offline
Raptors can't turn doorknobs.
FRC #1718 (The Fighting Pi)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 1999
Location: Armada, Michigan
Posts: 2,554
Tom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

Please use the search function. You will find that NI is already working on resolving this - it is not your fault. It is a bug in the current software.
  #3   Spotlight this post!  
Unread 02-02-2010, 21:28
Greg McKaskle Greg McKaskle is offline
Registered User
FRC #2468 (Team NI & Appreciate)
 
Join Date: Apr 2008
Rookie Year: 2008
Location: Austin, TX
Posts: 4,756
Greg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

Can you describe the situations that provoke this? What processes are running? What tab is frontmost on the DS? Is the dashboard also visible? Is Vision displaying in the dashboard? What account was logged in?

Greg McKaskle
  #4   Spotlight this post!  
Unread 02-02-2010, 21:53
lollypop2020 lollypop2020 is offline
Registered User
FRC #2733 (Pigmice)
Team Role: Programmer
 
Join Date: Jan 2009
Rookie Year: 2003
Location: Portland, OR
Posts: 19
lollypop2020 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

Quote:
Originally Posted by Tom Line View Post
Please use the search function. You will find that NI is already working on resolving this - it is not your fault. It is a bug in the current software.
I did search first, but most of the threads I found were for people getting a few expirations here and there, not the hundreds I am seeing.

Quote:
Originally Posted by Greg McKaskle View Post
Can you describe the situations that provoke this? What processes are running? What tab is frontmost on the DS? Is the dashboard also visible? Is Vision displaying in the dashboard? What account was logged in?

Greg McKaskle
It happens whenever the robot is enabled. I even tried taking all code out of the teleop enabled state, but the expirations still happen. I don't have the DS with me at the moment, but I can find out more about what processes are running tomorrow afternoon. The DS and Dashboard work fine, as does vision. I honestly wouldn't have known anything was going on were it not for the hundreds of system watchdog expiration errors in the diagnostic tab and the periodic flickering of the RSL and Jaguar LEDs. I was logged into the driver account only.
__________________
  #5   Spotlight this post!  
Unread 03-02-2010, 20:38
BLProgram2010's Avatar
BLProgram2010 BLProgram2010 is offline
Registered User
FRC #2534 (Robo Lake)
Team Role: Programmer
 
Join Date: Jan 2010
Rookie Year: 2008
Location: Baltimore
Posts: 11
BLProgram2010 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

We're having the exact same problem, and every time we enable the robot, there is a 'watchdog not feed' message and the robot won't respond to the joysticks. Please help!!!!!
  #6   Spotlight this post!  
Unread 03-02-2010, 21:04
Greg McKaskle Greg McKaskle is offline
Registered User
FRC #2468 (Team NI & Appreciate)
 
Join Date: Apr 2008
Rookie Year: 2008
Location: Austin, TX
Posts: 4,756
Greg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

Watchdog not fed messages will normally indicate that the code is not feeding the watchdog. This could be because there is a loop or slow operation in the Teleop or Autonomous Iterative method.

Does this happen with teleop, auto, both?

Greg McKaskle
  #7   Spotlight this post!  
Unread 04-02-2010, 00:34
lollypop2020 lollypop2020 is offline
Registered User
FRC #2733 (Pigmice)
Team Role: Programmer
 
Join Date: Jan 2009
Rookie Year: 2003
Location: Portland, OR
Posts: 19
lollypop2020 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

Quote:
Originally Posted by Greg McKaskle View Post
Watchdog not fed messages will normally indicate that the code is not feeding the watchdog. This could be because there is a loop or slow operation in the Teleop or Autonomous Iterative method.

Does this happen with teleop, auto, both?

Greg McKaskle
I used the totally unchanged new project code that was working perfectly a few days ago. I also tried taking all the code out of the teleop method, but the system watchdog still expired rapidly. This happened in both auto and teleop, but only when enabled.

I called NI today, and spoke to someone for quite a bit who was unable to figure out what was wrong. We went through all the troubleshooting steps, but she said that it was beyond her knowledge and that unless I talked to R&D, there was nothing I could do unless the upcoming update fixes it.
__________________
  #8   Spotlight this post!  
Unread 04-02-2010, 02:57
Tom Line's Avatar
Tom Line Tom Line is offline
Raptors can't turn doorknobs.
FRC #1718 (The Fighting Pi)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 1999
Location: Armada, Michigan
Posts: 2,554
Tom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

FYI - we are also seeing this on a heavily modified project. Literally hundreds.
  #9   Spotlight this post!  
Unread 04-02-2010, 16:47
BLProgram2010's Avatar
BLProgram2010 BLProgram2010 is offline
Registered User
FRC #2534 (Robo Lake)
Team Role: Programmer
 
Join Date: Jan 2010
Rookie Year: 2008
Location: Baltimore
Posts: 11
BLProgram2010 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

I'm having the exact same problem, Do you know if there is anyway to fix it?
  #10   Spotlight this post!  
Unread 05-02-2010, 00:46
Tom Line's Avatar
Tom Line Tom Line is offline
Raptors can't turn doorknobs.
FRC #1718 (The Fighting Pi)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 1999
Location: Armada, Michigan
Posts: 2,554
Tom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

NI is looking into it. It's a bug, but so far it hasn't impacted how our robot actually functions. It's just annoying seeing error messages when we don't think we have errors
  #11   Spotlight this post!  
Unread 06-02-2010, 23:51
lollypop2020 lollypop2020 is offline
Registered User
FRC #2733 (Pigmice)
Team Role: Programmer
 
Join Date: Jan 2009
Rookie Year: 2003
Location: Portland, OR
Posts: 19
lollypop2020 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

I tried installing the DS and Dashboard software on a desktop computer to see if that would improve anything, amazingly enough our system watchdog expirations completely stopped happening. It's good that we have something to work with until the next update, but still rather frustrating that the classmate doesn't work.

With the classmate, I decided to completely start over from scratch. I got out the recovery flash drive, and completely reinstalled windows. I installed the labview update and installed/uninstalled the DS update until it worked. Even after doing all that, re-imaging the cRIO and still using a completely 100% unchanged project, we are still getting the hundreds of errors. It makes me inclined to think that something is actually wrong with our classmate, but I'm not sure.
__________________
  #12   Spotlight this post!  
Unread 07-02-2010, 07:49
Greg McKaskle Greg McKaskle is offline
Registered User
FRC #2468 (Team NI & Appreciate)
 
Join Date: Apr 2008
Rookie Year: 2008
Location: Austin, TX
Posts: 4,756
Greg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

Is it possible that you are fast user switching and running the DS in both driver and developer accounts?

If not, let me sound like an optometrist for a minute to see if we can discover what is causing this.

Log into the classmate DS as developer. Note that means booting with shift key down or exiting the DS in driver first. Run the driver station from the Start menu. Open the task manager from a right click on the task bar.

If the system watchdogs are occurring, what is the CPU load? Does this get better or worse if you plug in the stop button? Does it get better or worse on a particular DS tab? If you click the button on the dashboard video to halt the video, better or worse? Go ahead and close the DB, better or worse.

If one of these makes the situation significantly different, please post the results.

Greg McKaskle
  #13   Spotlight this post!  
Unread 07-02-2010, 11:54
Tom Line's Avatar
Tom Line Tom Line is offline
Raptors can't turn doorknobs.
FRC #1718 (The Fighting Pi)
Team Role: Mentor
 
Join Date: Jan 2007
Rookie Year: 1999
Location: Armada, Michigan
Posts: 2,554
Tom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond reputeTom Line has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

We'll check that tomorrow, and also check it on another computer. We'll compare classmate driverstation account, developer account, and then that other computer, and tell if you we get any significant differences.
  #14   Spotlight this post!  
Unread 07-02-2010, 14:46
lollypop2020 lollypop2020 is offline
Registered User
FRC #2733 (Pigmice)
Team Role: Programmer
 
Join Date: Jan 2009
Rookie Year: 2003
Location: Portland, OR
Posts: 19
lollypop2020 is an unknown quantity at this point
Re: Hundreds of "Watchdog Expiration: System X" Errors

Quote:
Originally Posted by Greg McKaskle View Post
Is it possible that you are fast user switching and running the DS in both driver and developer accounts?

If not, let me sound like an optometrist for a minute to see if we can discover what is causing this.

Log into the classmate DS as developer. Note that means booting with shift key down or exiting the DS in driver first. Run the driver station from the Start menu. Open the task manager from a right click on the task bar.

If the system watchdogs are occurring, what is the CPU load? Does this get better or worse if you plug in the stop button? Does it get better or worse on a particular DS tab? If you click the button on the dashboard video to halt the video, better or worse? Go ahead and close the DB, better or worse.

If one of these makes the situation significantly different, please post the results.

Greg McKaskle
I am very sure that I haven't been fast user switching, I only ever use one account at a time and make sure the other one is logged off.

When I run the DS and Dashboard in developer, interestingly enough, I get significantly less system watchdog expirations, but still more then if I use a completely different computer. It goes down to about 3 or 4 every 5 seconds rather then the 5-6 per second I was getting when in the driver account.

In task manager, when the DS is running the CPU is always at 100%. The DS usually uses 50-60% the Dashboard uses 10-20% and something called mscorsvw.exe uses whatever is left. Occasionally another process will use a bit of CPU, but nothing unusually high.

Amazingly enough, after a few minutes, mscorsvw.exe went away and the watchdog expirations almost completely stopped. I still get one when switching tabs or windows, but that is much more acceptable then what I was getting before. However, this was with no vision and a e-stop button plugged in. When I turned vision back on, and used the override for the stop button, the number of errors went way back up.
__________________
  #15   Spotlight this post!  
Unread 07-02-2010, 22:47
Greg McKaskle Greg McKaskle is offline
Registered User
FRC #2468 (Team NI & Appreciate)
 
Join Date: Apr 2008
Rookie Year: 2008
Location: Austin, TX
Posts: 4,756
Greg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond reputeGreg McKaskle has a reputation beyond repute
Re: Hundreds of "Watchdog Expiration: System X" Errors

That process is something related to Microsoft .NET compilation. I'm not sure why it is acting the way it is, but perhaps you can google it and figure out what to install or reconfigure.

Edit: I found a number of articles that indicate this is usually caused by a visual studio install. There were several approaches that seemed to correct it including this one.

Quote:
Kusok wrote:
Well, I don't know why do you do all this insane stuff to stop the process. You can just go to Control Panel/Administrative tools/services and stop the optimization service(which is the first in the list) and set it to manual start.
Greg McKaskle

Last edited by Greg McKaskle : 07-02-2010 at 22:57. Reason: Clarity
Closed Thread


Thread Tools
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
"watchdog not fed" error Lumit NI LabVIEW 8 04-02-2010 18:45
error : "There were linking errors!"....help please ProgrammerMike Programming 3 21-02-2008 08:59
842's "Digitally Enhanced Scouting System" ChuckDickerson General Forum 6 06-04-2007 11:44
Code Errors With "Bells and Whistles" Ryan O Programming 2 31-01-2006 19:29
Linking Errors: "section '????' can not fit the section. ..." Astronouth7303 Programming 3 16-01-2005 21:36


All times are GMT -5. The time now is 02:17.

The Chief Delphi Forums are sponsored by Innovation First International, Inc.


Powered by vBulletin® Version 3.6.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © Chief Delphi