Invariant FPGA Image Version Error?

[jhersh]

Originally Posted by 1951-44U

Here is what happened:

When we loaded the file in via FTP Client (FileZilla), we rebooted the robot. We intently watched the serial output and found (to our surprise) that everything started up normally! However, upon enabling, a "Watchdog Not Fed" error shows up on the Classmate as a status. So we reloaded our program. But then upon reboot we get the same error as before.

Can you try rebooting a number of times, watching for the error each time? I'm curious if you see this every time or if it is an intermittent issue. In your second boot, you can see the Hardware GUID trace is corrupted, but the FPGA version check passed. In the 3rd boot (like the original post) the version check failed but the printed GUID is good.

The way the version check works is it simply reads the GUID from the hardware and compares it with the software value... if it fails for the invariant FPGA, it then prints out both versions. The fact that it is wrong one time and right immediately after is troubling. It tends to point to a hardware problem since no other team is seeing this, and you see it consistently. I believe this chassis should be RMA'd.

-Joe

[1951-44U]

Here are 5 other reboots for ya (i think you may be right):

                            cRIO-907x Boot


Copyright 2007 National Instruments Corp.





Bootrom version: 2.4.7
Creation date: Jul  9 2007, 00:45:07


_

Press any key to stop auto-boot...
 1
 0

auto-booting...


boot device          : tffs=0,0
unit number          : 0 
processor number     : 0 
host name            : host
file name            : /c/ni-rt/system/vxWorks
flags (f)            : 0x8 

Mounting tffs...
Attaching to TFFS... Datalight Reliance v3.00.1218T
VxWorks Edition for ppc603
Copyright (c) 2003-2007 Datalight, Inc.
done.
3572144
Starting at 0x100000...

ATA device not detected.

Adding 8459 symbols for standalone.
Mounting onboard storage...
Reliance File System Driver
Datalight Reliance v3.2.2 Build 1376BV
VxWorks Edition for ppc603
Copyright (c) 2003-2008 Datalight, Inc.  All Rights Reserved Worldwide.

-> lvusEngine: PPC603 CPU detected...
CPU tick frequency: 33.000741 MHz [Using: 1000 MHz]
MAX system identification name: Team25
Initializing network... 
Device 1 - MAC addr: 00:80:2F:11:5A:D1 - 10.0.25.2 /8 (primary - static)
Device 2 - MAC addr: 00:80:2F:11:5A:D2 - 192.168.0.3 /24 (static)

Loading LVRT...
* Loading EarlyStartupLibraries: tsengine
Time sync source: rtc now active
* Loading StartupDlls: debug
Entering debug.o StartupLibraryInit
Debugging is up, target server mounted at /tsfs


                VxWorks

Copyright 1984-2006  Wind River Systems, Inc.

             CPU: MPC5200 -- Wind River Lite5200 BSP.
    Runtime Name: VxWorks
 Runtime Version: 6.3
     BSP version: 2.0/10
         Created: Jul 29 2009, 13:41:47
ED&R Policy Mode: Deployed
   WDB Comm Type: WDB_COMM_END
             WDB: Ready.

Leaving debug.o StartupLibraryInit
* Loading StartupDlls: NiRioRpc
* Loading StartupDlls: niorbs
* Loading StartupDlls: NiViSrvr
* Loading StartupDlls: nivissvc
task 0xec2cd8 (PAL00f94078) deleted: errno=0 (0) status=0 (0)
NI-RIO Server 3.2 started successfully.
task 0xc3e130 (NiRioRpc) deleted: errno=0 (0) status=0 (0)
* Loading StartupDlls: nivision
* Loading StartupDlls: niserial
* Loading StartupDlls: FRC_FPGA
* Loading StartupDlls: FRC_NetworkCommunication
FRC_NetworkCommunication was compiled from SVN revision 2123
Error, Invariant FPGA image version error! (-63194)
FPGA Hardware GUID: 0x0AF07C6B1E53E3F869DC0EE6C45E6FA9
FPGA Software GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Hardware Version: 49391
FPGA Software Version: 49391
FPGA Hardware Revision: 1.0.0
FPGA Software Revision: 1.0.0
FPGA Hardware GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Software GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Hardware Version: 2010
FPGA Software Version: 2010
FPGA Hardware Revision: 1.3.0
FPGA Software Revision: 1.3.0
* Loading StartupDlls: FRC_UserProgram
ERROR: Network communication failed to initialize!











                            cRIO-907x Boot


Copyright 2007 National Instruments Corp.





Bootrom version: 2.4.7
Creation date: Jul  9 2007, 00:45:07




Press any key to stop auto-boot...
 1
 0

auto-booting...


boot device          : tffs=0,0
unit number          : 0 
processor number     : 0 
host name            : host
file name            : /c/ni-rt/system/vxWorks
flags (f)            : 0x8 

Mounting tffs...
Attaching to TFFS... Datalight Reliance v3.00.1218T
VxWorks Edition for ppc603
Copyright (c) 2003-2007 Datalight, Inc.
done.
3572144
Starting at 0x100000...

ATA device not detected.

Adding 8459 symbols for standalone.
Mounting onboard storage...
Reliance File System Driver
Datalight Reliance v3.2.2 Build 1376BV
VxWorks Edition for ppc603
Copyright (c) 2003-2008 Datalight, Inc.  All Rights Reserved Worldwide.

-> lvusEngine: PPC603 CPU detected...
CPU tick frequency: 33.000718 MHz [Using: 1000 MHz]
MAX system identification name: Team25
Initializing network... 
Device 1 - MAC addr: 00:80:2F:11:5A:D1 - 10.0.25.2 /8 (primary - static)
Device 2 - MAC addr: 00:80:2F:11:5A:D2 - 192.168.0.3 /24 (static)

Loading LVRT...
* Loading EarlyStartupLibraries: tsengine
Time sync source: rtc now active
* Loading StartupDlls: debug
Entering debug.o StartupLibraryInit
Debugging is up, target server mounted at /tsfs


                VxWorks

Copyright 1984-2006  Wind River Systems, Inc.

             CPU: MPC5200 -- Wind River Lite5200 BSP.
    Runtime Name: VxWorks
 Runtime Version: 6.3
     BSP version: 2.0/10
         Created: Jul 29 2009, 13:41:47
ED&R Policy Mode: Deployed
   WDB Comm Type: WDB_COMM_END
             WDB: Ready.

Leaving debug.o StartupLibraryInit
* Loading StartupDlls: NiRioRpc
* Loading StartupDlls: niorbs
* Loading StartupDlls: NiViSrvr
* Loading StartupDlls: nivissvc
task 0xec2d58 (PAL00f940b8) deleted: errno=0 (0) status=0 (0)
NI-RIO Server 3.2 started successfully.
task 0xc3e1a8 (NiRioRpc) deleted: errno=0 (0) status=0 (0)
* Loading StartupDlls: nivision
* Loading StartupDlls: niserial
* Loading StartupDlls: FRC_FPGA
* Loading StartupDlls: FRC_NetworkCommunication
FRC_NetworkCommunication was compiled from SVN revision 2123
Error, Invariant FPGA image version error! (-63194)
FPGA Hardware GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Software GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Hardware Version: 49391
FPGA Software Version: 49391
FPGA Hardware Revision: 1.0.0
FPGA Software Revision: 1.0.0
FPGA Hardware GUID: 0x00000000000000000000000000000000
FPGA Software GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Hardware Version: 2010
FPGA Software Version: 2010
FPGA Hardware Revision: 1.3.0
FPGA Software Revision: 1.3.0
* Loading StartupDlls: FRC_UserProgram
WPILib was compiled from SVN revision 2069
task 0x219ab60 (t2) deleted: errno=0 (0) status=0 (0)

Welcome to LabVIEW Real-Time 8.6.1f2

NI-VISA Server 4.5 started successfully.
task 0xe41540 (t1) deleted: errno=1835009 (0x1c0001) status=1 (0x1)
Default Disabled() method... Overload me!











                            cRIO-907x Boot


Copyright 2007 National Instruments Corp.





Bootrom version: 2.4.7
Creation date: Jul  9 2007, 00:45:07




Press any key to stop auto-boot...
 1
 0

auto-booting...


boot device          : tffs=0,0
unit number          : 0 
processor number     : 0 
host name            : host
file name            : /c/ni-rt/system/vxWorks
flags (f)            : 0x8 

Mounting tffs...
Attaching to TFFS... Datalight Reliance v3.00.1218T
VxWorks Edition for ppc603
Copyright (c) 2003-2007 Datalight, Inc.
done.
3572144
Starting at 0x100000...

ATA device not detected.

Adding 8459 symbols for standalone.
Mounting onboard storage...
Reliance File System Driver
Datalight Reliance v3.2.2 Build 1376BV
VxWorks Edition for ppc603
Copyright (c) 2003-2008 Datalight, Inc.  All Rights Reserved Worldwide.

-> lvusEngine: PPC603 CPU detected...
CPU tick frequency: 33.000699 MHz [Using: 1000 MHz]
MAX system identification name: Team25
Initializing network... 
Device 1 - MAC addr: 00:80:2F:11:5A:D1 - 10.0.25.2 /8 (primary - static)
Device 2 - MAC addr: 00:80:2F:11:5A:D2 - 192.168.0.3 /24 (static)

Loading LVRT...
* Loading EarlyStartupLibraries: tsengine
Time sync source: rtc now active
* Loading StartupDlls: debug
Entering debug.o StartupLibraryInit
Debugging is up, target server mounted at /tsfs


                VxWorks

Copyright 1984-2006  Wind River Systems, Inc.

             CPU: MPC5200 -- Wind River Lite5200 BSP.
    Runtime Name: VxWorks
 Runtime Version: 6.3
     BSP version: 2.0/10
         Created: Jul 29 2009, 13:41:47
ED&R Policy Mode: Deployed
   WDB Comm Type: WDB_COMM_END
             WDB: Ready.

Leaving debug.o StartupLibraryInit
* Loading StartupDlls: NiRioRpc
* Loading StartupDlls: niorbs
* Loading StartupDlls: NiViSrvr
* Loading StartupDlls: nivissvc
task 0xec2bb8 (PAL00f94038) deleted: errno=0 (0) status=0 (0)
NI-RIO Server 3.2 started successfully.
task 0xc3e0f8 (NiRioRpc) deleted: errno=0 (0) status=0 (0)
* Loading StartupDlls: nivision
* Loading StartupDlls: niserial
* Loading StartupDlls: FRC_FPGA
* Loading StartupDlls: FRC_NetworkCommunication
FRC_NetworkCommunication was compiled from SVN revision 2123
Error, Invariant FPGA image version error! (-63194)
FPGA Hardware GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Software GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Hardware Version: 49391
FPGA Software Version: 49391
FPGA Hardware Revision: 1.0.0
FPGA Software Revision: 1.0.0
FPGA Hardware GUID: 0xB57A549EAD9A5591CC64E4DF756D77D1
FPGA Software GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Hardware Version: 2010
FPGA Software Version: 2010
FPGA Hardware Revision: 1.3.0
FPGA Software Revision: 1.3.0
* Loading StartupDlls: FRC_UserProgram
ERROR: Network communication failed to initialize!











                            cRIO-907x Boot


Copyright 2007 National Instruments Corp.





Bootrom version: 2.4.7
Creation date: Jul  9 2007, 00:45:07




Press any key to stop auto-boot...
 1
 0

auto-booting...


boot device          : tffs=0,0
unit number          : 0 
processor number     : 0 
host name            : host
file name            : /c/ni-rt/system/vxWorks
flags (f)            : 0x8 

Mounting tffs...
Attaching to TFFS... Datalight Reliance v3.00.1218T
VxWorks Edition for ppc603
Copyright (c) 2003-2007 Datalight, Inc.
done.
3572144
Starting at 0x100000...

ATA device not detected.

Adding 8459 symbols for standalone.
Mounting onboard storage...
Reliance File System Driver
Datalight Reliance v3.2.2 Build 1376BV
VxWorks Edition for ppc603
Copyright (c) 2003-2008 Datalight, Inc.  All Rights Reserved Worldwide.

-> lvusEngine: PPC603 CPU detected...
CPU tick frequency: 33.000693 MHz [Using: 1000 MHz]
MAX system identification name: Team25
Initializing network... 
Device 1 - MAC addr: 00:80:2F:11:5A:D1 - 10.0.25.2 /8 (primary - static)
Device 2 - MAC addr: 00:80:2F:11:5A:D2 - 192.168.0.3 /24 (static)

Loading LVRT...
* Loading EarlyStartupLibraries: tsengine
Time sync source: rtc now active
* Loading StartupDlls: debug
Entering debug.o StartupLibraryInit
Debugging is up, target server mounted at /tsfs


                VxWorks

Copyright 1984-2006  Wind River Systems, Inc.

             CPU: MPC5200 -- Wind River Lite5200 BSP.
    Runtime Name: VxWorks
 Runtime Version: 6.3
     BSP version: 2.0/10
         Created: Jul 29 2009, 13:41:47
ED&R Policy Mode: Deployed
   WDB Comm Type: WDB_COMM_END
             WDB: Ready.

Leaving debug.o StartupLibraryInit
* Loading StartupDlls: NiRioRpc
* Loading StartupDlls: niorbs
* Loading StartupDlls: NiViSrvr
* Loading StartupDlls: nivissvc
task 0xec2dd8 (PAL00f94178) deleted: errno=0 (0) status=0 (0)
NI-RIO Server 3.2 started successfully.
task 0xc3e230 (NiRioRpc) deleted: errno=0 (0) status=0 (0)
* Loading StartupDlls: nivision
* Loading StartupDlls: niserial
* Loading StartupDlls: FRC_FPGA
* Loading StartupDlls: FRC_NetworkCommunication
FRC_NetworkCommunication was compiled from SVN revision 2123
Error, Invariant FPGA image version error! (-63194)
FPGA Hardware GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Software GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Hardware Version: 49391
FPGA Software Version: 49391
FPGA Hardware Revision: 1.0.0
FPGA Software Revision: 1.0.0
FPGA Hardware GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Software GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Hardware Version: 2010
FPGA Software Version: 2010
FPGA Hardware Revision: 1.3.0
FPGA Software Revision: 1.3.0
* Loading StartupDlls: FRC_UserProgram
ERROR: Network communication failed to initialize!











                            cRIO-907x Boot


Copyright 2007 National Instruments Corp.





Bootrom version: 2.4.7
Creation date: Jul  9 2007, 00:45:07




Press any key to stop auto-boot...
 1
 0

auto-booting...


boot device          : tffs=0,0
unit number          : 0 
processor number     : 0 
host name            : host
file name            : /c/ni-rt/system/vxWorks
flags (f)            : 0x8 

Mounting tffs...
Attaching to TFFS... Datalight Reliance v3.00.1218T
VxWorks Edition for ppc603
Copyright (c) 2003-2007 Datalight, Inc.
done.
3572144
Starting at 0x100000...

ATA device not detected.

Adding 8459 symbols for standalone.
Mounting onboard storage...
Reliance File System Driver
Datalight Reliance v3.2.2 Build 1376BV
VxWorks Edition for ppc603
Copyright (c) 2003-2008 Datalight, Inc.  All Rights Reserved Worldwide.

-> lvusEngine: PPC603 CPU detected...
CPU tick frequency: 33.000689 MHz [Using: 1000 MHz]
MAX system identification name: Team25
Initializing network... 
Device 1 - MAC addr: 00:80:2F:11:5A:D1 - 10.0.25.2 /8 (primary - static)
Device 2 - MAC addr: 00:80:2F:11:5A:D2 - 192.168.0.3 /24 (static)

Loading LVRT...
* Loading EarlyStartupLibraries: tsengine
Time sync source: rtc now active
* Loading StartupDlls: debug
Entering debug.o StartupLibraryInit
Debugging is up, target server mounted at /tsfs


                VxWorks

Copyright 1984-2006  Wind River Systems, Inc.

             CPU: MPC5200 -- Wind River Lite5200 BSP.
    Runtime Name: VxWorks
 Runtime Version: 6.3
     BSP version: 2.0/10
         Created: Jul 29 2009, 13:41:47
ED&R Policy Mode: Deployed
   WDB Comm Type: WDB_COMM_END
             WDB: Ready.

Leaving debug.o StartupLibraryInit
* Loading StartupDlls: NiRioRpc
* Loading StartupDlls: niorbs
* Loading StartupDlls: NiViSrvr
* Loading StartupDlls: nivissvc
task 0xec2e48 (PAL00f941e8) deleted: errno=0 (0) status=0 (0)
NI-RIO Server 3.2 started successfully.
task 0xc3e298 (NiRioRpc) deleted: errno=0 (0) status=0 (0)
* Loading StartupDlls: nivision
* Loading StartupDlls: niserial
* Loading StartupDlls: FRC_FPGA
* Loading StartupDlls: FRC_NetworkCommunication
FRC_NetworkCommunication was compiled from SVN revision 2123
Error, Invariant FPGA image version error! (-63194)
FPGA Hardware GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Software GUID: 0x1E53E3F869DC0EE6C45E6FA90AF07C6B
FPGA Hardware Version: 49391
FPGA Software Version: 49391
FPGA Hardware Revision: 1.0.0
FPGA Software Revision: 1.0.0
FPGA Hardware GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Software GUID: 0xAD9A5591CC64E4DF756D77D1B57A549E
FPGA Hardware Version: 2010
FPGA Software Version: 2010
FPGA Hardware Revision: 1.3.0
FPGA Software Revision: 1.3.0
* Loading StartupDlls: FRC_UserProgram
ERROR: Network communication failed to initialize!

[G-Money]

Let's see if my profile changes take effect now...

Sorry but I was the AE that you talked to on the phone just a little bit ago. There isn't any contact information for your Team Advisor so I couldn't call you guys back so I thought I would post back here since I told you to monitor it.

I talked with Joe about the issue and we think that it is probably something hardware related because it looks like the FPGA doesn't register properly.

It looks like the booting multiple times is also pointing to the same thing. Give us a call and we can pick up the troubleshooting again. Thanks!!

[1951-44U]

Just to satisfy my curiosity, what caused those Watchdog.cpp errors in the data I posted in the first post of this topic?

[jhersh]

Originally Posted by 1951-44U

Just to satisfy my curiosity, what caused those Watchdog.cpp errors in the data I posted in the first post of this topic?

The Watchdog class uses the FPGA chip object interface like all others. One of the first things each class does is check that the FPGA is the right version for the class. If the GUID reads fail, it won't match and will return that same version mismatch error.

[Wayne C.]

Joe-

This is the head coach for 25. I spoke to NI yesterday after Phil was on for quite a while and they want us to return the unit. They were to be sending us a cRIO and we are supposed to return our unit in the box once it arrives. However they had no idea when or if another cRIO would be available any time soon.

Time is of the essence here. We cannot afford even a few days lost. Do you have any idea whether units are/will be available in the next day or so? Apparently we cant even buy a new one.

WC

[StephBrierty]

Hi guys -
There has been some confusion on this and so the following will be in the team update going out tomorrow:

Teams that need to send their cRIO-FRC back to National Instruments for repair will get a replacement sent overnight to them if it is in NI's system before 4pm Central, otherwise it will be processed and overnighted the next day.
NOTE: This is at the mercy of other teams however. We only have so many in stock and if teams that request this do not send theirs back to get repaired in a timely matter, our stock can get low. We are currently fine though.

Teams purchasing spare or extra cRIOs will receive their systems in approximately 2 weeks.

Let me know if you have any particular questions on here or via email (see below). Thanks!

[Wayne C.]

Thanks NI-

today I had numerous contacts with your people and confusion from yesterday was cleared up. The cRIO replacement is on the way. Your staff handled it all with compassion and I thank you for it.

WC