Chief Delphi - A very weird digital sidecar problem...

Chief Delphi (http://www.chiefdelphi.com/forums/index.php)

- Electrical (http://www.chiefdelphi.com/forums/forumdisplay.php?f=53)

- - A very weird digital sidecar problem... (http://www.chiefdelphi.com/forums/showthread.php?t=104402)

Re: A very weird digital sidecar problem...

Could you check the LEDs on the DSC (BAT, 5V, 6V) with the encoders attached and removed?

My current bet is either that the 5V supply is being shorted by the encoder, or that the 12V power isn't attached correctly and the DSC is being phantom powered by the cRIO.

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by pfreivald (Post 1141528)

This was literally a question of "it worked last night, we turned it on and went out to the field and it stopped working halfway through a match".

We unplug the encoders, everything else works fine. We can't seem to even come up with something else to check.

Bingo! Something happened during that match. A hard hit or bounce, etc.

Quote:

Originally Posted by EricVanWyk (Post 1141624)

My current bet is either that the 5V supply is being shorted by the encoder, or that the 12V power isn't attached correctly and the DSC is being phantom powered by the cRIO.

I have seen this behavior, now that Eric mentioned the "phantom power", I remember this during our build season.
The three LEDS might be lit, but weakly. Check the power (+12v) coming in. Maybe a bad breaker or bad connector on the PDC. Move to a new slot on the PDC and new breaker on the PDC and you may have better luck.

Re: A very weird digital sidecar problem...

So after we were eliminated and went to the practice field to diagnose, everything worked fine -- we plugged 'em back in to start troubleshooting and it simply worked; indeed, we couldn't recreate the problem. This is troubling because we didn't actually diagnose and solve the problem, so it's far too likely that it will reappear at a particularly inconvenient time (say, Buckeye). I'm happy if it doesn't, but don't trust that it won't.

A hypothesis (based on, as far as I can tell, a hunch and nothing more from one of my students talking with another mentor) is that the encoders spin so fast that they are generating too constant a high voltage signal, and that this is tripping some kind of internal breaker in the sidecar or module. I don't even know how I'd begin to test that hypothesis, or what we could do about it if it were true -- seems fishy to me anyway, as many other teams are using kit encoders on their shooters without the same problem.

Thanks so much, everyone, for taking the time to ask and answer. We're hoping we can narrow it down fast so practice day results in a fast fix!

I'm answering all questions below; please forgive the terse tone -- I'm exhausted and going to bed just as soon as I finish replying to this!

Quote:

Originally Posted by slijin (Post 1141540)

That being said, a few questions (some elementary, but bear with me):
- Which encoders are you using? (I assume the E4P from USDigital, which is what's standard in the KoP)

Correct.

Quote:

Originally Posted by slijin (Post 1141540)

- Is this behavior consistent no matter which DIO (technically, the term is GPIO ;)) pins are used? That is, it doesn't matter which pair of pins is connected to the encoder?

Also correct.

Quote:

Originally Posted by slijin (Post 1141540)

- Have you double checked the encoder wiring setup? (i.e. made sure each line is isolated and not shorting to something else, and that you have +5 to +5, A and B to GPIO, and GND to GND)

Yes. We successfully used encoders last year, and they were working through weeks of testing. The wiring was double-triple-quadruple checked for continuity, shorts, and correct pin positions. DSC pins were checked for shorts.

Quote:

Originally Posted by slijin (Post 1141540)

- Do other digital sensors work on the GPIO pins? (If you don't have any on hand, see if any other teams have spare photoelectric sensors that you could play with).

Yes. We use some digital photoelectric sensors on our ball management system, and they're working fine (as long as the encoders are not plugged in).

Quote:

Originally Posted by slijin (Post 1141540)

- You said the 5V power fails; I assume this means that the 5V light turns off while the 6V and BAT lights stay on? (note to Eric: p3 of the spec sheet seems to have the 6V and "Power Input good" labels reversed)

Correct -- and all Victors start flashing the "no signal" flash.

Quote:

Originally Posted by slijin (Post 1141540)

- What do you mean by bumper? The 9403 module (the 37-pin module that plugs into the cRIO)? Something tells me that you're not plugging the DB37 into your bumper... :ahh:

Module, sorry -- the DIO module has no bumper, and I know that.

Quote:

Originally Posted by slijin (Post 1141540)

- Since the only remaining common at this point is the cRIO port, have you tried using a different slot for the module?

Yes.

Quote:

Originally Posted by slijin (Post 1141540)

- When you replaced parts, did you restore the original after finding that the replacement didn't fix the problem? (If a replacement has a problem, it introduces another problem to the system that you're likely to not notice, because fixing the original problem won't fix the system).

Yes.

Quote:

Originally Posted by Al Skierkiewicz (Post 1141574)

Pat,
The power supply in the DSC is capable of several amps so it should handle two encoders. Is there any chance that someone unplugged the encoder connectors and put them back reversed? Some devices are reverse polarity protected and would produce a short if wired backwards and thereby cause the 5 volt supply to shut down.

We repeatedly verified that they are not reversed.

Quote:

Originally Posted by Al Skierkiewicz (Post 1141574)

It is also possible that the power feeding the DSC has a loose wire. Does the 6 volt supply also shut down? If multiple power supplies shutdown at the same time, the input power is the likely cause.

Only the 5V shuts down. The 6V and 12V LEDs stay bright and solid -- and we can still fire relays (the compressor doesn't run because of the pressure switch not working, but our LED ring on our camera lights up as normal. Swapping the two caused the compressor to run.).

Quote:

Originally Posted by DavisC (Post 1141578)

Also when you tested it in the morning, was there new code deployed, or was it "permanent" code with no new deploying?

"Run at startup" from the problem-free night before.

Quote:

Originally Posted by DavisC (Post 1141578)

Also, did you test different power wires/connectors from the Power Distribution Board to the DSC?

Yes.

Quote:

Originally Posted by DavisC (Post 1141578)

So I would check any loose connections starting with the battery.

Done and done and done.

Quote:

Originally Posted by DavisC (Post 1141578)

Also, test the 12V dedicated supply for the Wifi but use it on the DSC and see if it does that any more.

I'm not sure what you mean here.

Quote:

Originally Posted by RyanN (Post 1141603)

It still sounds like a short in the encoder circuit. Whether it's wired wrong now, it's shorting somewhere, not sure. The power shouldn't just go out because of plugging in something unless it is shorting the power supply. Encoders are pretty dumb devices in the terms of sensors. They take in power, and give out a pulse that the cRIO counts. Plugging them into the sidecar should yield no changes at all, ever.

Yup, we know all that. There are no shorts anywhere that we can find, either on the encoders, the sidecar pins, or the cables.

Quote:

Originally Posted by RyanN (Post 1141603)

I'd recommend doing the wiring again. I'd recommend YOU doing the wiring again. Only then do you know if it was a wiring fault.

Done and done; same problem.

Quote:

Originally Posted by EricVanWyk (Post 1141624)

Wouldn't the latter cause a loss of functionality altogether, and not just when the encoders are plugged in? We had full pwm functionality when the encoders weren't plugged in, and none when they were.

As to the former: that was our bet, too, but we cannot find any evidence of a short on any component.

Quote:

Originally Posted by billbo911 (Post 1141659)

Bingo! Something happened during that match. A hard hit or bounce, etc.

Perhaps, though not that we recall -- either way, it's odd that the short (if it is indeed a short) seems to be undetectable by mortal (that is, 1551) means.

Quote:

Originally Posted by RyanN (Post 1141603)

I have seen this behavior, now that Eric mentioned the "phantom power", I remember this during our build season.

I saw that last year and looked for it. Our LEDs are not weak, they're bright and strong as normal. And as I said before, we can fire Spike relays.

--------

Thanks and goodnight!

There are a max number of counter channels of different types, is it possible you you exceeded them?

Monitor the crio console as it boots. Any error or diagnostic messages?

Try a new digital module?

Good luck!

Re: A very weird digital sidecar problem...

From your description of the diagnostic LEDs, this is an electrical problem in either the DSC or your encoder: Your 5V rail is getting shorted out. You can eliminate any theories related to software, the PD, or the cRIO.

I'm betting you have an intermittent short in your encoder wiring. This would explain why it magically fixes itself.

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by pfreivald (Post 1141922)

Perhaps accumulated static electricity? It's a ridiculous hypothesis, but it's all I can think of.

The 9403 can withstand +-30V, and since the encoders are just a digital signal, I can't see how this would cause a problem.

The only suggestion that I have is to prepare a secondary system with Jaguars on CAN (the black ones, not the tan ones) for the explicit purpose of encoder input (and if so desired, to use them to control your shooter as well) in the event that this problem recurs.

Re: A very weird digital sidecar problem...

Maybe try replacing the encoders? (Didn't see it suggested here, sorry if it was). It could be something inside the encoder shorting that may have broken from a hard hit. Try borrowing one or just plugging an extra one in using the same wiring to your current encoders and see what happens?

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by Brandon_L (Post 1142010)

See the OP.

Quote:

Originally Posted by pfreivald (Post 1141484)

We tried replacing the encoders, the wires from the encoders to the sidecar, the sidecar, the cable from the sidecar to the bumper, and the bumper... Even replacing *ALL* of them yielded the same result.

Re: A very weird digital sidecar problem...

Does the issue persist when the encoders are plugged in but not mounted to the robot?

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by EricVanWyk (Post 1142017)

Does the issue persist when the encoders are plugged in but not mounted to the robot?

Good question -- we don't know. We did test to see if the encoders (and everything else) were electrically isolated from the frame, and they are. If the problem pops up again as I suspect it will, that's something new we can check.

It looks very much like, as you said, a short in either the encoder wiring or the DSC -- which is why it's frustrating that we replaced both encoders, their wiring, and the digital sidecar and yet still had the same problem.

We'll try another set of brand new encoders with brand new wiring when we get to Buckeye and can take the bot out of the bag.

Meantime, does anyone have any suggestions on alternate sensors we could easily adapt to get rpm values?

Thanks for the help everyone!

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by pfreivald (Post 1142062)

Meantime, does anyone have any suggestions on alternate sensors we could easily adapt to get rpm values?

Thanks for the help everyone!

Honestly, I don't recall where you were using the encoders, but I guess it really doesn't matter.
Banner makes several sensors that could be adapted. As an example, you could use a Retro sensor and a small piece of the retro tape to create a counter.

Then just use a little math to calculate your RPM.

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by billbo911 (Post 1142078)

Are they fast enough? We were thinking of using the optical sensors (included in the kit last year, and FIRST choice this year) to count either spokes or white/dark coloration, but we don't know if they have a sufficient response time to do the job.

Re: A very weird digital sidecar problem...

From the specs page.

Quote:

Output Response Time Opposed:750 microseconds ON; 375 microseconds OFF
All others:600 microseconds ON/OFF
Delay at Power-up 100 milliseconds; outputs do not conduct during this time.

It looks like they are able to count, at minimum, up to approx. 888 Hz. Therefore they should be able to track a wheel turning at up to 53.2K RPM. Surely you are not tracking anything that fast! ;)

Re: A very weird digital sidecar problem...

Quote:

Originally Posted by pfreivald (Post 1142091)

1712 uses the QS18 retroreflective sensor for our RPM and a piece of retro tape included in the kit. It has worked great for us after nothing but problems with the USDigital encoders.

Re: A very weird digital sidecar problem...

Great to know, guys, thanks! I'll discuss this with my teams on Tuesday.