This may sound stupid, but have you tried flipping the colors?
I ran the 2-color tracking code and you select your friendly color, and then when you test it at the camera you flip it because it wants to track the "enemy" color.
Yes it is a bit confusing at first to wonder why it didn't track the color we selected because it's not specifically stated that it will only track the "enemy color." Then again maybe I was just having an off day
