[45Auto]

We're using a similar pick-up system, and had the same problem. Even made our rollers the same way you did. The ball needs to be able to roll against your side guides.

Put some PVC "rollers" over your guide rails, like you see in the cad model below. That simple fix made ours work unbelievably well!