[nuclearnerd]

You can do anything with enough torque, but short answer is I would recommend at least a press in brass or plastic bushing (cheap, and available from McMaster-Carr).

You could do the math to find out exactly what difference in friction there will be on the sprocket shaft, but I would worry more about wear. The sprockets you buy from AndyMark or Vex are made from aluminum. Aluminum does NOT wear well, even when anodized - a few hundred turns under load and I would expect it to seize on the shaft.