Yep, very possible. That is what you are shimming for, shim out til it doesn't make any ill noises or binds, then it's good. To far out and it will be out of the flywheel., or damage the bendix. It's trial and error, just keep playing with it. Mine had 5 shims, I replaced the starter, used the same 5 shims and it is perfect. If you had it too close, you may have already messed up the Bendix.
The correct way to shim it is to remove the solenoid, mount the starter, engage the bendix and put a 1/16" or 1/8th drill bit between the gear of the bendix and the flywheel. When you get that, it's shimmed correctly.