I agree, it should not be. I'm getting to the point where it would almost be easier to remove the camshafts so that I would not have to do battle with them as well.
Only a thought but are you sure the tool you are using to hold the bucket down isn't fouling the shim (this would make them impossible to remove ??)