ER32 Collet+Nut Damage

Are you ensuring the collets are snapped into the collet nut before inserting a bit and threading onto the collet holder? I’ve seen people have issues with this using handheld routers. Just a thought.