The half doz Lee ingot molds I use are from 5-10 years old and the handles are still intact despite lots of use. If there was a flaw in the handle area I can see it being the weak link, but otherwise, ham handed treatment is likely the reason.
Unless there are burrs that need correction, there is no need to beat the mold to drop the ingots.