Multi-step mechanism of damage accumulation in irradiated crystals