The carbon–carbon covalent (electron-sharing) bond is stable and strong.
The covalent bond is directional; there's a particular favorable structural orientation, and the atoms tend to arrange in this orientation and stay there.
In contrast to graphite, diamond comprises a 3D network structure (called, hey,
diamond cubic), so the above characteristics apply in all directions.
Dislocations (i.e., 1D defects that direct stresses to break only a few bonds at a time, enabling slip) don't readily move in diamond's 3D structure as they do in ductile metals with more accessible [slip systems](https://en.wikipedia.org/wiki/Slip_\(materials_science\)). Thus, increasing the strain energy stored in a diamond leads not to [plasticity](https://en.wikipedia.org/wiki/Plasticity_\(physics\)) (
softness) but to brittle fracture—Nature essentially directs this energy into creating new surfaces.