The quantum tug-of-war between structure and spin