A training step completes only after every participant reaches the same barrier. A recent review in Nature Reviews Electrical Engineering argues that addressing this at rack scale is a silicon problem rather than a bandwidth problem, and identifies the three hardware structures it requires.