techl8

KI-Pioneer Sutton calls synthetic data a "big mistake" in the face

KI-Pioneer Sutton calls synthetic data a "big mistake" in the face of an infinitely complex world

Turing Award winner Richard Sutton calls synthetic data a "big mistake" for scaling large language models. The world is infinitely complex, and any simulation of it is "microscopic," with human expertise acting as a bottleneck that blocks real scaling. Sutton's alternative is…

Source: The Decoder · Opens in new tab