techl8

Ex-OpenAI researcher bets $100 billion will flow into training data

Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it

Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models. Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas. Ho…

Source: The Decoder · Opens in new tab