AIOpenAI3h ago

OpenAI shares its models' perplexity, or how well they predict data

OpenAI shares its models' perplexity, or how well they predict data, and urges pacing limits based on such metrics, citing a possible 2027 avalanche of AI gains

OpenAI shares its models' perplexity, or how well they predict data

- Difficulty of comparison across labs. … - Detachment from actionable evaluations. … - Not accounting for advances outside of pretraining.

Read full article

Source: OpenAI · Opens in new tab