techl8

Tencent releases Hy3 open-source model that allegedly matches models up

Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size

Tencent has released Hy3, an open-source language model with 295 billion parameters built on a mixture-of-experts architecture. Only 21 billion parameters are active at any given time. Tencent says Hy3 matches models two to five times its size while cutting its hallucination…

Source: The Decoder · Opens in new tab