techl8

Google speeds up Gemma 4 threefold with multi-token prediction

Google has released multi-token prediction drafters for its Gemma 4 open model family that speed up text generation by up to three times. A small auxiliary model suggests several tokens at once while the main model checks them in a single pass. The article Google speeds up Gemma…

Source: The Decoder · Opens in new tab