techl8

AMD acquires Taalas, a startup

AMD acquires Taalas, a startup that bakes AI models directly into silicon

AMD is buying Canadian startup Taalas, which hard-codes model weights directly into inference chips. That makes them extremely fast but locks each chip to a single model. A demo chip hit over 16,000 tokens per second per user running Llama 3.1-8B. Google is reportedly working on…

Source: The Decoder · Opens in new tab