TechTom's Hardware1h ago
AI developer runs 28.9-million-parameter model on $10 ESP32-S3
AI developer runs 28.9-million-parameter model on $10 ESP32-S3 microcontroller — uses Google's Per-Layer Embeddings technique, stores table on 16MB Flash memory
Getting a local language model running on a sub-$10 microcontroller is impressive despite its obvious limitations.
Read full articleSource: Tom's Hardware · Opens in new tab