#Apple#Hardware#M5#On-device AI
Apple Unveils M5 Chip: 100 TOPS on a Laptop?
Apple's 'Spring Forward' event in November surprises everyone with the early release of the M5 chip, focused entirely on local AI inference.
Apple M5: The On-Device AI Powerhouse
Breaking from their usual cycle, Apple has announced the M5 chip, and the specs are terrifyingly good for local AI developers.
The Neutral Engine Expansion
The headline feature is the expanded Neural Engine (NPU):
- 100 TOPS (Trillions of Operations Per Second) INT8 performance.
- Dedicated transformer acceleration blocks.
- Unified Memory bandwidth increased to 800GB/s on Max chips.
"Siri with Context"
Alongside the chip, Apple demoed "Siri with Context" — essentially a local LLM running constantly to understand user intent across apps without sending data to the cloud.
"Privacy is not an afterthought; it's the architecture." - Tim Cook