We introduce two multilingual, multimodal foundation language models that power Apple Intelligence features across Apple devices and services: (i) a ∼3B-parameter on-device model optimized for Apple silicon through architectural innovations such as KV-cache sharing and 2-bit quantization-aware training; and (ii) a scalable server model built on a novel Parallel-Track Mixture-of-Experts (PT-MoE) transformer that combines track parallelism, mixture-of-experts sparse computation, and …
Read More »Tag Archives: language
How incel language infected the mainstream internet
This excerpt from Adam Aleksic’s Algospeak: How Social Media Is Transforming the Future of Language has been abridged for online publication. The book is out on July 15th. The modern-day incel is entirely an invention of the twenty-first century. Before the internet, lonely men simply didn’t have a way to gather and share ideas. That all began to change in …
Read More »