Tag Archives: Foundation

We introduce two multilingual, multimodal foundation language models that power Apple Intelligence features across Apple devices and services: (i) a ∼3B-parameter on-device model optimized for Apple silicon through architectural innovations such as KV-cache sharing and 2-bit quantization-aware training; and (ii) a scalable server model built on a novel Parallel-Track Mixture-of-Experts (PT-MoE) transformer that combines track parallelism, mixture-of-experts sparse computation, and …

A coalition of funders, including the Gates Foundation and Ballmer Group, will spend $1 billion over 15 years to help develop artificial intelligence tools for public defenders, parole officers, social workers and others who help Americans in precarious situations. The funders announced Thursday that they will create a new entity, NextLadder Ventures, to offer grants and investments to nonprofits and …