2.8 Trillion Parameters - Kimi K3 is here

The video announces the release of Kimi K3, a 2.8 trillion parameter open-source language model developed by Moonshot AI. It emphasizes that Kimi K3 is the largest open-source model to date and is built on Kimi Delta Attention and Attention Residuals. The presenter discusses its impressive performance, ranking second only to Claude Fable 5 and GPT-5.6 Sol in evaluations, and its ability to handle a 1 million token context window. The video also touches on the model's architectural innovations, its pricing structure, and its capabilities in various tasks including coding, knowledge work, and vision input.