POPA ReconMoonshot Releases Kimi K3, a 2.8T Open-Weight Model
Moonshot Releases Kimi K3, a 2.8T Open-Weight Model Chinese AI lab Moonshot has published the model weights and technical report for Kimi K3, a 2.8-trillion-parameter mixture-of-experts model, under a permissive open-weight license. K3 activates about 104B parameters per token and adds native vision, a 1M-token context window and roughly 2.5x better compute efficiency than its predecessor Kimi K2, driven by a new attention design. Moonshot also released supporting infrastructure, including its attention kernels and inference recipes. K3 is billed as the largest open-weight model to date and…
The excerpt is quoted from a public Telegram channel, which owns its text.