Topic · 8 stories
8 stories tagged moe on AI Tamer, newest first.
Inkling 2 Small: 594B MoE / 17B active with vision. On Tinker now. AA Index about 31. Apache-2.0 weights intended next week after safety, not public yet.
KRAFTON AI posted Raon-1 mini preview on Hugging Face: 28.8B total and 4.3B active parameters, trained from scratch, 262K context. Access is by request.
Ant Group's inclusionAI posted Ling-3.1-flash weights. The card declares MIT, 560B total and 25B active. config.json's max length is 262,144.
Mistral previewed Large 4 on 6 October (1.05T total, 49B active, 1M context). The weights came out on 29 October under a modified MIT licence.
On 3 October 2026 Aleph Alpha released Kolibri, a bilingual German-English mixture-of-experts model with 78.1B total parameters, 3.46B active, Apache 2.0 weights, and context up to 1M tokens.
Ai2 released Olmo-core 3 on Oct 1, 2026: an open MoE training stack (DDP experts, MXFP8, trillion-scale benches) under Apache-2.0. Training infra only—not a new public Olmo chat model.
NaiveAI’s Naive-N0.5-Flash (Sep 27, 2026): open-weight 309B MoE / 15.5B active, native 1M hybrid SWA–DSA, MIT on HF. API ($0.10/$0.40/$0.01) and NaiveRT remain future-tense—NaiveRT GitHub still 404 at the time of writing (promised by Oct 12). Benches/tok/s are NaiveAI harness claims only.
Holo4 (Sep 28, 2026): 27B dense (Qwen3.8) + 35B-A3B MoE (Qwen3.6) for GUI/code/MCP/API computer-use. License split: 27B weights CC BY-NC 4.0; 35B-A3B Apache-2.0. Both on H Models API + HF. OSWorld/cost figures are H Company harness claims only. Prefer BF16; context 256K (config max 262,144).
