VIDRAFT Releases Aether-7B-5Attn: A Fully Open-Source MoE LLM with Five Heterogeneous Attention Mechanisms TL;DR: Korean AI startup VIDRAFT has released Aether-7B-5Attn , a 6.59B-parameter Mixture-of-Experts foundation model on Hugging Face under Apache-2.0 — shipping not just weights but training data recipes, full training code, hyperparameters, training logs, intermediate checkpoints, and evaluation code. If you care about reproducibility, sovereign AI, or heterogeneous attention res...