Gemma 4 Narrows Open Model Gap With Efficient Multimodality
Dense and MoE variants combine thinking traces, local-global attention, QAT, and MTP drafting, reaching 1451 Arena Elo with a 31B dense model.
Jul 28, 20265 min2607.02770
2 articles on SOTA Papers
Dense and MoE variants combine thinking traces, local-global attention, QAT, and MTP drafting, reaching 1451 Arena Elo with a 31B dense model.
FARS runs ideation, planning, experiments, and writing end to end, producing 166 papers with 282 human reviews exposing quality and integrity gaps.