Gemma 4 Narrows Open Model Gap With Efficient Multimodality
Dense and MoE variants combine thinking traces, local-global attention, QAT, and MTP drafting, reaching 1451 Arena Elo with a 31B dense model.
Jul 28, 20265 min2607.02770
2 articles on SOTA Papers
Dense and MoE variants combine thinking traces, local-global attention, QAT, and MTP drafting, reaching 1451 Arena Elo with a 31B dense model.
FoundCAC pretrains on a stratified lens library and retrieves vector-quantized PSF features, reaching 26.84 dB average PSNR on RealLens-Sim.