Microsoft's 4B Mage-Flow rivals FLUX.2 32B on image tasks
TL;DR
- Mage-Flow is a 4B open model that scores 0.90 on GenEval, ahead of FLUX.2-dev at 32B and Qwen-Image at 20B, both at 0.87.
- The 4-step Turbo variant generates a 1024² image in 0.59s and edits one in 1.02s on a single A100, at roughly 18-20 GB peak memory.
- One checkpoint handles resolutions from 512 to 2048 on any aspect ratio, including 4:1, using a Mage-VAE tokenizer and Qwen3-VL prompt encoder.
A small pattern from this month's image-model releases is worth pausing on: a 4-billion-parameter open model that reportedly tops open systems eight times its size on the standard prompt-following benchmark. Microsoft's Mage-Flow, described in an arXiv preprint and now available on Hugging Face, scores 0.90 on GenEval against 0.87 for FLUX.2-dev at 32B and 0.87 for Qwen-Image at 20B. The 4-step Turbo variant still lands at 0.88 on the same benchmark.
What makes that interesting is the practicality that comes with it. At 1024² on a single A100, Mage-Flow-Turbo generates an image in 0.59s and edits one in 1.02s, with peak memory the model card puts at roughly 18-20 GB. The same checkpoint handles resolutions from 512 to 2048 on any aspect ratio, including 4:1 letterbox and portrait crops. Those are numbers that put interactive editing on a single commodity accelerator, not a cluster.
What drives the shrink is co-design rather than a bigger model. A lightweight tokenizer called Mage-VAE reportedly matches FLUX.2's VAE reconstruction fidelity with roughly 12× and 22× fewer encode and decode MACs per pixel. Native-resolution packing plus fused CUDA kernels lifts model FLOPs utilization from about 33% to about 77%, which the authors say translates into roughly 2.5× training throughput. Prompt encoding runs through Qwen3-VL, which is worth flagging because it hard-couples the stack to a separate model family's release schedule.
The honest caveat is that one benchmark win is not a general win. FLUX.2-dev still comes out ahead on DPG, TIIF-Short and Long, CVTG-2K, and long-text English rendering; Qwen-Image leads on long-text Chinese. On editing the table is muddier still: Mage-Flow-Edit-Turbo posts the top GEdit-EN and GEdit-CN scores in the reported table, but FireRed-Image-Edit at 20B leads on ImgEdit (4.56) and text-edit rendering. What the reporting does not give you is a human-preference study, a training-data disclosure, or a red-team result, so take the specifics as reported, not settled.
If the numbers hold up outside the authors' harness, the interesting move is not that Microsoft won a leaderboard row. It is that a model small enough to serve on a single card, at sub-second latency, is now credible for generation and editing work that has mostly lived behind hosted APIs.
Originally reported by paper
Read the original article →Original headline: Microsoft Mage-Flow: 4B Model Beats FLUX.2 32B and Qwen-Image 20B on Image Gen+Edit