PixVid retrofits Wan2.1-14B to render video in pixel space
TL;DR
- PixVid replaces the VAE decoder of Wan2.1-14B with a convolutional head so the diffusion transformer renders each frame directly in pixel space.
- The authors report the pixel-space model is competitive with the latent baseline after roughly 1.3 million fine-tuning clips.
- Working framewise in pixels, PixVid generates at 2× higher resolution at the same per-frame token count and responds to each action at the next frame.
"Frontier video generation models work in a VAE latent space that compresses video in both space and time," the PixVid paper begins. The compression made training tractable, but the authors argue it is now the bottleneck: "doubling resolution quadruples token count," conditions "apply to groups of frames rather than individual ones," and each response "must wait for the rest of its multi-frame block."
Their method, finetuned from Wan2.1-14B, keeps the diffusion transformer but replaces the VAE decoder with a convolutional head that renders directly to pixels. "We find that predicting clean video rather than velocity, together with a larger noise shift, is key to quality," the authors write. After roughly 1.3M training clips they report the pixel-space model is "competitive with the latent baseline within ~1.3M training clips." Working framewise, it generates at "2× higher resolution with the same per-frame token count," keeps depth-conditioned editing aligned under fast motion, and responds to each action at the next frame.
The abstract publishes no numerical benchmark scores against the latent baseline and no per-step inference cost for the new architecture.
Originally reported by paper
Read the original article →Original headline: PixVid Lifts Wan2.1-14B Video Model to Pixel Space, Delivers 2× Resolution at Same Per-Frame Token Count