Hollywood VFX turns to AI rotoscoping to trim $75K minutes
TL;DR
- The NYT reports Hollywood VFX shops are adopting AI rotoscoping tools, a task that can cost up to $75,000 per one-minute scene.
- Foundry's SmartRoto plug-in for Nuke claims artists can work up to four times faster than manual rotoscoping, with Adobe offering similar single-click outline tools.
- Foundry creative director Juan Salazar told the paper 'everyone wants a magic button, but it doesn't exist,' citing blurred generative output visible on theater screens.
Hollywood's visual effects shops have long treated rotoscoping, the frame-by-frame tracing that separates actors from their backgrounds, as a necessary slog. A New York Times piece by Matt Stevens reports that even as the industry keeps its distance from generative AI, those same shops are embracing AI-assisted rotoscoping tools that compress a process which can run up to $75,000 for a single one-minute scene.
The craft itself is old. Rotoscoping is what let the original Star Wars (1977) composite Princess Leia's hologram and lightsaber glows onto live-action plates, and it has traditionally been outsourced to studios in India to keep the hourly rate down.
Tools from Adobe and Foundry, maker of the Nuke compositing software widely used in the industry, now offer single-click object detection and automatic outline tracking across sequential frames. Foundry's SmartRoto plug-in claims artists can work up to four times faster than by hand. 'Everyone wants a magic button, but it doesn't exist,' Juan Salazar, Foundry's creative director, told the paper, pointing out that generative AI output can still look slightly blurred on a big screen.
That gap is why trained compositors still oversee every pass. This shows up in AI video coverage on our tracker as a different pattern from the end-to-end generation headlines: the compression is in the pipeline step, not in the finished frame.
Originally reported by nytimes.com
Read the original article →Original headline: NYT: Hollywood VFX Studios Adopt AI Rotoscoping Tools, Replacing Work That Cost up to $75K a Minute