The Oscar for Best Visual Effects Goes To: AI

Tomorrow's VFX artists might not be human.

3. 28. 18 by Kristin Houser
Marvel Studios

The next breakout star in Hollywood might be an AI named Arraiy.

Arraiy is a computer vision and machine learning platform specifically designed for film and television effects.

Arraiy’s creators are training the system to rotoscope — the process of separating certain parts of footage from the background (for example) separating an actor from the green screen behind them) with years’ worth of human-created visual effects as training tools.

The ultimate goal, though, is to do it more quickly and cheaply than humans can, and just as effectively. Rotoscoping by hand can take dozens of hours, but Arraiy can do it in a fraction of the time. This gives a filmmaker a chance to see how a finished scene could look before they even leave the set. That allows films to dedicate many fewer resources to the effects, eliminating the need to reshoot scenes repeatedly if the effects aren’t quite right.


So far, Arraiy has been used to make one short film (“The Human Race”) and one music video (The Black Eyed Peas’ “Street Livin'”).

Arraiy isn’t the only company looking to bring AI to the world of special effects. Adobe, along with other software companies, are doing the same, the New York Times reports. But Arraiy may be in a position to dominate; the company just raised $10 million in funding.

“Our aim is make movies better, cheaper, and faster to produce by empowering creators with a practical machine learning based workflow,” Ethan Rublee, co-founder and CEO of Arraiy, said in a press release.

“We’re filmmakers, scientists, roboticists, and engineers; and we’re passionate about the opportunity to bring all of these disciplines together as we reimagine the process of making movie magic.”


Care about supporting clean energy adoption? Find out how much money (and planet!) you could save by switching to solar power at By signing up through this link, may receive a small commission.

Share This Article

Keep up.
Subscribe to our daily newsletter to keep in touch with the subjects shaping our future.
I understand and agree that registration on or use of this site constitutes agreement to its User Agreement and Privacy Policy


Copyright ©, Camden Media Inc All Rights Reserved. See our User Agreement, Privacy Policy and Data Use Policy. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with prior written permission of Futurism. Fonts by Typekit and Monotype.