Generative AI Video & VP: Beyond Animatics to Background Plates?

Hey everyone, Troy here. I’m a grip, usually hustling around a VENICE 2 or an ARRI, rigging lights like the Orbiter or a couple of SkyPanel S60-Cs on set. We're looking at a new project, smaller budget, but with some ambitious virtual production elements.

I’ve been watching the generative video AI tools like Sora 2 and Kling 2.x mature absurdly fast. A while back, it felt like these were just good for quick animatics or placeholder stuff, throw it on a screen to get an idea of timing. But now, seeing some of the output, it's making me wonder.

Have any of you successfully integrated these generative AI videos directly into a VP workflow as actual background plates? Not just as a rough idea, but as something usable on an LED wall? I’m curious if anyone's bypassing traditional pre-rendered VFX plates for certain types of shots. What hurdles are getting hit? Quality? Consistency? Any insights would be great.