When AI Starts Acting Like a Director
Last week, Higgsfield released Cinema Studio 2.0. The headline feature is called "What's Next" — an AI that suggests how a scene might progress, letting creators iterate on visuals and narrative simultaneously.
As someone who has directed commercials for Disney, Starbucks, and Nestlé over the last 14 years, I had to test this immediately. Not because I thought it would replace me, but because I've been waiting for AI to understand something fundamental: direction isn't just about shots. It's about flow.
And for the first time, an AI tool seems to get that — at least partially.
What It Does
Higgsfield Cinema Studio 2.0 is a billion-dollar AI startup's attempt to give creators genuine directorial control over AI-generated video. The core innovation is the "What's Next" feature: you generate a scene, and the AI suggests multiple options for how it could continue. Different camera angles, different character movements, different emotional beats.
Think of it as a branching narrative tool for video. Instead of getting one output and hoping it works, you get a tree of possibilities. You choose the path that matches your creative vision, then iterate further.
Additional features include:
- Camera path control: Define specific camera movements — dolly, track, crane, pan — and the AI executes them while maintaining scene consistency.
- Character persistence: Lock a character's appearance across multiple generations so they look the same from shot to shot.
- Scene memory: The AI remembers the environment, lighting, and spatial relationships from previous generations in your sequence.
- Director's notes: A text input where you describe the emotional tone, pacing, and intent of each shot, and the AI adjusts accordingly.
Real-World Test
I set up three test scenarios based on actual commercial work I've done:
Test 1: Product Reveal
A slow dolly-in on a beverage, warm lighting, with the product gradually coming into focus. This is bread-and-butter commercial work — I've shot hundreds of these.
Result: Impressive. The dolly movement was smooth and consistent. The lighting held. The product stayed in frame without warping. I'd rate this 8/10 compared to what I'd get from a real camera move. The missing 2 points? The "soul" of the light — that specific way a real key light wraps around a glass bottle — was approximated but not quite right.
Test 2: Character Walking Through a Space
A person entering a cafe, looking around, sitting down. Three shots: wide establishing, medium follow, close-up reaction.
Result: Mixed. The character consistency was genuinely good — same clothes, same face, same build across all three shots. But the "performance" was flat. Real actors bring micro-expressions, hesitations, authentic movement patterns. The AI-generated character moved like a video game NPC: technically correct, emotionally vacant.
Test 3: The "What's Next" Feature in Action
I generated an opening shot and let the AI suggest continuations. This is where Cinema Studio 2.0 shines.
The AI offered four options for how the scene could progress: a wide pullback, a cut to a close-up, a pan to reveal a second character, and a slow zoom into a detail. Each option maintained the established scene. Each felt like a legitimate creative choice.
This is the closest I've seen an AI tool come to understanding editorial thinking. Not just "generate another shot" but "what would a director do next?" It's not replacing directorial instinct, but it's providing a framework for creative exploration that didn't exist before.
What Actually Works
- Camera movement consistency: When you tell it to track left or dolly in, the AI preserves character and environment integrity better than anything I've seen. The subject stays the subject. The background doesn't morph into something unrecognizable.
- Scene continuity: The ability to maintain a consistent environment across multiple generations is a major step forward. This makes it usable for projects that require visual coherence — commercials, short films, branded content.
- Creative exploration: The branching "What's Next" feature is genuinely useful for pre-visualization. I can explore five different approaches to a scene without spending money on a shoot or hours in post.
- Speed of iteration: I tested 40 different approaches to a single scene in two hours. In traditional production, that would take days of shooting and weeks of editing.
What Still Breaks
- Performance direction: AI can suggest where to put the camera, but it has zero understanding of why a performance works. It doesn't know that an actor's hesitation creates tension. It doesn't understand that the way someone picks up a coffee cup reveals character. The shots are technically correct but emotionally inert.
- Lighting subtlety: Cinema Studio handles broad lighting setups well — daylight, golden hour, night. But the nuanced stuff — a practical lamp creating a pool of warm light that shifts as a character moves through it — is beyond its capabilities.
- Complex multi-character scenes: Two people in a scene? Manageable. Three or more? Chaos. Characters merge, positions shift, spatial relationships break down.
- Audio integration: Like most AI video tools, Cinema Studio generates visuals only. No dialogue, no ambient sound, no music. You're building half a film.
Pros and Cons
Pros
- Best-in-class camera movement control
- "What's Next" feature is genuinely innovative for creative exploration
- Character persistence across shots actually works
- Excellent for pre-visualization and concept development
- Fast iteration speed enables rapid creative exploration
Cons
- No emotional performance capability
- Limited to simple scenes (1-2 characters)
- No audio generation or integration
- Pricing is steep at $99/month for the Pro tier
- Rendering quality varies — sometimes stunning, sometimes uncanny
Who It's For
Commercial directors doing pre-vis: This is where Cinema Studio 2.0 genuinely earns its place. If you're pitching a concept to a client and need to show them what the final product could look like, this tool generates pre-visualization material that's orders of magnitude better than storyboard sketches.
Solo content creators: If you're producing branded content on your own and need cinematic-looking video without a production budget, Cinema Studio delivers results that are usable for social media and web content.
Music video directors: The aesthetic flexibility and camera control make it interesting for music videos where visual spectacle matters more than realistic human performance.
Not for: Narrative filmmakers who need authentic human performance, documentary creators, or anyone working on projects where emotional truth matters more than visual polish.
The Bigger Picture
What excites me about Cinema Studio 2.0 isn't the output quality — that will keep improving. It's the philosophy. Higgsfield is building a tool that respects the director's role. It doesn't try to replace creative decision-making; it provides a faster way to explore creative options.
That's the right approach. The AI video tools that will win aren't the ones that promise to make films without directors. They're the ones that make directors more powerful.
Cinema Studio 2.0 isn't there yet. But it's pointing in the right direction.
Rating: 7.5/10 — The "What's Next" feature is genuinely innovative and the camera control is best-in-class. Held back by flat performances and limited scene complexity. Worth the investment for pre-vis and concept work.