Create an AI-Generated Short Film with Sora 2 + Runway Gen-4

Step 3: Enhance with Runway Gen-4 (15 minutes)

Refine Key Scenes

• Import your best clips into Runway
• Use Motion Brush to add specific animations (wind in hair, flowing water)
• Use the Frames feature to match visual style across all clips
• Generate transition shots between scenes

Camera Movement Polish:

• Add camera movements to static-feeling clips
• Use Runway's precise camera control for dolly, pan, or crane shots
• Ensure camera movements serve the story (move toward tension, pull back for reveal)

Step 4: Add Audio (15 minutes)

Voiceover/Narration (if needed)

• Write narration that complements but doesn't duplicate the visuals
• Generate with ElevenLabs — choose a voice that matches your story's tone
• Keep narration minimal; let visuals tell the story

Sound Design

• If using Veo 3 for any scenes, leverage its native audio
• For other clips, add ambient sounds and sound effects in your editor
• Background music sets emotional tone — choose wisely

Music Selection:

• CapCut's free music library has cinematic options
• Match music tempo to your edit pace
• Fade music during dialogue or key visual moments

Step 5: Edit in CapCut (20 minutes)

Assembly Edit

1. Import all AI-generated clips in scene order
2. Trim each clip to remove weak opening/closing frames
3. Arrange on timeline following your storyboard

Refine the Edit

• Add 0.5-1 second dissolve transitions between scenes
• Use simple cuts for dramatic moments
• Add text overlays for title and credits
• Sync music to visual beats

Color Consistency

• Apply the same color grade to all clips
• AI-generated clips often vary in warmth and contrast
• A consistent LUT (look-up table) unifies the look

Final Touches

• Add title card at the beginning
• Add end credits
• Export at highest quality (4K if source material supports it)

Step 6: Review and Polish (10 minutes)

Watch the complete film 3 times:

1. First watch: Story flow — does the narrative make sense?
2. Second watch: Technical — any jarring cuts, color mismatches, or artifacts?
3. Third watch: Emotional — does it evoke the intended feeling?

Common Fixes:

• Re-generate any clips with visible AI artifacts
• Adjust timing if scenes feel rushed or slow
• Fine-tune audio levels between scenes

Pro Tip: Show your film to one person before finalizing. Fresh eyes catch issues you've become blind to.

Example: "The Last Light"

Here's a sample script we created using this workflow:

Scene 1: A lone astronomer in a small observatory, sunset light through the dome opening. (Sora 2 — establish character)

Scene 2: She discovers an anomaly in her telescope data — a brief flash of light from a seemingly empty region of space. (Runway Gen-4 — Motion Brush on screen data)

Scene 3: Time-lapse of her working through the night, coffee cups accumulating, notes filling the desk. (Sora 2 — time progression with character consistency)

Scene 4: She realizes the pattern matches a signal — not random noise. Her expression shifts from confusion to wonder. (Sora 2 — close-up on facial expression)

Scene 5: She steps outside into dawn light, looking up at the sky with new understanding. Camera slowly pulls up and away. (Runway Gen-4 — controlled crane shot)

Total generation time: ~45 minutes. Total edit time: ~30 minutes. Result: A 75-second atmospheric short film.