FBRC.ai’s Living Lab and Luma AI present: CREATIVE CONTROL, a hackathon dedicated to merging and transforming tooling APIs into flexible production pipelines for creatives.
In traditional generative workflows, achieving the right shot can involve hundreds of attempts—often with a 300:1 or greater ratio of generated to final shots.
Guided by renowned VFX supervisor Robert Legato (Avatar, The Lion King, Titanic, and more), this hackathon aims to put creative power and clear artistic direction back into the hands of the director.
Participants will utilize APIs from Luma AI--as well as from tools like ElevenLabs, Mod Tech Labs, Playbook--to craft custom production to bring creative control to the process of bringing scenes from an original script by Robert Legato to life. Assume that Robert will make shooting decisions based on the workflows you create—meaning, you should consider: what does creative direction with generative AI look like?
As they build, participants are encouraged to either:
1) Work directly with the Luma API to create custom pipelines that bring more control into the generative AI process--potentially through integration with tools like Blender and Maya, and augmented with additional APIs like Mod Tech Labs' or Elevenlabs'
OR
2) Build ComfyUI workflows that call Luma's API (potentially building on top of tools like Playbook) to enable more specific creative direction of their chosen scenes.
Participants can work across three separate tracks:
Creative Camera Control: This track centers around bringing cinematographic vision and direction into the creative process of working with generative AI. Drawing from Robert Legato’s script, participants in this track will choose at least one scene with complex camera movement and use the available tools and APIs to create a workflow that enables targeted shot selection and camera control.
Creative Scene Control: This track centers around world consistency and persistence from shot to shot and from project to project. Drawing from Robert Legato’s script, participants in this track will choose a key location that is used across multiple scenes and will create a workflow that demonstrates both inter-scene and intra-scene generative continuity and persistence.
Creative Actor Control: This track centers around tools that enable directors to work with generative characters to deliver emotional performances. From the script, participants in this track should choose a scene with at least two characters in conversation with each other, and create a workflow that enables the director to guide emotional expression of the generative characters.
First-place winners in each track will have the chance to participate in a 6-week remote incubator, where they’ll work directly with Robert Legato to refine the AI tools that will support him on bringing his short film to life.
Schedule
February 8th
10am Doors Open
10:15am Welcome & Breakdown of Challenges
11am Team Building
1pm Lunch
2pm Workshops
7pm Dinner
February 9th
9am Breakfast
11am Projects submitted
12pm Lunch + Demos and Judging
2pm Finished
Please register to see the exact location of this event.