AI Film News | April 12th, 2024
In this article and video, we will give you the latest AI film news that is most applicable to everyone in the world of AI filmmakers.
We talk about some of the latest AI Film News and new technology in AI Filmmaking. We also highlight some incredible AI Filmmaking projects. You can find the AI Film News links shown in the video below.
Join Our Newsletter for the Latest AI Film News.
Check out our AI Filmmaking Course.
Take a look at our AI Advertising Course.
AI Film News Video | April 12th 2024
AI Film News | April 12th, 2024
Here is a breakdown of the AI Film News from the video.
Adobe's HUGE AI News - Adobe just announced a slew of new AI features include AI generation directly in Premiere and video in-painting. This is a BIG deal.
Physavatar: Physavatar essentially allows you to shoot a scene with multiple camera angles and then create a 3D model of the scene. This tool could revolutionize filmmaking by allowing post-production adjustments like camera angles, lighting, and wardrobe. This technology enables directors to experiment with visuals and storytelling beyond traditional constraints.
Udio AI Music Generator: Udio is being called the 'SORA' of AI Music tools. It can generate covers of songs in different genres, completely new songs, and even songs where you customize your own lyrics. Here are a few of our favorite examples:
• Rising Sun (Gospel Rendition)
Feature Splatting: Feature Splatting uses text input to generate animations and physics-based 3D scene simulations. This technology facilitates creating dynamic animations and detailed physics interactions through simple textual descriptions. It's not where it would need to be in order to be used in a production pipeline, but the examples are still very fascinating. It feels as though it is creating another world.
MagicTime: If you have tried to generate timelapse footage using AI video generators such as Runway or Pika, the chances are you have been greatly disappointed. One filmmaker even tried in SORA and had no luck. MagicTime is a new tool in development that creates brilliant timelapse videos. This is because they trained the model on only timelapse footage as opposed to more of a broad scope of different footage like that other tools have done.
Generative Interpolation from Photos: If you have been with us for long, you have most likely heard us talk about frame interpolation. It is essentially adding frames into footage to change the frame rate. Our favorite tool for this is Topaz Video. Google just released a white paper that essentially allows you to use frame interpolation from photos. Basically, this will enable you to create videos from multiple photos. The examples appear to have lengths more similar to GIFs, but this development creates ease for filmmakers who are trying to make videos with fewer assets.
Google's Text to Live Image Generator: Speaking of Google, they also launched a preview of their new text to live image generator. It appears Google may have some things in the works to move closer to the top in the AI world.
Krea's Realtime Multi Prompting Tool: This new feature basically gives you more control for your real-time image generations. It allows you to upload a reference image along with your drawings and test prompt.
Pika Labs Film Festival: Pika Labs teamed up with Elevenlabs to host a 72-hour film festival. We are excited that our good friend Dave Clark is on the judges panel. Best of luck to everyone who is participating.
NAB Party: Today is the day where we will be hosting the biggest event for AI filmmakers in history. Be there or be square, well not square but probably really sad that you missed out. ;)
AnyV2V Video Style Transfer: There is a new style transfer tool that is better than any we have seen yet. We compared this tool to Runway Gen-1 and it blows it out of the water.
Gaussian Splatts + Unreal Engine: Akshat Sharma did this beautiful experiment where they brought Gaussian splatts into Unreal Engine and what they got is magnificent. The quality is spectacular and this is just another step towards helping make the lives of VFX artists easier in a very necessary way
Spotify's New AI Feature: If you are in the UK or Australia, let us know how Spotify's new AI playlist feature works. They launched a brand new multi-modal tool that allows you to curate a playlist based on what you prompt.
Gemini 1.5 Pro Demo: Bilawal utilized Grok 1.5 to launch one of the recent YouTube videos with NVIDIA's David Chu. His insight is brilliant and we actually gave it a shot in launching this week's web show. What do you think?
Midjourney v1 vs v6: Nick St. Pierre did a Midjourney experiment this past week and we could not resist joining in. It is so fun to look back on all of the AI developments and see how far everything has come. We tested Midjourney v1 versus v6 and it is mind-blowing the difference.
