What Is Comfy UI? | A Simple Breakdown
In this article, we help you understand what ComfyUI is and how filmmakers can use it in their creative process.
ComfyUI is a powerful, open-source, node-based interface and backend for Stable Diffusion and other generative AI models that allows you to create a visual workflow for generating images, character models and videos.
Ok, but what does all of that really mean?
In this article we break down ComfyUI in simple terms, to help you start using this really powerful tool!
What Is Comfy UI? | A Simple Breakdown
Below we walk you through the basics of ComfyUI.
After checking out this breakdown, we hope you’ll feel more educated and inspired to start using this super helpful tool.
What Is Comfy UI?
ComfyUI is a tool that helps you create images using AI. Think of it as a digital art studio where you connect different “building blocks” (called nodes) to generate images.
But before we dive in, let’s explore the difference between cloud-based and local. This will help you determine how to run Comfy for your own projects!
Pros & Cons of Cloud-Based vs. Local Tools
If a tool is “cloud based” this means the software runs on external, powerful internet servers. You access it through a website in your browser, without downloading anything!
All the processing happens on remote computers, which leaves more storage on your own device.
Here are the pros and cons of cloud-based vs local ComfyUI.
Pros of Using Cloud:
No need for a powerful computer!
Nothing to install or set up.
Works on almost any device that can access the internet.
Updates automatically.
Often has more storage space for your projects.
Easier for Mac users.
Cons of Using Cloud:
Requires internet connection to work.
Might cost you money (in subscription fees).
Less control over your data.
Could be slower, if many people are using it at once.
Sometimes has limits on what features you can access.
On the other hand, if a tool is “local” that means the software is installed directly on your computer.
Your own machine does all the processing, and it can run independently without needing internet access.
Keep in mind running ComfyUI locally will require you to have a pretty powerful computer!
Pros of Using Local:
Works without internet (once installed).
Usually free to use (no subscription).
Complete control over and privacy with your data.
Often faster, if you have a good computer.
No usage limits beyond your computer's capabilities.
Cons of Using Local:
Requires a powerful computer (especially a good graphics card).
Takes up space on your hard drive.
You need to install and set up everything yourself.
You need to remember to update the software manually.
Your projects are limited by your own computer's storage.
If you’re just starting out with Comfy and don’t have a good computer, you’re going to have a rough experience using a local version. Ideally, a powerful PC with an NVIDIA graphics card is the way to go.
Plenty of folks start with cloud-based options to learn the basics, then move to local installation as they get more serious about their projects.
After walking you through how ComfyUI works, will show you how to use it on the cloud or how to download it locally!
How can filmmakers use ComfyUI?
Pre-Production Planning
ComfyUI can help you create wonderful character concept art. You can even design custom sets and locations digitally. Without a big budget, you can quickly experiment with different visual styles to find the perfect look for your film.
One of the best ways to use ComfyUI is creating detailed storyboards at a much lower cost!
Build Backgrounds
You can generate realistic backgrounds for green screen footage with ComfyUI that blends seamlessly once you start shooting. It’s a great way to build immersive fantasy worlds or futuristic cities that only exist in your imagination.
Help With VFX
ComfyUI lets you make clear reference images that keep your VFX artists on the same page. It’s also a great tool for mocking up seemingly “impossible shots” before determining how to execute them.
Create An AI Film
Using ComfyUI empowers anyone who’s already using AI in their filmmaking workflow. You can create entire films using AI tools and ComfyUI together!
How Does Comfy UI Work?
Instead of just typing what you want into an image generator, ComfyUI uses a system of connected blocks called "nodes."
You arrange these nodes like a flowchart, telling the computer exactly how you want your image to look.
This can feel a little intimidating visually, but don’t worry!
You can get the hang of it with practice and patience.
Getting Started With Comfy UI (Cloud-Based)
RunComfy is a cloud-based platform that we highly recommend! You can run it directly from your web browser and it even gives you GPU options.
The cloud version mirrors the local ComfyUI setup, offering the same structure and workflow configurations. (Meaning, you’ll get the same experience as using it locally!)
With ComfyUI Manager already set up inside for you, you can immediately browse and install custom nodes and extensions for added flexibility.
You can get started now by going to RunComfy.com!
This is just one way to use ComfyUI. You can also check out more cloud-based options like Replicate or ComfyAI.run.
But if you have a good computer and want to explore local options, check out the section below.
Running Comfy UI (Local)
Remember, ComfyUI on a local machine is computer intensive, and this is pretty much only recommended for PC users. Mac users will probably have a better experience running it on the cloud!
Step 1: Installing ComfyUI Portable
To download Comfy UI, head to the ComfyUI GitHub Releases page and download the portable version for Windows.
After downloading, extract the files to your preferred location.
Now you can launch ComfyUI!
If you have an NVIDIA GPU, run the run_nvidia_gpu.bat file for optimal performance.
If not, you can use run_CPU.bat, but note that this will run significantly slower.
Step 2: Adding ComfyUI Manager
Now you’ll want to download the ComfyUI Manager. You can get it from the ComfyUI Manager GitHub page.
Next, install in the “Custom Nodes Folder”. Place the extracted files in the custom_nodes folder within your ComfyUI directory.
Finally, access the “Manager Tab” to relaunch ComfyUI. You’ll now see a new “Manager” tab in the interface, allowing you to easily browse and install custom nodes and extensions directly.
Extra Resources
If you’re interested in learning more, you can get access to a FREE ComfyUI Course by becoming a Curious Refuge student. Feel free to check out our catalog of AI courses. :)
We also recommend joining the RunComfy Discord community, which you can find a link to on their website. This is where you can interact with other users and ask questions as you’re getting started.
RunComfy also has some helpful articles like this one about creating consistent characters.
ComfyUI might seem a little complicated at first, but with practice, it can be a super powerful tool for bringing your film and video ideas to life!
Get Free ComfyUI Training With Any Course
If you want to learn more about using ComfyUI or how to create with AI but don’t know where to start, we would love for you to join us in our next session for AI Filmmaking, AI Advertising or any of our creative courses.
By signing up for any course, you’ll automatically get access to our FREE ComfyUI Training!
Feel free to check out our course catalog. Reach out to us via email at hello@curiousrefuge.com with any questions and we will be happy to help!
