SakeTami
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


ComfyUI Workflow Create Animation Easy Consistent Style With Differential Diffusion Latent Noise

Full Workflow Creation Tutorial : https://youtu.be/alnrfN6F-lI

(Watch it before you ask any question, because things might covered already)

We'll be exploring different methods create ComfyUI Workflow to generate AI Animation Using Differential Diffusion, SEGs Mask, IPAdapter only.

Throughout the video, we'll be discussing the various techniques involved in the Differential Diffusion workflow. From IPAdapters to segmentation masking, we'll cover it all. I've done extensive research on this topic and have been experimenting with different methods to achieve stunning results.

a-person-mask-generator: https://github.com/djbielejeski/a-person-mask-generator

Differential Diffusion: https://differential-diffusion.github.io/

Workflow for Patreon Supporters : https://www.patreon.com/posts/102610598/

In this video, I'll be sharing some of my findings and demonstrating how you can use diffusions to transform the appearance of characters, specifically focusing on outfit changes. Imagine being able to alter the style of a dancer or a character without affecting their movements. It's truly fascinating!

I'll also be showcasing the use of different tools like COCO segmenter, Segment Anything, and the Person Mask Generator from Automatic 1111 extension to achieve accurate and efficient masking. These tools, combined with the powerful Comfy UI nodes, allow for precise control over the masking, growth, and shape of the character's outfit.

Additionally, I'll be introducing you to the concept of Differential Diffusion, a feature that's readily available in Comfy UI itself. I'll guide you through the process of using Differential Diffusion for image mapping, and how it can enhance your creations.

If you're interested in learning more about diffusions and how they can elevate your creative projects, this video is a must-watch. I'll be sharing some insider tips and tricks along the way, so make sure to stick around till the end.

Don't forget to hit that like button if you find this video helpful, and don't hesitate to leave a comment if you have any questions or suggestions. And of course, make sure to subscribe to my channel for more exciting content like this!

Discord : https://discord.gg/BTXWX4vVTS

Comments

Looks like there's a conflict on checkpoint type

Benjamin Law

Do you know what is causing this issue: "Error occurred when executing CheckpointLoaderSimple: 'model.diffusion_model.input_blocks.0.0.weight'"

Josephine Miller

I have watched your videos many times. The workflow is the same as the settings in the video. The model uses realDream_turboLCM6. How can I upload the video I made for you to take a look at.

木 苏

Show us your generate result, the input you use and setting. Also , know that you are in join, you created your own workflow. So I don't know what is your workflow's nodes that are using.

Benjamin Law

Why is the video I generated so unclear?

木 苏

Just don't need it, since IPAdaptor is smart enough to do it now.

Benjamin Law

Im recieving the error " Error occurred when executing RemBGSession+: [WinError 267] The directory name is invalid: 'E:\\AI_Advantage\\Data\\Packages\\ComfyUI\\venv\\lib\\site-packages\\jsonschema_specifications\\schemas\\desktop.ini'" I think it's because my comfy env is running in python 3.10.11 and Rembf requires either "python: >3.7, <3.13". I can't change the python version as I use Stability Matrix to manage my workflows, etc. Could you pretty please advise me to another bg removal node you'd reccomend and how I should change the current workflow to allow for it to work.

Finn Negrello

😅😅bro, that is very difficult in Patreon. Let me think how to build 1 community for China.😊

Benjamin Law

How can I pay using Alipay

木 苏

enjoy it :)

Benjamin Law

Ooooh i was waiting for this! You are a genious

Mauricio Tonon


More Creators