SakeTami
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


Stable Diffusion Animation Create Unique Outfits For YT Shorts Dance AI Video

Tutorial Video : https://youtu.be/Sg3KgA3_fPU 

tutorial on using Stable Diffusion Animation to effortlessly change background and character outfit colors! In this video, we will walk you through the step-by-step process using the ComfyUI workflow.

Workflow (Supporters Early Access) : https://www.patreon.com/posts/96537203 

OpenArt Workflow List : https://openart.ai/workflows/profile/futurebenji 


Series Of Tutorial Videos About This AnimateDiff Workflow: 

https://youtu.be/O99foVhbILs 

https://youtu.be/aCbjIYQSuos 

https://youtu.be/g9QYXvVxkkM 

https://youtu.be/AoUlADxSDAg 

https://youtu.be/wFahkr-b7HI 




Comments

No, I am just passionate on tech stuffs, not no innovator. LOL. anyway thanks for support , and keep inspiring.

Benjamin Law

Benji - you are no1 innovator in this space - thank you for all your efforts helping people.

Chick

Lip sync never do good , I know a guy did a workflow for that but it took 3 workflow to create 1 little animation, not worth it for business honestly. I suggest after finish you dance or movement motion, use Facefusion for lipsync with audio.

Benjamin Law

How do i get the face lips to move in sync with my video. I find the dwpose is very inaccurate - I want 100% match to my videos face mouth and eye movements.

Chick

You do AI influencer like Lopez?

Benjamin Law

hi Benji - you do amazing work. Question: How do I ensure to maintain the face and body shape 100% of my Influencer. When I load a video in - the output always seems to adjust the characters body and face shape the source video. i.e. want to ensure consistent Influencer body & face in all videos generated and do not want them to change each time I use a different video. Example: The dance and faceposes should change but not the physical shape of my character. i.e. consistent influencer look for all videos.

Chick

Looks like you need to update your IPA custom node. Haven't you?

Benjamin Law

I guess you have no watch the tutorial follow the install steps.πŸ˜‰

Benjamin Law

I have a problem, neither the setnode nor the getnode loads.

Mario

what i do

polaraju p

Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). File "D:\AI\ComfyUI\ComfyUI\execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\AI\ComfyUI\ComfyUI\execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\AI\ComfyUI\ComfyUI\execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\AI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 653, in apply_ipadapter self.ipadapter = IPAdapter( File "D:\AI\ComfyUI\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 279, in __init__ self.image_proj_model.load_state_dict(ipadapter_model["image_proj"]) File "C:\Users\RAJU\AppData\Roaming\Python\Python310\site-packages\torch\nn\modules\module.py", line 2152, in load_state_dict raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(

polaraju p

In Comfyui manager download it, by click the Install Missing Custom Node. I have show previous video. Try it and the list will show you what to install.

Benjamin Law

i have error When loading the graph, the following node types were not found: SetNode GetNode Image Resize ReActorFaceSwap Nodes that have failed to load will show as red on the graph.

polaraju p


More Creators