Stable Diffusion Animation Create Consistnace Character Youtube Dance Video (Tutorial Guide)
Added 2024-01-22 14:06:35 +0000 UTC
Tutorial : https://youtu.be/2kCs6MglK70
Model Link and resource: https://thefuturethinker.org/stable-diffusion-animation-unleashing-the-power-of-rave-technology-for-video-editing/
Comments
Select the motion model that you have. The one that I use is a finetuned motion model from v3 Motion model. From this question, i think you should back to the fundamental learn the file structure and how to load custome node in ComfyUI first.
Benjamin Law
2024-05-21 07:59:51 +0000 UTCpls help to solve this problem, Loading motion module v3_sd15_mm-kpop_dance200-finetuned.ckpt via Gen2 !!! Exception during processing!!! 'NoneType' object has no attribute 'lower' Error occurred when executing ADE_LoadAnimateDiffModel: 'NoneType' object has no attribute 'lower'
Jack Mayer
2024-05-21 02:49:26 +0000 UTCAnimateDiff Motion ControlNet : https://huggingface.co/crishhh/animatediff_controlnet/tree/main
Benjamin Law
2024-01-27 05:28:56 +0000 UTCHello Benji Where can I find this Animate_controlnet_checkpoint.ckpt model with the same name?
ANNAY SIMS
2024-01-27 05:21:53 +0000 UTCThat's weird, I never have that happen in Comfyui. Have you check the config file?
Benjamin Law
2024-01-24 18:03:49 +0000 UTCI made my first video but it's not in the output folder. i found it in C:\ComfyUI_windows_portable\ComfyUI/temp how do i fix this so the final video after face swap goes to output folder?
yohance modeste
2024-01-24 18:02:13 +0000 UTCOh wow, I want to get one A100 too. Yes, it does have the frames limitation. That is the coding level of this Python. I think the developer have not handle momories caching.
Benjamin Law
2024-01-24 05:07:37 +0000 UTCok, let me answer to myself > no, you are not
karel svoboda
2024-01-24 05:07:26 +0000 UTCThe question I have for you Benji is this. How do you get around memory issues when using a control net for face poses? I am trying to make my new videos lip sync the audio. It works very well for short videos. Anything over a few hundred frames and I hit issues. My GPU has 45 gigs of vram. (Some times I have a A100 80gigs). I need to set up some sort of batch processing...... I would love to hear your thoughts on that.
Terry Craddock
2024-01-24 04:57:48 +0000 UTCim on https://huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K/tree/main is it this? open_clip_pytorch_model.safetensors also where to find sd1.5/model.safetensors
yohance modeste
2024-01-24 01:37:22 +0000 UTCHi, I'm trying to set up workflow correctly. where to find CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors Is there a video that goes over this?
yohance modeste
2024-01-24 01:30:59 +0000 UTCLet me know if you gen. some cool results.
Benjamin Law
2024-01-23 15:53:03 +0000 UTCThanks Benji. I run through the whole json script. Hope we can have a pipeline like cloth images to video + RAVE + Mesh Graphormer. (<- sounds like ultimate solution)
Nelson
2024-01-23 15:20:48 +0000 UTCLOL I am not Kenji . the Lora here : https://civitai.com/models/58390
Benjamin Law
2024-01-23 14:46:49 +0000 UTCHi kengi. I have a question. I can't find it in the tutorial. where can i download >> Load LoRa file "add_detail_safetensors" ?
Yu Mu
2024-01-23 14:45:15 +0000 UTCIt's in here : Model Link and resource: https://thefuturethinker.org/stable-diffusion-animation-unleashing-the-power-of-rave-technology-for-video-editing/ then scroll down find the list everything is in there.
Benjamin Law
2024-01-23 09:00:36 +0000 UTCHI Kengi. Such a great work. I have a question. Where can I download Animate_controlnet_checkpoint.ckpt?
Nelson
2024-01-23 08:50:16 +0000 UTCIt works fine for me. I am making videos right now as we speak. I just wish he would have release the rave with ip adapters. I am waiting for that one.
Terry Craddock
2024-01-22 19:55:01 +0000 UTCare you willing to help with debugging? I ran into an error that I wasn't able to debugg, it seems to me like I'm the only one on this planet experience this... Both nodes installed via manager, animate diff and other workflows run without problems (until this happened, now they don't), but this.... when I load just the original example workflow - it occurs in both of them, i get : When loading the graph, the following node types were not found: BNK_DuplicateBatchIndex and in the cmd : [Errno 2] No such file or directory: 'D:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI-Advanced-ControlNet\\control/control.py\\__init__.py' Could not find AnimateDiff nodes so I un/re-install advanced control net - no change, un/re-install animatediff evolved - no change >>> do you have any suggestions or should I just try one custom node by one... ?
karel svoboda
2024-01-22 19:35:03 +0000 UTC
