Animation Flicker-Free AnimateDiff Workflow Update - V8
Added 2024-01-04 12:02:31 +0000 UTCAn update of the AnimateDiff workflow within ComfyUI, I introduce the integration of IP adapter Face ID, offering a flicker-free animation experience and also speed up the generation.
Feel free to ask in the comment section.
Version: V8
Comments
check out the latest version: https://www.youtube.com/watch?v=O99foVhbILs this is easier for setting frames number.
Benjamin Law
2024-01-09 16:51:49 +0000 UTCand how do I get a video of 3-5 seconds, 75-125 frames, and not one second?
Draid
2024-01-09 16:06:50 +0000 UTCTry to bypass the IPAdaptor FaceID group, and run a simple short vid first. Eventually, increase the frame numbers see how far your computer can goes.
Benjamin Law
2024-01-07 21:54:53 +0000 UTCI have a issue that, at the end of the queue when the "Video Save" appears, my computer shuts down. The last thing I managed to capture in the cmd before the shutdown is "Loads SAM model sam_vit_b_01ec64.pth and some process: 0:640 1 face, 105.7ms Speed: 4.Sms preprocess, 106.7ms interference, 38.7ms postprocess per image at shape (1, 3, 640, 352). I've been wondering if it's not the graphics card (RTX 3090) with the bad (850W) power supply, but the readings show that the graphics card stops working at the start of this process.
Kamil
2024-01-07 21:35:28 +0000 UTCYou can use the previous version that have BG mask remove features. https://www.patreon.com/posts/94931812?utm_campaign=postshare_creator Then make 1 clip of a character, and gen 1 BG vid (set the denoising lower like 0.35-0.5) Thats what I did. Hope this help
Benjamin Law
2024-01-07 05:51:55 +0000 UTCHow do you use this workflow with consistent background, like you showed in video a few weeks back. Trying to get similar background image shown here: https://www.youtube.com/watch?v=g9QYXvVxkkM Specifically, something similar to the background of the female with blonde hair, black dress, and long boots dancing in front of a consistent store-front background.
Peter C
2024-01-06 22:10:28 +0000 UTCi was unable to upload the log file so i put here.
Seth Chapin
2024-01-05 15:39:29 +0000 UTC####################################################################### [2024-01-05 10:31] [ComfyUI-Manager] Starting dependency installation/(de)activation for the extension [2024-01-05 10:31] [2024-01-05 10:31] Install: pip packages for 'C:\sdxl\ComfyUI\ComfyUI\custom_nodes\comfyui-reactor-node' [2024-01-05 10:31] Collecting insightface==0.7.3 [2024-01-05 10:31] Using cached insightface-0.7.3.tar.gz (439 kB) [2024-01-05 10:31] Installing build dependencies: started [2024-01-05 10:31] Installing build dependencies: finished with status 'done' [2024-01-05 10:31] Getting requirements to build wheel: started [2024-01-05 10:31] Getting requirements to build wheel: finished with status 'error' [2024-01-05 10:31] [!] error: subprocess-exited-with-error [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] Getting requirements to build wheel did not run successfully. [2024-01-05 10:31] [!] exit code: 1 [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] [18 lines of output] [2024-01-05 10:31] [!] Traceback (most recent call last): [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in [2024-01-05 10:31] [!] main() [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main [2024-01-05 10:31] [!] json_out['return_val'] = hook(**hook_input['kwargs']) [2024-01-05 10:31] [!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel [2024-01-05 10:31] [!] return hook(config_settings) [2024-01-05 10:31] [!] ^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 325, in get_requires_for_build_wheel [2024-01-05 10:31] [!] return self._get_build_requires(config_settings, requirements=['wheel']) [2024-01-05 10:31] [!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 295, in _get_build_requires [2024-01-05 10:31] [!] self.run_setup() [2024-01-05 10:31] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup [2024-01-05 10:31] [!] exec(code, locals()) [2024-01-05 10:31] [!] File "", line 11, in [2024-01-05 10:31] [!] ModuleNotFoundError: No module named 'Cython' [2024-01-05 10:31] [!] [end of output] [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] note: This error originates from a subprocess, and is likely not a problem with pip. [2024-01-05 10:31] [!] error: subprocess-exited-with-error [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] Getting requirements to build wheel did not run successfully. [2024-01-05 10:31] [!] exit code: 1 [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] See above for output. [2024-01-05 10:31] [!] [2024-01-05 10:31] [!] note: This error originates from a subprocess, and is likely not a problem with pip. [2024-01-05 10:31] Install: install script for 'C:\sdxl\ComfyUI\ComfyUI\custom_nodes\comfyui-reactor-node' [2024-01-05 10:31] Collecting insightface==0.7.3 [2024-01-05 10:31] Using cached insightface-0.7.3.tar.gz (439 kB) [2024-01-05 10:31] Installing build dependencies: started [2024-01-05 10:31] Installing build dependencies: finished with status 'done' [2024-01-05 10:32] Getting requirements to build wheel: started [2024-01-05 10:32] Getting requirements to build wheel: finished with status 'error' [2024-01-05 10:32] [!] error: subprocess-exited-with-error [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] Getting requirements to build wheel did not run successfully. [2024-01-05 10:32] [!] exit code: 1 [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] [18 lines of output] [2024-01-05 10:32] [!] Traceback (most recent call last): [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in [2024-01-05 10:32] [!] main() [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main [2024-01-05 10:32] [!] json_out['return_val'] = hook(**hook_input['kwargs']) [2024-01-05 10:32] [!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel [2024-01-05 10:32] [!] return hook(config_settings) [2024-01-05 10:32] [!] ^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 325, in get_requires_for_build_wheel [2024-01-05 10:32] [!] return self._get_build_requires(config_settings, requirements=['wheel']) [2024-01-05 10:32] [!] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 295, in _get_build_requires [2024-01-05 10:32] [!] self.run_setup() [2024-01-05 10:32] [!] File "C:\sdxl\ComfyUI\python_embeded\Lib\site-packages\setuptools\build_meta.py", line 311, in run_setup [2024-01-05 10:32] [!] exec(code, locals()) [2024-01-05 10:32] [!] File "", line 11, in [2024-01-05 10:32] [!] ModuleNotFoundError: No module named 'Cython' [2024-01-05 10:32] [!] [end of output] [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] note: This error originates from a subprocess, and is likely not a problem with pip. [2024-01-05 10:32] [!] error: subprocess-exited-with-error [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] Getting requirements to build wheel did not run successfully. [2024-01-05 10:32] [!] exit code: 1 [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] See above for output. [2024-01-05 10:32] [!] [2024-01-05 10:32] [!] note: This error originates from a subprocess, and is likely not a problem with pip. [2024-01-05 10:32] Status: The 'insightface==0.7.3' distribution was not found and is required by the application [2024-01-05 10:32] Ok [2024-01-05 10:32] [ComfyUI-Manager] Startup script completed.
Seth Chapin
2024-01-05 15:39:00 +0000 UTCI am having an issue with the v8 workflow on this post. I was able to get all the nodes running except the faceswapping one. In the consol/CMD, it throws an error 'module not found... 'cython''. however, i do have cython installed. any ideas? i can send over the output from the command prompt if needed.
Seth Chapin
2024-01-05 15:36:41 +0000 UTCMaybe you missed my last video : https://youtu.be/a225Q5waYRQ You may need to check out the this post: https://www.patreon.com/posts/ipadapter-faceid-95651113 Then download the model files in ComfyUI_IPAdapter_plus Github https://github.com/cubiq/ComfyUI_IPAdapter_plus#installation
Benjamin Law
2024-01-04 18:29:32 +0000 UTCit seems i am missing some model files: Can you help me how to get them? or which ones they are? CLIP-ViT-H-14-laion2B-s32B-b79K.safetensonsors SD1.5\model.safetensors
Marv Reinholds
2024-01-04 18:17:41 +0000 UTC
