SDXL Lightning And AnimateDiff In ComfyUI Workflow
Added 2024-03-07 13:24:41 +0000 UTCTutorial Video : https://youtu.be/0A8fWcjyAAg
It document detailly how to create this workflow.
Feel free to ask if you have any question.
*** For use hsxl Temp. Motion model, remember to set the Context Option to 8, by default it is 16.
Update :
Since Stable Diffusion never release a official set of ControlNet, and all CN models are trained by helpful individuals.
So here's a list of SDXL ControlNet that you can try it out. SDXL ControlNet: https://huggingface.co/collections/diffusers/sdxl-controlnets-64f9c35846f3f06f5abe351f https://huggingface.co/TTPlanet/TTPLanet_SDXL_Controlnet_Tile_Realistic_V1/tree/main https://huggingface.co/thibaud https://huggingface.co/lllyasviel https://huggingface.co/bdsqlsz/qinglong_controlnet-lllite
Comments
It doesn't support SDXL, unfortunately. The author just train in SD 1.5.
Benjamin Law
2024-03-28 16:35:37 +0000 UTCHi! Nice workflow, I don't find the detph anything model for xl, can you please share the link?
Flavio
2024-03-28 16:34:46 +0000 UTCHi, https://i.imgur.com/PqA1YtD.png This one show you need to put the right values in the Reactor node. As I saw the second one which is a failed update. Thats why it is missing some values from the lastest update version of ReActor. Please check the Comand Prompt Windows error message, it show the detail whats wrong with it.
Benjamin Law
2024-03-11 05:58:49 +0000 UTCCan you help me, I'm having these errors and I can't fix them. https://i.imgur.com/PqA1YtD.png https://i.imgur.com/82eqheq.png
Andres Eduardo Damonte
2024-03-11 03:10:58 +0000 UTCHi, I have face this issue before. What I did , I was lower the image resolution down 512 x 960 or 960 x 512px. Then the sampler run normal. Therefore , I put an upscaler at the end .
Benjamin Law
2024-03-07 21:33:40 +0000 UTCThank you for your very good workflows and explanations about this. But same issue here. 1. Sampler frozen. No green progress bar visible. VRAM 98%, GPU 100%, CPU 3%.
Andreas Stegemann
2024-03-07 21:23:57 +0000 UTCno problem :) But when I saw that, it feels like really weird because A100 man, it shouldn't take that long. Maybe you can test it step by step, try 1 Sampling group , and disable other Sampling and Detailer first. And also see if the ControlNet model you are using.
Benjamin Law
2024-03-07 15:12:58 +0000 UTCI think I'm making a mistake somewhere but I haven't figured it out yet. I will watch the video again and try to find it. Thank you for the fast response.
bw
2024-03-07 15:09:47 +0000 UTCCPU ? using SDXL Lightning take too much time ? you see my command prompt, I use a 4090 , about 1 -2 mins for 60 frames only. See the video.
Benjamin Law
2024-03-07 15:03:28 +0000 UTCHi Benji, I was trying this workflow, it looks great. You've done great job one more time. But, it is using too much CPU on 1st Sampling and 0 GPU usage. Also, it takes about 30 minutes to complete with single A100. I couldn't find where I made a mistake. Do you have any advice? Thanks a lot.
bw
2024-03-07 14:54:39 +0000 UTC
