SakeTami
Innovate Futures @ Benji
Innovate Futures @ Benji

patreon


RAVE AnimateDiff Animation Workflow Available in OpenArt

For anyone who are join as free members here, you can try this workflow in OpenArt:

https://openart.ai/workflows/AaH6b9J8oDPHmYenNJtS 


This workflow use RAVE , AnimateDiff

RAVE: https://rave-video.github.io/

RAVE allows you to unleash your imagination and bring your wildest ideas to life. With just a few simple text prompts, you can completely change the style, theme, and even the characters in your videos. Imagine transforming a girl doing exercise into a firefighter or morphing a car into a truck, train, or fire truck.

By combining the power of RAVE and Animate Diff, you can achieve stunning visual effects and enhance the overall impact of your videos.

Wolkthrough Of This Workflow : https://www.youtube.com/watch?v=2kCs6MglK70

----------------------------------------------------------------------------

Also you need , AnimateDiff :  https://animatediff.github.io/

----------------------------------------------------------------------------

ComfyUI RAVE Required Nodes:

https://github.com/spacepxl/ComfyUI-RAVE/tree/main

https://github.com/BlenderNeko/ComfyUI_Noise

----------------------------------------------------------------------------

Other Nodes We need:

ComfyUI-KJNodes(For Get Set Nodes)

***You need this to connection each nodes , you have to search "KJNodes" in ComfyUI Manager to download it

or get it in here : https://github.com/kijai/ComfyUI-KJNodes

----------------------------------------------------------------------------

ControlNet (copy in models/controlnet folder)

Depth: can be downloaded from ComfyUI manager

AnimateDiff Motion ControlNet : https://huggingface.co/crishhh/animatediff_controlnet/tree/main

Animatediff Motion Models: https://huggingface.co/guoyww/animatediff/tree/main

----------------------------------------------------------------------------

System Requirement

Min. Requirement : 15GB VRAM

Best number of frame range: 60-200 frames per each generation

Suggestted Frames Width And Height : 512, 560 , 980, 960, 920 px.  (Do not try to run HD or 4K resolution in the LoadVideo. It will burn your computer memory in a second)

Suggestted ControlNet : Depth , DWPose, LineArt, Animate ControlNet.

----------------------------------------------------------------------------

If you do not have high end graphic card, I suggest you run this in OpenArt A10 cloud server.

I have not try other ComfyUI supported cloud server, so I cannot answer you about other company cloud servers.

----------------------------------------------------------------------------

P.S: Thank you for some supporters join into my Patreon. But some people are trying to game the system subscribe and cancel at the same day, and that cause the Patreon fraud detection system mark your action as suspicious activity. Their fraud detection system are going to block this automatically.  When you try something shady on a system, then don't come here to blame me , try to leave a comment to bad mouth about it.  I am just try to focus on making workflow, improve things and publish on public share with like minded people.  I have no time to see every people joining in my Patreon activities.

Comments

would love if you did more on this

ryanontheinside

(high ceiling), (Gothic style) ,dark mansion, candle, (Windows frame)

Benjamin Law

What were the prompts you used for the other backgrounds (besides the beach one that's included in the current .json)?

Peter C


More Creators