https://github.com/chaosaiart/Chaosaiart-Nodes

Use AI to Animate - ComfyUI Custom Nodes include IMG Caches, Switches, Prompt & Checkpoint changer...
https://github.com/chaosaiart/Chaosaiart-Nodes

ai animation comfyui comfyui-nodes comfyui-workflow stable-diffusion

Last synced: 2 months ago
JSON representation

Use AI to Animate - ComfyUI Custom Nodes include IMG Caches, Switches, Prompt & Checkpoint changer...

• Host: GitHub
• URL: https://github.com/chaosaiart/Chaosaiart-Nodes
• Owner: chaosaiart
• Created: 2024-03-24T13:09:56.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-12T20:31:35.000Z (about 1 year ago)
• Last Synced: 2024-09-13T10:15:57.086Z (about 1 year ago)
• Topics: ai, animation, comfyui, comfyui-nodes, comfyui-workflow, stable-diffusion
• Language: Python
• Homepage: https://chaosaiart.de/nodes/
• Size: 405 KB
• Stars: 54
• Watchers: 3
• Forks: 9
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-comfyui - **Chaosaiart-Nodes** - img2video - video2video , Frame by Frame, compatible with LowVRAM GPUs (Workflows (3360) sorted by GitHub Stars)
• awesome-comfyui - **Chaosaiart-Nodes** - img2video - video2video , Frame by Frame, compatible with LowVRAM GPUs (All Workflows Sorted by GitHub Stars)
• awesome-comfyui - **Chaosaiart-Nodes** - img2video - video2video , Frame by Frame, compatible with LowVRAM GPUs (Workflows (3088) sorted by GitHub Stars)

README

          



 






 

  

  

  

  

 






   




 

  

  

  





   

  

  





 

  

     


    LowVRAM Animation


 

     


     


    
 

        

        

    




    

         




     


    


        

        

        

    




     




     


    Work in Progress. 

    



    
  

     


    Simplified workflow, VAE inclusion in KSampler


    Workflow automation, e.g., changing checkpoints


    Logical process for testing elements like Controlnet


    Rethinking workflows with switches


 

     


    This node is based on frame-to-frame generation (img after img).


    This means it is VRAM efficient and suitable for GPUs with low VRAM.



    Additional: Chaosaiart-Node is in the early phase, 
more nodes will be added + Bug fixes + changes.











 



 




 

   

  

  



     




 

 

 








  


    


      
  

      1. Install ComfyUI


      2. Download Chaosaiart-Nodes


      3. Unzip Chaosaiart-Nodes with 7zip


      4. Grab the Unzipped "Chaosaiart-Nodes" folder


      5. go into ComfyUI Folder, then "../comfyUI/custom_nodes/" place it in.
 

      



      6. Windows:

      


      


Use the Install_windows file in the "Chaosaiart-Nodes" folder


      
      

      Linux:  


    pip install opencv-python & pip install tqdm

If you are using a virtual environment (venv), make sure it is activated before installation. 




 


 

Open ComfyUI, Load or Drag & Drop one of the workflows.    

     









  





  












  


    


      
   

      1. Install ComfyUI


      2. Install ComfyUI Manager


      3. Open Manager, Use "Install via Git URL".


      4. Command:

      

    https://github.com/chaosaiart/Chaosaiart-Nodes




 

Open ComfyUI, Load or Drag & Drop one of the workflows.    

      













  


 

   





 

  

   

   

    

 






  







  


    


      


      

      
  

        

        

        

      

      
  

        

        

        

      

      
  

        

        

         

      

      
  

        

         

         

      

      
  

         

         

         

      

      

      



      
 

      


      Change Checkpoint, you can specify when.


      1x Frame = 1x generated Img / Batch


      


      




        

       

      

      

      



      

      
 

      


      Change Prompt, you can specify when.


      1x Frame = 1x generated Img / Batch


      


      


 

      

      

      

      



      
 

      
 

      


      Change Checkpoint & Prompt, you can specify when.


      1x Frame = 1x generated Img / Batch


      


      


 

      

      

      

      



      

      
 

      


      Basic img2img Batch Loader


      Select folder, Each generation uses the next image.


      You also can Repeat Img.


      


      


 

      

      


      Basic Controlnet Batch Loader


      Select folder, Each generation uses the next image.


      You also can Repeat Img.


      


      


 

      

      

      

      



      
 

      
 

      


      Splitt Video in to Frames / img 

      
  

      


 

      

      

      

      



      

      
 

      


      Stitching Image to Video

      
  

      


 

      



 

      Stitching Image to Gif 

      
  

      


 

      

      

      

      

  

      

      
 

      


      First Step for Animation


      Cache a Img for the next generate, in this Case Img2img. 

      My Promptchanger workflow has been implemented. Prompt Changer
 

      
  

      


 

      

      

      

      



      

      
 

      


      Change Controlnet Settings by Counting.


      1x Frame = 1x generated Img / Batch = Step


      You will need Canny Model

      


      


 

      

      

      

      



      

      
 

      


      Save and Load your Prompt + Simple Workflow.


      For Loading & Saving Text you need to Install this Custom Node

      


      


 

      

      

      

      



      

      
 

      


      Using Any-Switch to control any input at any time.

      


      


 

      

      

      

      



      

      
 

      


      Utilize arrays to enhance the organization of your workspace, or swiftly switch between processes to test things.

      


      


 

      

      

      

      



      

      
 

      


      idrirap has written a great Lora Auto-Trigger-Words Custom Node. Through this, I found out that all tags are included in the metadata. From now on, all tags and their frequency of use will be output by Lora via Info.

      



      How to Use Loras:


      


      


 

      

      

      

      



      

      
 

      


      usable in all 🔶Chaosaiart prompt fields. 

      


      
 

      
 

      

      

      

      



      



      


      
 

      


      Change Contrast, Color, Brightness, Red, Green, Blue.

      


      
 

      


 

      
 

      

      

      

      



      

      


      
 

      


      Change Contrast, Color, Brightness, Red, Green, Blue.

      


      
 

      


 

      
 

      

      



      




        

  



  







  


    


      


      
  

         

         

      
 

      

      



        

      


      Animation:
 

        This workflow has integrated the cache of the Cache Workflow in KSampler. 


        Additionally, KSampler has been modified to yield better results for animations.
 

        For example, the method "Fixed 0.5" has been optimized for checkpoint sd1.5.


        Afterwards, you must stitch the images into a video using img2video Basic Workflow 

       

      
 

      


 

      

      

      



      

      


      Same workflow as txt2video, but with image input.

      

      


 

      

      
 

       






      

  



 




  







  


    


      


      
  

          

      

      

      



        

      


       In this workflow, the 🔶 Ksampler txt & img2video v1 has been dissected into its individual components.
 This allows you to see what it consists of and enables you to adjust the values yourselves.

       

      
 

      


 

      



  







 







 




    

  

  🔶 Image 

  
 

  

  



   

  

  🔶 Ksampler 

  

  
 

  

  

  

  



   

  

  🔶 Cache 

  

  
 

  

  

  



   

  

  🔶 Logic 

   

  
 

  



   

  

  🔶 Prompt 

   

  
 

  

  



   

  

  🔶 Checkpoint

   

  
 

  

  

  



   

  

  🔶 Lora

   

  
 

  



   

  

  🔶 Controlnet

   

  
 

  



   

  

  🔶 Special

   

  
 

  



  

  

  🔶 Switch

   

  
 

  

  



 






















Open Buymeacoffee











Open Paypal













Open Patreon





























Credits to pythongosssss for their custom node without it, my info display would have been more challenging.


Credits to Idrirap for their custom node and the idea of extracting tags from the metadata of Lora. 













https://chaosaiart.de &

https://chaosaiart.com