{"id":23233366,"url":"https://github.com/if-ai/ComfyUI-IF_AI_tools","last_synced_at":"2025-08-19T18:31:52.705Z","repository":{"id":227247898,"uuid":"770876408","full_name":"if-ai/ComfyUI-IF_AI_tools","owner":"if-ai","description":"ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.","archived":false,"fork":false,"pushed_at":"2024-12-14T11:57:54.000Z","size":18683,"stargazers_count":547,"open_issues_count":41,"forks_count":43,"subscribers_count":8,"default_branch":"main","last_synced_at":"2024-12-14T17:02:28.674Z","etag":null,"topics":["anthropic","comfyui","flux","gemini","graphrag","groq","koboldcpp","llamacpp","lmstudio","mistral","ocr","ollama","omost","rag","stable-diffusion","supervision","textgeneration","transformers","xai"],"latest_commit_sha":null,"homepage":"https://ko-fi.com/impactframes","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/if-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":"ImpactFrames","patreon":"ImpactFrames","ko_fi":"impactframes"}},"created_at":"2024-03-12T10:14:54.000Z","updated_at":"2024-12-14T11:57:58.000Z","dependencies_parsed_at":"2024-06-02T23:43:37.779Z","dependency_job_id":"8195756b-6f45-43e9-b434-2eaf60675747","html_url":"https://github.com/if-ai/ComfyUI-IF_AI_tools","commit_stats":null,"previous_names":["if-ai/comfyui-if_ai_tools","if-ai/comfyui_if_ai_tools"],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/if-ai%2FComfyUI-IF_AI_tools","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/if-ai%2FComfyUI-IF_AI_tools/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/if-ai%2FComfyUI-IF_AI_tools/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/if-ai%2FComfyUI-IF_AI_tools/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/if-ai","download_url":"https://codeload.github.com/if-ai/ComfyUI-IF_AI_tools/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":230367780,"owners_count":18215325,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anthropic","comfyui","flux","gemini","graphrag","groq","koboldcpp","llamacpp","lmstudio","mistral","ocr","ollama","omost","rag","stable-diffusion","supervision","textgeneration","transformers","xai"],"created_at":"2024-12-19T03:01:27.385Z","updated_at":"2024-12-19T03:01:46.631Z","avatar_url":"https://github.com/if-ai.png","language":"Python","funding_links":["https://github.com/sponsors/ImpactFrames","https://patreon.com/ImpactFrames","https://ko-fi.com/impactframes"],"categories":["Workflows (3120) sorted by GitHub Stars","All Workflows Sorted by GitHub Stars","⭐ Community Favorites \u0026 Top Repos"],"sub_categories":["🎭 Specialized Extensions"],"readme":"[![ComfyUI-IF_AI_tools](https://img.youtube.com/vi/QAnapTWnawU/0.jpg)](https://youtu.be/QAnapTWnawU?si=Uomv_NXT2n2Mg9rG)\r\n\r\n# ComfyUI-IF_AI_tools\r\n\r\nComfyUI-IF_AI_tools is a set of custom nodes to Run Local and API LLMs and LMMs, Features OCR-RAG (Bialdy), nanoGraphRAG, Supervision Object Detection, supports Ollama, LlamaCPP LMstudio, Koboldcpp, TextGen, Transformers or via APIs Anthropic, Groq, OpenAI, Google Gemini, Mistral, xAI and create your own charcters assistants (SystemPrompts) with custom presets and muchmore\r\n\r\n################# ATENTION ####################\r\n\r\n   ** I am Moving the prompt generation to this new node PromptImaGen\r\n    https://github.com/if-ai/ComfyUI-IF_AI_PromptImaGen/tree/main\r\n    You will need to uninstall or disable this repo to use the PromptImaGen **\r\n   \r\n###############################################\r\n# Prerequisite Installation (Poppler)\r\n\r\nTo ensure compatibility and functionality with all tools, you may need `poppler` for PDF-related operations. Use `scoop` to install `poppler` on Windows:\r\n\r\n### Step 1: Install `scoop` (if not already installed)\r\nIf you haven't installed `scoop` yet, run the following command in **PowerShell**:\r\n\r\n```powershell\r\niwr -useb get.scoop.sh | iex\r\n```\r\nStep 2: Install poppler with scoop\r\nOnce scoop is installed, you can install poppler by running:\r\n\r\nwindows 10+ istall scoop and then \r\n```powershell\r\nscoop install poppler\r\n```\r\nDebian/Ubuntu\r\n```bash\r\nsudo apt-get install poppler-utils\r\n```\r\nMacOS\r\n```bash\r\nbrew install poppler\r\n```\r\n\r\ncheck is working\r\n```powershell\r\npdftotext -v\r\n```\r\n\r\n### Install Ollama\r\n\r\nYou can technically use any LLM API that you want, but for the best expirience install Ollama and set it up.\r\n- Visit [ollama.com](https://ollama.com) for more information.\r\n\r\nTo install Ollama models just open CMD or any terminal and type the run command follow by the model name such as\r\n```powershell\r\nollama run llama3.2-vision\r\n```\r\nIf you want to use omost \r\n```bash\r\nollama run impactframes/dolphin_llama3_omost\r\n```\r\nif you need a good smol model\r\n```bash\r\nollama run ollama run llama3.2\r\n```\r\n\r\nOptionally Set enviromnet variables for any of your favourite LLM API keys \"XAI_API_KEY\", \"GOOGLE_API_KEY\", \"ANTHROPIC_API_KEY\", \"MISTRAL_API_KEY\", \"OPENAI_API_KEY\" or \"GROQ_API_KEY\" with those names or otherwise\r\nit won't pick it up you can also use .env file to store your keys\r\n\r\n## Features\r\n_[NEW]_ nanoGraphRAG, \r\n_[NEW]_ OCR-RAG ColPali \u0026 ColQwen (Bialdy), \r\n_[NEW]_ Supervision Object Detection Florence2   \r\n_[NEW]_ Endpoints xAI, Transformers,\r\n_[NEW]_ IF_Assistants System Prompts with Reasoning/Reflection/Reward Templates and custom presets\r\n\r\n- Gemini, Groq, Mistral, OpenAI, Anthropic, Google, xAI, Transformers, Koboldcpp, TextGen, LlamaCPP, LMstudio, Ollama \r\n- Omost_tool the first tool \r\n- Vision Models Haiku, Florence2\r\n- [Ollama-Omost]https://ollama.com/impactframes/dolphin_llama3_omost can be 2x to 3x faster than other Omost Models\r\nLLama3 and Phi3 IF_AI Prompt mkr models released\r\n![ComfyUI_00021_](https://github.com/if-ai/ComfyUI-IF_AI_tools/assets/21185218/fac9fb38-66ac-431b-8ef9-b0fee5d0e5dc)\r\n\r\n`ollama run impactframes/llama3_ifai_sd_prompt_mkr_q4km:latest`\r\n\r\n`ollama run impactframes/ifai_promptmkr_dolphin_phi3:latest`\r\n\r\nhttps://huggingface.co/impactframes/llama3_if_ai_sdpromptmkr_q4km\r\n\r\nhttps://huggingface.co/impactframes/ifai_promptmkr_dolphin_phi3_gguf\r\n\r\n\r\n## Installation\r\n1. Open the manager search for IF_AI_tools and install\r\n\r\n### Install ComfyUI-IF_AI_tools -hardest way\r\n   \r\n1. Navigate to your ComfyUI `custom_nodes` folder, type `CMD` on the address bar to open a command prompt,\r\n   and run the following command to clone the repository:\r\n   ```bash\r\n      git clone https://github.com/if-ai/ComfyUI-IF_AI_tools.git\r\n      ```\r\nOR\r\n1. In ComfyUI protable version just dounle click `embedded_install.bat` or  type `CMD` on the address bar on the newly created `custom_nodes\\ComfyUI-IF_AI_tools` folder type \r\n   ```bash\r\n      H:\\ComfyUI_windows_portable\\python_embeded\\python.exe -m pip install -r requirements.txt\r\n      ```\r\n   replace `C:\\` for your Drive letter where you have the ComfyUI_windows_portable directory\r\n\r\n2. On custom environment activate the environment and move to the newly created ComfyUI-IF_AI_tools\r\n   ```bash\r\n      cd ComfyUI-IF_AI_tools\r\n      python -m pip install -r requirements.txt\r\n      ```\r\n\r\n## Related Tools\r\n- [IF_prompt_MKR](https://github.com/if-ai/IF_prompt_MKR) \r\n-  A similar tool available for Stable Diffusion WebUI\r\n\r\n## Videos\r\nAIFuzz made a great video usining ollama and IF_AI tools \r\n\r\n[![AIFuzz](https://img.youtube.com/vi/nZx5g3TGsNc/0.jpg)](https://youtu.be/nZx5g3TGsNc?si=DFIqFuPoyKY1qJ2n)\r\n\r\nAlso Future thinker @ Benji Thankyou both for putting out this awesome videos\r\n\r\n[![Future Thinker @Benji](https://img.youtube.com/vi/EQZWyn9eCFE/0.jpg)](https://youtu.be/EQZWyn9eCFE?si=jgC28GL7bwFWj_sK)\r\n\r\n\r\n## Example using normal Model\r\nancient Megastructure, small lone figure \r\n'A dwarfed figure standing atop an ancient megastructure, worn stone towering overhead. Underneath the dim moonlight, intricate engravings adorn the crumbling walls. Overwhelmed by the sheer size and age of the structure, the small figure appears lost amidst the weathered stone behemoth. The background reveals a dark landscape, dotted with faint twinkles from other ancient structures, scattered across the horizon. The silent air is only filled with the soft echoes of distant whispers, carrying secrets of times long past. ethereal-fantasy-concept-art, magical-ambiance, magnificent, celestial, ethereal-lighting, painterly, epic, majestic, dreamy-atmosphere, otherworldly, mystic-elements, surreal, immersive-detail'\r\n![_IF_prompt_Mkr__00011_](https://github.com/if-ai/ComfyUI-IF_AI_tools/assets/21185218/08dde522-f541-49f4-aa6b-e0653f13aa52)\r\n![_IF_prompt_Mkr__00012_](https://github.com/if-ai/ComfyUI-IF_AI_tools/assets/21185218/ec3ef715-fbe6-4ba0-80f8-00bf10f56f7b)\r\n![_IF_prompt_Mkr__00010_](https://github.com/if-ai/ComfyUI-IF_AI_tools/assets/21185218/e4dc671b-8eea-47f3-84ef-876e5938e120)\r\n![_IF_prompt_Mkr__00014_](https://github.com/if-ai/ComfyUI-IF_AI_tools/assets/21185218/d0b436cd-c4a8-41a2-83ad-34d8c50bb39b)\r\n\r\n## TODO\r\n- [ ] Fix Bugs and make it work on latest ComfyUI\r\n- [ ] Fix Graph Visualizer Node\r\n- [ ] Tweak IF_Assistants and Templates\r\n- [ ] FrontEnd for IF_Assistants and Chat \r\n- [ ] Node and workflow creator\r\n- [ ] two additional Endpoints one API and one Local\r\n- [ ] Add New workflows\r\n- [ ] Image Generation, Text 2 Image, Image to Image, Video Generation\r\n\r\n## Support\r\nIf you find this tool useful, please consider supporting my work by:\r\n- Starring the repository on GitHub: [ComfyUI-IF_AI_tools](https://github.com/if-ai/ComfyUI-IF_AI_tools)\r\n- Subscribing to my YouTube channel: [Impact Frames](https://youtube.com/@impactframes?si=DrBu3tOAC2-YbEvc)\r\n- Follow me on X: [Impact Frames X](https://x.com/impactframesX)\r\n- Supporting me on Ko-fi: [Impact Frames Ko-fi](https://ko-fi.com/impactframes)\r\n- Becoming a patron on Patreon: [Impact Frames Patreon](https://patreon.com/ImpactFrames)\r\nThank You!\r\n\r\n\u003cimg src=\"https://count.getloli.com/get/@IFAItools_comfy?theme=moebooru\" alt=\":IFAItools_comfy\" /\u003e\r\n\r\n\r\n\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fif-ai%2FComfyUI-IF_AI_tools","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fif-ai%2FComfyUI-IF_AI_tools","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fif-ai%2FComfyUI-IF_AI_tools/lists"}