awesome-llm-tools
  
  
    Large Language Model Frameworks curated List 
    https://github.com/dr-saad-la/awesome-llm-tools
  
        Last synced: about 5 hours ago 
        JSON representation
    
- 
            
🔓 Open Source Models
- 
                    
**Meta's Llama Family** ⭐⭐⭐⭐⭐ 💰
 - 
                    
**Microsoft's Small Giants**
 - 
                    
**Specialized Models**
 - 
                    
**European Excellence**
 
 - 
                    
 - 
            
💻 Local Deployment Tools
- 
                    
**Desktop Applications**
 - 
                    
**Server Deployment & High-Performance Inference**
 
 - 
                    
 - 
            
🏢 Commercial LLM APIs
- 
                    
**Tier 1: Leading Providers**
 - 
                    
**Tier 2: Specialized & Emerging**
 
 - 
                    
 - 
            
🛠️ Development Frameworks
- 
                    
**High-Level Application Frameworks**
 - 
                    
**Low-Level Libraries**
 
 - 
                    
 - 
            
🗂️ Vector Databases & RAG
 - 
            
🤖 Agent Frameworks & Multi-Agent Systems
- 
                    
**Advanced Agent Orchestration**
 
 - 
                    
 - 
            
🧠 Structured Generation & Control
- 
                    
**Output Structure & Validation**
 
 - 
                    
 - 
            
🤝 Contributing
 - 
            
🧐 Memory & Persistence
 - 
            
🎙️ Voice & Audio Tools
- 
                    
**Speech-to-Text & Text-to-Speech**
 
 - 
                    
 - 
            
💻 Code-Focused LLM Tools
 - 
            
🌐 Self-hosted & Local Platforms
- 
                    
**Complete LLM Platforms**
 
 - 
                    
 - 
            
🔄 Visual Workflow Builders
 - 
            
📊 LLM Gateway & Operations
- 
                    
**LLM Infrastructure & Management**
 
 - 
                    
 - 
            
🔬 Research & Evaluation Tools
- 
                    
**Academic & Research Platforms**
 
 - 
                    
 - 
            
🎨 Multimodal & Specialized Models
- 
                    
**Vision-Language Models**
 
 - 
                    
 - 
            
🔗 Integration & Utility Tools
- 
                    
**Connectors & Utilities**
 
 - 
                    
 - 
            
📱 Mobile & Edge Deployment
 - 
            
📄 License
- 
                    
**Recognition**
 - 
                    
⭐ Star Growth
- ![Star History Chart - history.com/#dr-saad-la/awesome-llm-tools&Date)
 - ![Star History Chart - history.com/#dr-saad-la/awesome-llm-tools&Date)
 
 
 - 
                    
 
            Programming Languages
          
          
        
            Categories
          
          
              
                💻 Local Deployment Tools
                15
              
              
                🏢 Commercial LLM APIs
                13
              
              
                🗂️ Vector Databases & RAG
                13
              
              
                🔓 Open Source Models
                11
              
              
                🤖 Agent Frameworks & Multi-Agent Systems
                10
              
              
                🧠 Structured Generation & Control
                9
              
              
                🛠️ Development Frameworks
                9
              
              
                🔄 Visual Workflow Builders
                8
              
              
                🌐 Self-hosted & Local Platforms
                8
              
              
                🔬 Research & Evaluation Tools
                8
              
              
                🎙️ Voice & Audio Tools
                8
              
              
                📄 License
                6
              
              
                📊 LLM Gateway & Operations
                6
              
              
                🎨 Multimodal & Specialized Models
                6
              
              
                💻 Code-Focused LLM Tools
                5
              
              
                🔗 Integration & Utility Tools
                4
              
              
                📱 Mobile & Edge Deployment
                4
              
              
                🧐 Memory & Persistence
                4
              
              
                🤝 Contributing
                2
              
          
        
            Sub Categories
          
          
              
                **Vector Databases**
                11
              
              
                **Advanced Agent Orchestration**
                10
              
              
                **Server Deployment & High-Performance Inference**
                10
              
              
                **Output Structure & Validation**
                9
              
              
                **No-Code/Low-Code LLM Apps**
                8
              
              
                **Speech-to-Text & Text-to-Speech**
                8
              
              
                **Academic & Research Platforms**
                8
              
              
                **Tier 2: Specialized & Emerging**
                8
              
              
                **Complete LLM Platforms**
                8
              
              
                **High-Level Application Frameworks**
                7
              
              
                **Specialized Models**
                6
              
              
                **Vision-Language Models**
                6
              
              
                **LLM Infrastructure & Management**
                6
              
              
                **IDE Extensions & Code Assistants**
                5
              
              
                **Tier 1: Leading Providers**
                5
              
              
                **Desktop Applications**
                5
              
              
                **Mobile LLM Solutions**
                4
              
              
                **Connectors & Utilities**
                4
              
              
                **Long-term Memory Systems**
                4
              
              
                **Recognition**
                4
              
              
                ⭐ Star Growth
                2
              
              
                **How to Add a Tool**
                2
              
              
                **RAG Enhancement Tools**
                2
              
              
                **Low-Level Libraries**
                2
              
              
                **Microsoft's Small Giants**
                2
              
              
                **European Excellence**
                2
              
              
                **Meta's Llama Family** ⭐⭐⭐⭐⭐ 💰
                1
              
          
        
            Keywords
          
          
              
                llm
                28
              
              
                openai
                26
              
              
                ai
                18
              
              
                chatgpt
                14
              
              
                gpt
                14
              
              
                large-language-models
                12
              
              
                llmops
                10
              
              
                gpt-4
                10
              
              
                python
                10
              
              
                rag
                10
              
              
                deep-learning
                8
              
              
                agent
                8
              
              
                langchain
                8
              
              
                anthropic
                6
              
              
                chatbot
                6
              
              
                agi
                6
              
              
                multimodal
                6
              
              
                vector-database
                6
              
              
                generative-ai
                6
              
              
                nextjs
                6
              
              
                transformer
                6
              
              
                language-model
                6
              
              
                pytorch
                6
              
              
                artificial-intelligence
                6
              
              
                gpt-3
                4
              
              
                inference
                4
              
              
                agents
                4
              
              
                deepseek
                4
              
              
                open-source
                4
              
              
                llama-index
                4
              
              
                nlp
                4
              
              
                prompt-engineering
                4
              
              
                llama
                4
              
              
                react
                4
              
              
                ai-agents
                4
              
              
                evaluation
                4
              
              
                llama3
                4
              
              
                gemini
                4
              
              
                foundation-models
                4
              
              
                webui
                4
              
              
                copilot
                4
              
              
                text-to-speech
                2
              
              
                application
                2
              
              
                tacotron
                2
              
              
                aiagent
                2
              
              
                foundation-model
                2
              
              
                tts
                2
              
              
                superagi
                2
              
              
                tts-model
                2
              
              
                pinecone
                2