https://github.com/dylanhogg/awesome-python
π Hand-picked awesome Python libraries and frameworks, organised by category
https://github.com/dylanhogg/awesome-python
List: awesome-python
awesome awesome-list awesome-python chatgpt data data-science deep-learning jupyter machine-learning natural-language-processing nlp open-source pandas python python-library
Last synced: 10 months ago
JSON representation
π Hand-picked awesome Python libraries and frameworks, organised by category
- Host: GitHub
- URL: https://github.com/dylanhogg/awesome-python
- Owner: dylanhogg
- License: mit
- Created: 2020-06-20T09:36:39.000Z (about 6 years ago)
- Default Branch: main
- Last Pushed: 2024-05-05T09:48:36.000Z (about 2 years ago)
- Last Synced: 2024-05-23T02:00:38.890Z (about 2 years ago)
- Topics: awesome, awesome-list, awesome-python, chatgpt, data, data-science, deep-learning, jupyter, machine-learning, natural-language-processing, nlp, open-source, pandas, python, python-library
- Homepage: https://www.awesomepython.org
- Size: 63.2 MB
- Stars: 258
- Watchers: 11
- Forks: 20
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- stargazer - dylanhogg/awesome-python - π Hand-picked awesome Python libraries and frameworks, organised by category \[*MIT License*\] (βοΈ467) (Unknown)
- ultimate-awesome - awesome-python - π Hand-picked awesome Python libraries and frameworks, organised by category. (Other Lists / TeX Lists)
- awesome-ChatGPT-repositories - awesome-python - π Hand-picked awesome Python libraries and frameworks, organised by category (Awesome-lists)
README
# Awesome Python
[](https://awesome.re)  [](https://opensource.org/licenses/MIT)
Hand-picked awesome Python libraries and frameworks, organised by category π
Interactive version: [www.awesomepython.org](https://www.awesomepython.org/)
Updated 28 Sep 2025
## Categories
- [Newly Created Repositories](#newly-created-repositories) - Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here (10 repos)
- [Agentic AI](#agentic-ai) - Agentic AI libraries, frameworks and tools: AI agents, workflows, autonomous decision-making, goal-oriented tasks, and API integrations (103 repos)
- [Code Quality](#code-quality) - Code quality tooling: linters, formatters, pre-commit hooks, unused code removal (17 repos)
- [Crypto and Blockchain](#crypto-and-blockchain) - Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity (14 repos)
- [Data](#data) - General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks (118 repos)
- [Debugging](#debugging) - Debugging and tracing tools (9 repos)
- [Diffusion Text to Image](#diffusion-text-to-image) - Text-to-image diffusion model libraries, tools and apps for generating images from natural language (43 repos)
- [Finance](#finance) - Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives (36 repos)
- [Game Development](#game-development) - Game development tools, engines and libraries (8 repos)
- [GIS](#gis) - Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections (29 repos)
- [Graph](#graph) - Graphs and network libraries: network analysis, graph machine learning, visualisation (6 repos)
- [GUI](#gui) - Graphical user interface libraries and toolkits (8 repos)
- [Jupyter](#jupyter) - Jupyter and JupyterLab and Notebook tools, libraries and plugins (28 repos)
- [LLMs and ChatGPT](#llms-and-chatgpt) - Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover (346 repos)
- [Math and Science](#math-and-science) - Mathematical, numerical and scientific libraries (28 repos)
- [Machine Learning - General](#machine-learning---general) - General and classical machine learning libraries. See below for other sections covering specialised ML areas (172 repos)
- [Machine Learning - Deep Learning](#machine-learning---deep-learning) - Machine learning libraries that cross over with deep learning in some way (78 repos)
- [Machine Learning - Interpretability](#machine-learning---interpretability) - Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training (27 repos)
- [Machine Learning - Ops](#machine-learning---ops) - MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models (49 repos)
- [Machine Learning - Reinforcement](#machine-learning---reinforcement) - Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF (23 repos)
- [Machine Learning - Time Series](#machine-learning---time-series) - Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics (21 repos)
- [Natural Language Processing](#natural-language-processing) - Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover (89 repos)
- [Packaging](#packaging) - Python packaging, dependency management and bundling (27 repos)
- [Pandas](#pandas) - Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations (25 repos)
- [Performance](#performance) - Performance, parallelisation and low level libraries (28 repos)
- [Profiling](#profiling) - Memory and CPU/GPU profiling tools and libraries (11 repos)
- [Security](#security) - Security related libraries: vulnerability discovery, SQL injection, environment auditing (16 repos)
- [Simulation](#simulation) - Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover (42 repos)
- [Study](#study) - Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials (67 repos)
- [Template](#template) - Template tools and libraries: cookiecutter repos, generators, quick-starts (11 repos)
- [Terminal](#terminal) - Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars (21 repos)
- [Testing](#testing) - Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins (24 repos)
- [Typing](#typing) - Typing libraries: static and run-time type checking, annotations (15 repos)
- [Utility](#utility) - General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools (216 repos)
- [Vizualisation](#vizualisation) - Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL (37 repos)
- [Web](#web) - Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management (60 repos)
## Newly Created Repositories
Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here.
1. tencentcloudadp/youtu-agent β 3,157
A flexible, high-performance framework for building, running, and evaluating autonomous agents
π [tencentcloudadp.github.io/youtu-agent](https://tencentcloudadp.github.io/youtu-agent/)
2. github/spec-kit β 2,670
Toolkit to help you get started with Spec-Driven Development: specifications become executable, directly generating working implementations
3. karpathy/rendergit β 1,732
Render any git repo into a single static HTML page for humans or LLMs
4. thinking-machines-lab/batch_invariant_ops β 746
Defeating Nondeterminism in LLM Inference: fixing floating-point non-associativity
5. run-llama/semtools β 723
Semantic search and document parsing tools for the command line
6. vllm-project/semantic-router β 680
An Mixture-of-Models router that directs OpenAI API requests to the most suitable models from a defined pool based on Semantic Understanding
π [vllm-semantic-router.com](https://vllm-semantic-router.com)
7. google-deepmind/limit β 557
On the Theoretical Limitations of Embedding-Based Retrieval
π [arxiv.org/abs/2508.21038](https://arxiv.org/abs/2508.21038)
8. ivebotunac/PrimoAgent β 208
PrimoAgent is an multi agent AI stock analysis system built on LangGraph architecture that orchestrates four specialized agents to provide comprehensive daily trading insights and next-day price predictions
π [primoinvesting.com](https://primoinvesting.com/)
9. apple/ml-l3m β 161
A flexible library for training any type of large model, regardless of modality. Instead of more traditional approaches, we opt for a config-heavy approach
10. agentscope-ai/agentscope-runtime β 98
AgentScope Runtime: secure sandboxed tool execution and scalable agent deployment
π [runtime.agentscope.io](https://runtime.agentscope.io/)
## Agentic AI
Agentic AI libraries, frameworks and tools: AI agents, workflows, autonomous decision-making, goal-oriented tasks, and API integrations.
1. langchain-ai/langchain β 111,211
π¦π Build context-aware reasoning applications
π [python.langchain.com](https://python.langchain.com)
2. langgenius/dify β 106,582
Production-ready platform for agentic workflow development.
π [dify.ai](https://dify.ai)
3. logspace-ai/langflow β 84,456
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
π [www.langflow.org](http://www.langflow.org)
4. browser-use/browser-use β 65,222
Browser use is the easiest way to connect your AI agents with the browser.
π [browser-use.com](https://browser-use.com)
5. geekan/MetaGPT β 57,123
π The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
π [mgx.dev](https://mgx.dev/)
6. microsoft/autogen β 47,125
AutoGen is a framework for creating multi-agent AI applications that can act autonomously or work alongside humans.
π [microsoft.github.io/autogen](https://microsoft.github.io/autogen/)
7. run-llama/llama_index β 43,023
LlamaIndex is the leading framework for building LLM-powered agents over your data.
π [docs.llamaindex.ai](https://docs.llamaindex.ai)
8. mem0ai/mem0 β 36,622
Enhances AI assistants and agents with an intelligent memory layer, enabling personalized AI interactions
π [mem0.ai](https://mem0.ai)
9. crewaiinc/crewAI β 34,041
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
π [crewai.com](https://crewai.com)
10. agno-agi/agno β 29,627
Full-stack framework for building Multi-Agent Systems with memory, knowledge and reasoning.
π [docs.agno.com](https://docs.agno.com)
11. openbmb/ChatDev β 27,134
ChatDev stands as a virtual software company that operates through various intelligent agents holding different roles, including Chief Executive Officer, Chief Product Officer etc
π [arxiv.org/abs/2307.07924](https://arxiv.org/abs/2307.07924)
12. stanford-oval/storm β 26,507
An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
π [storm.genie.stanford.edu](http://storm.genie.stanford.edu)
13. composiohq/composio β 25,556
Composio equips your AI agents & LLMs with 100+ high-quality integrations via function calling
π [docs.composio.dev](https://docs.composio.dev)
14. microsoft/OmniParser β 22,620
OmniParser is a comprehensive method for parsing user interface screenshots into structured and easy-to-understand elements
15. assafelovic/gpt-researcher β 22,287
LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
π [gptr.dev](https://gptr.dev)
16. yoheinakajima/babyagi β 21,635
GPT-4 powered task-driven autonomous agent
π [babyagi.org](https://babyagi.org/)
17. huggingface/smolagents β 21,121
π€ smolagents: a barebones library for agents that think in code.
π [huggingface.co/docs/smolagents](https://huggingface.co/docs/smolagents)
18. fosowl/agenticSeek β 20,487
A 100% local alternative to Manus AI, this voice-enabled AI assistant autonomously browses the web, writes code, and plans tasks while keeping all data on your device.
π [agenticseek.tech](http://agenticseek.tech)
19. openai/swarm β 20,078
A framework exploring ergonomic, lightweight multi-agent orchestration.
20. unity-technologies/ml-agents β 18,381
The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
π [unity.com/products/machine-learning-agents](https://unity.com/products/machine-learning-agents)
21. a2aproject/A2A β 18,227
An open protocol enabling communication and interoperability between opaque agentic applications.
π [a2aproject.github.io/a2a](https://a2aproject.github.io/A2A/)
22. camel-ai/owl β 17,424
π¦ OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation
23. letta-ai/letta β 17,246
Letta (formerly MemGPT) is a framework for creating LLM services with memory.
π [docs.letta.com](https://docs.letta.com/)
24. dzhng/deep-research β 16,977
An AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models.
25. langchain-ai/langgraph β 15,529
LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
π [langchain-ai.github.io/langgraph](https://langchain-ai.github.io/langgraph/)
26. google-gemini/gemini-fullstack-langgraph-quickstart β 15,479
Demonstrates a fullstack application using a React and LangGraph-powered backend agent. The agent is designed to perform comprehensive research on a user's query.
π [ai.google.dev/gemini-api/docs/google-search](https://ai.google.dev/gemini-api/docs/google-search)
27. bytedance/deer-flow β 15,067
DeerFlow is a community-driven Deep Research framework, combining language models with tools like web search, crawling, and Python execution, while contributing back to the open-source community.
π [deerflow.tech](https://deerflow.tech)
28. nirdiamant/GenAI_Agents β 14,307
Tutorials and implementations for various Generative AI Agent techniques, from basic to advanced. It serves as a comprehensive guide for building intelligent, interactive AI systems.
29. camel-ai/camel β 13,300
π« CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
π [docs.camel-ai.org](https://docs.camel-ai.org/)
30. openai/openai-agents-python β 12,497
A lightweight yet powerful framework for building multi-agent workflows. It is provider-agnostic, supporting the OpenAI Responses and Chat Completions APIs, as well as 100+ other LLMs.
π [openai.github.io/openai-agents-python](https://openai.github.io/openai-agents-python/)
31. smol-ai/developer β 12,072
the first library to let you embed a developer agent in your own app!
π [twitter.com/smolmodels](https://twitter.com/SmolModels)
32. sakanaai/AI-Scientist β 11,256
The AI Scientist, the first comprehensive system for fully automatic scientific discovery, enabling Foundation Models such as Large Language Models (LLMs) to perform research independently.
33. agentscope-ai/agentscope β 11,125
AgentScope: Agent-Oriented Programming for Building LLM Applications
π [doc.agentscope.io](https://doc.agentscope.io/)
34. google/adk-python β 10,817
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
π [google.github.io/adk-docs](https://google.github.io/adk-docs/)
35. pydantic/pydantic-ai β 10,726
PydanticAI is a Python Agent Framework designed to make it less painful to build production grade applications with Generative AI.
π [ai.pydantic.dev](https://ai.pydantic.dev)
36. asyncfuncai/deepwiki-open β 8,026
Custom implementation of DeepWiki, automatically creates beautiful, interactive wikis for any GitHub, GitLab, or BitBucket repository
37. meta-llama/llama-stack β 7,901
Llama Stack standardizes the building blocks needed to bring genai applications to market. These blocks cover model training and fine-tuning, evaluation, and running AI agents in production
π [llama-stack.readthedocs.io](https://llama-stack.readthedocs.io)
38. upsonic/Upsonic β 7,572
Upsonic is a reliability-focused framework designed for real-world applications. It enables trusted agent workflows in your organization through advanced reliability features, including verification layers, triangular architecture, validator agents, and output evaluation systems.
π [docs.upsonic.ai](https://docs.upsonic.ai)
39. microsoft/magentic-ui β 6,668
A prototype of a human-centered interface powered by a multi-agent system that can browse and perform actions on the web, generate and execute code
π [www.microsoft.com/en-us/research/blog/magentic-ui-an-experimental-human-centered-web-agent](https://www.microsoft.com/en-us/research/blog/magentic-ui-an-experimental-human-centered-web-agent/)
40. zilliztech/deep-searcher β 6,492
DeepSearcher combines reasoning LLMs and VectorDBs o perform search, evaluation, and reasoning based on private data, providing highly accurate answer and comprehensive report
π [zilliztech.github.io/deep-searcher](https://zilliztech.github.io/deep-searcher/)
41. awslabs/agent-squad β 6,230
Flexible, lightweight open-source framework for orchestrating multiple AI agents to handle complex conversations
π [awslabs.github.io/agent-squad](https://awslabs.github.io/agent-squad/)
42. mnotgod96/AppAgent β 5,997
AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
π [appagent-official.github.io](https://appagent-official.github.io/)
43. prefecthq/marvin β 5,808
an ambient intelligence library
π [marvin.mintlify.app](https://marvin.mintlify.app)
44. openai/openai-cs-agents-demo β 5,540
Demo of a Customer Service Agent interface built on top of the OpenAI Agents SDK
45. pyspur-dev/pyspur β 5,280
A visual playground for agentic workflows: Iterate over your agents 10x faster
π [pyspur.dev](https://pyspur.dev)
46. kyegomez/swarms β 5,003
The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai
π [docs.swarms.world](https://docs.swarms.world)
47. ag-ui-protocol/ag-ui β 4,972
AG-UI: the Agent-User Interaction Protocol. Bring Agents into Frontend Applications.
π [ag-ui.com](https://ag-ui.com)
48. landing-ai/vision-agent β 4,927
VisionAgent is a library that helps you utilize agent frameworks to generate code to solve your vision task
49. crewaiinc/crewAI-examples β 4,445
A collection of examples that show how to use CrewAI framework to automate workflows.
50. x-plug/MobileAgent β 4,445
Mobile-Agent: The Powerful Mobile Device Operation Assistant Family
π [arxiv.org/abs/2501.11733](https://arxiv.org/abs/2501.11733)
51. langchain-ai/open_deep_research β 4,304
Open Deep Research is an open source assistant that automates research and produces customizable reports on any topic
52. meta-llama/llama-stack-apps β 4,265
Agentic components of the Llama Stack APIs
53. brainblend-ai/atomic-agents β 4,143
Atomic Agents provides a set of tools and agents that can be combined to create powerful applications. It is built on top of Instructor and leverages the power of Pydantic for data and schema validation and serialization.
54. getzep/zep β 3,668
Zep is a memory platform for AI agents that learns from user interactions and business data
π [help.getzep.com](https://help.getzep.com)
55. langroid/langroid β 3,468
Harness LLMs with Multi-Agent Programming
π [langroid.github.io/langroid](https://langroid.github.io/langroid/)
56. rowboatlabs/rowboat β 3,307
AI-powered multi-agent builder
π [www.rowboatlabs.com](https://www.rowboatlabs.com)
57. joshuac215/agent-service-toolkit β 3,286
A full toolkit for running an AI agent service built with LangGraph, FastAPI and Streamlit.
π [agent-service-toolkit.streamlit.app](https://agent-service-toolkit.streamlit.app)
58. emcie-co/parlant β 3,281
LLM agents built for control. Designed for real-world use. Deployed in minutes.
π [www.parlant.io](https://www.parlant.io)
59. codelion/openevolve β 3,170
Evolutionary coding agent (like AlphaEvolve) enabling automated scientific and algorithmic discovery
60. tencentcloudadp/youtu-agent β 3,157
A flexible, high-performance framework for building, running, and evaluating autonomous agents
π [tencentcloudadp.github.io/youtu-agent](https://tencentcloudadp.github.io/youtu-agent/)
61. openmanus/OpenManus-RL β 3,157
OpenManus-RL is an open-source initiative collaboratively led by Ulab-UIUC and MetaGPT. This project is an extended version of the original OpenManus initiative.
62. ag2ai/ag2 β 2,983
AG2 (formerly AutoGen) is an open-source programming framework for building AI agents and facilitating cooperation among multiple agents to solve tasks.
π [ag2.ai](https://ag2.ai)
63. going-doer/Paper2Code β 2,886
A multi-agent LLM system that transforms paper into a code repository. It follows a three-stage pipeline: planning, analysis, and code generation, each handled by specialized agents.
64. facebookresearch/Pearl β 2,880
A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.
65. cheshire-cat-ai/core β 2,818
AI agent microservice
π [cheshirecat.ai](https://cheshirecat.ai)
66. github/spec-kit β 2,670
Toolkit to help you get started with Spec-Driven Development: specifications become executable, directly generating working implementations
67. i-am-bee/beeai-framework β 2,620
Build production-ready AI agents in both Python and Typescript.
π [framework.beeai.dev](http://framework.beeai.dev)
68. om-ai-lab/OmAgent β 2,524
OmAgent is python library for building multimodal language agents with ease. We try to keep the library simple without too much overhead like other agent framework.
π [om-agent.com](https://om-agent.com)
69. griptape-ai/griptape β 2,339
Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
π [www.griptape.ai](https://www.griptape.ai)
70. run-llama/llama_deploy β 2,035
Async-first framework for deploying, scaling, and productionizing agentic multi-service systems based on workflows from llama_index.
π [docs.llamaindex.ai/en/stable/module_guides/llama_deploy](https://docs.llamaindex.ai/en/stable/module_guides/llama_deploy/)
71. strands-agents/sdk-python β 1,997
A model-driven approach to building AI agents in just a few lines of code.
π [strandsagents.com](https://strandsagents.com)
72. btahir/open-deep-research β 1,993
Open source alternative to Gemini Deep Research. Generate reports with AI based on search results.
π [opendeepresearch.vercel.app](https://opendeepresearch.vercel.app)
73. langchain-ai/executive-ai-assistant β 1,909
Executive AI Assistant (EAIA) is an AI agent that attempts to do the job of an Executive Assistant (EA).
74. agentops-ai/AgentStack β 1,884
AgentStack scaffolds your agent stack - The tech stack that collectively is your agent
75. openautocoder/Agentless β 1,782
Agentlessπ±: an agentless approach to automatically solve software development problems
76. swe-agent/mini-swe-agent β 1,732
The 100 line AI agent that solves GitHub issues or helps you in your command line
π [mini-swe-agent.com](https://mini-swe-agent.com)
77. msoedov/agentic_security β 1,530
An open-source vulnerability scanner for Agent Workflows and LLMs. Protecting AI systems from jailbreaks, fuzzing, and multimodal attacks.
π [agentic-security.vercel.app](https://agentic-security.vercel.app)
78. weaviate/elysia β 1,434
Elysia is an agentic platform designed to use tools in a decision tree. A decision agent decides which tools to use dynamically based on its environment and context.
79. sakanaai/AI-Scientist-v2 β 1,427
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
80. link-agi/AutoAgents β 1,379
[IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.
π [huggingface.co/spaces/linksoul/autoagents](https://huggingface.co/spaces/LinkSoul/AutoAgents)
81. agentera/Agently β 1,377
Agently is a development framework that helps developers build AI agent native application really fast.
π [agently.tech](http://agently.tech)
82. shengranhu/ADAS β 1,369
Automated Design of Agentic Systems using Meta Agent Search to show agents can invent novel and powerful agent designs
π [www.shengranhu.com/adas](https://www.shengranhu.com/ADAS/)
83. prefecthq/ControlFlow β 1,339
ControlFlow provides a structured, developer-focused framework for defining workflows and delegating work to LLMs, without sacrificing control or transparency
π [controlflow.ai](https://controlflow.ai)
84. szczyglis-dev/py-gpt β 1,104
Desktop AI Assistant powered by o1, o3, GPT-4, Gemini, Claude, Ollama, DeepSeek, Grok, Bielik, chat, vision, voice control, image generation and analysis, agents, command execution, file upload/download, speech synthesis and recognition, access to Web, memory, presets, assistants, plugins, and more. Linux, Windows, Mac
π [pygpt.net](https://pygpt.net)
85. plurai-ai/intellagent β 1,084
Simulate interactions, analyze performance, and gain actionable insights for conversational agents. Test, evaluate, and optimize your agent to ensure reliable real-world deployment.
π [intellagent-doc.plurai.ai](https://intellagent-doc.plurai.ai/)
86. langchain-ai/langgraph-swarm-py β 1,024
A library for creating swarm-style multi-agent systems using LangGraph. A swarm is a type of multi-agent architecture where agents dynamically hand off control to one another based on their specializations
π [langchain-ai.github.io/langgraph/concepts/multi_agent](https://langchain-ai.github.io/langgraph/concepts/multi_agent/)
87. thudm/CogAgent β 994
An open-sourced end-to-end VLM-based GUI Agent
88. victordibia/autogen-ui β 950
Web UI for AutoGen (A Framework Multi-Agent LLM Applications)
89. humanlayer/humanlayer β 949
HumanLayer is an API and SDK that enables AI Agents to contact humans for help, feedback, and approvals.
π [humanlayer.dev](https://humanlayer.dev)
90. google-deepmind/concordia β 930
Concordia is a library to facilitate construction and use of generative agent-based models to simulate interactions of agents in grounded physical, social, or digital space.
91. thytu/Agentarium β 923
Framework for managing and orchestrating AI agents with ease. Agentarium provides a flexible and intuitive way to create, manage, and coordinate interactions between multiple AI agents in various environments.
92. strnad/CrewAI-Studio β 910
agentic,gui,automation
93. deedy/mac_computer_use β 808
A fork of Anthropic Computer Use that you can run on Mac computers to give Claude and other AI models autonomous access to your computer.
π [x.com/deedydas/status/1849481225041559910](https://x.com/deedydas/status/1849481225041559910)
94. vllm-project/semantic-router β 680
An Mixture-of-Models router that directs OpenAI API requests to the most suitable models from a defined pool based on Semantic Understanding
π [vllm-semantic-router.com](https://vllm-semantic-router.com)
95. salesforceairesearch/AgentLite β 611
AgentLite is a research-oriented library designed for building and advancing LLM-based task-oriented agent systems. It simplifies the implementation of new agent/multi-agent architectures, enabling easy orchestration of multiple agents through a manager agent.
96. codingmoh/open-codex β 577
Open Codex is a fully open-source command-line AI assistant inspired by OpenAI Codex, supporting local language models like phi-4-mini and full integration with Ollama.
97. jd-opensource/OxyGent β 552
OxyGent is a modular multi-agent framework that lets you build, deploy, and evolve AI teams
π [oxygent.jd.com](https://oxygent.jd.com)
98. quantalogic/quantalogic β 433
QuantaLogic is a ReAct (Reasoning & Action) framework for building advanced AI agents. The cli version include coding capabilities comparable to Aider.
99. bytedance-seed/m3-agent β 344
Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory
100. sakanaai/AI-Scientist-ICLR2025-Workshop-Experiment β 262
A paper produced by The AI Scientist passed a peer-review process at a workshop in a top machine learning conference
101. prithivirajdamodaran/Route0x β 105
A production-grade query routing solution, leveraging LLMs while optimizing for cost per query
102. agentscope-ai/agentscope-runtime β 98
AgentScope Runtime: secure sandboxed tool execution and scalable agent deployment
π [runtime.agentscope.io](https://runtime.agentscope.io/)
103. mannaandpoem/OpenManus β 30
Open source version of Manus, the general AI agent
## Code Quality
Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.
1. astral-sh/ruff β 40,712
An extremely fast Python linter and code formatter, written in Rust.
π [docs.astral.sh/ruff](https://docs.astral.sh/ruff)
2. psf/black β 40,483
The uncompromising Python code formatter
π [black.readthedocs.io/en/stable](https://black.readthedocs.io/en/stable/)
3. pre-commit/pre-commit β 13,996
A framework for managing and maintaining multi-language pre-commit hooks.
π [pre-commit.com](https://pre-commit.com)
4. google/yapf β 13,913
A formatter for Python files
5. sqlfluff/sqlfluff β 9,012
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
π [www.sqlfluff.com](https://www.sqlfluff.com)
6. pycqa/isort β 6,779
A Python utility / library to sort imports.
π [pycqa.github.io/isort](https://pycqa.github.io/isort/)
7. davidhalter/jedi β 5,971
Awesome autocompletion, static analysis and refactoring library for python
π [jedi.readthedocs.io](http://jedi.readthedocs.io)
8. pycqa/pylint β 5,506
It's not just a linter that annoys you!
π [pylint.readthedocs.io/en/latest](https://pylint.readthedocs.io/en/latest/)
9. jendrikseipp/vulture β 3,912
Find dead Python code
10. asottile/pyupgrade β 3,826
A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.
11. pycqa/flake8 β 3,645
flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
π [flake8.pycqa.org](https://flake8.pycqa.org)
12. wemake-services/wemake-python-styleguide β 2,741
The strictest and most opinionated python linter ever!
π [wemake-python-styleguide.rtfd.io](https://wemake-python-styleguide.rtfd.io)
13. python-lsp/python-lsp-server β 2,270
Fork of the python-language-server project, maintained by the Spyder IDE team and the community
14. codespell-project/codespell β 2,167
check code for common misspellings
15. sourcery-ai/sourcery β 1,685
Instant AI code reviews
π [sourcery.ai](https://sourcery.ai)
16. callowayproject/bump-my-version β 501
A small command line tool to simplify releasing software by updating all version strings in your source code by the correct increment and optionally commit and tag the changes.
π [callowayproject.github.io/bump-my-version](https://callowayproject.github.io/bump-my-version/)
17. tconbeer/sqlfmt β 464
sqlfmt formats your dbt SQL files so you don't have to
π [sqlfmt.com](https://sqlfmt.com)
## Crypto and Blockchain
Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.
1. freqtrade/freqtrade β 40,352
Free, open source crypto trading bot
π [www.freqtrade.io](https://www.freqtrade.io)
2. ccxt/ccxt β 37,197
A JavaScript / TypeScript / Python / C# / PHP / Go cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
π [docs.ccxt.com](https://docs.ccxt.com)
3. crytic/slither β 5,773
Static Analyzer for Solidity and Vyper
π [blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework](https://blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework/)
4. ethereum/web3.py β 5,310
A python interface for interacting with the Ethereum blockchain and ecosystem.
π [web3py.readthedocs.io](http://web3py.readthedocs.io)
5. ethereum/consensus-specs β 3,749
Ethereum Proof-of-Stake Consensus Specifications
6. cyberpunkmetalhead/Binance-volatility-trading-bot β 3,463
This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.
7. bmoscon/cryptofeed β 2,485
Cryptocurrency Exchange Websocket Data Feed Handler
8. ethereum/py-evm β 2,346
A Python implementation of the Ethereum Virtual Machine
π [py-evm.readthedocs.io/en/latest](https://py-evm.readthedocs.io/en/latest/)
9. binance/binance-public-data β 1,924
Details on how to get Binance public data
10. ofek/bit β 1,300
Bitcoin made easy.
π [ofek.dev/bit](https://ofek.dev/bit/)
11. man-c/pycoingecko β 1,080
Python wrapper for the CoinGecko API
12. palkeo/panoramix β 863
Ethereum decompiler
13. coinbase/agentkit β 764
AgentKit is Coinbase Developer Platform's framework for easily enabling AI agents to take actions onchain. It is designed to be framework-agnostic, so you can use it with any AI framework, and wallet-agnostic
π [docs.cdp.coinbase.com/agentkit/docs/welcome](https://docs.cdp.coinbase.com/agentkit/docs/welcome)
14. dylanhogg/awesome-crypto β 77
A list of awesome crypto and blockchain projects
π [www.awesomecrypto.xyz](https://www.awesomecrypto.xyz/)
## Data
General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.
1. microsoft/markitdown β 60,175
A utility for converting files to Markdown, supports: PDF, PPT, Word, Excel, Images etc
2. scrapy/scrapy β 57,531
Scrapy, a fast high-level web crawling & scraping framework for Python.
π [scrapy.org](https://scrapy.org)
3. apache/spark β 41,437
Apache Spark - A unified analytics engine for large-scale data processing
π [spark.apache.org](https://spark.apache.org/)
4. ds4sd/docling β 34,090
Docling parses documents and exports them to the desired format with ease and speed.
π [docling-project.github.io/docling](https://docling-project.github.io/docling)
5. mindsdb/mindsdb β 33,455
AI's query engine - Platform for building AI that can answer questions over large scale federated data. - The only MCP Server you'll ever need
π [mindsdb.com](https://mindsdb.com)
6. pathwaycom/pathway β 28,641
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
π [pathway.com](https://pathway.com)
7. getredash/redash β 27,519
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
π [redash.io](http://redash.io/)
8. jaidedai/EasyOCR β 27,245
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
π [www.jaided.ai](https://www.jaided.ai)
9. qdrant/qdrant β 24,599
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
π [qdrant.tech](https://qdrant.tech)
10. humansignal/label-studio β 23,194
Label Studio is an open source data labeling tool. It lets you label data types like audio, text, images, videos, and time series with a simple and straightforward UI and export to various model formats.
π [labelstud.io](https://labelstud.io)
11. chroma-core/chroma β 20,981
the AI-native open-source embedding database
π [www.trychroma.com](https://www.trychroma.com/)
12. airbytehq/airbyte β 18,675
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
π [airbyte.com](https://airbyte.com)
13. joke2k/faker β 18,535
Faker is a Python package that generates fake data for you.
π [faker.readthedocs.io](https://faker.readthedocs.io)
14. avaiga/taipy β 18,236
Turns Data and AI algorithms into production-ready web applications in no time.
π [www.taipy.io](https://www.taipy.io)
15. binux/pyspider β 16,707
A Powerful Spider(Web Crawler) System in Python.
π [docs.pyspider.org](http://docs.pyspider.org/)
16. tiangolo/sqlmodel β 16,317
SQL databases in Python, designed for simplicity, compatibility, and robustness.
π [sqlmodel.tiangolo.com](https://sqlmodel.tiangolo.com/)
17. twintproject/twint β 16,142
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
18. apache/arrow β 15,685
Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics
π [arrow.apache.org](https://arrow.apache.org/)
19. weaviate/weaviate β 13,878
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native databaseβ.
π [weaviate.io/developers/weaviate](https://weaviate.io/developers/weaviate/)
20. redis/redis-py β 13,118
Redis Python client
21. s0md3v/Photon β 11,700
Incredibly fast crawler designed for OSINT.
22. coleifer/peewee β 11,614
a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
π [docs.peewee-orm.com](http://docs.peewee-orm.com/)
23. cyclotruc/gitingest β 10,836
Turn any Git repository into a prompt-friendly text ingest for LLMs.
π [gitingest.com](https://gitingest.com)
24. sqlalchemy/sqlalchemy β 10,628
The Database Toolkit for Python
π [www.sqlalchemy.org](https://www.sqlalchemy.org)
25. simonw/datasette β 10,180
An open source multi-tool for exploring and publishing data
π [datasette.io](https://datasette.io)
26. bigscience-workshop/petals β 9,709
πΈ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
π [petals.dev](https://petals.dev)
27. voxel51/fiftyone β 9,700
Refine high-quality datasets and visual AI models
π [fiftyone.ai](https://fiftyone.ai)
28. yzhao062/pyod β 9,325
A Python Library for Outlier and Anomaly Detection, Integrating Classical and Deep Learning Techniques
π [pyod.readthedocs.io](http://pyod.readthedocs.io)
29. gristlabs/grist-core β 8,631
Grist is the evolution of spreadsheets.
π [www.getgrist.com](https://www.getgrist.com)
30. tobymao/sqlglot β 7,977
Python SQL Parser and Transpiler
π [sqlglot.com](https://sqlglot.com/)
31. lancedb/lancedb β 7,001
Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
π [lancedb.github.io/lancedb](https://lancedb.github.io/lancedb/)
32. alirezamika/autoscraper β 6,843
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
33. kaggle/kaggle-api β 6,718
Official Kaggle API
34. madmaze/pytesseract β 6,159
A Python wrapper for Google Tesseract
35. ibis-project/ibis β 5,914
Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
π [ibis-project.org](https://ibis-project.org)
36. vi3k6i5/flashtext β 5,659
Extract Keywords from sentence or Replace keywords in sentences.
37. airbnb/knowledge-repo β 5,526
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
38. googleapis/genai-toolbox β 5,273
MCP Toolbox for Databases is an open source MCP server for databases. Develop tools easier, faster, and more securely by handling connection pooling, authentication.
π [googleapis.github.io/genai-toolbox/getting-started/introduction](https://googleapis.github.io/genai-toolbox/getting-started/introduction/)
39. superduperdb/superduper β 5,096
Superduper: End-to-end framework for building custom AI applications and agents.
π [superduper.io](https://superduper.io)
40. facebookresearch/AugLy β 5,021
A data augmentations library for audio, image, text, and video.
π [ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models](https://ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models/)
41. jazzband/tablib β 4,704
Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
π [tablib.readthedocs.io](https://tablib.readthedocs.io/)
42. giskard-ai/giskard β 4,693
π’ Open-Source Evaluation & Testing for AI & LLM systems
π [docs.giskard.ai](https://docs.giskard.ai)
43. amundsen-io/amundsen β 4,613
Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
π [www.amundsen.io/amundsen](https://www.amundsen.io/amundsen/)
44. lk-geimfari/mimesis β 4,595
Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
π [mimesis.name](https://mimesis.name)
45. rapidai/RapidOCR β 4,515
π Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.
π [rapidai.github.io/rapidocrdocs](https://rapidai.github.io/RapidOCRDocs)
46. adbar/trafilatura β 4,473
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
π [trafilatura.readthedocs.io](https://trafilatura.readthedocs.io)
47. mongodb/mongo-python-driver β 4,242
PyMongo - the Official MongoDB Python driver
π [www.mongodb.com/docs/languages/python/pymongo-driver/current](https://www.mongodb.com/docs/languages/python/pymongo-driver/current/)
48. rom1504/img2dataset β 4,084
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
49. andialbrecht/sqlparse β 3,894
A non-validating SQL parser module for Python
50. dlt-hub/dlt β 3,868
data load tool (dlt) is an open source Python library that makes data loading easy π οΈ
π [dlthub.com/docs](https://dlthub.com/docs)
51. deepchecks/deepchecks β 3,838
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
π [docs.deepchecks.com/stable](https://docs.deepchecks.com/stable)
52. jmcnamara/XlsxWriter β 3,807
A Python module for creating Excel XLSX files.
π [xlsxwriter.readthedocs.io](https://xlsxwriter.readthedocs.io)
53. praw-dev/praw β 3,753
PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
π [praw.readthedocs.io](http://praw.readthedocs.io/)
54. run-llama/llama-hub β 3,475
A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
π [llamahub.ai](https://llamahub.ai/)
55. sqlalchemy/alembic β 3,454
A database migrations tool for SQLAlchemy.
56. mlabonne/llm-datasets β 3,251
Curated list of datasets and tools for post-training.
π [mlabonne.github.io/blog](https://mlabonne.github.io/blog)
57. pyeve/cerberus β 3,223
Lightweight, extensible data validation library for Python
π [python-cerberus.org](http://python-cerberus.org)
58. zoomeranalytics/xlwings β 3,176
xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
π [www.xlwings.org](https://www.xlwings.org)
59. docarray/docarray β 3,080
Represent, send, store and search multimodal data
π [docs.docarray.org](https://docs.docarray.org/)
60. sdv-dev/SDV β 3,058
Synthetic data generation for tabular data
π [docs.sdv.dev/sdv](https://docs.sdv.dev/sdv)
61. pallets/itsdangerous β 3,031
Safely pass trusted data to untrusted environments and back.
π [itsdangerous.palletsprojects.com](https://itsdangerous.palletsprojects.com)
62. datafold/data-diff β 2,975
Compare tables within or across databases
π [docs.datafold.com](https://docs.datafold.com)
63. goldsmith/Wikipedia β 2,957
A Pythonic wrapper for the Wikipedia API
π [wikipedia.readthedocs.org](https://wikipedia.readthedocs.org/)
64. awslabs/amazon-redshift-utils β 2,808
Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment
65. kayak/pypika β 2,695
PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
π [pypika.readthedocs.io/en/latest](http://pypika.readthedocs.io/en/latest/)
66. samuelcolvin/arq β 2,567
Fast job queuing and RPC in python with asyncio and redis.
π [arq-docs.helpmanual.io](https://arq-docs.helpmanual.io/)
67. pynamodb/PynamoDB β 2,518
A pythonic interface to Amazon's DynamoDB
π [pynamodb.readthedocs.io](http://pynamodb.readthedocs.io)
68. huggingface/datatrove β 2,463
DataTrove is a library to process, filter and deduplicate text data at a very large scale. It provides a set of prebuilt commonly used processing blocks with a framework to easily add custom functionality
69. mangiucugna/json_repair β 2,440
A python module to repair invalid JSON from LLMs
π [pypi.org/project/json-repair](https://pypi.org/project/json-repair/)
70. pikepdf/pikepdf β 2,404
A Python library for reading and writing PDF, powered by QPDF
π [pikepdf.readthedocs.io](https://pikepdf.readthedocs.io/)
71. uqfoundation/dill β 2,365
serialize all of Python
π [dill.rtfd.io](http://dill.rtfd.io)
72. sfu-db/connector-x β 2,353
Fastest library to load data from DB to DataFrames in Rust and Python
π [sfu-db.github.io/connector-x](https://sfu-db.github.io/connector-x)
73. emirozer/fake2db β 2,330
Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.
74. graphistry/pygraphistry β 2,289
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
75. aminalaee/sqladmin β 2,249
SQLAlchemy Admin for FastAPI and Starlette
π [aminalaee.github.io/sqladmin](https://aminalaee.github.io/sqladmin/)
76. accenture/AmpliGraph β 2,216
Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
77. milvus-io/bootcamp β 2,169
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
π [milvus.io](https://milvus.io)
78. agronholm/sqlacodegen β 2,125
Automatic model code generator for SQLAlchemy
79. simonw/sqlite-utils β 1,862
Python CLI utility and library for manipulating SQLite databases
π [sqlite-utils.datasette.io](https://sqlite-utils.datasette.io)
80. uber/petastorm β 1,847
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
81. aio-libs/aiomysql β 1,822
aiomysql is a library for accessing a MySQL database from the asyncio
π [aiomysql.rtfd.io](https://aiomysql.rtfd.io)
82. simple-salesforce/simple-salesforce β 1,787
A very simple Salesforce.com REST API client for Python
83. collerek/ormar β 1,757
python async orm with fastapi in mind and pydantic validation
π [collerek.github.io/ormar](https://collerek.github.io/ormar/)
84. zarr-developers/zarr-python β 1,737
An implementation of chunked, compressed, N-dimensional arrays for Python.
π [zarr.readthedocs.io](https://zarr.readthedocs.io)
85. scholarly-python-package/scholarly β 1,666
Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
π [scholarly.readthedocs.io](https://scholarly.readthedocs.io/)
86. eleutherai/the-pile β 1,581
The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.
87. ydataai/ydata-synthetic β 1,558
Synthetic data generators for tabular and time-series data
π [docs.sdk.ydata.ai](https://docs.sdk.ydata.ai)
88. d-star-ai/dsRAG β 1,442
A retrieval engine for unstructured data. It is especially good at handling challenging queries over dense text, like financial reports, legal documents, and academic papers.
89. mchong6/JoJoGAN β 1,430
Official PyTorch repo for JoJoGAN: One Shot Face Stylization
90. google/tensorstore β 1,422
Library for reading and writing large multi-dimensional arrays.
π [google.github.io/tensorstore](https://google.github.io/tensorstore/)
91. sdispater/orator β 1,417
The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
π [orator-orm.com](https://orator-orm.com)
92. quixio/quix-streams β 1,402
Python Streaming DataFrames for Kafka
π [docs.quix.io](https://docs.quix.io)
93. aio-libs/aiocache β 1,308
Asyncio cache manager for redis, memcached and memory
π [aiocache.readthedocs.io](http://aiocache.readthedocs.io)
94. eliasdabbas/advertools β 1,248
advertools - online marketing productivity and analysis tools
π [advertools.readthedocs.io](https://advertools.readthedocs.io)
95. pytorch/data β 1,211
A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
96. igorbenav/fastcrud β 1,190
FastCRUD is a Python package for FastAPI, offering robust async CRUD operations and flexible endpoint creation utilities.
π [benavlabs.github.io/fastcrud](https://benavlabs.github.io/fastcrud/)
97. duckdb/dbt-duckdb β 1,110
dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)
98. brettkromkamp/contextualise β 1,078
Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
π [contextualise.dev](https://contextualise.dev/)
99. uber/fiber β 1,044
Distributed Computing for AI Made Simple
π [uber.github.io/fiber](https://uber.github.io/fiber/)
100. meta-llama/synthetic-data-kit β 1,006
Tool for generating high-quality synthetic datasets to fine-tune LLMs. Generate Reasoning Traces, QA Pairs, save them to a fine-tuning format with a simple CLI.
π [pypi.org/project/synthetic-data-kit](https://pypi.org/project/synthetic-data-kit/)
101. goccy/bigquery-emulator β 959
BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.
102. scikit-hep/awkward β 896
Manipulate JSON-like data with NumPy-like idioms.
π [awkward-array.org](https://awkward-array.org)
103. macbre/sql-metadata β 864
Uses tokenized query returned by python-sqlparse and generates query metadata
π [pypi.python.org/pypi/sql-metadata](https://pypi.python.org/pypi/sql-metadata)
104. koaning/human-learn β 817
Natural Intelligence is still a pretty good idea.
π [koaning.github.io/human-learn](https://koaning.github.io/human-learn/)
105. weaviate/recipes β 802
This repository shares end-to-end notebooks on how to use various Weaviate features and integrations!
106. apache/iceberg-python β 801
PyIceberg is a Python library for programmatic access to Iceberg table metadata as well as to table data in Iceberg format.
π [py.iceberg.apache.org](https://py.iceberg.apache.org/)
107. googleapis/python-bigquery β 779
Python Client for Google BigQuery
108. unstructured-io/unstructured-api β 767
API for Open-Source Pre-Processing Tools for Unstructured Data
109. huggingface/aisheets β 736
Build, enrich, and transform datasets using AI models with no code. Deploy locally or on the Hub with access to thousands of open models.
π [huggingface.co/spaces/aisheets/sheets](https://huggingface.co/spaces/aisheets/sheets)
110. kagisearch/vectordb β 735
A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.
π [vectordb.com](https://vectordb.com)
111. ibm/data-prep-kit β 728
Data Prep Kit is a community project to democratize and accelerate unstructured data preparation for LLM app developers
π [data-prep-kit.github.io/data-prep-kit](https://data-prep-kit.github.io/data-prep-kit/)
112. hyperqueryhq/whale β 728
π³ The stupidly simple CLI workspace for your data warehouse.
π [rsyi.gitbook.io/whale](https://rsyi.gitbook.io/whale)
113. dgarnitz/vectorflow β 694
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
π [www.getvectorflow.com](https://www.getvectorflow.com/)
114. jina-ai/vectordb β 626
A Python vector database you just need - no more, no less.
115. koaning/bulk β 587
Bulk is a quick UI developer tool to apply some bulk labels.
116. koaning/doubtlab β 513
Doubt your data, find bad labels.
π [koaning.github.io/doubtlab](https://koaning.github.io/doubtlab/)
117. titan-systems/titan β 471
Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data access. Declarative Python Resource API.
118. stackloklabs/promptwright β 432
Promptwright is a Python library designed for generating large synthetic datasets using LLMs
## Debugging
Debugging and tracing tools.
1. cool-rr/PySnooper β 16,510
Never use print for debugging again
2. gruns/icecream β 9,817
π¦ Never use print() to debug again.
3. shobrook/rebound β 4,126
Instant Stack Overflow results whenever an exception is thrown
4. inducer/pudb β 3,113
Full-screen console debugger for Python
π [documen.tician.de/pudb](https://documen.tician.de/pudb/)
5. gotcha/ipdb β 1,925
Integration of IPython pdb
6. alexmojaki/heartrate β 1,818
Simple real time visualisation of the execution of a Python program.
7. alexmojaki/birdseye β 1,682
Graphical Python debugger which lets you easily view the values of all evaluated expressions
π [birdseye.readthedocs.io](https://birdseye.readthedocs.io)
8. pdbpp/pdbpp β 1,391
pdb++, a drop-in replacement for pdb (the Python debugger)
9. alexmojaki/snoop β 1,367
A powerful set of Python debugging tools, based on PySnooper
## Diffusion Text to Image
Text-to-image diffusion model libraries, tools and apps for generating images from natural language.
1. automatic1111/stable-diffusion-webui β 154,377
Stable Diffusion web UI
2. comfyanonymous/ComfyUI β 82,156
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
π [www.comfy.org](https://www.comfy.org/)
3. compvis/stable-diffusion β 71,105
A latent text-to-image diffusion model
π [ommer-lab.com/research/latent-diffusion-models](https://ommer-lab.com/research/latent-diffusion-models/)
4. stability-ai/stablediffusion β 41,327
High-Resolution Image Synthesis with Latent Diffusion Models
5. lllyasviel/ControlNet β 32,709
Let us control diffusion models!
6. huggingface/diffusers β 29,738
π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
π [huggingface.co/docs/diffusers](https://huggingface.co/docs/diffusers)
7. invoke-ai/InvokeAI β 25,476
Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
π [invoke-ai.github.io/invokeai](https://invoke-ai.github.io/InvokeAI/)
8. openbmb/MiniCPM-o β 19,800
MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone
9. apple/ml-stable-diffusion β 17,474
Stable Diffusion with Core ML on Apple Silicon
10. borisdayma/dalle-mini β 14,816
DALLΒ·E Mini - Generate images from a text prompt
π [www.craiyon.com](https://www.craiyon.com)
11. divamgupta/diffusionbee-stable-diffusion-ui β 13,305
Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
π [diffusionbee.com](https://diffusionbee.com)
12. compvis/latent-diffusion β 13,067
High-Resolution Image Synthesis with Latent Diffusion Models
13. instantid/InstantID β 11,711
InstantID: Zero-shot Identity-Preserving Generation in Seconds π₯
π [instantid.github.io](https://instantid.github.io/)
14. lucidrains/DALLE2-pytorch β 11,299
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
15. facebookresearch/dinov2 β 11,069
PyTorch code and models for the DINOv2 self-supervised learning method.
16. ashawkey/stable-dreamfusion β 8,669
Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
17. opengvlab/InternVL β 8,538
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. ζ₯θΏGPT-4o葨η°ηεΌζΊε€ζ¨‘ζε―Ήθ―樑ε
π [internvl.readthedocs.io/en/latest](https://internvl.readthedocs.io/en/latest/)
18. idea-research/GroundingDINO β 8,432
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
π [arxiv.org/abs/2303.05499](https://arxiv.org/abs/2303.05499)
19. carson-katri/dream-textures β 8,038
Stable Diffusion built-in to Blender
20. xavierxiao/Dreambooth-Stable-Diffusion β 7,743
Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion
21. timothybrooks/instruct-pix2pix β 6,721
PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.
22. openai/consistency_models β 6,376
Official repo for consistency models.
23. salesforce/BLIP β 5,375
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
24. nateraw/stable-diffusion-videos β 4,608
Create π₯ videos with Stable Diffusion by exploring the latent space and morphing between text prompts
25. lkwq007/stablediffusion-infinity β 3,875
Outpainting with Stable Diffusion on an infinite canvas
26. jina-ai/discoart β 3,843
πͺ© Create Disco Diffusion artworks in one line
27. mlc-ai/web-stable-diffusion β 3,671
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
π [mlc.ai/web-stable-diffusion](https://mlc.ai/web-stable-diffusion)
28. openai/glide-text2im β 3,645
GLIDE: a diffusion-based text-conditional image synthesis model
29. openai/improved-diffusion β 3,618
Release for Improved Denoising Diffusion Probabilistic Models
30. google-research/big_vision β 2,999
Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
31. saharmor/dalle-playground β 2,759
A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
32. open-compass/VLMEvalKit β 2,692
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
π [huggingface.co/spaces/opencompass/open_vlm_leaderboard](https://huggingface.co/spaces/opencompass/open_vlm_leaderboard)
33. stability-ai/stability-sdk β 2,440
SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
π [platform.stability.ai](https://platform.stability.ai/)
34. thudm/CogVLM2 β 2,377
GPT4V-level open-source multi-modal model based on Llama3-8B
35. coyote-a/ultimate-upscale-for-automatic1111 β 1,744
Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI
36. divamgupta/stable-diffusion-tensorflow β 1,606
Stable Diffusion in TensorFlow / Keras
37. nvlabs/