Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dylanhogg/awesome-python
๐ Hand-picked awesome Python libraries and frameworks, organised by category
https://github.com/dylanhogg/awesome-python
List: awesome-python
awesome awesome-list awesome-python chatgpt data data-science deep-learning jupyter machine-learning natural-language-processing nlp open-source pandas python python-library
Last synced: 20 days ago
JSON representation
๐ Hand-picked awesome Python libraries and frameworks, organised by category
- Host: GitHub
- URL: https://github.com/dylanhogg/awesome-python
- Owner: dylanhogg
- License: mit
- Created: 2020-06-20T09:36:39.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2024-05-05T09:48:36.000Z (2 months ago)
- Last Synced: 2024-05-23T02:00:38.890Z (about 1 month ago)
- Topics: awesome, awesome-list, awesome-python, chatgpt, data, data-science, deep-learning, jupyter, machine-learning, natural-language-processing, nlp, open-source, pandas, python, python-library
- Homepage: https://www.awesomepython.org
- Size: 63.2 MB
- Stars: 258
- Watchers: 11
- Forks: 20
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Lists
- badge.svg?count_bg=%2379C83D&edge_flat=false&icon=&icon_color=%23E7E7E7&title=hits&title_bg=%23555555&url=https%3A%2F%2Fgithub.com%2Fdylanhogg%2Fawesome-python - Web
- ultimate-awesome - awesome-python - ๐ Hand-picked awesome Python libraries and frameworks, organised by category. (Other Lists / Julia Lists)
- awesome-stars - dylanhogg/awesome-python - ๐ Hand-picked awesome Python libraries and frameworks, organised by category (Others)
- my-awesome-stars - dylanhogg/awesome-python - ๐ Hand-picked awesome Python libraries and frameworks, organised by category (Others)
- awesome-ChatGPT-repositories - awesome-python - ๐ Hand-picked awesome Python libraries and frameworks, organised by category (Awesome-lists)
README
# Awesome Python
[](https://awesome.re)  [](https://opensource.org/licenses/MIT)
Hand-picked awesome Python libraries and frameworks, organised by category ๐
Interactive version: [www.awesomepython.org](https://www.awesomepython.org/)
Updated 11 Jun 2024
## Categories
- [Newly Created Repositories](#newly-created-repositories) - Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here (10 repos)
- [Code Quality](#code-quality) - Code quality tooling: linters, formatters, pre-commit hooks, unused code removal (17 repos)
- [Crypto and Blockchain](#crypto-and-blockchain) - Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity (13 repos)
- [Data](#data) - General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks (100 repos)
- [Debugging](#debugging) - Debugging and tracing tools (9 repos)
- [Diffusion Text to Image](#diffusion-text-to-image) - Text-to-image diffusion model libraries, tools and apps for generating images from natural language (41 repos)
- [Finance](#finance) - Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives (31 repos)
- [Game Development](#game-development) - Game development tools, engines and libraries (6 repos)
- [GIS](#gis) - Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections (29 repos)
- [Graph](#graph) - Graphs and network libraries: network analysis, graph machine learning, visualisation (6 repos)
- [GUI](#gui) - Graphical user interface libraries and toolkits (8 repos)
- [Jupyter](#jupyter) - Jupyter and JupyterLab and Notebook tools, libraries and plugins (24 repos)
- [LLMs and ChatGPT](#llms-and-chatgpt) - Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover (245 repos)
- [Math and Science](#math-and-science) - Mathematical, numerical and scientific libraries (22 repos)
- [Machine Learning - General](#machine-learning---general) - General and classical machine learning libraries. See below for other sections covering specialised ML areas (154 repos)
- [Machine Learning - Deep Learning](#machine-learning---deep-learning) - Machine learning libraries that cross over with deep learning in some way (72 repos)
- [Machine Learning - Interpretability](#machine-learning---interpretability) - Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training (19 repos)
- [Machine Learning - Ops](#machine-learning---ops) - MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models (44 repos)
- [Machine Learning - Reinforcement](#machine-learning---reinforcement) - Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF (22 repos)
- [Machine Learning - Time Series](#machine-learning---time-series) - Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics (19 repos)
- [Natural Language Processing](#natural-language-processing) - Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover (82 repos)
- [Packaging](#packaging) - Python packaging, dependency management and bundling (28 repos)
- [Pandas](#pandas) - Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations (24 repos)
- [Performance](#performance) - Performance, parallelisation and low level libraries (28 repos)
- [Profiling](#profiling) - Memory and CPU/GPU profiling tools and libraries (11 repos)
- [Security](#security) - Security related libraries: vulnerability discovery, SQL injection, environment auditing (14 repos)
- [Simulation](#simulation) - Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover (28 repos)
- [Study](#study) - Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials (55 repos)
- [Template](#template) - Template tools and libraries: cookiecutter repos, generators, quick-starts (8 repos)
- [Terminal](#terminal) - Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars (15 repos)
- [Testing](#testing) - Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins (24 repos)
- [Typing](#typing) - Typing libraries: static and run-time type checking, annotations (12 repos)
- [Utility](#utility) - General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools (195 repos)
- [Vizualisation](#vizualisation) - Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL (33 repos)
- [Web](#web) - Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management (57 repos)
## Newly Created Repositories
Awesome Python is regularly updated, and this category lists the most recently created GitHub repositories from all the other repositories here.
1. naklecha/llama3-from-scratch โญ 10,094
llama3 implementation one matrix multiplication at a time
2. codium-ai/cover-agent โญ 3,816
CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! ๐ป๐ค๐งช๐
๐ [www.codium.ai](https://www.codium.ai/)
3. blealtan/efficient-kan โญ 3,254
An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
4. google-research/timesfm โญ 2,811
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
๐ [research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting](https://research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting/)
5. cohere-ai/cohere-toolkit โญ 2,299
Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
6. mistralai/mistral-finetune โญ 2,225
A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.
7. pydantic/logfire โญ 1,482
Uncomplicated Observability for Python and beyond! ๐ชต๐ฅ
๐ [docs.pydantic.dev/logfire](https://docs.pydantic.dev/logfire/)
8. thudm/CogVLM2 โญ 1,267
GPT4V-level open-source multi-modal model based on Llama3-8B
9. likejazz/llama3.np โญ 900
llama3.np is a pure NumPy implementation for Llama 3 model.
10. eureka-research/DrEureka โญ 713
Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
๐ [eureka-research.github.io/dr-eureka](https://eureka-research.github.io/dr-eureka/)
## Code Quality
Code quality tooling: linters, formatters, pre-commit hooks, unused code removal.
1. psf/black โญ 37,638
The uncompromising Python code formatter
๐ [black.readthedocs.io/en/stable](https://black.readthedocs.io/en/stable/)
2. astral-sh/ruff โญ 27,860
An extremely fast Python linter and code formatter, written in Rust.
๐ [docs.astral.sh/ruff](https://docs.astral.sh/ruff)
3. google/yapf โญ 13,667
A formatter for Python files
4. pre-commit/pre-commit โญ 12,256
A framework for managing and maintaining multi-language pre-commit hooks.
๐ [pre-commit.com](https://pre-commit.com)
5. sqlfluff/sqlfluff โญ 7,325
A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
๐ [www.sqlfluff.com](https://www.sqlfluff.com)
6. pycqa/isort โญ 6,342
A Python utility / library to sort imports.
๐ [pycqa.github.io/isort](https://pycqa.github.io/isort/)
7. davidhalter/jedi โญ 5,701
Awesome autocompletion, static analysis and refactoring library for python
๐ [jedi.readthedocs.io](http://jedi.readthedocs.io)
8. pycqa/pylint โญ 5,166
It's not just a linter that annoys you!
๐ [pylint.readthedocs.io/en/latest](https://pylint.readthedocs.io/en/latest/)
9. asottile/pyupgrade โญ 3,370
A tool (and pre-commit hook) to automatically upgrade syntax for newer versions of the language.
10. pycqa/flake8 โญ 3,312
flake8 is a python tool that glues together pycodestyle, pyflakes, mccabe, and third-party plugins to check the style and quality of some python code.
๐ [flake8.pycqa.org](https://flake8.pycqa.org)
11. jendrikseipp/vulture โญ 3,135
Find dead Python code
12. wemake-services/wemake-python-styleguide โญ 2,449
The strictest and most opinionated python linter ever!
๐ [wemake-python-styleguide.rtfd.io](https://wemake-python-styleguide.rtfd.io)
13. codespell-project/codespell โญ 1,781
check code for common misspellings
14. python-lsp/python-lsp-server โญ 1,723
Fork of the python-language-server project, maintained by the Spyder IDE team and the community
15. sourcery-ai/sourcery โญ 1,493
Instant AI code reviews
๐ [sourcery.ai](https://sourcery.ai)
16. akaihola/darker โญ 617
Apply black reformatting to Python files only in regions changed since a given commit. For a practical usage example, see the blog post at https://dev.to/akaihola/improving-python-code-incrementally-3f7a
๐ [pypi.org/project/darker](https://pypi.org/project/darker/)
17. tconbeer/sqlfmt โญ 354
sqlfmt formats your dbt SQL files so you don't have to
๐ [sqlfmt.com](https://sqlfmt.com)
## Crypto and Blockchain
Cryptocurrency and blockchain libraries: trading bots, API integration, Ethereum virtual machine, solidity.
1. ccxt/ccxt โญ 31,703
A JavaScript / TypeScript / Python / C# / PHP cryptocurrency trading API with support for more than 100 bitcoin/altcoin exchanges
๐ [docs.ccxt.com](https://docs.ccxt.com)
2. freqtrade/freqtrade โญ 26,030
Free, open source crypto trading bot
๐ [www.freqtrade.io](https://www.freqtrade.io)
3. crytic/slither โญ 5,092
Static Analyzer for Solidity and Vyper
๐ [blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework](https://blog.trailofbits.com/2018/10/19/slither-a-solidity-static-analysis-framework/)
4. ethereum/web3.py โญ 4,855
A python interface for interacting with the Ethereum blockchain and ecosystem.
๐ [web3py.readthedocs.io](http://web3py.readthedocs.io)
5. ethereum/consensus-specs โญ 3,467
Ethereum Proof-of-Stake Consensus Specifications
6. cyberpunkmetalhead/Binance-volatility-trading-bot โญ 3,361
This is a fully functioning Binance trading bot that measures the volatility of every coin on Binance and places trades with the highest gaining coins If you like this project consider donating though the Brave browser to allow me to continuously improve the script.
7. ethereum/py-evm โญ 2,210
A Python implementation of the Ethereum Virtual Machine
๐ [py-evm.readthedocs.io/en/latest](https://py-evm.readthedocs.io/en/latest/)
8. bmoscon/cryptofeed โญ 2,110
Cryptocurrency Exchange Websocket Data Feed Handler
9. binance/binance-public-data โญ 1,382
Details on how to get Binance public data
10. ofek/bit โญ 1,213
Bitcoin made easy.
๐ [ofek.dev/bit](https://ofek.dev/bit/)
11. man-c/pycoingecko โญ 1,034
Python wrapper for the CoinGecko API
12. palkeo/panoramix โญ 768
Ethereum decompiler
13. dylanhogg/awesome-crypto โญ 66
A list of awesome crypto and blockchain projects
๐ [www.awesomecrypto.xyz](https://www.awesomecrypto.xyz/)
## Data
General data libraries: data processing, serialisation, formats, databases, SQL, connectors, web crawlers, data generation/augmentation/checks.
1. scrapy/scrapy โญ 51,375
Scrapy, a fast high-level web crawling & scraping framework for Python.
๐ [scrapy.org](https://scrapy.org)
2. apache/spark โญ 38,662
Apache Spark - A unified analytics engine for large-scale data processing
๐ [spark.apache.org](https://spark.apache.org/)
3. getredash/redash โญ 25,209
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
๐ [redash.io](http://redash.io/)
4. jaidedai/EasyOCR โญ 22,508
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
๐ [www.jaided.ai](https://www.jaided.ai)
5. mindsdb/mindsdb โญ 21,794
The platform for customizing AI from enterprise data
๐ [mindsdb.com](https://mindsdb.com)
6. qdrant/qdrant โญ 18,499
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
๐ [qdrant.tech](https://qdrant.tech)
7. joke2k/faker โญ 17,234
Faker is a Python package that generates fake data for you.
๐ [faker.readthedocs.io](https://faker.readthedocs.io)
8. humansignal/label-studio โญ 17,005
Label Studio is an open source data labeling tool. It lets you label data types like audio, text, images, videos, and time series with a simple and straightforward UI and export to various model formats.
๐ [labelstud.io](https://labelstud.io)
9. binux/pyspider โญ 16,382
A Powerful Spider(Web Crawler) System in Python.
๐ [docs.pyspider.org](http://docs.pyspider.org/)
10. twintproject/twint โญ 15,617
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
11. airbytehq/airbyte โญ 14,523
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
๐ [airbyte.com](https://airbyte.com)
12. apache/arrow โญ 13,753
Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing
๐ [arrow.apache.org](https://arrow.apache.org/)
13. tiangolo/sqlmodel โญ 13,351
SQL databases in Python, designed for simplicity, compatibility, and robustness.
๐ [sqlmodel.tiangolo.com](https://sqlmodel.tiangolo.com/)
14. chroma-core/chroma โญ 12,988
the AI-native open-source embedding database
๐ [www.trychroma.com](https://www.trychroma.com/)
15. redis/redis-py โญ 12,346
Redis Python client
16. coleifer/peewee โญ 10,900
a small, expressive orm -- supports postgresql, mysql, sqlite and cockroachdb
๐ [docs.peewee-orm.com](http://docs.peewee-orm.com/)
17. s0md3v/Photon โญ 10,599
Incredibly fast crawler designed for OSINT.
18. avaiga/taipy โญ 9,462
Turns Data and AI algorithms into production-ready web applications in no time.
๐ [www.taipy.io](https://www.taipy.io)
19. sqlalchemy/sqlalchemy โญ 9,023
The Database Toolkit for Python
๐ [www.sqlalchemy.org](https://www.sqlalchemy.org)
20. simonw/datasette โญ 9,019
An open source multi-tool for exploring and publishing data
๐ [datasette.io](https://datasette.io)
21. bigscience-workshop/petals โญ 8,795
๐ธ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
๐ [petals.dev](https://petals.dev)
22. yzhao062/pyod โญ 8,066
A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
๐ [pyod.readthedocs.io](http://pyod.readthedocs.io)
23. voxel51/fiftyone โญ 6,881
The open-source tool for building high-quality datasets and computer vision models
๐ [fiftyone.ai](https://fiftyone.ai)
24. gristlabs/grist-core โญ 6,454
Grist is the evolution of spreadsheets.
๐ [www.getgrist.com](https://www.getgrist.com/)
25. alirezamika/autoscraper โญ 6,019
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
26. kaggle/kaggle-api โญ 5,984
Official Kaggle API
27. tobymao/sqlglot โญ 5,846
Python SQL Parser and Transpiler
๐ [sqlglot.com](https://sqlglot.com/)
28. madmaze/pytesseract โญ 5,604
A Python wrapper for Google Tesseract
29. vi3k6i5/flashtext โญ 5,560
Extract Keywords from sentence or Replace keywords in sentences.
30. airbnb/knowledge-repo โญ 5,447
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
31. facebookresearch/AugLy โญ 4,913
A data augmentations library for audio, image, text, and video.
๐ [ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models](https://ai.facebook.com/blog/augly-a-new-data-augmentation-library-to-help-build-more-robust-ai-models/)
32. jazzband/tablib โญ 4,542
Python Module for Tabular Datasets in XLS, CSV, JSON, YAML, &c.
๐ [tablib.readthedocs.io](https://tablib.readthedocs.io/)
33. superduperdb/superduperdb โญ 4,452
๐ฎ SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
๐ [superduperdb.com](https://superduperdb.com)
34. ibis-project/ibis โญ 4,394
Ibis is a Python library that provides a lightweight, universal interface for data wrangling. It helps Python users explore and transform data of any size, stored anywhere.
๐ [ibis-project.org](https://ibis-project.org)
35. lk-geimfari/mimesis โญ 4,321
Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
๐ [mimesis.name](https://mimesis.name)
36. amundsen-io/amundsen โญ 4,312
Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.
๐ [www.amundsen.io/amundsen](https://www.amundsen.io/amundsen/)
37. mongodb/mongo-python-driver โญ 4,066
PyMongo - the Official MongoDB Python driver
๐ [pymongo.readthedocs.io](https://pymongo.readthedocs.io)
38. andialbrecht/sqlparse โญ 3,613
A non-validating SQL parser module for Python
39. jmcnamara/XlsxWriter โญ 3,523
A Python module for creating Excel XLSX files.
๐ [xlsxwriter.readthedocs.io](https://xlsxwriter.readthedocs.io)
40. giskard-ai/giskard โญ 3,482
๐ข Open-Source Evaluation & Testing for LLMs and ML models
๐ [docs.giskard.ai](https://docs.giskard.ai)
41. deepchecks/deepchecks โญ 3,448
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
๐ [docs.deepchecks.com/stable](https://docs.deepchecks.com/stable)
42. run-llama/llama-hub โญ 3,416
A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
๐ [llamahub.ai](https://llamahub.ai/)
43. rom1504/img2dataset โญ 3,366
Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
44. praw-dev/praw โญ 3,349
PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
๐ [praw.readthedocs.io](http://praw.readthedocs.io/)
45. lancedb/lancedb โญ 3,316
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
๐ [lancedb.github.io/lancedb](https://lancedb.github.io/lancedb/)
46. pyeve/cerberus โญ 3,118
Lightweight, extensible data validation library for Python
๐ [python-cerberus.org](http://python-cerberus.org)
47. datafold/data-diff โญ 2,903
Compare tables within or across databases
๐ [docs.datafold.com](https://docs.datafold.com)
48. zoomeranalytics/xlwings โญ 2,872
xlwings is a Python library that makes it easy to call Python from Excel and vice versa. It works with Excel on Windows and macOS as well as with Google Sheets and Excel on the web.
๐ [www.xlwings.org](https://www.xlwings.org)
49. pallets/itsdangerous โญ 2,849
Safely pass trusted data to untrusted environments and back.
๐ [itsdangerous.palletsprojects.com](https://itsdangerous.palletsprojects.com)
50. goldsmith/Wikipedia โญ 2,835
A Pythonic wrapper for the Wikipedia API
๐ [wikipedia.readthedocs.org](https://wikipedia.readthedocs.org/)
51. docarray/docarray โญ 2,811
Represent, send, store and search multimodal data
๐ [docs.docarray.org](https://docs.docarray.org/)
52. awslabs/amazon-redshift-utils โญ 2,723
Amazon Redshift Utils contains utilities, scripts and view which are useful in a Redshift environment
53. sqlalchemy/alembic โญ 2,541
A database migrations tool for SQLAlchemy.
54. pathwaycom/pathway โญ 2,455
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
๐ [pathway.com](https://pathway.com)
55. kayak/pypika โญ 2,404
PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.
๐ [pypika.readthedocs.io/en/latest](http://pypika.readthedocs.io/en/latest/)
56. pynamodb/PynamoDB โญ 2,388
A pythonic interface to Amazon's DynamoDB
๐ [pynamodb.readthedocs.io](http://pynamodb.readthedocs.io)
57. emirozer/fake2db โญ 2,265
Generate fake but valid data filled databases for test purposes using most popular patterns(AFAIK). Current support is sqlite, mysql, postgresql, mongodb, redis, couchdb.
58. rapidai/RapidOCR โญ 2,223
Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVION and PaddlePaddle.
๐ [rapidai.github.io/rapidocrdocs](https://rapidai.github.io/RapidOCRDocs)
59. uqfoundation/dill โญ 2,186
serialize all of Python
๐ [dill.rtfd.io](http://dill.rtfd.io)
60. sdv-dev/SDV โญ 2,178
Synthetic data generation for tabular data
๐ [docs.sdv.dev/sdv](https://docs.sdv.dev/sdv)
61. accenture/AmpliGraph โญ 2,102
Python library for Representation Learning on Knowledge Graphs https://docs.ampligraph.org
62. graphistry/pygraphistry โญ 2,081
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
63. samuelcolvin/arq โญ 1,989
Fast job queuing and RPC in python with asyncio and redis.
๐ [arq-docs.helpmanual.io](https://arq-docs.helpmanual.io/)
64. dlt-hub/dlt โญ 1,861
data load tool (dlt) is an open source Python library that makes data loading easy ๐ ๏ธ
๐ [dlthub.com/docs](https://dlthub.com/docs)
65. sfu-db/connector-x โญ 1,830
Fastest library to load data from DB to DataFrames in Rust and Python
๐ [sfu-db.github.io/connector-x](https://sfu-db.github.io/connector-x)
66. agronholm/sqlacodegen โญ 1,761
Automatic model code generator for SQLAlchemy
67. uber/petastorm โญ 1,759
Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
68. aio-libs/aiomysql โญ 1,711
aiomysql is a library for accessing a MySQL database from the asyncio
๐ [aiomysql.rtfd.io](https://aiomysql.rtfd.io)
69. milvus-io/bootcamp โญ 1,678
Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
๐ [milvus.io](https://milvus.io)
70. aminalaee/sqladmin โญ 1,641
SQLAlchemy Admin for FastAPI and Starlette
๐ [aminalaee.dev/sqladmin](https://aminalaee.dev/sqladmin/)
71. huggingface/datatrove โญ 1,636
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
72. simple-salesforce/simple-salesforce โญ 1,613
A very simple Salesforce.com REST API client for Python
73. collerek/ormar โญ 1,600
python async orm with fastapi in mind and pydantic validation
๐ [collerek.github.io/ormar](https://collerek.github.io/ormar/)
74. simonw/sqlite-utils โญ 1,544
Python CLI utility and library for manipulating SQLite databases
๐ [sqlite-utils.datasette.io](https://sqlite-utils.datasette.io)
75. sdispater/orator โญ 1,426
The Orator ORM provides a simple yet beautiful ActiveRecord implementation.
๐ [orator-orm.com](https://orator-orm.com)
76. eleutherai/the-pile โญ 1,420
The Pile is a large, diverse, open source language modelling data set that consists of many smaller datasets combined together.
77. mchong6/JoJoGAN โญ 1,409
Official PyTorch repo for JoJoGAN: One Shot Face Stylization
78. aio-libs/aiopg โญ 1,383
aiopg is a library for accessing a PostgreSQL database from the asyncio
๐ [aiopg.readthedocs.io](http://aiopg.readthedocs.io)
79. zarr-developers/zarr-python โญ 1,371
An implementation of chunked, compressed, N-dimensional arrays for Python.
๐ [zarr.readthedocs.io](http://zarr.readthedocs.io/)
80. ydataai/ydata-synthetic โญ 1,342
Synthetic data generators for tabular and time-series data
๐ [docs.synthetic.ydata.ai](https://docs.synthetic.ydata.ai)
81. google/tensorstore โญ 1,307
Library for reading and writing large multi-dimensional arrays.
๐ [google.github.io/tensorstore](https://google.github.io/tensorstore/)
82. scholarly-python-package/scholarly โญ 1,265
Retrieve author and publication information from Google Scholar in a friendly, Pythonic way without having to worry about CAPTCHAs!
๐ [scholarly.readthedocs.io](https://scholarly.readthedocs.io/)
83. pytorch/data โญ 1,075
A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.
84. eliasdabbas/advertools โญ 1,073
advertools - online marketing productivity and analysis tools
๐ [advertools.readthedocs.io](https://advertools.readthedocs.io)
85. aio-libs/aiocache โญ 1,052
Asyncio cache manager for redis, memcached and memory
๐ [aiocache.readthedocs.io](http://aiocache.readthedocs.io)
86. brettkromkamp/contextualise โญ 1,041
Contextualise is an effective tool particularly suited for organising information-heavy projects and activities consisting of unstructured and widely diverse data and information resources
๐ [contextualise.dev](https://contextualise.dev/)
87. uber/fiber โญ 1,041
Distributed Computing for AI Made Simple
๐ [uber.github.io/fiber](https://uber.github.io/fiber/)
88. intake/intake โญ 989
Intake is a lightweight package for finding, investigating, loading and disseminating data.
๐ [intake.readthedocs.io](https://intake.readthedocs.io/)
89. scikit-hep/awkward โญ 804
Manipulate JSON-like data with NumPy-like idioms.
๐ [awkward-array.org](https://awkward-array.org)
90. koaning/human-learn โญ 785
Natural Intelligence is still a pretty good idea.
๐ [koaning.github.io/human-learn](https://koaning.github.io/human-learn/)
91. duckdb/dbt-duckdb โญ 764
dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)
92. macbre/sql-metadata โญ 755
Uses tokenized query returned by python-sqlparse and generates query metadata
๐ [pypi.python.org/pypi/sql-metadata](https://pypi.python.org/pypi/sql-metadata)
93. goccy/bigquery-emulator โญ 744
BigQuery emulator provides a way to launch a BigQuery server on your local machine for testing and development.
94. hyperqueryhq/whale โญ 725
๐ณ The stupidly simple CLI workspace for your data warehouse.
๐ [rsyi.gitbook.io/whale](https://rsyi.gitbook.io/whale)
95. googleapis/python-bigquery โญ 716
Python Client for Google BigQuery
96. mcfunley/pugsql โญ 670
A HugSQL-inspired database library for Python
๐ [pugsql.org](https://pugsql.org)
97. dgarnitz/vectorflow โญ 648
VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
๐ [www.getvectorflow.com](https://www.getvectorflow.com/)
98. kagisearch/vectordb โญ 569
A minimal Python package for storing and retrieving text using chunking, embeddings, and vector search.
๐ [vectordb.com](https://vectordb.com)
99. koaning/bulk โญ 463
Bulk is a quick UI developer tool to apply some bulk labels.
100. igorbenav/fastcrud โญ 438
FastCRUD is a Python package for FastAPI, offering robust async CRUD operations and flexible endpoint creation utilities.
## Debugging
Debugging and tracing tools.
1. cool-rr/PySnooper โญ 16,289
Never use print for debugging again
2. gruns/icecream โญ 8,599
๐ฆ Never use print() to debug again.
3. shobrook/rebound โญ 4,085
Command-line tool that instantly fetches Stack Overflow results when an exception is thrown
4. inducer/pudb โญ 2,893
Full-screen console debugger for Python
๐ [documen.tician.de/pudb](https://documen.tician.de/pudb/)
5. gotcha/ipdb โญ 1,826
Integration of IPython pdb
6. alexmojaki/heartrate โญ 1,738
Simple real time visualisation of the execution of a Python program.
7. alexmojaki/birdseye โญ 1,640
Graphical Python debugger which lets you easily view the values of all evaluated expressions
๐ [birdseye.readthedocs.io](https://birdseye.readthedocs.io)
8. alexmojaki/snoop โญ 1,207
A powerful set of Python debugging tools, based on PySnooper
9. samuelcolvin/python-devtools โญ 959
Dev tools for python
๐ [python-devtools.helpmanual.io](https://python-devtools.helpmanual.io/)
## Diffusion Text to Image
Text-to-image diffusion model libraries, tools and apps for generating images from natural language.
1. automatic1111/stable-diffusion-webui โญ 133,335
Stable Diffusion web UI
2. compvis/stable-diffusion โญ 66,125
A latent text-to-image diffusion model
๐ [ommer-lab.com/research/latent-diffusion-models](https://ommer-lab.com/research/latent-diffusion-models/)
3. comfyanonymous/ComfyUI โญ 37,181
The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
4. stability-ai/stablediffusion โญ 36,971
High-Resolution Image Synthesis with Latent Diffusion Models
5. lllyasviel/ControlNet โญ 28,570
Let us control diffusion models!
6. huggingface/diffusers โญ 23,281
๐ค Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
๐ [huggingface.co/docs/diffusers](https://huggingface.co/docs/diffusers)
7. invoke-ai/InvokeAI โญ 22,040
InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multi...
๐ [invoke-ai.github.io/invokeai](https://invoke-ai.github.io/InvokeAI/)
8. apple/ml-stable-diffusion โญ 16,344
Stable Diffusion with Core ML on Apple Silicon
9. borisdayma/dalle-mini โญ 14,674
DALLยทE Mini - Generate images from a text prompt
๐ [www.craiyon.com](https://www.craiyon.com)
10. divamgupta/diffusionbee-stable-diffusion-ui โญ 12,039
Diffusion Bee is the easiest way to run Stable Diffusion locally on your M1 Mac. Comes with a one-click installer. No dependencies or technical knowledge needed.
๐ [diffusionbee.com](https://diffusionbee.com)
11. lucidrains/DALLE2-pytorch โญ 10,918
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
12. compvis/latent-diffusion โญ 10,874
High-Resolution Image Synthesis with Latent Diffusion Models
13. instantid/InstantID โญ 10,231
InstantID : Zero-shot Identity-Preserving Generation in Seconds ๐ฅ
๐ [instantid.github.io](https://instantid.github.io/)
14. facebookresearch/dinov2 โญ 8,149
PyTorch code and models for the DINOv2 self-supervised learning method.
15. ashawkey/stable-dreamfusion โญ 7,910
Text-to-3D & Image-to-3D & Mesh Exportation with NeRF + Diffusion.
16. carson-katri/dream-textures โญ 7,662
Stable Diffusion built-in to Blender
17. xavierxiao/Dreambooth-Stable-Diffusion โญ 7,489
Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion
18. openbmb/MiniCPM-V โญ 6,808
MiniCPM-Llama3-V 2.5: A GPT-4V Level Multimodal LLM on Your Phone
19. timothybrooks/instruct-pix2pix โญ 6,036
PyTorch implementation of InstructPix2Pix, an instruction-based image editing model, based on the original CompVis/stable_diffusion repo.
20. openai/consistency_models โญ 5,997
Official repo for consistency models.
21. idea-research/GroundingDINO โญ 5,311
Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
๐ [arxiv.org/abs/2303.05499](https://arxiv.org/abs/2303.05499)
22. salesforce/BLIP โญ 4,380
PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
23. nateraw/stable-diffusion-videos โญ 4,296
Create ๐ฅ videos with Stable Diffusion by exploring the latent space and morphing between text prompts
24. jina-ai/discoart โญ 3,835
๐ชฉ Create Disco Diffusion artworks in one line
25. lkwq007/stablediffusion-infinity โญ 3,815
Outpainting with Stable Diffusion on an infinite canvas
26. openai/glide-text2im โญ 3,487
GLIDE: a diffusion-based text-conditional image synthesis model
27. mlc-ai/web-stable-diffusion โญ 3,484
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
๐ [mlc.ai/web-stable-diffusion](https://mlc.ai/web-stable-diffusion)
28. opengvlab/InternVL โญ 3,382
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. ๆฅ่ฟGPT-4V่กจ็ฐ็ๅฏๅ็จๅผๆบๅคๆจกๆๅฏน่ฏๆจกๅ
๐ [internvl.github.io](https://internvl.github.io/)
29. openai/improved-diffusion โญ 2,923
Release for Improved Denoising Diffusion Probabilistic Models
30. saharmor/dalle-playground โญ 2,764
A playground to generate images from any text prompt using Stable Diffusion (past: using DALL-E Mini)
31. stability-ai/stability-sdk โญ 2,409
SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)
๐ [platform.stability.ai](https://platform.stability.ai/)
32. google-research/big_vision โญ 1,887
Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
33. divamgupta/stable-diffusion-tensorflow โญ 1,571
Stable Diffusion in TensorFlow / Keras
34. coyote-a/ultimate-upscale-for-automatic1111 โญ 1,536
Ultimate SD Upscale extension for AUTOMATIC1111 Stable Diffusion web UI
35. nvlabs/prismer โญ 1,286
The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
๐ [shikun.io/projects/prismer](https://shikun.io/projects/prismer)
36. thudm/CogVLM2 โญ 1,267
GPT4V-level open-source multi-modal model based on Llama3-8B
37. chenyangqiqi/FateZero โญ 1,062
[ICCV 2023 Oral] "FateZero: Fusing Attentions for Zero-shot Text-based Video Editing"
๐ [fate-zero-edit.github.io](http://fate-zero-edit.github.io/)
38. thereforegames/unprompted โญ 757
Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
39. sharonzhou/long_stable_diffusion โญ 676
Long-form text-to-images generation, using a pipeline of deep generative models (GPT-3 and Stable Diffusion)
40. tanelp/tiny-diffusion โญ 560
A minimal PyTorch implementation of probabilistic diffusion models for 2D datasets.
41. open-compass/VLMEvalKit โญ 532
Open-source evaluation toolkit of large vision-language models (LVLMs), support GPT-4v, Gemini, QwenVLPlus, 50+ HF models, 20+ benchmarks
๐ [huggingface.co/spaces/opencompass/open_vlm_leaderboard](https://huggingface.co/spaces/opencompass/open_vlm_leaderboard)
## Finance
Financial and quantitative libraries: investment research tools, market data, algorithmic trading, backtesting, financial derivatives.
1. openbb-finance/OpenBBTerminal โญ 26,339
Investment Research for Everyone, Everywhere.
๐ [openbb.co](https://openbb.co)
2. quantopian/zipline โญ 17,175
Zipline, a Pythonic Algorithmic Trading Library
๐ [www.zipline.io](https://www.zipline.io)
3. microsoft/qlib โญ 14,405
Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, ...
๐ [qlib.readthedocs.io/en/latest](https://qlib.readthedocs.io/en/latest/)
4. mementum/backtrader โญ 13,327
Python Backtesting library for trading strategies
๐ [www.backtrader.com](https://www.backtrader.com)
5. ai4finance-foundation/FinGPT โญ 12,309
FinGPT: Open-Source Financial Large Language Models! Revolutionize ๐ฅ We release the trained model on HuggingFace.
๐ [ai4finance.org](https://ai4finance.org)
6. ranaroussi/yfinance โญ 12,206
Download market data from Yahoo! Finance's API
๐ [aroussi.com/post/python-yahoo-finance](https://aroussi.com/post/python-yahoo-finance)
7. ai4finance-foundation/FinRL โญ 9,284
FinRL: Financial Reinforcement Learning. ๐ฅ
๐ [ai4finance.org](https://ai4finance.org)
8. ta-lib/ta-lib-python โญ 9,142
Python wrapper for TA-Lib (http://ta-lib.org/).
๐ [ta-lib.github.io/ta-lib-python](http://ta-lib.github.io/ta-lib-python)
9. quantconnect/Lean โญ 8,835
Lean Algorithmic Trading Engine by QuantConnect (Python, C#)
๐ [lean.io](https://lean.io)
10. quantopian/pyfolio โญ 5,469
Portfolio and risk analytics in Python
๐ [quantopian.github.io/pyfolio](https://quantopian.github.io/pyfolio)
11. kernc/backtesting.py โญ 4,958
:mag_right: :chart_with_upwards_trend: ๐ :moneybag: Backtest trading strategies in Python.
๐ [kernc.github.io/backtesting.py](https://kernc.github.io/backtesting.py/)
12. twopirllc/pandas-ta โญ 4,888
Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 150+ Indicators
๐ [twopirllc.github.io/pandas-ta](https://twopirllc.github.io/pandas-ta/)
13. ranaroussi/quantstats โญ 4,425
Portfolio analytics for quants, written in Python
14. google/tf-quant-finance โญ 4,340
High-performance TensorFlow library for quantitative finance.
15. gbeced/pyalgotrade โญ 4,314
Python Algorithmic Trading Library
๐ [gbeced.github.io/pyalgotrade](http://gbeced.github.io/pyalgotrade/)
16. borisbanushev/stockpredictionai โญ 3,973
In this noteboook I will create a complete process for predicting stock price movements. Follow along and we will achieve some pretty good results. For that purpose we will use a Generative Adversarial Network (GAN) with LSTM, a type of Recurrent Neural Network, as generator, and a Convolutional Neural Networ...
17. polakowo/vectorbt โญ 3,894
Find your trading edge, using the fastest engine for backtesting, algorithmic trading, and research.
๐ [vectorbt.dev](https://vectorbt.dev)
18. matplotlib/mplfinance โญ 3,437
Financial Markets Data Visualization using Matplotlib
๐ [pypi.org/project/mplfinance](https://pypi.org/project/mplfinance/)
19. cuemacro/finmarketpy โญ 3,373
Python library for backtesting trading strategies & analyzing financial markets (formerly pythalesians)
๐ [www.cuemacro.com](http://www.cuemacro.com)
20. quantopian/alphalens โญ 3,143
Performance analysis of predictive (alpha) stock factors
๐ [quantopian.github.io/alphalens](http://quantopian.github.io/alphalens)
21. zvtvz/zvt โญ 3,045
modular quant framework.
๐ [zvt.readthedocs.io/en/latest](https://zvt.readthedocs.io/en/latest/)
22. goldmansachs/gs-quant โญ 2,795
Python toolkit for quantitative finance
๐ [developer.gs.com/discover/products/gs-quant](https://developer.gs.com/discover/products/gs-quant/)
23. robcarver17/pysystemtrade โญ 2,447
Systematic Trading in python
24. quantopian/research_public โญ 2,336
Quantitative research and educational materials
๐ [www.quantopian.com/lectures](https://www.quantopian.com/lectures)
25. pmorissette/bt โญ 2,068
bt - flexible backtesting for Python
๐ [pmorissette.github.io/bt](http://pmorissette.github.io/bt)
26. blankly-finance/blankly โญ 2,008
๐ ๐ธ Easily build, backtest and deploy your algo in just a few lines of code. Trade stocks, cryptos, and forex across exchanges w/ one package.
๐ [package.blankly.finance](https://package.blankly.finance)
27. domokane/FinancePy โญ 1,957
A Python Finance Library that focuses on the pricing and risk-management of Financial Derivatives, including fixed-income, equity, FX and credit derivatives.
๐ [financepy.com](https://financepy.com/)
28. pmorissette/ffn โญ 1,823
ffn - a financial function library for Python
๐ [pmorissette.github.io/ffn](pmorissette.github.io/ffn)
29. cuemacro/findatapy โญ 1,589
Python library to download market data via Bloomberg, Eikon, Quandl, Yahoo etc.
30. quantopian/empyrical โญ 1,234
Common financial risk and performance metrics. Used by zipline and pyfolio.
๐ [quantopian.github.io/empyrical](https://quantopian.github.io/empyrical)
31. idanya/algo-trader โญ 756
Trading bot with support for realtime trading, backtesting, custom strategies and much more.
## Game Development
Game development tools, engines and libraries.
1. kitao/pyxel โญ 13,337
A retro game engine for Python
2. pygame/pygame โญ 7,071
๐๐ฎ pygame (the library) is a Free and Open Source python programming language library for making multimedia applications like games built on top of the excellent SDL library. C, Python, Native, OpenGL.
๐ [www.pygame.org](https://www.pygame.org)
3. panda3d/panda3d โญ 4,316
Powerful, mature open-source cross-platform game engine for Python and C++, developed by Disney and CMU
๐ [www.panda3d.org](https://www.panda3d.org/)
4. pokepetter/ursina โญ 2,115
A game engine powered by python and panda3d.
๐ [pokepetter.github.io/ursina](https://pokepetter.github.io/ursina/)
5. pyglet/pyglet โญ 1,785
pyglet is a cross-platform windowing and multimedia library for Python, for developing games and other visually rich applications.
๐ [pyglet.org](http://pyglet.org)
6. pythonarcade/arcade โญ 1,635
Easy to use Python library for creating 2D arcade games.
๐ [arcade.academy](http://arcade.academy)
## GIS
Geospatial libraries: raster and vector data formats, interactive mapping and visualisation, computing frameworks for processing images, projections.
1. domlysz/BlenderGIS โญ 7,364
Blender addons to make the bridge between Blender and geographic data
2. python-visualization/folium โญ 6,729
Python Data. Leaflet.js Maps.
๐ [python-visualization.github.io/folium](https://python-visualization.github.io/folium/)
3. gboeing/osmnx โญ 4,712
OSMnx is a Python package to easily download, model, analyze, and visualize street networks and other geospatial features from OpenStreetMap.
๐ [osmnx.readthedocs.io](https://osmnx.readthedocs.io)
4. osgeo/gdal โญ 4,585
GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats.
๐ [gdal.org](https://gdal.org)
5. geopandas/geopandas โญ 4,269
Python tools for geographic data
๐ [geopandas.org](http://geopandas.org/)
6. shapely/shapely โญ 3,717
Manipulation and analysis of geometric objects
๐ [shapely.readthedocs.io/en/stable](https://shapely.readthedocs.io/en/stable/)
7. giswqs/geemap โญ 3,263
A Python package for interactive geospatial analysis and visualization with Google Earth Engine.
๐ [geemap.org](https://geemap.org)
8. holoviz/datashader โญ 3,232
Quickly and accurately render even the largest data.
๐ [datashader.org](http://datashader.org)
9. opengeos/leafmap โญ 2,955
A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment
๐ [leafmap.org](https://leafmap.org)
10. opengeos/segment-geospatial โญ 2,703
A Python package for segmenting geospatial data with the Segment Anything Model (SAM)
๐ [samgeo.gishub.org](https://samgeo.gishub.org)
11. google/earthengine-api โญ 2,573
Python and JavaScript bindings for calling the Earth Engine API.
12. microsoft/torchgeo โญ 2,289
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
๐ [www.osgeo.org/projects/torchgeo](https://www.osgeo.org/projects/torchgeo/)
13. rasterio/rasterio โญ 2,162
Rasterio reads and writes geospatial raster datasets
๐ [rasterio.readthedocs.io](https://rasterio.readthedocs.io/)
14. mcordts/cityscapesScripts โญ 2,104
README and scripts for the Cityscapes Dataset
15. azavea/raster-vision โญ 2,014
An open source library and framework for deep learning on satellite and aerial imagery.
๐ [docs.rastervision.io](https://docs.rastervision.io)
16. plant99/felicette โญ 1,813
Satellite imagery for dummies.
17. apache/sedona โญ 1,800
A cluster computing framework for processing large-scale geospatial data
๐ [sedona.apache.org](https://sedona.apache.org/)
18. gboeing/osmnx-examples โญ 1,479
Gallery of OSMnx tutorials, usage examples, and feature demonstations.
๐ [osmnx.readthedocs.io](https://osmnx.readthedocs.io)
19. jupyter-widgets/ipyleaflet โญ 1,459
A Jupyter - Leaflet.js bridge
๐ [ipyleaflet.readthedocs.io](https://ipyleaflet.readthedocs.io)
20. microsoft/GlobalMLBuildingFootprints โญ 1,315
Worldwide building footprints derived from satellite imagery
21. pysal/pysal โญ 1,284
PySAL: Python Spatial Analysis Library Meta-Package
๐ [pysal.org/pysal](http://pysal.org/pysal)
22. anitagraser/movingpandas โญ 1,155
Movement trajectory classes and functions built on top of GeoPandas
๐ [movingpandas.org](http://movingpandas.org)
23. residentmario/geoplot โญ 1,121
High-level geospatial data visualization library for Python.
๐ [residentmario.github.io/geoplot/index.html](https://residentmario.github.io/geoplot/index.html)
24. sentinel-hub/eo-learn โญ 1,084
Earth observation processing framework for machine learning in Python
๐ [eo-learn.readthedocs.io/en/latest](https://eo-learn.readthedocs.io/en/latest/)
25. opengeos/streamlit-geospatial โญ 816
A multi-page streamlit app for geospatial
๐ [huggingface.co/spaces/giswqs/streamlit](https://huggingface.co/spaces/giswqs/Streamlit)
26. makepath/xarray-spatial โญ 794
Raster-based Spatial Analytics for Python
๐ [xarray-spatial.readthedocs.io](https://xarray-spatial.readthedocs.io/)
27. osgeo/grass โญ 780
GRASS GIS - free and open-source geospatial processing engine
๐ [grass.osgeo.org](https://grass.osgeo.org)
28. developmentseed/titiler โญ 710
Build your own Raster dynamic map tile services
๐ [developmentseed.org/titiler](https://developmentseed.org/titiler/)
29. scikit-mobility/scikit-mobility โญ 693
scikit-mobility: mobility analysis in Python
๐ [scikit-mobility.github.io/scikit-mobility](https://scikit-mobility.github.io/scikit-mobility/)
## Graph
Graphs and network libraries: network analysis, graph machine learning, visualisation.
1. networkx/networkx โญ 14,358
Network Analysis in Python
๐ [networkx.org](https://networkx.org)
2. stellargraph/stellargraph โญ 2,909
StellarGraph - Machine Learning on Graphs
๐ [stellargraph.readthedocs.io](https://stellargraph.readthedocs.io/)
3. westhealth/pyvis โญ 930
Python package for creating and visualizing interactive network graphs.
๐ [pyvis.readthedocs.io/en/latest](http://pyvis.readthedocs.io/en/latest/)
4. rampasek/GraphGPS โญ 605
Recipe for a General, Powerful, Scalable Graph Transformer
5. microsoft/graspologic โญ 587
graspologic is a package for graph statistical algorithms
๐ [graspologic-org.github.io/graspologic](https://graspologic-org.github.io/graspologic/)
6. dylanhogg/llmgraph โญ 149
Create knowledge graphs with LLMs
## GUI
Graphical user interface libraries and toolkits.
1. pysimplegui/PySimpleGUI โญ 13,210
Python GUIs for Humans! PySimpleGUI is the top-rated Python application development environment. Launched in 2018 and actively developed, maintained, and supported in 2024. Transforms tkinter, Qt, WxPython, and Remi into a simple, intuitive, and fun experience for both hobbyists and expert users.
๐ [www.pysimplegui.com](https://www.PySimpleGUI.com)
2. hoffstadt/DearPyGui โญ 12,479
Dear PyGui: A fast and powerful Graphical User Interface Toolkit for Python with minimal dependencies
๐ [dearpygui.readthedocs.io/en/latest](https://dearpygui.readthedocs.io/en/latest/)
3. parthjadhav/Tkinter-Designer โญ 8,492
An easy and fast way to create a Python GUI ๐
4. samuelcolvin/FastUI โญ 7,661
FastUI is a new way to build web application user interfaces defined by declarative Python code.
๐ [fastui-demo.onrender.com](https://fastui-demo.onrender.com)
5. r0x0r/pywebview โญ 4,411
Build GUI for your Python program with JavaScript, HTML, and CSS
๐ [pywebview.flowrl.com](https://pywebview.flowrl.com)
6. beeware/toga โญ 4,163
A Python native, OS native GUI toolkit.
๐ [toga.readthedocs.io/en/latest](https://toga.readthedocs.io/en/latest/)
7. dddomodossola/remi โญ 3,461
Python REMote Interface library. Platform independent. In about 100 Kbytes, perfect for your diet.
8. wxwidgets/Phoenix โญ 2,225
wxPython's Project Phoenix. A new implementation of wxPython, better, stronger, faster than he was before.
๐ [wxpython.org](http://wxpython.org/)
## Jupyter
Jupyter and JupyterLab and Notebook tools, libraries and plugins.
1. jupyterlab/jupyterlab โญ 13,875
JupyterLab computational environment.
๐ [jupyterlab.readthedocs.io](https://jupyterlab.readthedocs.io/)
2. jupyter/notebook โญ 11,292
Jupyter Interactive Notebook
๐ [jupyter-notebook.readthedocs.io](https://jupyter-notebook.readthedocs.io/)
3. mwouts/jupytext โญ 6,478
Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
๐ [jupytext.readthedocs.io](https://jupytext.readthedocs.io)
4. nteract/papermill โญ 5,689
๐ Parameterize, execute, and analyze notebooks
๐ [papermill.readthedocs.io/en/latest](http://papermill.readthedocs.io/en/latest/)
5. connorferster/handcalcs โญ 5,371
Python library for converting Python calculations into rendered latex.
6. voila-dashboards/voila โญ 5,273
Voilร turns Jupyter notebooks into standalone web applications
๐ [voila.readthedocs.io](https://voila.readthedocs.io)
7. executablebooks/jupyter-book โญ 3,734
Create beautiful, publication-quality books and documents from computational content.
๐ [jupyterbook.org](http://jupyterbook.org)
8. jupyterlite/jupyterlite โญ 3,703
Wasm powered Jupyter running in the browser ๐ก
๐ [jupyterlite.rtfd.io/en/stable/try/lab](https://jupyterlite.rtfd.io/en/stable/try/lab)
9. jupyterlab/jupyterlab-desktop โญ 3,439
JupyterLab desktop application, based on Electron.
10. jupyter-widgets/ipywidgets โญ 3,081
Interactive Widgets for the Jupyter Notebook
๐ [ipywidgets.readthedocs.io](https://ipywidgets.readthedocs.io)
11. quantopian/qgrid โญ 3,032
An interactive grid for sorting, filtering, and editing DataFrames in Jupyter notebooks
12. jupyterlab/jupyter-ai โญ 2,943
A generative AI extension for JupyterLab
๐ [jupyter-ai.readthedocs.io](https://jupyter-ai.readthedocs.io/)
13. jupyter/nbdime โญ 2,613
Tools for diffing and merging of Jupyter notebooks.
๐ [nbdime.readthedocs.io](http://nbdime.readthedocs.io)
14. mito-ds/mito โญ 2,237
The mitosheet package, trymito.io, and other public Mito code.
๐ [trymito.io](https://trymito.io)
15. jupyter/nbviewer โญ 2,178
nbconvert as a web service: Render Jupyter Notebooks as static web pages
๐ [nbviewer.jupyter.org](https://nbviewer.jupyter.org)
16. maartenbreddels/ipyvolume โญ 1,921
3d plotting for Python in the Jupyter notebook based on IPython widgets using WebGL
17. jupyter-lsp/jupyterlab-lsp โญ 1,754
Coding assistance for JupyterLab (code navigation + hover suggestions + linters + autocompletion + rename) using Language Server Protocol
๐ [jupyterlab-lsp.readthedocs.io](https://jupyterlab-lsp.readthedocs.io)
18. jupyter/nbconvert โญ 1,679
Jupyter Notebook Conversion
๐ [nbconvert.readthedocs.io](https://nbconvert.readthedocs.io/)
19. nbqa-dev/nbQA โญ 983
Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks
๐ [nbqa.readthedocs.io/en/latest/index.html](https://nbqa.readthedocs.io/en/latest/index.html)
20. vizzuhq/ipyvizzu โญ 929
Build animated charts in Jupyter Notebook and similar environments with a simple Python syntax.
๐ [ipyvizzu.vizzuhq.com](https://ipyvizzu.vizzuhq.com)
21. koaning/drawdata โญ 730
Draw datasets from within Jupyter.
๐ [calmcode.io/labs/drawdata.html](https://calmcode.io/labs/drawdata.html)
22. aws/graph-notebook โญ 699
Library extending Jupyter notebooks to integrate with Apache TinkerPop, openCypher, and RDF SPARQL.
๐ [github.com/aws/graph-notebook](https://github.com/aws/graph-notebook)
23. linealabs/lineapy โญ 660
Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.
๐ [lineapy.org](https://lineapy.org)
24. xiaohk/stickyland โญ 505
Break the linear presentation of Jupyter Notebooks with sticky cells!
๐ [xiaohk.github.io/stickyland](https://xiaohk.github.io/stickyland/)
## LLMs and ChatGPT
Large language model and GPT libraries and frameworks: auto-gpt, agents, QnA, chain-of-thought workflows, API integations. Also see the Natural Language Processing category for crossover.
1. significant-gravitas/AutoGPT โญ 162,889
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
๐ [agpt.co](https://agpt.co)
2. hwchase17/langchain โญ 86,865
๐ฆ๐ Build context-aware reasoning applications
๐ [python.langchain.com](https://python.langchain.com)
3. nomic-ai/gpt4all โญ 65,728
gpt4all: run open-source LLMs anywhere
๐ [gpt4all.io](https://gpt4all.io)
4. ggerganov/llama.cpp โญ 59,897
LLM inference in C/C++
5. xtekky/gpt4free โญ 58,660
The official gpt4free repository | various collection of powerful language models
๐ [g4f.ai](https://g4f.ai)
6. facebookresearch/llama โญ 53,830
Inference code for Llama models
7. imartinez/private-gpt โญ 52,578
Interact with your documents using the power of GPT, 100% privately, no data leaks
๐ [docs.privategpt.dev](https://docs.privategpt.dev)
8. gpt-engineer-org/gpt-engineer โญ 51,004
Specify what you want it to build, the AI asks for clarification, and then builds it.
9. killianlucas/open-interpreter โญ 49,538
A natural language interface for computers
๐ [openinterpreter.com](http://openinterpreter.com/)
10. xai-org/grok-1 โญ 48,993
This repository contains JAX example code for loading and running the Grok-1 open-weights model.
11. geekan/MetaGPT โญ 40,758
๐ The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
๐ [deepwisdom.ai](https://deepwisdom.ai/)
12. thudm/ChatGLM-6B โญ 39,746
ChatGLM-6B: An Open Bilingual Dialogue Language Model | ๅผๆบๅ่ฏญๅฏน่ฏ่ฏญ่จๆจกๅ
13. hpcaitech/ColossalAI โญ 38,146
Making large AI models cheaper, faster and more accessible
๐ [www.colossalai.org](https://www.colossalai.org)
14. oobabooga/text-generation-webui โญ 37,599
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
15. laion-ai/Open-Assistant โญ 36,781
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
๐ [open-assistant.io](https://open-assistant.io)
16. lm-sys/FastChat โญ 35,167
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
17. moymix/TaskMatrix โญ 34,529
Connects ChatGPT and a series of Visual Foundation Models to enable sending and receiving images during chatting.
18. quivrhq/quivr โญ 33,690
Your GenAI Second Brain ๐ง A personal productivity assistant (RAG) โก๏ธ๐ค Chat with your docs (PDF, CSV, ...) & apps using Langchain, GPT 3.5 / 4 turbo, Private, Anthropic, VertexAI, Ollama, LLMs, Groq that you can share with users ! Local & Private alternative to OpenAI GPTs & ChatGPT powered by retrieval-augmented...
๐ [quivr.app](https://quivr.app)
19. karpathy/nanoGPT โญ 32,867
The simplest, fastest repository for training/finetuning medium-sized GPTs.
20. jerryjliu/llama_index โญ 32,513
LlamaIndex is a data framework for your LLM applications
๐ [docs.llamaindex.ai](https://docs.llamaindex.ai)
21. tatsu-lab/stanford_alpaca โญ 29,018
Code and documentation to train Stanford's Alpaca models, and generate the data.
๐ [crfm.stanford.edu/2023/03/13/alpaca.html](https://crfm.stanford.edu/2023/03/13/alpaca.html)
22. pythagora-io/gpt-pilot โญ 28,864
The first real AI developer
23. microsoft/autogen โญ 27,041
A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
๐ [microsoft.github.io/autogen](https://microsoft.github.io/autogen/)
24. vision-cair/MiniGPT-4 โญ 25,057
Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
๐ [minigpt-4.github.io](https://minigpt-4.github.io)
25. hiyouga/LLaMA-Factory โญ 23,979
Unify Efficient Fine-Tuning of 100+ LLMs
26. microsoft/JARVIS โญ 23,221
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
27. openai/gpt-2 โญ 21,453
Code for the paper "Language Models are Unsupervised Multitask Learners"
๐ [openai.com/blog/better-language-models](https://openai.com/blog/better-language-models/)
28. openai/chatgpt-retrieval-plugin โญ 20,924
The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
29. vllm-project/vllm โญ 20,751
A high-throughput and memory-efficient inference and serving engine for LLMs
๐ [docs.vllm.ai](https://docs.vllm.ai)
30. karpathy/llm.c โญ 20,533
LLM training in simple, pure C/CUDA. There is no need for 245MB of PyTorch or 107MB of cPython
31. yoheinakajima/babyagi โญ 19,512
GPT-4 powered task-driven autonomous agent
32. karpathy/minGPT โญ 19,192
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
33. microsoft/semantic-kernel โญ 18,952
Integrate cutting-edge LLM technology quickly and easily into your apps
๐ [aka.ms/semantic-kernel](https://aka.ms/semantic-kernel)
34. logspace-ai/langflow โญ 18,736
โ๏ธ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.
๐ [www.langflow.org](http://www.langflow.org)
35. tloen/alpaca-lora โญ 18,309
Instruct-tune LLaMA on consumer hardware
36. rasahq/rasa โญ 18,151
๐ฌ Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
๐ [rasa.com/docs/rasa](https://rasa.com/docs/rasa/)
37. guidance-ai/guidance โญ 17,902
A guidance language for controlling large language models.
38. stitionai/devika โญ 17,498
Devika is an advanced AI software engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective.
39. mlc-ai/mlc-llm โญ 17,472
Universal LLM Deployment Engine with ML Compilation
๐ [llm.mlc.ai](https://llm.mlc.ai/)
40. haotian-liu/LLaVA โญ 17,351
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
๐ [llava.hliu.cc](https://llava.hliu.cc)
41. karpathy/llama2.c โญ 16,544
Inference Llama 2 in one file of pure C
42. joaomdmoura/crewAI โญ 15,713
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
๐ [crewai.com](https://crewai.com)
43. thudm/ChatGLM2-6B โญ 15,560
ChatGLM2-6B: An Open Bilingual Chat LLM | ๅผๆบๅ่ฏญๅฏน่ฏ่ฏญ่จๆจกๅ
44. danielmiessler/fabric โญ 15,495
fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
๐ [danielmiessler.com/p/fabric-origin-story](https://danielmiessler.com/p/fabric-origin-story)
45. facebookresearch/codellama โญ 15,345
Inference code for CodeLlama models
46. transformeroptimus/SuperAGI โญ 14,771
<โก๏ธ> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
๐ [superagi.com](https://superagi.com/)
47. mayooear/gpt4-pdf-chatbot-langchain โญ 14,691
GPT4 & LangChain Chatbot for large PDF docs
๐ [www.youtube.com/watch?v=ih9pbgvvoo4](https://www.youtube.com/watch?v=ih9PBGVVOO4)
48. huggingface/peft โญ 14,549
๐ค PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
๐ [huggingface.co/docs/peft](https://huggingface.co/docs/peft)
49. fauxpilot/fauxpilot โญ 14,360
FauxPilot - an open-source alternative to GitHub Copilot server
50. deepset-ai/haystack โญ 14,226
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conv...
๐ [haystack.deepset.ai](https://haystack.deepset.ai)
51. openai/evals โญ 14,217
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
52. idea-research/Grounded-Segment-Anything โญ 13,870
Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
๐ [arxiv.org/abs/2401.14159](https://arxiv.org/abs/2401.14159)
53. stanfordnlp/dspy โญ 12,561
DSPy: The framework for programmingโnot promptingโfoundation models
๐ [dspy-docs.vercel.app](https://dspy-docs.vercel.app/)
54. assafelovic/gpt-researcher โญ 12,561
GPT based autonomous agent that does online comprehensive research on any given topic
๐ [gptr.dev](https://gptr.dev)
55. qwenlm/Qwen โญ 11,964
The official repo of Qwen (้ไนๅ้ฎ) chat & pretrained large language model proposed by Alibaba Cloud.
56. openlmlab/MOSS โญ 11,865
An open-source tool-augmented conversational language model from Fudan University
๐ [txsun1997.github.io/blogs/moss.html](https://txsun1997.github.io/blogs/moss.html)
57. blinkdl/RWKV-LM โญ 11,845
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
58. smol-ai/developer โญ 11,699
the first library to let you embed a developer agent in your own app!
๐ [twitter.com/smolmodels](https://twitter.com/SmolModels)
59. paddlepaddle/PaddleNLP โญ 11,623
๐ Easy-to-use and powerful NLP and LLM library with ๐ค Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ๐Text Classification, ๐ Neural Search, โ Question Answering, โน๏ธ Information Extraction, ๐ Document Intelligence, ๐ Sentiment Analysis etc.
๐ [paddlenlp.readthedocs.io](https://paddlenlp.readthedocs.io)
60. dao-ailab/flash-attention โญ 11,494
Fast and memory-efficient exact attention
61. unslothai/unsloth โญ 11,286
Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory
๐ [unsloth.ai](https://unsloth.ai)
62. mlc-ai/web-llm โญ 11,048
High-performance In-browser LLM Inference Engine
๐ [webllm.mlc.ai](https://webllm.mlc.ai)
63. h2oai/h2ogpt โญ 10,851
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
๐ [h2o.ai](http://h2o.ai)
64. databrickslabs/dolly โญ 10,794
Databricksโ Dolly, a large language model trained on the Databricks Machine Learning Platform
๐ [www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html](https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html)
65. shishirpatil/gorilla โญ 10,444
Enables LLMs to use tools by invoking APIs. Given a query, Gorilla comes up with the semantically and syntactically correct API.
๐ [gorilla.cs.berkeley.edu](https://gorilla.cs.berkeley.edu/)
66. facebookresearch/llama-recipes โญ 10,068
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta ...
67. phidatahq/phidata โญ 9,930
Phidata is a toolkit for building AI Assistants using function calling.
๐ [docs.phidata.com](https://docs.phidata.com)
68. artidoro/qlora โญ 9,602
QLoRA: Efficient Finetuning of Quantized LLMs
๐ [arxiv.org/abs/2305.14314](https://arxiv.org/abs/2305.14314)
69. berriai/litellm โญ 9,598
Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
๐ [docs.litellm.ai/docs](https://docs.litellm.ai/docs/)
70. google-research/vision_transformer โญ 9,565
Vision Transformer and MLP-Mixer Architectures
71. microsoft/LoRA โญ 9,491
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
๐ [arxiv.org/abs/2106.09685](https://arxiv.org/abs/2106.09685)
72. blinkdl/ChatRWKV โญ 9,324
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
73. infiniflow/ragflow โญ 9,032
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
๐ [ragflow.io](https://ragflow.io)
74. nvidia/Megatron-LM โญ 9,013
Ongoing research training transformer models at scale
๐ [docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start](https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start)
75. mistralai/mistral-inference โญ 8,994
Official inference library for Mistral models
๐ [mistral.ai](https://mistral.ai/)
76. embedchain/embedchain โญ 8,778
Memory for AI agents
๐ [docs.embedchain.ai](https://docs.embedchain.ai)
77. karpathy/minbpe โญ 8,515
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
78. microsoft/promptflow โญ 8,496
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
๐ [microsoft.github.io/promptflow](https://microsoft.github.io/promptflow/)
79. lvwerra/trl โญ 8,471
Train transformer language models with reinforcement learning.
๐ [hf.co/docs/trl](http://hf.co/docs/trl)
80. mshumer/gpt-prompt-engineer โญ 8,175
Simply input a description of your task and some test cases, and the system will generate, test, and rank a multitude of prompts to find the ones that perform the best.
81. eleutherai/gpt-neo โญ 8,157
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
๐ [www.eleuther.ai](https://www.eleuther.ai)
82. optimalscale/LMFlow โญ 8,081
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
๐ [optimalscale.github.io/lmflow](https://optimalscale.github.io/LMFlow/)
83. apple/ml-ferret โญ 7,954
Ferret: Refer and Ground Anything Anywhere at Any Granularity
84. thudm/CodeGeeX โญ 7,858
CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)
๐ [codegeex.cn](https://codegeex.cn)
85. vanna-ai/vanna โญ 7,830
๐ค Chat with your SQL database ๐. Accurate Text-to-SQL Generation via LLMs using RAG ๐.
๐ [vanna.ai/docs](https://vanna.ai/docs/)
86. lightning-ai/litgpt โญ 7,669
Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
๐ [lightning.ai](https://lightning.ai)
87. lianjiatech/BELLE โญ 7,651
BELLE: Be Everyone's Large Language model Engine๏ผๅผๆบไธญๆๅฏน่ฏๅคงๆจกๅ๏ผ
88. thudm/GLM-130B โญ 7,635
GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
89. plachtaa/VALL-E-X โญ 7,345
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io
90. openlm-research/open_llama โญ 7,245
OpenLLaMA: An Open Reproduction of LLaMA
91. sweepai/sweep โญ 7,215
Sweep: open-source AI-powered Software Developer for small features and bug fixes.
๐ [sweep.dev](https://sweep.dev)
92. bigcode-project/starcoder โญ 7,157
Home of StarCoder: fine-tuning & inference!
93. jzhang38/TinyLlama โญ 7,088
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
94. sjtu-ipads/PowerInfer โญ 7,074
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
95. abetlen/llama-cpp-python โญ 6,919
Simple Python bindings for @ggerganov's llama.cpp library.
๐ [llama-cpp-python.readthedocs.io](https://llama-cpp-python.readthedocs.io)
96. bhaskatripathi/pdfGPT โญ 6,778
PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
๐ [huggingface.co/spaces/bhaskartripathi/pdfgpt_turbo](https://huggingface.co/spaces/bhaskartripathi/pdfGPT_Turbo)
97. vaibhavs10/insanely-fast-whisper โญ 6,770
An opinionated CLI to transcribe Audio files w/ Whisper on-device! Powered by ๐ค Transformers, Optimum & flash-attn
98. eleutherai/gpt-neox โญ 6,648
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
๐ [www.eleuther.ai](https://www.eleuther.ai/)
99. apple/corenet โญ 6,643
CoreNet is a deep neural network toolkit that allows researchers and engineers to train standard and novel small and large-scale models for variety of tasks, including foundation models (e.g., CLIP and LLM), object classification, object detection, and semantic segmentation.
100. zilliztech/GPTCache โญ 6,588
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
๐ [gptcache.readthedocs.io](https://gptcache.readthedocs.io)
101. outlines-dev/outlines โญ 6,539
Structured Text Generation from LLMs
๐ [outlines-dev.github.io/outlines](https://outlines-dev.github.io/outlines/)
102. mit-han-lab/streaming-llm โญ 6,299
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
๐ [arxiv.org/abs/2309.17453](https://arxiv.org/abs/2309.17453)
103. langchain-ai/opengpts โญ 6,244
An open source effort to create a similar experience to OpenAI's GPTs and Assistants API.
104. nat/openplayground โญ 6,128
An LLM playground you can run on your laptop
105. jxnl/instructor โญ 6,079
Instructor is a Python library that makes it a breeze to work with structured outputs from large language models (LLMs). Built on top of Pydantic, it provides a simple, transparent, and user-friendly API to manage validation, retries, and streaming responses.
๐ [python.useinstructor.com](https://python.useinstructor.com/)
106. skypilot-org/skypilot โญ 6,048
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed executionโall with a simple interface.
๐ [skypilot.readthedocs.io](https://skypilot.readthedocs.io)
107. run-llama/rags โญ 5,994
Build ChatGPT over your data, all with natural language
108. lightning-ai/lit-llama โญ 5,857
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
109. chainlit/chainlit โญ 5,838
Build Conversational AI in minutes โก๏ธ
๐ [docs.chainlit.io](https://docs.chainlit.io)
110. eleutherai/lm-evaluation-harness โญ 5,488
A framework for few-shot evaluation of language models.
๐ [www.eleuther.ai](https://www.eleuther.ai)
111. internlm/InternLM โญ 5,435
Official release of InternLM2 7B and 20B base and chat models. 200K context support
๐ [internlm.intern-ai.org.cn](https://internlm.intern-ai.org.cn/)
112. dsdanielpark/Bard-API โญ 5,362
The unofficial python package that returns response of Google Bard through cookie value.
๐ [pypi.org/project/bardapi](https://pypi.org/project/bardapi/)
113. explodinggradients/ragas โญ 5,298
Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
๐ [docs.ragas.io](https://docs.ragas.io)
114. minedojo/Voyager โญ 5,270
An Open-Ended Embodied Agent with Large Language Models
๐ [voyager.minedojo.org](https://voyager.minedojo.org/)
115. pytorch-labs/gpt-fast โญ 5,267
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
116. skyvern-ai/skyvern โญ 5,215
Skyvern automates browser-based workflows using LLMs and computer vision. It provides a simple API endpoint to fully automate manual workflows, replacing brittle or unreliable automation solutions.
๐ [www.skyvern.com](https://www.skyvern.com)
117. microsoft/promptbase โญ 5,193
promptbase is an evolving collection of resources, best practices, and example scripts for eliciting the best performance from foundation models.
118. langchain-ai/chat-langchain โญ 4,902
Locally hosted chatbot specifically focused on question answering over the LangChain documentation
๐ [chat.langchain.com](https://chat.langchain.com)
119. weaviate/Verba โญ 4,574
Retrieval Augmented Generation (RAG) chatbot powered by Weaviate
120. openbmb/ToolBench โญ 4,529
[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
๐ [openbmb.github.io/toolbench](https://openbmb.github.io/ToolBench/)
121. mnotgod96/AppAgent โญ 4,496
AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
๐ [appagent-official.github.io](https://appagent-official.github.io/)
122. togethercomputer/RedPajama-Data โญ 4,411
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
123. microsoft/BioGPT โญ 4,243
Implementation of BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
124. vikhyat/moondream โญ 4,205
A tiny open-source computer-vision language model designed to run efficiently on edge devices
๐ [moondream.ai](https://moondream.ai)
125. allenai/OLMo โญ 4,116
OLMo is a repository for training and using AI2's state-of-the-art open language models. It is built by scientists, for scientists.
๐ [allenai.org/olmo](https://allenai.org/olmo)
126. llmware-ai/llmware โญ 4,115
Unified framework for building enterprise RAG pipelines with small, specialized models
๐ [llmware-ai.github.io/llmware](https://llmware-ai.github.io/llmware/)
127. kyegomez/tree-of-thoughts โญ 4,098
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
๐ [discord.gg/qutxnk2nmf](https://discord.gg/qUtxnK2NMf)
128. microsoft/LLMLingua โญ 4,070
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
๐ [llmlingua.com](https://llmlingua.com/)
129. instruction-tuning-with-gpt-4/GPT-4-LLM โญ 4,040
Instruction Tuning with GPT-4
๐ [instruction-tuning-with-gpt-4.github.io](https://instruction-tuning-with-gpt-4.github.io/)
130. 1rgs/jsonformer โญ 3,921
A Bulletproof Way to Generate Structured JSON from Language Models
131. yizhongw/self-instruct โญ 3,875
Aligning pretrained language models with instruction data generated by themselves.
132. mshumer/gpt-llm-trainer โญ 3,854
Input a description of your task, and the system will generate a dataset, parse it, and fine-tune a LLaMA 2 model for you
133. ravenscroftj/turbopilot โญ 3,826
Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
134. cg123/mergekit โญ 3,824
Tools for merging pretrained large language models.
135. whitead/paper-qa โญ 3,715
LLM Chain for answering questions from documents with citations
136. h2oai/h2o-llmstudio โญ 3,714
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/
๐ [gpt-gm.h2o.ai](https://gpt-gm.h2o.ai)
137. langchain-ai/langgraph โญ 3,614
LangGraph is a library for building stateful, multi-actor applications with LLMs, built on top of (and intended to be used with) LangChain.
๐ [langchain-ai.github.io/langgraph](https://langchain-ai.github.io/langgraph/)
138. mmabrouk/llm-workflow-engine โญ 3,602
Power CLI and Workflow manager for LLMs (core package)
139. nvidia/NeMo-Guardrails โญ 3,599
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
140. guardrails-ai/guardrails โญ 3,506
Open-source Python package for specifying structure and type, validating and correcting the outputs of large language models (LLMs)
๐ [www.guardrailsai.com/docs](https://www.guardrailsai.com/docs)
141. luodian/Otter โญ 3,488
๐ฆฆ Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
๐ [otter-ntu.github.io](https://otter-ntu.github.io/)
142. eth-sri/lmql โญ 3,427
A language for constraint-guided and efficient LLM programming.
๐ [lmql.ai](https://lmql.ai)
143. minimaxir/simpleaichat โญ 3,407
Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
144. minimaxir/gpt-2-simple โญ 3,394
Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts
145. microsoft/LMOps โญ 3,267
General technology for enabling AI capabilities w/ LLMs and MLLMs
๐ [aka.ms/generalai](https://aka.ms/GeneralAI)
146. simonw/llm โญ 3,260
Access large language models from the command-line
๐ [llm.datasette.io](https://llm.datasette.io)
147. deep-diver/LLM-As-Chatbot โญ 3,244
LLM as a Chatbot Service
148. promptfoo/promptfoo โญ 3,212
Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
๐ [www.promptfoo.dev](https://www.promptfoo.dev/)
149. pathwaycom/llm-app โญ 3,177
LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,โกin sync with your data sources.
๐ [pathway.com/developers/showcases/llm-app-pathway](https://pathway.com/developers/showcases/llm-app-pathway/)
150. jaymody/picoGPT โญ 3,115
An unnecessarily tiny implementation of GPT-2 in NumPy.
151. turboderp/exllamav2 โญ 3,105
A fast inference library for running LLMs locally on modern consumer-class GPUs
152. defog-ai/sqlcoder โญ 2,988
SoTA LLM for converting natural language questions to SQL queries
153. next-gpt/NExT-GPT โญ 2,981
Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
๐ [next-gpt.github.io](https://next-gpt.github.io/)
154. baichuan-inc/Baichuan-13B โญ 2,970
A 13B large language model developed by Baichuan Intelligent Technology
๐ [huggingface.co/baichuan-inc/baichuan-13b-chat](https://huggingface.co/baichuan-inc/Baichuan-13B-Chat)
155. microsoft/torchscale โญ 2,952
Foundation Architecture for (M)LLMs
๐ [aka.ms/generalai](https://aka.ms/GeneralAI)
156. open-compass/opencompass โญ 2,949
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
๐ [opencompass.org.cn](https://opencompass.org.cn/)
157. iryna-kondr/scikit-llm โญ 2,934
Seamlessly integrate LLMs into scikit-learn.
๐ [beastbyte.ai](https://beastbyte.ai/)
158. freedomintelligence/LLMZoo โญ 2,890
โกLLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.โก
159. agiresearch/AIOS โญ 2,805
AIOS, a Large Language Model (LLM) Agent operating system, embeds large language model into Operating Systems (OS) as the brain of the OS, enabling an operating system "with soul" -- an important step towards AGI.
160. juncongmoo/pyllama โญ 2,796
LLaMA: Open and Efficient Foundation Language Models
161. li-plus/chatglm.cpp โญ 2,690
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs
162. paperswithcode/galai โญ 2,658
Model API for GALACTICA
163. truefoundry/cognita โญ 2,641
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
๐ [cognita.truefoundry.com](https://cognita.truefoundry.com)
164. sgl-project/sglang โญ 2,612
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
165. alpha-vllm/LLaMA2-Accessory โญ 2,577
An Open-source Toolkit for LLM Development
๐ [llama2-accessory.readthedocs.io](https://llama2-accessory.readthedocs.io/)
166. hegelai/prompttools โญ 2,500
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
๐ [prompttools.readthedocs.io](http://prompttools.readthedocs.io)
167. databricks/dbrx โญ 2,451
Code examples and resources for DBRX, a large language model developed by Databricks
๐ [www.databricks.com](https://www.databricks.com/)
168. ofa-sys/OFA โญ 2,355
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
169. bclavie/RAGatouille โญ 2,304
Bridging the gap between state-of-the-art research and alchemical RAG pipeline practices.
170. cohere-ai/cohere-toolkit โญ 2,299
Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
171. civitai/sd_civitai_extension โญ 2,281
All of the Civitai models inside Automatic 1111 Stable Diffusion Web UI
172. young-geng/EasyLM โญ 2,274
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
173. mistralai/mistral-finetune โญ 2,225
A light-weight codebase that enables memory-efficient and performant finetuning of Mistral's models. It is based on LoRA.
174. huggingface/text-embeddings-inference โญ 2,148
A blazing fast inference solution for text embeddings models
๐ [huggingface.co/docs/text-embeddings-inference/quick_tour](https://huggingface.co/docs/text-embeddings-inference/quick_tour)
175. openai/finetune-transformer-lm โญ 2,108
Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
๐ [s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf)
176. noahshinn/reflexion โญ 2,066
[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning
177. cheshire-cat-ai/core โญ 2,064
Production ready AI agent framework
๐ [cheshirecat.ai](https://cheshirecat.ai)
178. tairov/llama2.mojo โญ 2,046
Inference Llama 2 in one file of pure ๐ฅ
๐ [www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov](https://www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov)
179. intel/neural-compressor โญ 2,029
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
๐ [intel.github.io/neural-compressor](https://intel.github.io/neural-compressor/)
180. openai/image-gpt โญ 2,008
Archived. Code and models from the paper "Generative Pretraining from Pixels"
181. spcl/graph-of-thoughts โญ 1,921
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
๐ [arxiv.org/pdf/2308.09687.pdf](https://arxiv.org/pdf/2308.09687.pdf)
182. neulab/prompt2model โญ 1,916
prompt2model - Generate Deployable Models from Natural Language Instructions
183. lucidrains/toolformer-pytorch โญ 1,911
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
184. openai/gpt-2-output-dataset โญ 1,908
Dataset of GPT-2 outputs for research in detection, biases, and more
185. minimaxir/aitextgen โญ 1,830
A robust Python tool for text-based AI training and generation using GPT-2.
๐ [docs.aitextgen.io](https://docs.aitextgen.io)
186. langroid/langroid โญ 1,805
Harness LLMs with Multi-Agent Programming
๐ [langroid.github.io/langroid](https://langroid.github.io/langroid/)
187. ist-daslab/gptq โญ 1,758
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
๐ [arxiv.org/abs/2210.17323](https://arxiv.org/abs/2210.17323)
188. truera/trulens โญ 1,752
Evaluation and Tracking for LLM Experiments
๐ [www.trulens.org](https://www.trulens.org/)
189. predibase/lorax โญ 1,731
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
๐ [loraexchange.ai](https://loraexchange.ai)
190. openai/gpt-discord-bot โญ 1,726
Example Discord bot written in Python that uses the completions API to have conversations with the `text-davinci-003` model, and the moderations API to filter the messages.
191. epfllm/meditron โญ 1,724
Meditron is a suite of open-source medical Large Language Models (LLMs).
๐ [huggingface.co/epfl-llm](https://huggingface.co/epfl-llm)
192. microsoft/Megatron-DeepSpeed โญ 1,687
Ongoing research training transformer language models at scale, including: BERT & GPT-2
193. pipecat-ai/pipecat โญ 1,602
Open Source framework for voice and multimodal conversational AI
194. ray-project/llm-applications โญ 1,565
A comprehensive guide to building RAG-based LLM applications for production.
195. akariasai/self-rag โญ 1,543
This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
๐ [selfrag.github.io](https://selfrag.github.io/)
196. jina-ai/thinkgpt โญ 1,482
Agent techniques to augment your LLM and push it beyong its limits
197. cstankonrad/long_llama โญ 1,433
LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
198. farizrahman4u/loopgpt โญ 1,405
Re-implementation of Auto-GPT as a python package, written with modularity and extensibility in mind.
199. run-llama/llama-lab โญ 1,343
Llama Lab is a repo dedicated to building cutting-edge projects using LlamaIndex
200. casper-hansen/AutoAWQ โญ 1,336
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
๐ [casper-hansen.github.io/autoawq](https://casper-hansen.github.io/AutoAWQ/)
201. explosion/spacy-transformers โญ 1,320
๐ธ Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy
๐ [spacy.io/usage/embeddings-transformers](https://spacy.io/usage/embeddings-transformers)
202. chatarena/chatarena โญ 1,275
ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
๐ [www.chatarena.org](https://www.chatarena.org/)
203. openai/simple-evals โญ 1,274
Lightweight library for evaluating language models
204. bigscience-workshop/Megatron-DeepSpeed โญ 1,259
Ongoing research training transformer language models at scale, including: BERT & GPT-2
205. ray-project/ray-llm โญ 1,190
RayLLM - LLMs on Ray
๐ [aviary.anyscale.com](https://aviary.anyscale.com)
206. srush/MiniChain โญ 1,178
A tiny library for coding with large language models.
๐ [srush-minichain.hf.space](https://srush-minichain.hf.space/)
207. meetkai/functionary โญ 1,163
Chat language model that can use tools and interpret the results
208. ibm/Dromedary โญ 1,091
Dromedary: towards helpful, ethical and reliable LLMs.
209. linksoul-ai/AutoAgents โญ 1,072
[IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.
๐ [huggingface.co/spaces/linksoul/autoagents](https://huggingface.co/spaces/LinkSoul/AutoAgents)
210. lupantech/chameleon-llm โญ 1,032
Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
๐ [chameleon-llm.github.io](https://chameleon-llm.github.io)
211. rlancemartin/auto-evaluator โญ 1,029
Evaluation tool for LLM QA chains
๐ [autoevaluator.langchain.com](https://autoevaluator.langchain.com/)
212. nomic-ai/pygpt4all โญ 1,026
Official supported Python bindings for llama.cpp + gpt4all
๐ [nomic-ai.github.io/pygpt4all](https://nomic-ai.github.io/pygpt4all/)
213. keirp/automatic_prompt_engineer โญ 1,015
Large Language Models Are Human-Level Prompt Engineers
214. hao-ai-lab/LookaheadDecoding โญ 1,011
Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
215. ctlllll/LLM-ToolMaker โญ 1,008
Large Language Models as Tool Makers
216. microsoft/Llama-2-Onnx โญ 996
A Microsoft optimized version of the Llama 2 model, available from Meta
217. explosion/spacy-llm โญ 981
๐ฆ Integrating LLMs into structured NLP pipelines
๐ [spacy.io/usage/large-language-models](https://spacy.io/usage/large-language-models)
218. evolvinglmms-lab/lmms-eval โญ 952
Accelerating the development of large multimodal models (LMMs) with lmms-eval
๐ [lmms-lab.github.io/lmms-eval-blog](https://lmms-lab.github.io/lmms-eval-blog/)
219. ajndkr/lanarky โญ 952
The web framework for building LLM microservices
๐ [lanarky.ajndkr.com](https://lanarky.ajndkr.com/)
220. agenta-ai/agenta โญ 930
The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
๐ [www.agenta.ai](http://www.agenta.ai)
221. pinecone-io/canopy โญ 912
Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone
๐ [www.pinecone.io](https://www.pinecone.io/)
222. likejazz/llama3.np โญ 900
llama3.np is a pure NumPy implementation for Llama 3 model.
223. huggingface/nanotron โญ 897
Minimalistic large language model 3D-parallelism training
224. cerebras/modelzoo โญ 858
Examples of common deep learning models that can be trained on Cerebras hardware
225. muennighoff/sgpt โญ 816
SGPT: GPT Sentence Embeddings for Semantic Search
๐ [arxiv.org/abs/2202.08904](https://arxiv.org/abs/2202.08904)
226. oliveirabruno01/babyagi-asi โญ 760
BabyAGI: an Autonomous and Self-Improving agent, or BASI
227. opengenerativeai/GenossGPT โญ 744
One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) ๐๐ Replace OpenAI GPT with any LLMs in your app with one line.
๐ [genoss.ai](https://genoss.ai/)
228. salesforce/xgen โญ 713
Salesforce open-source LLMs with 8k sequence length.
229. datadreamer-dev/DataDreamer โญ 703
DataDreamer is a powerful open-source Python library for prompting, synthetic data generation, and training workflows. It is designed to be simple, extremely efficient, and research-grade.
๐ [datadreamer.dev](https://datadreamer.dev)
230. topoteretes/cognee โญ 701
Deterministic LLMs Outputs for AI Applications and AI Agents
๐ [www.cognee.ai](https://www.cognee.ai)
231. langchain-ai/langsmith-cookbook โญ 649
LangSmith is a platform for building production-grade LLM applications.
๐ [langsmith-cookbook.vercel.app](https://langsmith-cookbook.vercel.app)
232. prometheus-eval/prometheus-eval โญ 605
Evaluate your LLM's response with Prometheus ๐ฏ
๐ [prometheus-eval.github.io/prometheus-eval](https://prometheus-eval.github.io/prometheus-eval/)
233. opengvlab/OmniQuant โญ 604
[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
234. squeezeailab/SqueezeLLM โญ 588
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
๐ [arxiv.org/abs/2306.07629](https://arxiv.org/abs/2306.07629)
235. wandb/weave โญ 560
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
๐ [wandb.me/weave](https://wandb.me/weave)
236. lupantech/ScienceQA โญ 553
Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
237. zhudotexe/kani โญ 536
kani (ใซใ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
๐ [kani.readthedocs.io](https://kani.readthedocs.io)
238. hazyresearch/ama_prompting โญ 531
Ask Me Anything language model prompting
239. vahe1994/SpQR โญ 513
Quantization algorithm and the model evaluation code for SpQR method for LLM compression
240. continuum-llms/chatgpt-memory โญ 512
Allows to scale the ChatGPT API to multiple simultaneous sessions with infinite contextual and adaptive memory powered by GPT and Redis datastore.
241. modal-labs/llm-finetuning โญ 460
Guide for fine-tuning Llama/Mistral/CodeLlama models and more
242. huggingface/lighteval โญ 437
LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.
243. judahpaul16/gpt-home โญ 338
ChatGPT at home! Basically a better Google Nest Hub or Amazon Alexa home assistant. Built on the Raspberry Pi using the OpenAI API.
๐ [hub.docker.com/r/judahpaul/gpt-home](https://hub.docker.com/r/judahpaul/gpt-home)
244. agentops-ai/tokencost โญ 218
Easy token price estimates for LLMs
๐ [agentops.ai](https://agentops.ai)
245. stanford-oval/suql โญ 154
SUQL: Conversational Search over Structured and Unstructured Data with LLMs
๐ [arxiv.org/abs/2311.09818](https://arxiv.org/abs/2311.09818)
## Math and Science
Mathematical, numerical and scientific libraries.
1. numpy/numpy โญ 26,739
The fundamental package for scientific computing with Python.
๐ [numpy.org](https://numpy.org)
2. taichi-dev/taichi โญ 24,918
Productive, portable, and performant GPU programming in Python: Taichi Lang is an open-source, imperative, parallel programming language for high-performance numerical computation.
๐ [taichi-lang.org](https://taichi-lang.org)
3. scipy/scipy โญ 12,610
SciPy library main repository
๐ [scipy.org](https://scipy.org)
4. sympy/sympy โญ 12,509
A computer algebra system written in pure Python
๐ [sympy.org](https://sympy.org/)
5. google/or-tools โญ 10,663
Google Optimization Tools (a.k.a., OR-Tools) is an open-source, fast and portable software suite for solving combinatorial optimization problems.
๐ [developers.google.com/optimization](https://developers.google.com/optimization/)
6. z3prover/z3 โญ 9,895
Z3 is a theorem prover from Microsoft Research with a Python language binding.
7. cupy/cupy โญ 7,890
NumPy & SciPy for GPU
๐ [cupy.dev](https://cupy.dev)
8. google-deepmind/alphageometry โญ 3,769
Solving Olympiad Geometry without Human Demonstrations
9. mikedh/trimesh โญ 2,813
Python library for loading and using triangular meshes.
๐ [trimesh.org](https://trimesh.org)
10. mckinsey/causalnex โญ 2,176
A Python library that helps data scientists to infer causation rather than observing correlation.
๐ [causalnex.readthedocs.io](http://causalnex.readthedocs.io/)
11. pyomo/pyomo โญ 1,888
An object-oriented algebraic modeling language in Python for structured optimization problems.
๐ [www.pyomo.org](https://www.pyomo.org)
12. facebookresearch/theseus โญ 1,632
A library for differentiable nonlinear optimization
13. google-research/torchsde โญ 1,501
Differentiable SDE solvers with GPU support and efficient sensitivity analysis.
14. dynamicslab/pysindy โญ 1,337
A package for the sparse identification of nonlinear dynamical systems from data
๐ [pysindy.readthedocs.io/en/latest](https://pysindy.readthedocs.io/en/latest/)
15. geomstats/geomstats โญ 1,162
Computations and statistics on manifolds with geometric structures.
๐ [geomstats.ai](http://geomstats.ai)
16. cma-es/pycma โญ 1,038
pycma is a Python implementation of CMA-ES and a few related numerical optimization tools.
17. sj001/AI-Feynman โญ 601
Implementation of AI Feynman: a Physics-Inspired Method for Symbolic Regression
18. willianfuks/tfcausalimpact โญ 584
Python Causal Impact Implementation Based on Google's R Package. Built using TensorFlow Probability.
19. brandondube/prysm โญ 241
Prysm is an open-source library for physical and first-order modeling of optical systems and analysis of related data: numerical and physical optics, integrated modeling, phase retrieval, segmented systems, polynomials and fitting, sequential raytracing.
๐ [prysm.readthedocs.io/en/stable](https://prysm.readthedocs.io/en/stable/)
20. lean-dojo/ReProver โญ 179
Retrieval-Augmented Theorem Provers for Lean
๐ [leandojo.org](https://leandojo.org)
21. albahnsen/pycircular โญ 88
pycircular is a Python module for circular data analysis
22. gbillotey/Fractalshades โญ 26
Arbitrary-precision fractal explorer - Python package
## Machine Learning - General
General and classical machine learning libraries. See below for other sections covering specialised ML areas.
1. scikit-learn/scikit-learn โญ 58,583
scikit-learn: machine learning in Python
๐ [scikit-learn.org](https://scikit-learn.org)
2. openai/openai-cookbook โญ 57,070
Examples and guides for using the OpenAI API
๐ [cookbook.openai.com](https://cookbook.openai.com)
3. tencentarc/GFPGAN โญ 34,898
GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.
4. suno-ai/bark โญ 33,330
๐ Text-Prompted Generative Audio Model
5. google-research/google-research โญ 33,187
This repository contains code released by Google Research
๐ [research.google](https://research.google)
6. facebookresearch/faiss โญ 28,908
A library for efficient similarity search and clustering of dense vectors.
๐ [faiss.ai](https://faiss.ai)
7. google/jax โญ 28,717
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
๐ [jax.readthedocs.io](http://jax.readthedocs.io/)
8. open-mmlab/mmdetection โญ 28,266
OpenMMLab Detection Toolbox and Benchmark
๐ [mmdetection.readthedocs.io](https://mmdetection.readthedocs.io)
9. ageron/handson-ml2 โญ 27,128
A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in Python using Scikit-Learn, Keras and TensorFlow 2.
10. lutzroeder/netron โญ 26,553
Visualizer for neural network, deep learning and machine learning models
๐ [netron.app](https://netron.app)
11. google/mediapipe โญ 25,881
Cross-platform, customizable ML solutions for live and streaming media.
๐ [mediapipe.dev](https://mediapipe.dev)
12. dmlc/xgboost โญ 25,716
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
๐ [xgboost.readthedocs.io/en/stable](https://xgboost.readthedocs.io/en/stable/)
13. harisiqbal88/PlotNeuralNet โญ 21,389
Latex code for making neural networks diagrams
14. jina-ai/jina โญ 20,356
โ๏ธ Build multimodal AI applications with cloud-native stack
๐ [docs.jina.ai](https://docs.jina.ai)
15. onnx/onnx โญ 17,079
Open standard for machine learning interoperability
๐ [onnx.ai](https://onnx.ai/)
16. microsoft/LightGBM โญ 16,176
A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
๐ [lightgbm.readthedocs.io/en/latest](https://lightgbm.readthedocs.io/en/latest/)
17. ml-explore/mlx โญ 15,102
MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research.
๐ [ml-explore.github.io/mlx](https://ml-explore.github.io/mlx/)
18. tensorflow/tensor2tensor โญ 15,035
Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
19. roboflow/supervision โญ 14,978
We write your reusable computer vision tools. ๐
๐ [supervision.roboflow.com](https://supervision.roboflow.com)
20. ddbourgin/numpy-ml โญ 14,691
Machine learning, in numpy
๐ [numpy-ml.readthedocs.io](https://numpy-ml.readthedocs.io/)
21. aleju/imgaug โญ 14,217
Image augmentation for machine learning experiments.
๐ [imgaug.readthedocs.io](http://imgaug.readthedocs.io)
22. microsoft/nni โญ 13,831
An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
๐ [nni.readthedocs.io](https://nni.readthedocs.io)
23. microsoft/onnxruntime โญ 13,167
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
๐ [onnxruntime.ai](https://onnxruntime.ai)
24. microsoft/Swin-Transformer โญ 13,160
This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
๐ [arxiv.org/abs/2103.14030](https://arxiv.org/abs/2103.14030)
25. jindongwang/transferlearning โญ 13,014
Transfer learning / domain adaptation / domain generalization / multi-task learning etc. Papers, codes, datasets, applications, tutorials.-่ฟ็งปๅญฆไน
๐ [transferlearning.xyz](http://transferlearning.xyz/)
26. deepmind/deepmind-research โญ 12,903
This repository contains implementations and illustrative code to accompany DeepMind publications
27. spotify/annoy โญ 12,822
Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk
28. neonbjb/tortoise-tts โญ 12,168
A multi-voice TTS system trained with an emphasis on quality
29. deepmind/alphafold โญ 11,991
Implementation of the inference pipeline of AlphaFold v2
30. facebookresearch/AnimatedDrawings โญ 10,274
Code to accompany "A Method for Animating Children's Drawings of the Human Figure"
31. ggerganov/ggml โญ 10,089
Tensor library for machine learning
32. twitter/the-algorithm-ml โญ 9,938
Source code for Twitter's Recommendation Algorithm
๐ [blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm](https://blog.twitter.com/engineering/en_us/topics/open-source/2023/twitter-recommendation-algorithm)
33. optuna/optuna โญ 9,932
A hyperparameter optimization framework
๐ [optuna.org](https://optuna.org)
34. statsmodels/statsmodels โญ 9,659
Statsmodels: statistical modeling and econometrics in Python
๐ [www.statsmodels.org/devel](http://www.statsmodels.org/devel/)
35. epistasislab/tpot โญ 9,550
A Python Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming.
๐ [epistasislab.github.io/tpot](http://epistasislab.github.io/tpot/)
36. megvii-basedetection/YOLOX โญ 9,101
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
37. cleanlab/cleanlab โญ 8,905
The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
๐ [cleanlab.ai](https://cleanlab.ai)
38. pycaret/pycaret โญ 8,580
An open-source, low-code machine learning library in Python
๐ [www.pycaret.org](https://www.pycaret.org)
39. wandb/wandb โญ 8,435
๐ฅ A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
๐ [wandb.ai](https://wandb.ai)
40. pymc-devs/pymc โญ 8,250
Bayesian Modeling and Probabilistic Programming in Python
๐ [docs.pymc.io](https://docs.pymc.io/)
41. uberi/speech_recognition โญ 8,123
Speech recognition module for Python, supporting several engines and APIs, online and offline.
๐ [pypi.python.org/pypi/speechrecognition](https://pypi.python.org/pypi/SpeechRecognition/)
42. facebookresearch/xformers โญ 7,847
Hackable and optimized Transformers building blocks, supporting a composable construction.
๐ [facebookresearch.github.io/xformers](https://facebookresearch.github.io/xformers/)
43. catboost/catboost โญ 7,833
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
๐ [catboost.ai](https://catboost.ai)
44. open-mmlab/mmsegmentation โญ 7,590
OpenMMLab Semantic Segmentation Toolbox and Benchmark.
๐ [mmsegmentation.readthedocs.io/en/main](https://mmsegmentation.readthedocs.io/en/main/)
45. automl/auto-sklearn โญ 7,453
Automated Machine Learning with scikit-learn
๐ [automl.github.io/auto-sklearn](https://automl.github.io/auto-sklearn)
46. awslabs/autogluon โญ 7,278
Fast and Accurate ML in 3 Lines of Code
๐ [auto.gluon.ai](https://auto.gluon.ai/)
47. huggingface/accelerate โญ 7,214
๐ A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
๐ [huggingface.co/docs/accelerate](https://huggingface.co/docs/accelerate)
48. hyperopt/hyperopt โญ 7,119
Distributed Asynchronous Hyperparameter Optimization in Python
๐ [hyperopt.github.io/hyperopt](http://hyperopt.github.io/hyperopt)
49. lmcinnes/umap โญ 7,112
Uniform Manifold Approximation and Projection
50. featurelabs/featuretools โญ 7,096
An open source python library for automated feature engineering
๐ [www.featuretools.com](https://www.featuretools.com)
51. hips/autograd โญ 6,840
Efficiently computes derivatives of numpy code.
52. py-why/dowhy โญ 6,835
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.
๐ [www.pywhy.org/dowhy](https://www.pywhy.org/dowhy)
53. scikit-learn-contrib/imbalanced-learn โญ 6,734
A Python Package to Tackle the Curse of Imbalanced Datasets in Machine Learning
๐ [imbalanced-learn.org](https://imbalanced-learn.org)
54. open-mmlab/mmagic โญ 6,669
OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic ๐ช: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.
๐ [mmagic.readthedocs.io/en/latest](https://mmagic.readthedocs.io/en/latest/)
55. probml/pyprobml โญ 6,316
Python code for "Probabilistic Machine learning" book by Kevin Murphy
56. nicolashug/Surprise โญ 6,239
A Python scikit for building and analyzing recommender systems
๐ [surpriselib.com](http://surpriselib.com)
57. google/automl โญ 6,165
Google Brain AutoML
58. cleverhans-lab/cleverhans โญ 6,094
An adversarial example library for constructing attacks, building defenses, and benchmarking both
59. kevinmusgrave/pytorch-metric-learning โญ 5,836
The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.
๐ [kevinmusgrave.github.io/pytorch-metric-learning](https://kevinmusgrave.github.io/pytorch-metric-learning/)
60. open-mmlab/mmcv โญ 5,694
OpenMMLab Computer Vision Foundation
๐ [mmcv.readthedocs.io/en/latest](https://mmcv.readthedocs.io/en/latest/)
61. project-monai/MONAI โญ 5,449
AI Toolkit for Healthcare Imaging
๐ [monai.io](https://monai.io/)
62. ml-explore/mlx-examples โญ 5,305
Examples in the MLX framework
63. mdbloice/Augmentor โญ 5,039
Image augmentation library in Python for machine learning.
๐ [augmentor.readthedocs.io/en/stable](https://augmentor.readthedocs.io/en/stable)
64. uber/causalml โญ 4,837
Uplift modeling and causal inference with machine learning algorithms
65. online-ml/river โญ 4,830
๐ Online machine learning in Python
๐ [riverml.xyz](https://riverml.xyz)
66. rasbt/mlxtend โญ 4,800
A library of extension and helper modules for Python's data analysis and machine learning libraries.
๐ [rasbt.github.io/mlxtend](https://rasbt.github.io/mlxtend/)
67. lucidrains/deep-daze โญ 4,379
Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun
68. google-deepmind/graphcast โญ 4,330
GraphCast: Learning skillful medium-range global weather forecasting
69. skvark/opencv-python โญ 4,250
Automated CI toolchain to produce precompiled opencv-python, opencv-python-headless, opencv-contrib-python and opencv-contrib-python-headless packages.
๐ [pypi.org/project/opencv-python](https://pypi.org/project/opencv-python/)
70. marqo-ai/marqo โญ 4,248
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
๐ [www.marqo.ai](https://www.marqo.ai/)
71. districtdatalabs/yellowbrick โญ 4,221
Visual analysis and diagnostic tools to facilitate machine learning model selection.
๐ [www.scikit-yb.org](http://www.scikit-yb.org/)
72. sanchit-gandhi/whisper-jax โญ 4,165
JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.
73. nv-tlabs/GET3D โญ 4,142
Generative Model of High Quality 3D Textured Shapes Learned from Images
74. apple/coremltools โญ 4,137
Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.
๐ [coremltools.readme.io](https://coremltools.readme.io)
75. nmslib/hnswlib โญ 4,088
Header-only C++/python library for fast approximate nearest neighbors
๐ [github.com/nmslib/hnswlib](https://github.com/nmslib/hnswlib)
76. cmusphinx/pocketsphinx โญ 3,798
A small speech recognizer
77. microsoft/FLAML โญ 3,728
A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.
๐ [microsoft.github.io/flaml](https://microsoft.github.io/FLAML/)
78. ourownstory/neural_prophet โญ 3,692
NeuralProphet: A simple forecasting package
๐ [neuralprophet.com](https://neuralprophet.com)
79. google-gemini/cookbook โญ 3,650
A collection of guides and examples for the Gemini API, including quickstart tutorials for writing prompts.
๐ [ai.google.dev/gemini-api/docs](https://ai.google.dev/gemini-api/docs)
80. py-why/EconML โญ 3,607
ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to brin...
๐ [www.microsoft.com/en-us/research/project/alice](https://www.microsoft.com/en-us/research/project/alice/)
81. huggingface/autotrain-advanced โญ 3,530
AutoTrain Advanced: faster and easier training and deployments of state-of-the-art machine learning models
๐ [huggingface.co/autotrain](https://huggingface.co/autotrain)
82. thudm/CogVideo โญ 3,529
Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"
83. huggingface/notebooks โญ 3,385
Notebooks using the Hugging Face libraries ๐ค
84. facebookresearch/vissl โญ 3,235
VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
๐ [vissl.ai](https://vissl.ai)
85. rucaibox/RecBole โญ 3,230
A unified, comprehensive and efficient recommendation library
๐ [recbole.io](https://recbole.io/)
86. yoheinakajima/instagraph โญ 3,225
Converts text input or URL into knowledge graph and displays
87. pytorch/glow โญ 3,176
Compiler for Neural Network hardware accelerators
88. hrnet/HRNet-Semantic-Segmentation โญ 3,078
The OCR approach is rephrased as Segmentation Transformer: https://arxiv.org/abs/1909.11065. This is an official implementation of semantic segmentation for HRNet. https://arxiv.org/abs/1908.07919
89. zjunlp/DeepKE โญ 3,075
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
๐ [deepke.zjukg.cn](http://deepke.zjukg.cn/)
90. lucidrains/musiclm-pytorch โญ 3,065
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
91. mljar/mljar-supervised โญ 2,952
Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
๐ [mljar.com](https://mljar.com)
92. lightly-ai/lightly โญ 2,798
A python library for self-supervised learning on images.
๐ [docs.lightly.ai/self-supervised-learning](https://docs.lightly.ai/self-supervised-learning/)
93. shankarpandala/lazypredict โญ 2,737
Lazy Predict help build a lot of basic models without much code and helps understand which models works better without any parameter tuning
94. scikit-optimize/scikit-optimize โญ 2,731
Sequential model-based optimization with a `scipy.optimize` interface
๐ [scikit-optimize.github.io](https://scikit-optimize.github.io)
95. scikit-learn-contrib/hdbscan โญ 2,709
A high performance implementation of HDBSCAN clustering.
๐ [hdbscan.readthedocs.io/en/latest](http://hdbscan.readthedocs.io/en/latest/)
96. google-research/t5x โญ 2,547
T5X is a modular, composable, research-friendly framework for high-performance, configurable, self-service training, evaluation, and inference of sequence models (starting with language) at many scales.
97. huggingface/safetensors โญ 2,539
Implements a new simple format for storing tensors safely (as opposed to pickle) and that is still fast (zero-copy).
๐ [huggingface.co/docs/safetensors](https://huggingface.co/docs/safetensors)
98. apple/ml-ane-transformers โญ 2,499
Reference implementation of the Transformer architecture optimized for Apple Neural Engine (ANE)
99. scikit-learn-contrib/category_encoders โญ 2,378
A library of sklearn compatible categorical variable encoders
๐ [contrib.scikit-learn.org/category_encoders](http://contrib.scikit-learn.org/category_encoders/)
100. freedmand/semantra โญ 2,333
Semantra is a multipurpose tool for semantically searching documents. Query by meaning rather than just by matching text.
101. huggingface/optimum โญ 2,245
๐ Accelerate training and inference of ๐ค Transformers and ๐ค Diffusers with easy to use hardware optimization tools
๐ [huggingface.co/docs/optimum/main](https://huggingface.co/docs/optimum/main/)
102. rom1504/clip-retrieval โญ 2,208
Easily compute clip embeddings and build a clip retrieval system with them
๐ [rom1504.github.io/clip-retrieval](https://rom1504.github.io/clip-retrieval/)
103. aws/sagemaker-python-sdk โญ 2,059
A library for training and deploying machine learning models on Amazon SageMaker
๐ [sagemaker.readthedocs.io](https://sagemaker.readthedocs.io/)
104. huggingface/evaluate โญ 1,856
๐ค Evaluate: A library for easily evaluating machine learning models and datasets.
๐ [huggingface.co/docs/evaluate](https://huggingface.co/docs/evaluate)
105. rentruewang/koila โญ 1,816
Prevent PyTorch's `CUDA error: out of memory` in just 1 line of code.
๐ [rentruewang.github.io/koila](https://rentruewang.github.io/koila/)
106. contextlab/hypertools โญ 1,805
A Python toolbox for gaining geometric insights into high-dimensional data
๐ [hypertools.readthedocs.io/en/latest](http://hypertools.readthedocs.io/en/latest/)
107. linkedin/greykite โญ 1,798
A flexible, intuitive and fast forecasting library
108. bmabey/pyLDAvis โญ 1,786
Python library for interactive topic model visualization. Port of the R LDAvis package.
109. huggingface/huggingface_hub โญ 1,780
The official Python client for the Huggingface Hub.
๐ [huggingface.co/docs/huggingface_hub](https://huggingface.co/docs/huggingface_hub)
110. eric-mitchell/direct-preference-optimization โญ 1,753
Reference implementation for DPO (Direct Preference Optimization)
111. scikit-learn-contrib/lightning โญ 1,706
Large-scale linear classification, regression and ranking in Python
๐ [contrib.scikit-learn.org/lightning](https://contrib.scikit-learn.org/lightning/)
112. tensorflow/addons โญ 1,679
Useful extra functionality for TensorFlow 2.x maintained by SIG-addons
113. microsoft/i-Code โญ 1,646
The ambition of the i-Code project is to build integrative and composable multimodal AI. The "i" stands for integrative multimodal learning.
114. castorini/pyserini โญ 1,516
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
๐ [pyserini.io](http://pyserini.io/)
115. kubeflow/katib โญ 1,446
Automated Machine Learning on Kubernetes
๐ [www.kubeflow.org/docs/components/katib](https://www.kubeflow.org/docs/components/katib)
116. visual-layer/fastdup โญ 1,443
fastdup is a powerful free tool designed to rapidly extract valuable insights from your image & video datasets. Assisting you to increase your dataset images & labels quality and reduce your data operations costs at an unparalleled scale.
117. jina-ai/finetuner โญ 1,443
:dart: Task-oriented embedding tuning for BERT, CLIP, etc.
๐ [finetuner.jina.ai](https://finetuner.jina.ai)
118. googlecloudplatform/vertex-ai-samples โญ 1,439
Sample code and notebooks for Vertex AI, the end-to-end machine learning platform on Google Cloud
๐ [cloud.google.com/vertex-ai](https://cloud.google.com/vertex-ai)
119. laekov/fastmoe โญ 1,433
A fast MoE impl for PyTorch
๐ [fastmoe.ai](https://fastmoe.ai)
120. csinva/imodels โญ 1,323
Interpretable ML package ๐ for concise, transparent, and accurate predictive modeling (sklearn-compatible).
๐ [csinva.io/imodels](https://csinva.io/imodels)
121. microsoft/Olive โญ 1,316
Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation.
๐ [microsoft.github.io/olive](https://microsoft.github.io/Olive/)
122. borealisai/advertorch โญ 1,279
A Toolbox for Adversarial Robustness Research
123. awslabs/dgl-ke โญ 1,242
High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.
๐ [dglke.dgl.ai/doc](https://dglke.dgl.ai/doc/)
124. microsoft/Semi-supervised-learning โญ 1,234
A Unified Semi-Supervised Learning Codebase (NeurIPS'22)
๐ [usb.readthedocs.io](https://usb.readthedocs.io)
125. patchy631/machine-learning โญ 1,215
Machine Learning Tutorials Repository
126. spotify/voyager โญ 1,192
๐ฐ๏ธ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
๐ [spotify.github.io/voyager](https://spotify.github.io/voyager/)
127. google/vizier โญ 1,181
Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
๐ [oss-vizier.readthedocs.io](https://oss-vizier.readthedocs.io)
128. koaning/scikit-lego โญ 1,165
Extra blocks for scikit-learn pipelines.
๐ [koaning.github.io/scikit-lego](https://koaning.github.io/scikit-lego/)
129. automl/TabPFN โญ 1,109
Official implementation of the TabPFN paper (https://arxiv.org/abs/2207.01848) and the tabpfn package.
๐ [priorlabs.ai](http://priorlabs.ai)
130. lightning-ai/lightning-thunder โญ 1,050
Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.
131. google-research/deeplab2 โญ 991
DeepLab2 is a TensorFlow library for deep labeling, aiming to provide a unified and state-of-the-art TensorFlow codebase for dense pixel labeling tasks.
132. qdrant/fastembed โญ 919
Fast, Accurate, Lightweight Python library to make State of the Art Embedding
๐ [qdrant.github.io/fastembed](https://qdrant.github.io/fastembed/)
133. davidmrau/mixture-of-experts โญ 873
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
134. lmcinnes/pynndescent โญ 857
A Python nearest neighbor descent for approximate nearest neighbors
135. hazyresearch/safari โญ 842
Convolutions for Sequence Modeling
136. opentensor/bittensor โญ 807
Internet-scale Neural Networks
๐ [www.bittensor.com](https://www.bittensor.com/)
137. nvidia/cuda-python โญ 790
CUDA Python Low-level Bindings
๐ [nvidia.github.io/cuda-python](https://nvidia.github.io/cuda-python/)
138. oml-team/open-metric-learning โญ 784
OML is a PyTorch-based framework to train and validate the models producing high-quality embeddings.
๐ [open-metric-learning.readthedocs.io/en/latest/index.html](https://open-metric-learning.readthedocs.io/en/latest/index.html)
139. criteo/autofaiss โญ 764
Automatically create Faiss knn indices with the most optimal similarity search parameters.
๐ [criteo.github.io/autofaiss](https://criteo.github.io/autofaiss/)
140. facebookresearch/balance โญ 673
The balance python package offers a simple workflow and methods for dealing with biased data samples when looking to infer from them to some target population of interest.
๐ [import-balance.org](https://import-balance.org)
141. replicate/replicate-python โญ 669
Python client for Replicate
๐ [replicate.com](https://replicate.com)
142. awslabs/python-deequ โญ 657
Python API for Deequ, a library built on Spark for defining "unit tests for data", which measure data quality in large datasets
143. nicolas-hbt/pygraft โญ 646
Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
๐ [pygraft.readthedocs.io/en/latest](https://pygraft.readthedocs.io/en/latest/)
144. hpcaitech/EnergonAI โญ 629
Large-scale model inference.
145. qdrant/quaterion โญ 627
Blazing fast framework for fine-tuning similarity learning models
๐ [quaterion.qdrant.tech](https://quaterion.qdrant.tech/)
146. huggingface/optimum-quanto โญ 616
A pytorch quantization backend for optimum
147. googleapis/python-aiplatform โญ 562
A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
148. huggingface/exporters โญ 559
Export Hugging Face models to Core ML and TensorFlow Lite
149. pymc-labs/pymc-marketing โญ 557
Bayesian marketing toolbox in PyMC. Media Mix (MMM), customer lifetime value (CLV), buy-till-you-die (BTYD) models and more.
๐ [www.pymc-marketing.io](https://www.pymc-marketing.io/)
150. microsoft/Focal-Transformer โญ 543
[NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"
151. nevronai/MetisFL โญ 533
The first open Federated Learning framework implemented in C++ and Python.
๐ [metisfl.org](https://metisfl.org)
152. cvxgrp/pymde โญ 524
Minimum-distortion embedding with PyTorch
๐ [pymde.org](https://pymde.org)
153. mrdbourke/m1-machine-learning-test โญ 508
Code for testing various M1 Chip benchmarks with TensorFlow.
154. dylanhogg/gptauthor โญ 47
GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.
## Machine Learning - Deep Learning
Machine learning libraries that cross over with deep learning in some way.
1. tensorflow/tensorflow โญ 183,354
An Open Source Machine Learning Framework for Everyone
๐ [tensorflow.org](https://tensorflow.org)
2. pytorch/pytorch โญ 79,294
Tensors and Dynamic neural networks in Python with strong GPU acceleration
๐ [pytorch.org](https://pytorch.org)
3. openai/whisper โญ 62,819
Robust Speech Recognition via Large-Scale Weak Supervision
4. keras-team/keras โญ 61,158
Deep Learning for humans
๐ [keras.io](http://keras.io/)
5. deepfakes/faceswap โญ 49,643
Deepfakes Software For All
๐ [www.faceswap.dev](https://www.faceswap.dev)
6. iperov/DeepFaceLab โญ 45,965
DeepFaceLab is the leading software for creating deepfakes.
7. facebookresearch/segment-anything โญ 44,924
The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
8. microsoft/DeepSpeed โญ 33,308
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
๐ [www.deepspeed.ai](https://www.deepspeed.ai/)
9. rwightman/pytorch-image-models โญ 30,332
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
๐ [huggingface.co/docs/timm](https://huggingface.co/docs/timm)
10. facebookresearch/detectron2 โญ 29,111
Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
๐ [detectron2.readthedocs.io/en/latest](https://detectron2.readthedocs.io/en/latest/)
11. lightning-ai/pytorch-lightning โญ 27,241
The deep learning framework to pretrain, finetune and deploy AI models. PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch code to decouple the science from the engineering.
๐ [lightning.ai](https://lightning.ai)
12. xinntao/Real-ESRGAN โญ 26,601
Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.
13. facebookresearch/Detectron โญ 26,179
FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
14. matterport/Mask_RCNN โญ 24,284
Mask R-CNN for object detection and instance segmentation on Keras and TensorFlow
15. openai/CLIP โญ 22,997
CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
16. paddlepaddle/Paddle โญ 21,717
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice ๏ผใ้ฃๆกจใๆ ธๅฟๆกๆถ๏ผๆทฑๅบฆๅญฆไน &ๆบๅจๅญฆไน ้ซๆง่ฝๅๆบใๅๅธๅผ่ฎญ็ปๅ่ทจๅนณๅฐ้จ็ฝฒ๏ผ
๐ [www.paddlepaddle.org](http://www.paddlepaddle.org/)
17. apache/mxnet โญ 20,721
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more
๐ [mxnet.apache.org](https://mxnet.apache.org)
18. pyg-team/pytorch_geometric โญ 20,408
Graph Neural Network Library for PyTorch
๐ [pyg.org](https://pyg.org)
19. lucidrains/vit-pytorch โญ 18,467
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
20. sanster/IOPaint โญ 17,820
Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
๐ [www.iopaint.com](https://www.iopaint.com/)
21. rasbt/deeplearning-models โญ 16,393
A collection of various deep learning architectures, models, and tips
22. danielgatis/rembg โญ 15,075
Rembg is a tool to remove images background
23. albumentations-team/albumentations โญ 13,616
Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125
๐ [albumentations.ai](https://albumentations.ai)
24. dmlc/dgl โญ 13,130
Python package built to ease deep learning on graph, on top of existing DL frameworks.
๐ [dgl.ai](http://dgl.ai)
25. facebookresearch/detr โญ 13,015
End-to-End Object Detection with Transformers
26. nvidia/DeepLearningExamples โญ 12,797
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
27. kornia/kornia โญ 9,532
Geometric Computer Vision Library for Spatial AI
๐ [kornia.readthedocs.io](https://kornia.readthedocs.io)
28. keras-team/autokeras โญ 9,090
AutoML library for deep learning
๐ [autokeras.com](http://autokeras.com/)
29. mlfoundations/open_clip โญ 8,857
An open source implementation of OpenAI's CLIP (Contrastive Language-Image Pre-training)
30. facebookresearch/pytorch3d โญ 8,419
PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
๐ [pytorch3d.org](https://pytorch3d.org/)
31. pyro-ppl/pyro โญ 8,411
Deep universal probabilistic programming with Python and PyTorch
๐ [pyro.ai](http://pyro.ai)
32. nvidia/apex โญ 8,128
A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
33. arogozhnikov/einops โญ 8,051
Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)
๐ [einops.rocks](https://einops.rocks)
34. facebookresearch/ImageBind โญ 7,987
ImageBind One Embedding Space to Bind Them All
35. google/trax โญ 7,980
Trax โ Deep Learning with Clear Code and Speed
36. lucidrains/imagen-pytorch โญ 7,843
Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch
37. xpixelgroup/BasicSR โญ 6,337
Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc. Currently, it includes EDSR, RCAN, SRResNet, SRGAN, ESRGAN, EDVR, BasicVSR, SwinIR, ECBSR, etc. Also support StyleGAN2, DFDNet.
๐ [basicsr.readthedocs.io/en/latest](https://basicsr.readthedocs.io/en/latest/)
38. google/flax โญ 5,684
Flax is a neural network library for JAX that is designed for flexibility.
๐ [flax.readthedocs.io](https://flax.readthedocs.io)
39. skorch-dev/skorch โญ 5,669
A scikit-learn compatible neural network library that wraps PyTorch
40. facebookresearch/mmf โญ 5,432
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
๐ [mmf.sh](https://mmf.sh/)
41. mosaicml/composer โญ 5,052
Supercharge Your Model Training
๐ [docs.mosaicml.com](http://docs.mosaicml.com)
42. pytorch/ignite โญ 4,475
High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
๐ [pytorch-ignite.ai](https://pytorch-ignite.ai)
43. facebookincubator/AITemplate โญ 4,472
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
44. deci-ai/super-gradients โญ 4,391
Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS.
๐ [www.supergradients.com](https://www.supergradients.com)
45. nvidiagameworks/kaolin โญ 4,282
A PyTorch Library for Accelerating 3D Deep Learning Research
46. williamyang1991/VToonify โญ 3,488
[SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer
47. facebookresearch/PyTorch-BigGraph โญ 3,354
Generate embeddings from large-scale graph-structured data.
๐ [torchbiggraph.readthedocs.io](https://torchbiggraph.readthedocs.io/)
48. cvg/LightGlue โญ 3,092
LightGlue: Local Feature Matching at Light Speed (ICCV 2023)
49. google-research/scenic โญ 3,076
Scenic: A Jax Library for Computer Vision Research and Beyond
50. alpa-projects/alpa โญ 2,997
Training and serving large-scale neural networks with auto parallelization.
๐ [alpa.ai](https://alpa.ai)
51. pytorch/botorch โญ 2,981
Bayesian optimization in PyTorch
๐ [botorch.org](https://botorch.org/)
52. deepmind/dm-haiku โญ 2,823
JAX-based neural network library
๐ [dm-haiku.readthedocs.io](https://dm-haiku.readthedocs.io)
53. explosion/thinc โญ 2,803
๐ฎ A refreshing functional take on deep learning, compatible with your favorite libraries
๐ [thinc.ai](https://thinc.ai)
54. nerdyrodent/VQGAN-CLIP โญ 2,580
Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.
55. danielegrattarola/spektral โญ 2,348
Graph Neural Networks with Keras and Tensorflow 2.
๐ [graphneural.network](https://graphneural.network)
56. google-research/electra โญ 2,301
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
57. neuralmagic/sparseml โญ 1,995
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
58. fepegar/torchio โญ 1,980
Medical imaging toolkit for deep learning
๐ [www.torchio.org](http://www.torchio.org)
59. pytorch/torchrec โญ 1,765
Pytorch domain library for recommendation systems
60. tensorflow/mesh โญ 1,563
Mesh TensorFlow: Model Parallelism Made Easier
61. vt-vl-lab/FGVC โญ 1,547
[ECCV 2020] Flow-edge Guided Video Completion
62. tensorly/tensorly โญ 1,510
TensorLy: Tensor Learning in Python.
๐ [tensorly.org](http://tensorly.org)
63. calculatedcontent/WeightWatcher โญ 1,406
The WeightWatcher tool for predicting the accuracy of Deep Neural Networks
64. hysts/pytorch_image_classification โญ 1,329
PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet
65. jeshraghian/snntorch โญ 1,143
Deep and online learning with spiking neural networks in Python
๐ [snntorch.readthedocs.io/en/latest](https://snntorch.readthedocs.io/en/latest/)
66. xl0/lovely-tensors โญ 1,060
Tensors, ready for human consumption
๐ [xl0.github.io/lovely-tensors](https://xl0.github.io/lovely-tensors)
67. tensorflow/similarity โญ 1,001
TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
68. deepmind/android_env โญ 966
RL research on Android devices.
69. keras-team/keras-cv โญ 962
Industry-strength Computer Vision workflows with Keras
70. deepmind/chex โญ 735
Chex is a library of utilities for helping to write reliable JAX code
๐ [chex.readthedocs.io](https://chex.readthedocs.io)
71. kakaobrain/rq-vae-transformer โญ 713
The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)
72. whitead/dmol-book โญ 588
Deep learning for molecules and materials book
๐ [dmol.pub](https://dmol.pub)
## Machine Learning - Interpretability
Machine learning interpretability libraries. Covers explainability, prediction explainations, dashboards, understanding knowledge development in training.
1. slundberg/shap โญ 21,928
A game theoretic approach to explain the output of any machine learning model.
๐ [shap.readthedocs.io](https://shap.readthedocs.io)
2. marcotcr/lime โญ 11,369
Lime: Explaining the predictions of any machine learning classifier
3. interpretml/interpret โญ 6,097
Fit interpretable models. Explain blackbox machine learning.
๐ [interpret.ml/docs](https://interpret.ml/docs)
4. pytorch/captum โญ 4,653
Model interpretability and understanding for PyTorch
๐ [captum.ai](https://captum.ai)
5. tensorflow/lucid โญ 4,623
A collection of infrastructure and tools for research in neural network interpretability.
6. pair-code/lit โญ 3,416
The Learning Interpretability Tool: Interactively analyze ML models to understand their behavior in an extensible and framework agnostic interface.
๐ [pair-code.github.io/lit](https://pair-code.github.io/lit)
7. arize-ai/phoenix โญ 2,866
AI Observability & Evaluation
๐ [docs.arize.com/phoenix](https://docs.arize.com/phoenix)
8. teamhg-memex/eli5 โญ 2,737
A library for debugging/inspecting machine learning classifiers and explaining their predictions
๐ [eli5.readthedocs.io](http://eli5.readthedocs.io)
9. maif/shapash โญ 2,670
๐
Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
๐ [maif.github.io/shapash](https://maif.github.io/shapash/)
10. seldonio/alibi โญ 2,319
Algorithms for explaining machine learning models
๐ [docs.seldon.io/projects/alibi/en/stable](https://docs.seldon.io/projects/alibi/en/stable/)
11. oegedijk/explainerdashboard โญ 2,249
Quickly build Explainable AI dashboards that show the inner workings of so-called "blackbox" machine learning models.
๐ [explainerdashboard.readthedocs.io](http://explainerdashboard.readthedocs.io)
12. eleutherai/pythia โญ 2,096
Interpretability analysis and scaling laws to understand how knowledge develops and evolves during training in autoregressive transformers
13. jalammar/ecco โญ 1,926
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
๐ [ecco.readthedocs.io](https://ecco.readthedocs.io)
14. trusted-ai/AIX360 โญ 1,549
Interpretability and explainability of data and machine learning models
๐ [aix360.res.ibm.com](https://aix360.res.ibm.com/)
15. google-deepmind/penzai โญ 1,497
A JAX library for writing models as legible, functional pytree data structures, along with tools for visualizing, modifying, and analyzing them. Penzai focuses on making it easy to do stuff with models after they have been trained
๐ [penzai.readthedocs.io](https://penzai.readthedocs.io/)
16. cdpierse/transformers-interpret โญ 1,216
Model explainability that works seamlessly with ๐ค transformers. Explain your transformers model in just 2 lines of code.
17. ethicalml/xai โญ 1,071
XAI is a Machine Learning library that is designed with AI explainability in its core. XAI contains various tools that enable for analysis and evaluation of data and models
๐ [ethical.institute/principles.html#commitment-3](https://ethical.institute/principles.html#commitment-3)
18. selfexplainml/PiML-Toolbox โญ 898
PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
๐ [selfexplainml.github.io/piml-toolbox](https://selfexplainml.github.io/PiML-Toolbox)
19. salesforce/OmniXAI โญ 821
OmniXAI: A Library for eXplainable AI
## Machine Learning - Ops
MLOps tools, frameworks and libraries: intersection of machine learning, data engineering and DevOps; deployment, health, diagnostics and governance of ML models.
1. apache/airflow โญ 34,988
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
๐ [airflow.apache.org](https://airflow.apache.org/)
2. ray-project/ray โญ 31,650
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
๐ [ray.io](https://ray.io)
3. mlflow/mlflow โญ 17,689
Open source platform for the machine learning lifecycle
๐ [mlflow.org](https://mlflow.org)
4. spotify/luigi โญ 17,446
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
5. prefecthq/prefect โญ 15,166
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
๐ [prefect.io](https://prefect.io)
6. horovod/horovod โญ 14,028
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
๐ [horovod.ai](http://horovod.ai)
7. iterative/dvc โญ 13,290
๐ฆ ML Experiments and Data Management with Git
๐ [dvc.org](https://dvc.org)
8. ludwig-ai/ludwig โญ 10,923
Low-code framework for building custom LLMs, neural networks, and other AI models
๐ [ludwig.ai](http://ludwig.ai)
9. dagster-io/dagster โญ 10,513
An orchestration platform for the development, production, and observation of data assets.
๐ [dagster.io](https://dagster.io)
10. great-expectations/great_expectations โญ 9,580
Always know what to expect from your data.
๐ [docs.greatexpectations.io](https://docs.greatexpectations.io/)
11. kedro-org/kedro โญ 9,426
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
๐ [kedro.org](https://kedro.org)
12. dbt-labs/dbt-core โญ 9,115
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
๐ [getdbt.com](https://getdbt.com)
13. bentoml/OpenLLM โญ 9,094
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
๐ [bentoml.com](https://bentoml.com)
14. huggingface/text-generation-inference โญ 8,197
A Rust, Python and gRPC server for text generation inference. Used in production at HuggingFace to power Hugging Chat, the Inference API and Inference Endpoint.
๐ [hf.co/docs/text-generation-inference](http://hf.co/docs/text-generation-inference)
15. activeloopai/deeplake โญ 7,811
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
๐ [activeloop.ai](https://activeloop.ai)
16. netflix/metaflow โญ 7,734
๐ Build and manage real-life ML, AI, and data science projects with ease!
๐ [metaflow.org](https://metaflow.org)
17. mage-ai/mage-ai โญ 7,281
๐ง Build, run, and manage data pipelines for integrating and transforming data.
๐ [www.mage.ai](https://www.mage.ai/)
18. kestra-io/kestra โญ 6,896
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
๐ [kestra.io](https://kestra.io)
19. bentoml/BentoML โญ 6,694
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
๐ [bentoml.com](https://bentoml.com)
20. allegroai/clearml โญ 5,354
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
๐ [clear.ml/docs](https://clear.ml/docs)
21. feast-dev/feast โญ 5,327
The Open Source Feature Store for Machine Learning
๐ [feast.dev](https://feast.dev)
22. flyteorg/flyte โญ 5,107
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
๐ [flyte.org](https://flyte.org)
23. aimhubio/aim โญ 4,886
Aim ๐ซ โ An easy-to-use & supercharged open-source experiment tracker.
๐ [aimstack.io](https://aimstack.io)
24. evidentlyai/evidently โญ 4,781
Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
25. adap/flower โญ 4,355
Flower: A Friendly Federated Learning Framework
๐ [flower.ai](https://flower.ai)
26. langfuse/langfuse โญ 4,147
๐ชข Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. ๐YC W23
๐ [langfuse.com/docs](https://langfuse.com/docs)
27. orchest/orchest โญ 4,026
Build data pipelines, the easy way ๐ ๏ธ
๐ [orchest.readthedocs.io/en/stable](https://orchest.readthedocs.io/en/stable/)
28. zenml-io/zenml โญ 3,725
ZenML ๐: Build portable, production-ready MLOps pipelines. https://zenml.io.
๐ [zenml.io](https://zenml.io)
29. polyaxon/polyaxon โญ 3,501
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
๐ [polyaxon.com](https://polyaxon.com)
30. kubeflow/pipelines โญ 3,479
Machine Learning Pipelines for Kubeflow
๐ [www.kubeflow.org/docs/components/pipelines](https://www.kubeflow.org/docs/components/pipelines/)
31. ploomber/ploomber โญ 3,407
The fastest โก๏ธ way to build data pipelines. Develop iteratively, deploy anywhere. โ๏ธ
๐ [docs.ploomber.io](https://docs.ploomber.io)
32. towhee-io/towhee โญ 3,041
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
๐ [towhee.io](https://towhee.io)
33. internlm/xtuner โญ 2,995
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
34. determined-ai/determined โญ 2,896
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
๐ [determined.ai](https://determined.ai)
35. internlm/lmdeploy โญ 2,892
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
๐ [lmdeploy.readthedocs.io/en/latest](https://lmdeploy.readthedocs.io/en/latest/)
36. leptonai/leptonai โญ 2,499
A Pythonic framework to simplify AI service building
๐ [lepton.ai](https://lepton.ai/)
37. meltano/meltano โญ 1,638
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
๐ [meltano.com](https://meltano.com/)
38. dagworks-inc/hamilton โญ 1,498
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
๐ [hamilton.dagworks.io/en/latest](https://hamilton.dagworks.io/en/latest/)
39. hi-primus/optimus โญ 1,450
:truck: Agile Data Preparation Workflows madeย easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
๐ [hi-optimus.com](https://hi-optimus.com)
40. azure/PyRIT โญ 1,390
The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and ML engineers to red team foundation models and their applications.
41. kubeflow/examples โญ 1,381
A repository to host extended examples and tutorials
42. dstackai/dstack โญ 1,146
An open-source container orchestration engine for running AI workloads in any cloud or data center. https://discord.gg/u8SmfwPpMd
๐ [dstack.ai](https://dstack.ai)
43. nccr-itmo/FEDOT โญ 616
Automated modeling and machine learning framework FEDOT
๐ [fedot.readthedocs.io](https://fedot.readthedocs.io)
44. dagworks-inc/burr โญ 590
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
๐ [burr.dagworks.io](https://burr.dagworks.io)
## Machine Learning - Reinforcement
Machine learning libraries and toolkits that cross over with reinforcement learning in some way: agent reinforcement learning, agent environemnts, RLHF
1. openai/gym โญ 34,056
A toolkit for developing and comparing reinforcement learning algorithms.
๐ [www.gymlibrary.dev](https://www.gymlibrary.dev)
2. unity-technologies/ml-agents โญ 16,510
The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.
๐ [unity.com/products/machine-learning-agents](https://unity.com/products/machine-learning-agents)
3. openai/baselines โญ 15,448
OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
4. google/dopamine โญ 10,400
Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
๐ [github.com/google/dopamine](https://github.com/google/dopamine)
5. deepmind/pysc2 โญ 7,944
StarCraft II Learning Environment
6. lucidrains/PaLM-rlhf-pytorch โญ 7,618
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
7. thu-ml/tianshou โญ 7,531
An elegant PyTorch deep reinforcement learning library.
๐ [tianshou.org](https://tianshou.org)
8. tensorlayer/TensorLayer โญ 7,298
Deep Learning and Reinforcement Learning Library for Scientists and Engineers
๐ [tensorlayerx.com](http://tensorlayerx.com)
9. farama-foundation/Gymnasium โญ 6,038
An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
๐ [gymnasium.farama.org](https://gymnasium.farama.org)
10. keras-rl/keras-rl โญ 5,496
Deep Reinforcement Learning for Keras.
๐ [keras-rl.readthedocs.io](http://keras-rl.readthedocs.io/)
11. deepmind/dm_control โญ 3,601
Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
12. facebookresearch/ReAgent โญ 3,533
A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)
๐ [reagent.ai](https://reagent.ai)
13. ai4finance-foundation/ElegantRL โญ 3,515
Massively Parallel Deep Reinforcement Learning. ๐ฅ
๐ [ai4finance.org](https://ai4finance.org)
14. deepmind/acme โญ 3,410
A library of reinforcement learning components and agents
15. eureka-research/Eureka โญ 2,701
Official Repository for "Eureka: Human-Level Reward Design via Coding Large Language Models" (ICLR 2024)
๐ [eureka-research.github.io](https://eureka-research.github.io/)
16. pettingzoo-team/PettingZoo โญ 2,428
An API standard for multi-agent reinforcement learning environments, with popular reference environments and related utilities
๐ [pettingzoo.farama.org](https://pettingzoo.farama.org)
17. kzl/decision-transformer โญ 2,210
Official codebase for Decision Transformer: Reinforcement Learning via Sequence Modeling.
18. pytorch/rl โญ 1,959
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
๐ [pytorch.org/rl](https://pytorch.org/rl)
19. anthropics/hh-rlhf โญ 1,470
Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
๐ [arxiv.org/abs/2204.05862](https://arxiv.org/abs/2204.05862)
20. humancompatibleai/imitation โญ 1,176
Clean PyTorch implementations of imitation and reward learning algorithms
๐ [imitation.readthedocs.io](https://imitation.readthedocs.io/)
21. arise-initiative/robosuite โญ 1,130
robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
๐ [robosuite.ai](https://robosuite.ai)
22. denys88/rl_games โญ 769
RL Games: High performance RL library
## Natural Language Processing
Natural language processing libraries and toolkits: text processing, topic modelling, tokenisers, chatbots. Also see the LLMs and ChatGPT category for crossover.
1. huggingface/transformers โญ 127,335
๐ค Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
๐ [huggingface.co/transformers](https://huggingface.co/transformers)
2. pytorch/fairseq โญ 29,557
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
3. explosion/spaCy โญ 29,033
๐ซ Industrial-strength Natural Language Processing (NLP) in Python
๐ [spacy.io](https://spacy.io)
4. myshell-ai/OpenVoice โญ 26,598
Instant voice cloning by MyShell.
๐ [research.myshell.ai/open-voice](https://research.myshell.ai/open-voice)
5. microsoft/unilm โญ 18,889
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
๐ [aka.ms/generalai](https://aka.ms/GeneralAI)
6. huggingface/datasets โญ 18,631
๐ค The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
๐ [huggingface.co/docs/datasets](https://huggingface.co/docs/datasets)
7. rare-technologies/gensim โญ 15,360
Topic Modelling for Humans
๐ [radimrehurek.com/gensim](https://radimrehurek.com/gensim)
8. ukplab/sentence-transformers โญ 14,169
Multilingual Sentence & Image Embeddings with BERT
๐ [www.sbert.net](https://www.SBERT.net)
9. gunthercox/ChatterBot โญ 13,940
ChatterBot is a machine learning, conversational dialog engine for creating chat bots
๐ [chatterbot.readthedocs.io](https://chatterbot.readthedocs.io)
10. flairnlp/flair โญ 13,654
A very simple framework for state-of-the-art Natural Language Processing (NLP)
๐ [flairnlp.github.io/flair](https://flairnlp.github.io/flair/)
11. nltk/nltk โญ 13,152
NLTK Source
๐ [www.nltk.org](https://www.nltk.org)
12. jina-ai/clip-as-service โญ 12,249
๐ Scalable embedding, reasoning, ranking for images and sentences with CLIP
๐ [clip-as-service.jina.ai](https://clip-as-service.jina.ai)
13. vikparuchuri/marker โญ 11,814
Marker converts PDF, EPUB, and MOBI to markdown. It's 10x faster than nougat, more accurate on most documents, and has low hallucination risk.
14. allenai/allennlp โญ 11,698
An open-source NLP research library, built on PyTorch.
๐ [www.allennlp.org](http://www.allennlp.org)
15. openai/tiktoken โญ 10,735
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
16. facebookresearch/ParlAI โญ 10,438
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
๐ [parl.ai](https://parl.ai)
17. facebookresearch/seamless_communication โญ 10,412
Foundational Models for State-of-the-Art Speech and Text Translation
18. nvidia/NeMo โญ 10,401
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
๐ [docs.nvidia.com/nemo-framework/user-guide/latest/overview.html](https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html)
19. google/sentencepiece โญ 9,702
Unsupervised text tokenizer for Neural Network-based text generation.
20. m-bain/whisperX โญ 9,630
WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)
21. doccano/doccano โญ 9,115
Open source annotation tool for machine learning practitioners.
22. togethercomputer/OpenChatKit โญ 9,012
OpenChatKit provides a powerful, open-source base to create both specialized and general purpose chatbots
23. sloria/TextBlob โญ 8,997
Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
๐ [textblob.readthedocs.io](https://textblob.readthedocs.io/)
24. clips/pattern โญ 8,693
Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
๐ [github.com/clips/pattern/wiki](https://github.com/clips/pattern/wiki)
25. vikparuchuri/surya โญ 8,555
OCR, layout analysis, reading order, line detection in 90+ languages
26. facebookresearch/nougat โญ 8,310
Implementation of Nougat Neural Optical Understanding for Academic Documents
๐ [facebookresearch.github.io/nougat](https://facebookresearch.github.io/nougat/)
27. speechbrain/speechbrain โญ 8,080
A PyTorch-based Speech Toolkit
๐ [speechbrain.github.io](http://speechbrain.github.io)
28. espnet/espnet โญ 8,006
End-to-End Speech Processing Toolkit
๐ [espnet.github.io/espnet](https://espnet.github.io/espnet/)
29. neuml/txtai โญ 7,250
๐ก All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
๐ [neuml.github.io/txtai](https://neuml.github.io/txtai)
30. deeppavlov/DeepPavlov โญ 6,574
An open source library for deep learning end-to-end dialog systems and chatbots.
๐ [deeppavlov.ai](https://deeppavlov.ai)
31. facebookresearch/metaseq โญ 6,413
A codebase for working with Open Pre-trained Transformers, originally forked from fairseq.
32. kingoflolz/mesh-transformer-jax โญ 6,238
Model parallel transformers in JAX and Haiku
33. maartengr/BERTopic โญ 5,687
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
๐ [maartengr.github.io/bertopic](https://maartengr.github.io/BERTopic/)
34. minimaxir/textgenrnn โญ 4,946
Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
35. prefecthq/marvin โญ 4,895
โจ Build AI interfaces that spark joy
๐ [askmarvin.ai](https://askmarvin.ai)
36. salesforce/CodeGen โญ 4,811
CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
37. aiwaves-cn/agents โญ 4,621
An Open-source Framework for Autonomous Language Agents
๐ [www.aiwaves-agents.com](http://www.aiwaves-agents.com/)
38. layout-parser/layout-parser โญ 4,575
A Unified Toolkit for Deep Learning Based Document Image Analysis
๐ [layout-parser.github.io](https://layout-parser.github.io/)
39. facebookresearch/DrQA โญ 4,467
Reading Wikipedia to Answer Open-Domain Questions
40. makcedward/nlpaug โญ 4,334
Data augmentation for NLP
๐ [makcedward.github.io](https://makcedward.github.io/)
41. thilinarajapakse/simpletransformers โญ 4,019
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI
๐ [simpletransformers.ai](https://simpletransformers.ai/)
42. life4/textdistance โญ 3,321
๐ Compute distance between sequences. 30+ algorithms, pure python implementation, common interface, optional external libs usage.
43. jsvine/markovify โญ 3,285
A simple, extensible Markov chain generator.
44. maartengr/KeyBERT โญ 3,278
Minimal keyword extraction with BERT
๐ [maartengr.github.io/keybert](https://MaartenGr.github.io/KeyBERT/)
45. argilla-io/argilla โญ 3,172
Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
๐ [docs.argilla.io](https://docs.argilla.io)
46. bytedance/lightseq โญ 3,111
LightSeq: A High Performance Library for Sequence Processing and Generation
47. promptslab/Promptify โญ 3,086
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
๐ [discord.gg/m88xfymbk6](https://discord.gg/m88xfYMbK6)
48. errbotio/errbot โญ 3,076
Errbot is a chatbot, a daemon that connects to your favorite chat service and bring your tools and some fun into the conversation.
๐ [errbot.io](http://errbot.io)
49. huawei-noah/Pretrained-Language-Model โญ 2,977
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
50. neuralmagic/deepsparse โญ 2,909
Sparsity-aware deep learning inference runtime for CPUs
๐ [neuralmagic.com/deepsparse](https://neuralmagic.com/deepsparse/)
51. jbesomi/texthero โญ 2,874
Text preprocessing, representation and visualization from zero to hero.
๐ [texthero.org](https://texthero.org)
52. ddangelov/Top2Vec โญ 2,865
Top2Vec learns jointly embedded topic, document and word vectors.
53. huggingface/neuralcoref โญ 2,827
โจFast Coreference Resolution in spaCy with Neural Networks
๐ [huggingface.co/coref](https://huggingface.co/coref/)
54. salesforce/CodeT5 โญ 2,630
Home of CodeT5: Open Code LLMs for Code Understanding and Generation
๐ [arxiv.org/abs/2305.07922](https://arxiv.org/abs/2305.07922)
55. bigscience-workshop/promptsource โญ 2,550
Toolkit for creating, sharing and using natural language prompts.
56. huggingface/setfit โญ 2,045
SetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers.
๐ [hf.co/docs/setfit](https://hf.co/docs/setfit)
57. jamesturk/jellyfish โญ 2,003
๐ชผ a python library for doing approximate and phonetic matching of strings.
๐ [jamesturk.github.io/jellyfish](https://jamesturk.github.io/jellyfish/)
58. alibaba/EasyNLP โญ 1,970
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
59. thudm/P-tuning-v2 โญ 1,915
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
60. marella/ctransformers โญ 1,741
Python bindings for the Transformer models implemented in C/C++ using GGML library.
61. deepset-ai/FARM โญ 1,729
๐ก Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
๐ [farm.deepset.ai](https://farm.deepset.ai)
62. featureform/featureform โญ 1,728
The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
๐ [www.featureform.com](https://www.featureform.com)
63. franck-dernoncourt/NeuroNER โญ 1,682
Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.
๐ [neuroner.com](http://neuroner.com)
64. plasticityai/magnitude โญ 1,614
A fast, efficient universal vector embedding utility package.
65. arxiv-vanity/arxiv-vanity โญ 1,598
Renders papers from arXiv as responsive web pages so you don't have to squint at a PDF.
๐ [www.arxiv-vanity.com](https://www.arxiv-vanity.com)
66. google-research/language โญ 1,573
Shared repository for open-sourced projects from the Google AI Language team.
๐ [ai.google/research/teams/language](https://ai.google/research/teams/language/)
67. explosion/spacy-models โญ 1,531
๐ซ Models for the spaCy Natural Language Processing (NLP) library
๐ [spacy.io](https://spacy.io)
68. chrismattmann/tika-python โญ 1,435
Tika-Python is a Python binding to the Apache Tikaโข REST services allowing Tika to be called natively in the Python community.
69. dmmiller612/bert-extractive-summarizer โญ 1,359
Easy to use extractive text summarization with BERT
70. gunthercox/chatterbot-corpus โญ 1,350
A multilingual dialog corpus
๐ [chatterbot-corpus.readthedocs.io](http://chatterbot-corpus.readthedocs.io)
71. jonasgeiping/cramming โญ 1,254
Cramming the training of a (BERT-type) language model into limited compute.
72. nomic-ai/nomic โญ 1,052
Interact, analyze and structure massive text, image, embedding, audio and video datasets
๐ [atlas.nomic.ai](https://atlas.nomic.ai)
73. abertsch72/unlimiformer โญ 1,036
Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
74. intellabs/fastRAG โญ 1,029
Efficient Retrieval Augmentation and Generation Framework
75. pemistahl/lingua-py โญ 969
The most accurate natural language detection library for Python, suitable for short text and mixed-language text
76. openai/grade-school-math โญ 915
GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems
77. norskregnesentral/skweak โญ 914
skweak: A software toolkit for weak supervision applied to NLP tasks
78. urchade/GLiNER โญ 774
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
๐ [arxiv.org/abs/2311.08526](https://arxiv.org/abs/2311.08526)
79. explosion/spacy-streamlit โญ 772
๐ spaCy building blocks and visualizers for Streamlit apps
๐ [share.streamlit.io/ines/spacy-streamlit-demo/master/app.py](https://share.streamlit.io/ines/spacy-streamlit-demo/master/app.py)
80. paddlepaddle/RocketQA โญ 751
๐ RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.
81. keras-team/keras-nlp โญ 719
Modular Natural Language Processing workflows with Keras
82. explosion/spacy-stanza โญ 716
๐ฅ Use the latest Stanza (StanfordNLP) research models directly in spaCy
## Packaging
Python packaging, dependency management and bundling.
1. pyenv/pyenv โญ 37,379
pyenv lets you easily switch between multiple versions of Python.
2. python-poetry/poetry โญ 29,911
Python packaging and dependency management made easy
๐ [python-poetry.org](https://python-poetry.org)
3. pypa/pipenv โญ 24,665
A virtualenv management tool that supports a multitude of systems and nicely bridges the gaps between pip, python and virtualenv.
๐ [pipenv.pypa.io](https://pipenv.pypa.io)
4. astral-sh/uv โญ 12,351
An extremely fast Python package installer and resolver, written in Rust. Designed as a drop-in replacement for pip and pip-compile.
๐ [astral.sh](https://astral.sh/)
5. mitsuhiko/rye โญ 11,873
a Hassle-Free Python Experience
๐ [rye.astral.sh](https://rye.astral.sh)
6. pyinstaller/pyinstaller โญ 11,430
Freeze (package) Python programs into stand-alone executables
๐ [www.pyinstaller.org](http://www.pyinstaller.org)
7. pypa/pipx โญ 9,279
Install and Run Python Applications in Isolated Environments
๐ [pipx.pypa.io](https://pipx.pypa.io)
8. jazzband/pip-tools โญ 7,530
A set of tools to keep your pinned Python dependencies fresh (pip-compile + pip-sync)
๐ [pip-tools.rtfd.io](https://pip-tools.rtfd.io)
9. pdm-project/pdm โญ 7,211
A modern Python package and dependency manager supporting the latest PEP standards
๐ [pdm-project.org](https://pdm-project.org)
10. mamba-org/mamba โญ 6,422
The Fast Cross-Platform Package Manager: mamba is a reimplementation of the conda package manager in C++
๐ [mamba.readthedocs.io](https://mamba.readthedocs.io)
11. conda/conda โญ 6,184
A system-level, binary package and environment manager running on all major operating systems and platforms.
๐ [docs.conda.io/projects/conda](https://docs.conda.io/projects/conda/)
12. conda-forge/miniforge โญ 5,597
A conda-forge distribution.
๐ [conda-forge.org/miniforge](https://conda-forge.org/miniforge)
13. pypa/hatch โญ 5,562
Modern, extensible Python project management
๐ [hatch.pypa.io/latest](https://hatch.pypa.io/latest/)
14. indygreg/PyOxidizer โญ 5,272
A modern Python application packaging and distribution tool
15. pypa/virtualenv โญ 4,739
A tool to create isolated Python environments. Since Python 3.3, a subset of it has been integrated into the standard lib venv module.
๐ [virtualenv.pypa.io](https://virtualenv.pypa.io)
16. spack/spack โญ 4,061
A flexible package manager that supports multiple versions, configurations, platforms, and compilers.
๐ [spack.io](https://spack.io)
17. pantsbuild/pex โญ 2,479
A tool for generating .pex (Python EXecutable) files, lock files and venvs.
๐ [docs.pex-tool.org](https://docs.pex-tool.org)
18. beeware/briefcase โญ 2,419
Tools to support converting a Python project into a standalone native application.
๐ [briefcase.readthedocs.io](https://briefcase.readthedocs.io/)
19. pypa/flit โญ 2,118
Simplified packaging of Python modules
๐ [flit.pypa.io](https://flit.pypa.io/)
20. prefix-dev/pixi โญ 2,089
pixi is a cross-platform, multi-language package manager and workflow tool built on the foundation of the conda ecosystem.
๐ [pixi.sh](https://pixi.sh)
21. linkedin/shiv โญ 1,702
shiv is a command line utility for building fully self contained Python zipapps as outlined in PEP 441, but with all their dependencies included.
22. marcelotduarte/cx_Freeze โญ 1,268
cx_Freeze creates standalone executables from Python scripts, with the same performance, is cross-platform and should work on any platform that Python itself works on.
๐ [marcelotduarte.github.io/cx_freeze](https://marcelotduarte.github.io/cx_Freeze/)
23. ofek/pyapp โญ 1,087
Runtime installer for Python applications
๐ [ofek.dev/pyapp](https://ofek.dev/pyapp/)
24. pypa/gh-action-pypi-publish โญ 861
The blessed :octocat: GitHub Action, for publishing your ๐ฆ distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
๐ [packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows](https://packaging.python.org/guides/publishing-package-distribution-releases-using-github-actions-ci-cd-workflows/)
25. py2exe/py2exe โญ 771
Create standalone Windows programs from Python code
๐ [www.py2exe.org](http://www.py2exe.org)
26. prefix-dev/rip โญ 624
RIP is a library that allows the resolving and installing of Python PyPI packages from Rust into a virtual environment. It's based on our experience with building Rattler and aims to provide the same experience but for PyPI instead of Conda.
๐ [prefix.dev](https://prefix.dev)
27. snok/install-poetry โญ 545
Github action for installing and configuring Poetry
28. python-poetry/install.python-poetry.org โญ 181
The official Poetry installation script
๐ [install.python-poetry.org](https://install.python-poetry.org)
## Pandas
Pandas and dataframe libraries: data analysis, statistical reporting, pandas GUIs, pandas performance optimisations.
1. pandas-dev/pandas โญ 42,339
Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
๐ [pandas.pydata.org](https://pandas.pydata.org)
2. pola-rs/polars โญ 27,040
Dataframes powered by a multithreaded, vectorized query engine, written in Rust
๐ [docs.pola.rs](https://docs.pola.rs)
3. duckdb/duckdb โญ 18,808
DuckDB is an analytical in-process SQL database management system
๐ [www.duckdb.org](http://www.duckdb.org)
4. ydataai/ydata-profiling โญ 12,160
1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
๐ [docs.profiling.ydata.ai](https://docs.profiling.ydata.ai)
5. gventuri/pandas-ai โญ 11,483
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
๐ [pandas-ai.com](https://pandas-ai.com)
6. kanaries/pygwalker โญ 10,510
PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis
๐ [kanaries.net/pygwalker](https://kanaries.net/pygwalker)
7. rapidsai/cudf โญ 7,874
cuDF is a GPU DataFrame library for loading joining, aggregating, filtering, and otherwise manipulating data
๐ [docs.rapids.ai/api/cudf/stable](https://docs.rapids.ai/api/cudf/stable/)
8. aws/aws-sdk-pandas โญ 3,832
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
๐ [aws-sdk-pandas.readthedocs.io](https://aws-sdk-pandas.readthedocs.io)
9. nalepae/pandarallel โญ 3,554
A simple and efficient tool to parallelize Pandas operations on all availableย CPUs
๐ [nalepae.github.io/pandarallel](https://nalepae.github.io/pandarallel)
10. blaze/blaze โญ 3,180
NumPy and Pandas interface to Big Data
๐ [blaze.pydata.org](blaze.pydata.org)
11. adamerose/PandasGUI โญ 3,141
A GUI for Pandas DataFrames
12. unionai-oss/pandera โญ 3,086
A light-weight, flexible, and expressive statistical data testing library
๐ [www.union.ai/pandera](https://www.union.ai/pandera)
13. pydata/pandas-datareader โญ 2,839
Extract data from a wide range of Internet sources into a pandas DataFrame.
๐ [pydata.github.io/pandas-datareader/stable/index.html](https://pydata.github.io/pandas-datareader/stable/index.html)
14. scikit-learn-contrib/sklearn-pandas โญ 2,789
Pandas integration with sklearn
15. jmcarpenter2/swifter โญ 2,480
A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner
16. delta-io/delta-rs โญ 1,905
A native Rust library for Delta Lake, with bindings into Python
๐ [delta-io.github.io/delta-rs](https://delta-io.github.io/delta-rs/)
17. fugue-project/fugue โญ 1,899
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
๐ [fugue-tutorials.readthedocs.io](https://fugue-tutorials.readthedocs.io/)
18. eventual-inc/Daft โญ 1,809
Distributed DataFrame for Python designed for the cloud, powered by Rust
๐ [getdaft.io](https://getdaft.io)
19. pyjanitor-devs/pyjanitor โญ 1,299
Clean APIs for data cleaning. Python implementation of R package Janitor
๐ [pyjanitor-devs.github.io/pyjanitor](https://pyjanitor-devs.github.io/pyjanitor)
20. machow/siuba โญ 1,117
Python library for using dplyr like syntax with pandas and SQL
๐ [siuba.org](https://siuba.org)
21. renumics/spotlight โญ 1,024
Interactively explore unstructured datasets from your dataframe.
๐ [renumics.com](https://renumics.com)
22. holoviz/hvplot โญ 989
A high-level plotting API for pandas, dask, xarray, and networkx built on HoloViews
๐ [hvplot.holoviz.org](https://hvplot.holoviz.org)
23. tkrabel/bamboolib โญ 936
bamboolib - a GUI for pandas DataFrames
๐ [bamboolib.com](https://bamboolib.com)
24. mwouts/itables โญ 695
This packages changes how Pandas and Polars DataFrames are rendered in Jupyter Notebooks. With itables you can display your tables as interactive DataTables that you can sort, paginate, scroll or filter.
๐ [mwouts.github.io/itables](https://mwouts.github.io/itables/)
## Performance
Performance, parallelisation and low level libraries.
1. celery/celery โญ 23,837
Distributed Task Queue (development branch)
๐ [docs.celeryq.dev](https://docs.celeryq.dev)
2. google/flatbuffers โญ 22,238
FlatBuffers: Memory Efficient Serialization Library
๐ [flatbuffers.dev](https://flatbuffers.dev/)
3. pybind/pybind11 โญ 15,004
Seamless operability between C++11 and Python
๐ [pybind11.readthedocs.io](https://pybind11.readthedocs.io/)
4. exaloop/codon โญ 13,935
A high-performance, zero-overhead, extensible Python compiler using LLVM
๐ [docs.exaloop.io/codon](https://docs.exaloop.io/codon)
5. dask/dask โญ 12,141
Parallel computing with task scheduling
๐ [dask.org](https://dask.org)
6. numba/numba โญ 9,556
NumPy aware dynamic Python compiler using LLVM
๐ [numba.pydata.org](https://numba.pydata.org/)
7. modin-project/modin โญ 9,546
Modin: Scale your Pandas workflows by changing a single line of code
๐ [modin.readthedocs.io](http://modin.readthedocs.io)
8. nebuly-ai/nebuly โญ 8,362
The user analytics platform for LLMs
๐ [www.nebuly.com](https://www.nebuly.com/)
9. vaexio/vaex โญ 8,197
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second ๐
๐ [vaex.io](https://vaex.io)
10. mher/flower โญ 6,233
Real-time monitor and web admin for Celery distributed task queue
๐ [flower.readthedocs.io](https://flower.readthedocs.io)
11. python-trio/trio โญ 5,942
Trio โ a friendly Python library for async concurrency and I/O
๐ [trio.readthedocs.io](https://trio.readthedocs.io)
12. ultrajson/ultrajson โญ 4,264
Ultra fast JSON decoder and encoder written in C with Python bindings
๐ [pypi.org/project/ujson](https://pypi.org/project/ujson/)
13. facebookincubator/cinder โญ 3,392
Cinder is Meta's internal performance-oriented production version of CPython.
๐ [trycinder.com](https://trycinder.com)
14. tlkh/asitop โญ 3,080
Perf monitoring CLI tool for Apple Silicon
๐ [tlkh.github.io/asitop](https://tlkh.github.io/asitop/)
15. ipython/ipyparallel โญ 2,560
IPython Parallel: Interactive Parallel Computing in Python
๐ [ipyparallel.readthedocs.io](https://ipyparallel.readthedocs.io/)
16. h5py/h5py โญ 2,028
HDF5 for Python -- The h5py package is a Pythonic interface to the HDF5 binary data format.
๐ [www.h5py.org](http://www.h5py.org)
17. intel/intel-extension-for-transformers โญ 2,002
โก Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platformsโก
18. airtai/faststream โญ 1,939
FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
๐ [faststream.airt.ai/latest](https://faststream.airt.ai/latest/)
19. faster-cpython/ideas โญ 1,660
Discussion and work tracker for Faster CPython project.
20. agronholm/anyio โญ 1,649
High level asynchronous concurrency and networking framework that works on top of either trio or asyncio
21. dask/distributed โญ 1,549
A distributed task scheduler for Dask
๐ [distributed.dask.org](https://distributed.dask.org)
22. tiangolo/asyncer โญ 1,487
Asyncer, async and await, focused on developer experience.
๐ [asyncer.tiangolo.com](https://asyncer.tiangolo.com/)
23. intel/intel-extension-for-pytorch โญ 1,426
A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
24. nschloe/perfplot โญ 1,316
:chart_with_upwards_trend: Performance analysis for Python snippets
25. intel/scikit-learn-intelex โญ 1,172
Intel(R) Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
๐ [intel.github.io/scikit-learn-intelex](https://intel.github.io/scikit-learn-intelex/)
26. markshannon/faster-cpython โญ 938
How to make CPython faster.
27. zerointensity/pointers.py โญ 907
Bringing the hell of pointers to Python.
๐ [pointers.zintensity.dev](https://pointers.zintensity.dev/)
28. brandtbucher/specialist โญ 613
Visualize CPython's specializing, adaptive interpreter. ๐ฅ
## Profiling
Memory and CPU/GPU profiling tools and libraries.
1. bloomberg/memray โญ 12,702
Memray is a memory profiler for Python
๐ [bloomberg.github.io/memray](https://bloomberg.github.io/memray/)
2. benfred/py-spy โญ 12,024
Sampling profiler for Python programs
3. plasma-umass/scalene โญ 11,290
Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
4. joerick/pyinstrument โญ 6,245
๐ดย Call stack profiler for Python. Shows you why your code is slow!
๐ [pyinstrument.readthedocs.io](https://pyinstrument.readthedocs.io/)
5. gaogaotiantian/viztracer โญ 4,549
VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.
๐ [viztracer.readthedocs.io](https://viztracer.readthedocs.io/)
6. pythonprofilers/memory_profiler โญ 4,253
Monitor Memory usage of Python code
๐ [pypi.python.org/pypi/memory_profiler](http://pypi.python.org/pypi/memory_profiler)
7. reloadware/reloadium โญ 2,724
Hot Reloading and Profiling for Python
๐ [reloadium.io](https://reloadium.io)
8. pyutils/line_profiler โญ 2,532
Line-by-line profiling for Python
9. jiffyclub/snakeviz โญ 2,261
An in-browser Python profile viewer
๐ [jiffyclub.github.io/snakeviz](https://jiffyclub.github.io/snakeviz/)
10. p403n1x87/austin โญ 1,375
Python frame stack sampler for CPython
๐ [pypi.org/project/austin-dist](https://pypi.org/project/austin-dist/)
11. pythonspeed/filprofiler โญ 820
A Python memory profiler for data processing and scientific computing applications
๐ [pythonspeed.com/products/filmemoryprofiler](https://pythonspeed.com/products/filmemoryprofiler/)
## Security
Security related libraries: vulnerability discovery, SQL injection, environment auditing.
1. swisskyrepo/PayloadsAllTheThings โญ 57,603
A list of useful payloads and bypass for Web Application Security and Pentest/CTF
๐ [swisskyrepo.github.io/payloadsallthethings](https://swisskyrepo.github.io/PayloadsAllTheThings/)
2. certbot/certbot โญ 31,011
Certbot is EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server. It can also act as a client for any other CA that uses the ACME protocol.
3. sqlmapproject/sqlmap โญ 30,947
Automatic SQL injection and database takeover tool
๐ [sqlmap.org](http://sqlmap.org)
4. aquasecurity/trivy โญ 21,803
Find vulnerabilities, misconfigurations, secrets, SBOM in containers, Kubernetes, code repositories, clouds and more
๐ [aquasecurity.github.io/trivy](https://aquasecurity.github.io/trivy)
5. bridgecrewio/checkov โญ 6,649
Checkov is a static code analysis tool for infrastructure as code (IaC) and also a software composition analysis (SCA) tool for images and open source packages.
๐ [www.checkov.io](https://www.checkov.io/)
6. nccgroup/ScoutSuite โญ 6,272
Multi-Cloud Security Auditing Tool
7. pycqa/bandit โญ 6,080
Bandit is a tool designed to find common security issues in Python code.
๐ [bandit.readthedocs.io](https://bandit.readthedocs.io)
8. stamparm/maltrail โญ 5,837
Malicious traffic detection system
9. rhinosecuritylabs/pacu โญ 4,116
The AWS exploitation framework, designed for testing the security of Amazon Web Services environments.
๐ [rhinosecuritylabs.com/aws/pacu-open-source-aws-exploitation-framework](https://rhinosecuritylabs.com/aws/pacu-open-source-aws-exploitation-framework/)
10. dashingsoft/pyarmor โญ 2,990
A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.
๐ [pyarmor.dashingsoft.com](http://pyarmor.dashingsoft.com)
11. luijait/DarkGPT โญ 1,824
DarkGPT is an OSINT assistant based on GPT-4-200K (recommended use) designed to perform queries on leaked databases, thus providing an artificial intelligence assistant that can be useful in your traditional OSINT processes.
12. pyupio/safety โญ 1,648
Safety checks Python dependencies for known security vulnerabilities and suggests the proper remediations for vulnerabilities detected.
๐ [safetycli.com/product/safety-cli](https://safetycli.com/product/safety-cli)
13. trailofbits/pip-audit โญ 932
Audits Python environments, requirements files and dependency trees for known security vulnerabilities, and can automatically fix them
๐ [pypi.org/project/pip-audit](https://pypi.org/project/pip-audit/)
14. fadi002/de4py โญ 788
toolkit for python reverse engineering
๐ [de4py.000.pe](https://de4py.000.pe)
## Simulation
Simulation libraries: robotics, economic, agent-based, traffic, physics, astronomy, chemistry, quantum simulation. Also see the Maths and Science category for crossover.
1. atsushisakai/PythonRobotics โญ 22,054
Python sample codes for robotics algorithms.
๐ [atsushisakai.github.io/pythonrobotics](https://atsushisakai.github.io/PythonRobotics/)
2. bulletphysics/bullet3 โญ 12,088
Bullet Physics SDK: real-time collision detection and multi-physics simulation for VR, games, visual effects, robotics, machine learning etc.
๐ [bulletphysics.org](http://bulletphysics.org)
3. isl-org/Open3D โญ 10,673
Open3D: A Modern Library for 3D Data Processing
๐ [www.open3d.org](http://www.open3d.org)
4. qiskit/qiskit โญ 4,750
Qiskit is an open-source SDK for working with quantum computers at the level of extended quantum circuits, operators, and primitives.
๐ [www.ibm.com/quantum/qiskit](https://www.ibm.com/quantum/qiskit)
5. astropy/astropy โญ 4,273
Astronomy and astrophysics core library
๐ [www.astropy.org](https://www.astropy.org)
6. quantumlib/Cirq โญ 4,180
A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.
7. openai/mujoco-py โญ 2,763
MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.
8. rdkit/rdkit โญ 2,484
The official sources for the RDKit library
9. taichi-dev/difftaichi โญ 2,411
10 differentiable physical simulators built with Taichi differentiable programming (DiffTaichi, ICLR 2020)
10. projectmesa/mesa โญ 2,267
Mesa is an open-source Python library for agent-based modeling, ideal for simulating complex systems and exploring emergent behaviors.
๐ [mesa.readthedocs.io](https://mesa.readthedocs.io)
11. google/brax โญ 2,107
Massively parallel rigidbody physics simulation on accelerator hardware.
12. quantecon/QuantEcon.py โญ 1,884
A community based Python library for quantitative economics
๐ [quantecon.org/quantecon-py](https://quantecon.org/quantecon-py/)
13. facebookresearch/habitat-lab โญ 1,782
A modular high-level library to train embodied AI agents across a variety of tasks and environments.
๐ [aihabitat.org](https://aihabitat.org/)
14. nvidia/warp โญ 1,756
A Python framework for high performance GPU simulation and graphics
๐ [nvidia.github.io/warp](https://nvidia.github.io/warp/)
15. microsoft/PromptCraft-Robotics โญ 1,749
Community for applying LLMs to robotics and a robot simulator with ChatGPT integration
๐ [aka.ms/chatgpt-robotics](https://aka.ms/ChatGPT-Robotics)
16. nvidia-omniverse/IsaacGymEnvs โญ 1,720
Example RL environments for the NVIDIA Isaac Gym high performance environments
17. deepmodeling/deepmd-kit โญ 1,392
A deep learning package for many-body potential energy representation and molecular dynamics
๐ [docs.deepmodeling.com/projects/deepmd](https://docs.deepmodeling.com/projects/deepmd/)
18. nvidia-omniverse/IsaacLab โญ 1,297
Unified framework for robot learning built on NVIDIA Isaac Sim
๐ [isaac-sim.github.io/isaaclab](https://isaac-sim.github.io/IsaacLab)
19. sail-sg/envpool โญ 1,032
C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
๐ [envpool.readthedocs.io](https://envpool.readthedocs.io)
20. a-r-j/graphein โญ 992
Protein Graph Library
๐ [graphein.ai](https://graphein.ai/)
21. hardmaru/estool โญ 923
Evolution Strategies Tool
22. viblo/pymunk โญ 896
Pymunk is a easy-to-use pythonic 2d physics library that can be used whenever you need 2d rigid body physics from Python
๐ [www.pymunk.org](http://www.pymunk.org)
23. bowang-lab/scGPT โญ 892
scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI
๐ [scgpt.readthedocs.io/en/latest](https://scgpt.readthedocs.io/en/latest/)
24. facebookresearch/fairo โญ 835
A modular embodied agent architecture and platform for building embodied agents
25. google-deepmind/materials_discovery โญ 825
Graph Networks for Materials Science (GNoME) is a project centered around scaling machine learning methods to tackle materials science.
26. google/evojax โญ 795
EvoJAX is a scalable, general purpose, hardware-accelerated neuroevolution toolkit built on the JAX library
27. nvidia-omniverse/OmniIsaacGymEnvs โญ 740
Reinforcement Learning Environments for Omniverse Isaac Gym
28. eureka-research/DrEureka โญ 713
Official Repository for "DrEureka: Language Model Guided Sim-To-Real Transfer" (RSS 2024)
๐ [eureka-research.github.io/dr-eureka](https://eureka-research.github.io/dr-eureka/)
## Study
Miscellaneous study resources: algorithms, general resources, system design, code repos for textbooks, best practices, tutorials.
1. thealgorithms/Python โญ 181,250
All Algorithms implemented in Python
๐ [the-algorithms.com](https://the-algorithms.com/)
2. microsoft/generative-ai-for-beginners โญ 46,861
18 Lessons, Get Started Building with Generative AI ๐ https://microsoft.github.io/generative-ai-for-beginners/
๐ [microsoft.github.io/generative-ai-for-beginners](https://microsoft.github.io/generative-ai-for-beginners/)
3. jakevdp/PythonDataScienceHandbook โญ 41,783
Python Data Science Handbook: full text in Jupyter Notebooks
๐ [jakevdp.github.io/pythondatasciencehandbook](http://jakevdp.github.io/PythonDataScienceHandbook)
4. mlabonne/llm-course โญ 32,745
Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
๐ [mlabonne.github.io/blog](https://mlabonne.github.io/blog/)
5. realpython/python-guide โญ 27,850
Python best practices guidebook, written for humans.
๐ [docs.python-guide.org](https://docs.python-guide.org)
6. christoschristofidis/awesome-deep-learning โญ 23,115
A curated list of awesome Deep Learning tutorials, projects and communities.
7. d2l-ai/d2l-en โญ 22,116
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
๐ [d2l.ai](https://D2L.ai)
8. wesm/pydata-book โญ 21,501
Materials and IPython notebooks for "Python for Data Analysis" by Wes McKinney, published by O'Reilly Media
9. rasbt/LLMs-from-scratch โญ 18,986
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step
๐ [www.manning.com/books/build-a-large-language-model-from-scratch](https://www.manning.com/books/build-a-large-language-model-from-scratch)
10. microsoft/recommenders โญ 18,238
Best Practices on Recommendation Systems
๐ [recommenders-team.github.io/recommenders/intro.html](https://recommenders-team.github.io/recommenders/intro.html)
11. fchollet/deep-learning-with-python-notebooks โญ 17,875
Jupyter notebooks for the code samples of the book "Deep Learning with Python"
12. hannibal046/Awesome-LLM โญ 15,416
Awesome-LLM: a curated list of Large Language Model
13. graykode/nlp-tutorial โญ 13,816
Natural Language Processing Tutorial for Deep Learning Researchers
๐ [www.reddit.com/r/machinelearning/comments/amfinl/project_nlptutoral_repository_who_is_studying](https://www.reddit.com/r/MachineLearning/comments/amfinl/project_nlptutoral_repository_who_is_studying/)
14. shangtongzhang/reinforcement-learning-an-introduction โญ 13,261
Python Implementation of Reinforcement Learning: An Introduction
15. karpathy/nn-zero-to-hero โญ 10,666
Neural Networks: Zero to Hero
16. eugeneyan/open-llms โญ 10,417
๐ A list of open LLMs available for commercial use.
17. naklecha/llama3-from-scratch โญ 10,094
llama3 implementation one matrix multiplication at a time
18. openai/spinningup โญ 9,749
An educational resource to help anyone learn deep reinforcement learning.
๐ [spinningup.openai.com](https://spinningup.openai.com/)
19. rucaibox/LLMSurvey โญ 9,271
The official GitHub page for the survey paper "A Survey of Large Language Models".
๐ [arxiv.org/abs/2303.18223](https://arxiv.org/abs/2303.18223)
20. mooler0410/LLMsPracticalGuide โญ 8,863
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
๐ [arxiv.org/abs/2304.13712v2](https://arxiv.org/abs/2304.13712v2)
21. karpathy/micrograd โญ 8,630
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
22. mrdbourke/pytorch-deep-learning โญ 8,520
Materials for the Learn PyTorch for Deep Learning: Zero to Mastery course.
๐ [learnpytorch.io](https://learnpytorch.io)
23. nielsrogge/Transformers-Tutorials โญ 8,256
This repository contains demos I made with the Transformers library by HuggingFace.
24. zhanymkanov/fastapi-best-practices โญ 7,432
FastAPI Best Practices and Conventions we used at our startup
25. firmai/industry-machine-learning โญ 7,064
A curated list of applied machine learning and data science notebooks and libraries across different industries (by @firmai)
๐ [www.linkedin.com/company/firmai](https://www.linkedin.com/company/firmai)
26. gkamradt/langchain-tutorials โญ 6,402
Overview and tutorial of the LangChain Library
27. srush/GPU-Puzzles โญ 5,230
Teaching beginner GPU programming in a completely interactive fashion
28. neetcode-gh/leetcode โญ 5,215
Leetcode solutions for NeetCode.io
29. udacity/deep-learning-v2-pytorch โญ 5,211
Projects and exercises for the latest Deep Learning ND program https://www.udacity.com/course/deep-learning-nanodegree--nd101
30. udlbook/udlbook โญ 4,964
Understanding Deep Learning - Simon J.D. Prince
31. mrdbourke/tensorflow-deep-learning โญ 4,955
All course materials for the Zero to Mastery Deep Learning with TensorFlow course.
๐ [dbourke.link/ztmtfcourse](https://dbourke.link/ZTMTFcourse)
32. roboflow/notebooks โญ 4,448
Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.
๐ [roboflow.com/models](https://roboflow.com/models)
33. timofurrer/awesome-asyncio โญ 4,446
A curated list of awesome Python asyncio frameworks, libraries, software and resources
34. zotroneneis/machine_learning_basics โญ 4,236
Plain python implementations of basic machine learning algorithms
35. huggingface/deep-rl-class โญ 3,681
This repo contains the syllabus of the Hugging Face Deep Reinforcement Learning Course.
36. alirezadir/Machine-Learning-Interviews โญ 3,592
This repo is meant to serve as a guide for Machine Learning/AI technical interviews.
37. promptslab/Awesome-Prompt-Engineering โญ 3,384
This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
๐ [discord.gg/m88xfymbk6](https://discord.gg/m88xfYMbK6)
38. cosmicpython/book โญ 3,294
A Book about Pythonic Application Architecture Patterns for Managing Complexity. Cosmos is the Opposite of Chaos you see. O'R. wouldn't actually let us call it "Cosmic Python" tho.
๐ [www.cosmicpython.com](https://www.cosmicpython.com)
39. huggingface/diffusion-models-class โญ 3,278
Materials for the Hugging Face Diffusion Models Course
40. fluentpython/example-code-2e โญ 3,016
Example code for Fluent Python, 2nd edition (O'Reilly 2022)
๐ [amzn.to/3j48u2j](https://amzn.to/3J48u2J)
41. rasbt/machine-learning-book โญ 2,997
Code Repository for Machine Learning with PyTorch and Scikit-Learn
๐ [sebastianraschka.com/books/#machine-learning-with-pytorch-and-scikit-learn](https://sebastianraschka.com/books/#machine-learning-with-pytorch-and-scikit-learn)
42. amanchadha/coursera-deep-learning-specialization โญ 2,780
Notes, programming assignments and quizzes from all courses within the Coursera Deep Learning specialization offered by deeplearning.ai: (i) Neural Networks and Deep Learning; (ii) Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization; (iii) Structuring Machine Learning Projects; (iv...
43. mrdbourke/zero-to-mastery-ml โญ 2,677
All course materials for the Zero to Mastery Machine Learning and Data Science course.
๐ [dbourke.link/ztmmlcourse](https://dbourke.link/ZTMmlcourse)
44. krzjoa/awesome-python-data-science โญ 2,393
Probably the best curated list of data science software in Python.
๐ [krzjoa.github.io/awesome-python-data-science](https://krzjoa.github.io/awesome-python-data-science)
45. cgpotts/cs224u โญ 2,067
Code for CS224u: Natural Language Understanding
46. cerlymarco/MEDIUM_NoteBook โญ 2,037
Repository containing notebooks of my posts on Medium
47. trananhkma/fucking-awesome-python โญ 1,973
awesome-python with :octocat: โญ and ๐ด
48. gerdm/prml โญ 1,958
Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop
49. atcold/NYU-DLSP21 โญ 1,502
NYU Deep Learning Spring 2021
๐ [atcold.github.io/nyu-dlsp21](https://atcold.github.io/NYU-DLSP21/)
50. chandlerbang/awesome-self-supervised-gnn โญ 1,493
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
51. huggingface/cookbook โญ 1,416
Community-driven practical examples of building AI applications and solving various tasks with AI using open-source tools and models.
๐ [huggingface.co/learn/cookbook](https://huggingface.co/learn/cookbook)
52. patrickloeber/MLfromscratch โญ 1,194
Machine Learning algorithm implementations from scratch.
53. davidadsp/Generative_Deep_Learning_2nd_Edition โญ 913
The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
๐ [www.oreilly.com/library/view/generative-deep-learning/9781098134174](https://www.oreilly.com/library/view/generative-deep-learning/9781098134174/)
54. jackhidary/quantumcomputingbook โญ 776
Companion site for the textbook Quantum Computing: An Applied Approach
55. dylanhogg/awesome-python โญ 263
๐ Hand-picked awesome Python libraries and frameworks, organised by category
๐ [www.awesomepython.org](https://www.awesomepython.org)
## Template
Template tools and libraries: cookiecutter repos, generators, quick-starts.
1. tiangolo/full-stack-fastapi-template โญ 23,912
Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.
2. cookiecutter/cookiecutter โญ 21,835
A cross-platform command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, C projects.
๐ [pypi.org/project/cookiecutter](https://pypi.org/project/cookiecutter/)
3. drivendata/cookiecutter-data-science โญ 7,745
A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.
๐ [cookiecutter-data-science.drivendata.org](https://cookiecutter-data-science.drivendata.org/)
4. buuntu/fastapi-react โญ 2,098
๐ Cookiecutter Template for FastAPI + React Projects. Using PostgreSQL, SQLAlchemy, and Docker
5. pyscaffold/pyscaffold โญ 2,037
๐ Python project template generator with batteries included
๐ [pyscaffold.org](https://pyscaffold.org)
6. cjolowicz/cookiecutter-hypermodern-python โญ 1,741
Cookiecutter template for a Python package based on the Hypermodern Python article series.
๐ [cookiecutter-hypermodern-python.readthedocs.io](http://cookiecutter-hypermodern-python.readthedocs.io/)
7. tezromach/python-package-template โญ 1,078
๐ Your next Python package needs a bleeding-edge project structure.
8. martinheinz/python-project-blueprint โญ 947
Blueprint/Boilerplate For Python Projects
## Terminal
Terminal and console tools and libraries: CLI tools, terminal based formatters, progress bars.
1. willmcgugan/rich โญ 47,653
Rich is a Python library for rich text and beautiful formatting in the terminal.
๐ [rich.readthedocs.io/en/latest](https://rich.readthedocs.io/en/latest/)
2. tqdm/tqdm โญ 27,706
:zap: A Fast, Extensible Progress Bar for Python and CLI
๐ [tqdm.github.io](https://tqdm.github.io)
3. google/python-fire โญ 26,476
Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.
4. willmcgugan/textual โญ 23,843
The lean application framework for Python. Build sophisticated user interfaces with a simple Python API. Run your apps in the terminal and a web browser.
๐ [textual.textualize.io](https://textual.textualize.io/)
5. pallets/click โญ 15,166
Python composable command line interface toolkit
๐ [click.palletsprojects.com](https://click.palletsprojects.com)
6. tiangolo/typer โญ 14,627
Typer, build great CLIs. Easy to code. Based on Python type hints.
๐ [typer.tiangolo.com](https://typer.tiangolo.com/)
7. saulpw/visidata โญ 7,494
A terminal spreadsheet multitool for discovering and arranging data
๐ [visidata.org](http://visidata.org)
8. manrajgrover/halo โญ 2,858
๐ซ Beautiful spinners for terminal, IPython and Jupyter
9. urwid/urwid โญ 2,752
Console user interface library for Python (official repo)
๐ [urwid.org](urwid.org)
10. tconbeer/harlequin โญ 2,744
The SQL IDE for Your Terminal.
๐ [harlequin.sh](https://harlequin.sh)
11. textualize/trogon โญ 2,378
Easily turn your Click CLI into a powerful terminal application
12. darrenburns/elia โญ 1,498
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
13. tmbo/questionary โญ 1,449
Python library to build pretty command line user prompts โจEasy to use multi-select lists, confirmations, free text prompts ...
14. jazzband/prettytable โญ 1,288
Display tabular data in a visually appealing ASCII table format
๐ [pypi.org/project/prettytable](https://pypi.org/project/PrettyTable/)
15. 1j01/textual-paint โญ 924
:art: MS Paint in your terminal.
๐ [pypi.org/project/textual-paint](https://pypi.org/project/textual-paint/)
## Testing
Testing libraries: unit testing, load testing, acceptance testing, code coverage, browser automation, plugins.
1. mitmproxy/mitmproxy โญ 34,825
An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.
๐ [mitmproxy.org](https://mitmproxy.org)
2. locustio/locust โญ 23,937
Write scalable load tests in plain Python ๐๐จ
3. pytest-dev/pytest โญ 11,533
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
๐ [pytest.org](https://pytest.org)
4. microsoft/playwright-python โญ 10,964
Python version of the Playwright testing and automation library.
๐ [playwright.dev/python](https://playwright.dev/python/)
5. robotframework/robotframework โญ 9,265
Generic automation framework for acceptance testing and RPA
๐ [robotframework.org](http://robotframework.org)
6. getmoto/moto โญ 7,443
A library that allows you to easily mock out tests based on AWS infrastructure.
๐ [docs.getmoto.org/en/latest](http://docs.getmoto.org/en/latest/)
7. hypothesisworks/hypothesis โญ 7,348
Hypothesis is a powerful, flexible, and easy to use library for property-based testing.
๐ [hypothesis.works](https://hypothesis.works)
8. newsapps/beeswithmachineguns โญ 6,404
A utility for arming (creating) many bees (micro EC2 instances) to attack (load test) targets (web applications).
๐ [apps.chicagotribune.com](http://apps.chicagotribune.com/)
9. seleniumbase/SeleniumBase โญ 4,381
๐ Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
๐ [seleniumbase.io](https://seleniumbase.io)
10. getsentry/responses โญ 4,068
A utility for mocking out the Python Requests library.
11. spulec/freezegun โญ 4,002
Let your Python tests travel through time
12. codium-ai/cover-agent โญ 3,816
CodiumAI Cover-Agent: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! ๐ป๐ค๐งช๐
๐ [www.codium.ai](https://www.codium.ai/)
13. tox-dev/tox โญ 3,560
Command line driven CI frontend and development task automation tool.
๐ [tox.wiki](https://tox.wiki)
14. behave/behave โญ 3,090
BDD, Python style.
๐ [behave.readthedocs.io/en/latest](https://behave.readthedocs.io/en/latest/)
15. nedbat/coveragepy โญ 2,872
The code coverage tool for Python
๐ [coverage.readthedocs.io](https://coverage.readthedocs.io)
16. cobrateam/splinter โญ 2,692
splinter - python test framework for web applications
๐ [splinter.readthedocs.org/en/stable/index.html](http://splinter.readthedocs.org/en/stable/index.html)
17. kevin1024/vcrpy โญ 2,629
Automatically mock your HTTP interactions to simplify and speed up testing
18. pytest-dev/pytest-testinfra โญ 2,333
With Testinfra you can write unit tests in Python to test actual state of your servers configured by management tools like Salt, Ansible, Puppet, Chef and so on.
๐ [testinfra.readthedocs.io](https://testinfra.readthedocs.io)
19. confident-ai/deepeval โญ 2,090
The LLM Evaluation Framework
๐ [docs.confident-ai.com](https://docs.confident-ai.com/)
20. pytest-dev/pytest-mock โญ 1,781
Thin-wrapper around the mock package for easier use with pytest
๐ [pytest-mock.readthedocs.io/en/latest](https://pytest-mock.readthedocs.io/en/latest/)
21. pytest-dev/pytest-cov โญ 1,684
Coverage plugin for pytest.
22. pytest-dev/pytest-xdist โญ 1,386
pytest plugin for distributed testing and loop-on-failures testing modes.
๐ [pytest-xdist.readthedocs.io](https://pytest-xdist.readthedocs.io)
23. pytest-dev/pytest-asyncio โญ 1,344
Asyncio support for pytest
๐ [pytest-asyncio.readthedocs.io](https://pytest-asyncio.readthedocs.io)
24. taverntesting/tavern โญ 996
A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax
๐ [taverntesting.github.io](https://taverntesting.github.io/)
## Machine Learning - Time Series
Machine learning and classical timeseries libraries: forecasting, seasonality, anomaly detection, econometrics.
1. facebook/prophet โญ 17,929
Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
๐ [facebook.github.io/prophet](https://facebook.github.io/prophet)
2. blue-yonder/tsfresh โญ 8,162
Automatic extraction of relevant features from time series:
๐ [tsfresh.readthedocs.io](http://tsfresh.readthedocs.io)
3. sktime/sktime โญ 7,506
A unified framework for machine learning with time series
๐ [www.sktime.net](https://www.sktime.net)
4. unit8co/darts โญ 7,467
A python library for user-friendly forecasting and anomaly detection on time series.
๐ [unit8co.github.io/darts](https://unit8co.github.io/darts/)
5. facebookresearch/Kats โญ 4,819
Kats, a kit to analyze time series data, a lightweight, easy-to-use, generalizable, and extendable framework to perform time series analysis, from understanding the key statistics and characteristics, detecting change points and anomalies, to forecasting future trends.
6. awslabs/gluonts โญ 4,383
Probabilistic time series modeling in Python
๐ [ts.gluon.ai](https://ts.gluon.ai)
7. nixtla/statsforecast โญ 3,652
Lightning โก๏ธ fast forecasting with statistical and econometric models.
๐ [nixtlaverse.nixtla.io/statsforecast](https://nixtlaverse.nixtla.io/statsforecast)
8. salesforce/Merlion โญ 3,288
Merlion: A Machine Learning Framework for Time Series Intelligence
9. tdameritrade/stumpy โญ 3,051
STUMPY is a powerful and scalable Python library for modern time series analysis
๐ [stumpy.readthedocs.io/en/latest](https://stumpy.readthedocs.io/en/latest/)
10. google-research/timesfm โญ 2,811
TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecasting.
๐ [research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting](https://research.google/blog/a-decoder-only-foundation-model-for-time-series-forecasting/)
11. rjt1990/pyflux โญ 2,094
Open source time series library for Python
12. amazon-science/chronos-forecasting โญ 1,940
Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting
๐ [arxiv.org/abs/2403.07815](https://arxiv.org/abs/2403.07815)
13. aistream-peelout/flow-forecast โญ 1,934
Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).
๐ [flow-forecast.atlassian.net/wiki/spaces/ff/overview](https://flow-forecast.atlassian.net/wiki/spaces/FF/overview)
14. uber/orbit โญ 1,814
A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.
๐ [orbit-ml.readthedocs.io/en/stable](https://orbit-ml.readthedocs.io/en/stable/)
15. alkaline-ml/pmdarima โญ 1,536
A statistical library designed to fill the void in Python's time series analysis capabilities, including the equivalent of R's auto.arima function.
๐ [www.alkaline-ml.com/pmdarima](https://www.alkaline-ml.com/pmdarima)
16. time-series-foundation-models/lag-llama โญ 1,051
Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting
17. winedarksea/AutoTS โญ 1,042
Automated Time Series Forecasting
18. autoviml/Auto_TS โญ 688
Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Created by Ram Seshadri. Collaborators welcome.
19. google/temporian โญ 636
Temporian is an open-source Python library for preprocessing โก and feature engineering ๐ temporal data ๐ for machine learning applications ๐ค
๐ [temporian.readthedocs.io](https://temporian.readthedocs.io)
## Typing
Typing libraries: static and run-time type checking, annotations.
1. python/mypy โญ 17,722
Optional static typing for Python
๐ [www.mypy-lang.org](https://www.mypy-lang.org/)
2. microsoft/pyright โญ 12,299
Static Type Checker for Python
3. facebook/pyre-check โญ 6,720
Performant type-checking for python.
๐ [pyre-check.org](https://pyre-check.org/)
4. python-attrs/attrs โญ 5,115
Python Classes Without Boilerplate
๐ [www.attrs.org](https://www.attrs.org/)
5. google/pytype โญ 4,642
A static type analyzer for Python code
๐ [google.github.io/pytype](https://google.github.io/pytype)
6. instagram/MonkeyType โญ 4,576
A Python library that generates static type annotations by collecting runtime types
7. python/typeshed โญ 4,134
Collection of library stubs for Python, with static types
8. mtshiba/pylyzer โญ 2,062
A fast static code analyzer & language server for Python
๐ [mtshiba.github.io/pylyzer](http://mtshiba.github.io/pylyzer/)
9. microsoft/pylance-release โญ 1,663
Fast, feature-rich language support for Python. Documentation and issues for Pylance.
10. agronholm/typeguard โญ 1,460
Run-time type checker for Python
11. patrick-kidger/torchtyping โญ 1,345
Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.
12. robertcraigie/pyright-python โญ 145
Python command line wrapper for pyright, a static type checker
๐ [pypi.org/project/pyright](https://pypi.org/project/pyright/)
## Utility
General utility libraries: miscellaneous tools, linters, code formatters, version management, package tools, documentation tools.
1. yt-dlp/yt-dlp โญ 73,906
A feature-rich command-line audio/video downloader
๐ [discord.gg/h5mncfw63r](https://discord.gg/H5MNcFW63r)
2. home-assistant/core โญ 69,355
๐ก Open source home automation that puts local control and privacy first.
๐ [www.home-assistant.io](https://www.home-assistant.io)
3. python/cpython โญ 60,413
The Python programming language
๐ [www.python.org](https://www.python.org/)
4. localstack/localstack โญ 52,613
๐ป A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
๐ [localstack.cloud](https://localstack.cloud)
5. faif/python-patterns โญ 39,669
A collection of design patterns/idioms in Python
6. mingrammer/diagrams โญ 35,240
:art: Diagram as Code for prototyping cloud system architectures
๐ [diagrams.mingrammer.com](https://diagrams.mingrammer.com)
7. ggerganov/whisper.cpp โญ 32,401
Port of OpenAI's Whisper model in C/C++
8. keon/algorithms โญ 23,700
Minimal examples of data structures and algorithms in Python
9. norvig/pytudes โญ 22,478
Python programs, usually short, of considerable difficulty, to perfect particular skills.
10. modularml/mojo โญ 21,865
The Mojo Programming Language
๐ [docs.modular.com/mojo](https://docs.modular.com/mojo)
11. openai/openai-python โญ 20,717
The official Python library for the OpenAI API
๐ [pypi.org/project/openai](https://pypi.org/project/openai/)
12. chriskiehl/Gooey โญ 20,432
Turn (almost) any Python command line program into a full GUI application with one line
13. facebookresearch/audiocraft โญ 19,957
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
14. pydantic/pydantic โญ 19,309
Data validation using Python type hints
๐ [docs.pydantic.dev](https://docs.pydantic.dev)
15. squidfunk/mkdocs-material โญ 18,747
Documentation that simply works
๐ [squidfunk.github.io/mkdocs-material](https://squidfunk.github.io/mkdocs-material/)
16. micropython/micropython โญ 18,568
MicroPython - a lean and efficient Python implementation for microcontrollers and constrained systems
๐ [micropython.org](https://micropython.org)
17. mkdocs/mkdocs โญ 18,524
Project documentation with Markdown.
๐ [www.mkdocs.org](https://www.mkdocs.org)
18. delgan/loguru โญ 18,494
Python logging made (stupidly) simple
19. rustpython/RustPython โญ 17,963
A Python Interpreter written in Rust
๐ [rustpython.github.io](https://rustpython.github.io)
20. kivy/kivy โญ 17,097
Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
๐ [kivy.org](https://kivy.org)
21. ipython/ipython โญ 16,167
Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.
๐ [ipython.readthedocs.org](https://ipython.readthedocs.org)
22. alievk/avatarify-python โญ 16,136
Avatars for Zoom, Skype and other video-conferencing apps.
23. higherorderco/Bend โญ 16,097
A massively parallel, high-level programming language
๐ [higherorderco.com](https://higherorderco.com)
24. blakeblackshear/frigate โญ 15,389
NVR with realtime local object detection for IP cameras
๐ [frigate.video](https://frigate.video)
25. zulko/moviepy โญ 11,979
Video editing with Python
๐ [zulko.github.io/moviepy](https://zulko.github.io/moviepy/)
26. python-pillow/Pillow โญ 11,823
The Python Imaging Library adds image processing capabilities to Python (Pillow is the friendly PIL fork)
๐ [python-pillow.org](https://python-pillow.org)
27. openai/triton โญ 11,611
Development repository for the Triton language and compiler
๐ [triton-lang.org](https://triton-lang.org/)
28. pyodide/pyodide โญ 11,573
Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
๐ [pyodide.org/en/stable](https://pyodide.org/en/stable/)
29. dbader/schedule โญ 11,571
Python job scheduling for humans.
๐ [schedule.readthedocs.io](https://schedule.readthedocs.io/)
30. pyo3/pyo3 โญ 11,288
Rust bindings for the Python interpreter
๐ [pyo3.rs](https://pyo3.rs)
31. paul-gauthier/aider โญ 11,227
Aider is a command line tool that lets you pair program with LLMs, to edit code stored in your local git repository
๐ [aider.chat](https://aider.chat/)
32. nuitka/Nuitka โญ 11,097
Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4-3.12. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
๐ [nuitka.net](http://nuitka.net)
33. caronc/apprise โญ 10,746
Apprise - Push Notifications that work with just about every platform!
๐ [hub.docker.com/r/caronc/apprise](https://hub.docker.com/r/caronc/apprise)
34. ninja-build/ninja โญ 10,694
Ninja is a small build system with a focus on speed.
๐ [ninja-build.org](https://ninja-build.org/)
35. pytube/pytube โญ 10,496
A lightweight, dependency-free Python library (and command-line utility) for downloading YouTube Videos.
๐ [pytube.io](https://pytube.io)
36. secdev/scapy โญ 10,204
Scapy: the Python-based interactive packet manipulation program & library.
๐ [scapy.net](https://scapy.net)
37. magicstack/uvloop โญ 10,102
Ultra fast asyncio event loop.
38. pallets/jinja โญ 10,025
A very fast and expressive template engine.
๐ [jinja.palletsprojects.com](https://jinja.palletsprojects.com)
39. asweigart/pyautogui โญ 9,792
A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.
40. aws/serverless-application-model โญ 9,266
The AWS Serverless Application Model (AWS SAM) transform is a AWS CloudFormation macro that transforms SAM templates into CloudFormation templates.
๐ [aws.amazon.com/serverless/sam](https://aws.amazon.com/serverless/sam)
41. cython/cython โญ 9,060
The most widely used Python to C compiler
๐ [cython.org](https://cython.org)
42. paramiko/paramiko โญ 8,890
The leading native Python SSHv2 protocol library.
๐ [paramiko.org](http://paramiko.org)
43. boto/boto3 โญ 8,779
AWS SDK for Python
๐ [aws.amazon.com/sdk-for-python](https://aws.amazon.com/sdk-for-python/)
44. arrow-py/arrow โญ 8,592
๐น Better dates & times for Python
๐ [arrow.readthedocs.io](https://arrow.readthedocs.io)
45. facebookresearch/hydra โญ 8,313
Hydra is a framework for elegantly configuring complex applications
๐ [hydra.cc](https://hydra.cc)
46. xonsh/xonsh โญ 8,111
:shell: Python-powered, cross-platform, Unix-gazing shell.
๐ [xon.sh](http://xon.sh)
47. eternnoir/pyTelegramBotAPI โญ 7,810
Python Telegram bot api.
48. kellyjonbrazil/jc โญ 7,655
CLI tool and python library that converts the output of popular command-line tools, file-types, and common strings to JSON, YAML, or Dictionaries. This allows piping of output to tools like jq and simplifying automation scripts.
49. py-pdf/pypdf โญ 7,620
A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files
๐ [pypdf.readthedocs.io/en/latest](https://pypdf.readthedocs.io/en/latest/)
50. googleapis/google-api-python-client โญ 7,500
๐ The official Python client library for Google's discovery based APIs.
๐ [googleapis.github.io/google-api-python-client/docs](https://googleapis.github.io/google-api-python-client/docs/)
51. theskumar/python-dotenv โญ 7,230
Reads key-value pairs from a .env file and can set them as environment variables. It helps in developing applications following the 12-factor principles.
๐ [saurabh-kumar.com/python-dotenv](https://saurabh-kumar.com/python-dotenv/)
52. google/latexify_py โญ 7,084
A library to generate LaTeX expression from Python code.
53. googlecloudplatform/python-docs-samples โญ 7,033
Code samples used on cloud.google.com
54. jasonppy/VoiceCraft โญ 6,995
Zero-Shot Speech Editing and Text-to-Speech in the Wild
55. marshmallow-code/marshmallow โญ 6,919
A lightweight library for converting complex objects to and from simple Python datatypes.
๐ [marshmallow.readthedocs.io](https://marshmallow.readthedocs.io/)
56. hugapi/hug โญ 6,836
Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.
57. pygithub/PyGithub โญ 6,756
Typed interactions with the GitHub API v3
๐ [pygithub.readthedocs.io](https://pygithub.readthedocs.io/)
58. openai/point-e โญ 6,370
Point cloud diffusion for 3D model synthesis
59. pyca/cryptography โญ 6,363
cryptography is a package designed to expose cryptographic primitives and recipes to Python developers.
๐ [cryptography.io](https://cryptography.io)
60. gorakhargosh/watchdog โญ 6,332
Python library and shell utilities to monitor filesystem events.
๐ [packages.python.org/watchdog](http://packages.python.org/watchdog/)
61. jd/tenacity โญ 6,141
Retrying library for Python
๐ [tenacity.readthedocs.io](http://tenacity.readthedocs.io)
62. sphinx-doc/sphinx โญ 6,133
The Sphinx documentation generator
๐ [www.sphinx-doc.org](https://www.sphinx-doc.org/)
63. sdispater/pendulum โญ 6,108
Python datetimes made easy
๐ [pendulum.eustace.io](https://pendulum.eustace.io)
64. icloud-photos-downloader/icloud_photos_downloader โญ 6,105
A command-line tool to download photos from iCloud
65. scikit-image/scikit-image โญ 5,917
Image processing in Python
๐ [scikit-image.org](https://scikit-image.org)
66. bndr/pipreqs โญ 5,911
pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.
67. wireservice/csvkit โญ 5,868
A suite of utilities for converting to and working with CSV, the king of tabular file formats.
๐ [csvkit.readthedocs.io](https://csvkit.readthedocs.io)
68. agronholm/apscheduler โญ 5,848
Task scheduling library for Python
69. ijl/orjson โญ 5,707
Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy
70. timdettmers/bitsandbytes โญ 5,631
Accessible large language models via k-bit quantization for PyTorch.
๐ [huggingface.co/docs/bitsandbytes/main/en/index](https://huggingface.co/docs/bitsandbytes/main/en/index)
71. pdfminer/pdfminer.six โญ 5,555
Community maintained fork of pdfminer - we fathom PDF
๐ [pdfminersix.readthedocs.io](https://pdfminersix.readthedocs.io)
72. pytransitions/transitions โญ 5,454
A lightweight, object-oriented finite state machine implementation in Python with many extensions
73. buildbot/buildbot โญ 5,186
Python-based continuous integration testing framework; your pull requests are more than welcome!
๐ [www.buildbot.net](https://www.buildbot.net)
74. rsalmei/alive-progress โญ 5,178
A new kind of Progress Bar, with real-time throughput, ETA, and very cool animations!
75. prompt-toolkit/ptpython โญ 5,081
A better Python REPL
76. pycqa/pycodestyle โญ 4,992
Simple Python style checker in one Python file
๐ [pycodestyle.pycqa.org](https://pycodestyle.pycqa.org)
77. spotify/pedalboard โญ 4,933
๐ ๐ A Python library for audio.
๐ [spotify.github.io/pedalboard](https://spotify.github.io/pedalboard)
78. jorgebastida/awslogs โญ 4,778
AWS CloudWatch logs for Humansโข
79. pywinauto/pywinauto โญ 4,699
Windows GUI Automation with Python (based on text properties)
๐ [pywinauto.github.io](http://pywinauto.github.io/)
80. tebelorg/RPA-Python โญ 4,643
Python package for doing RPA
81. pytoolz/toolz โญ 4,547
A functional standard library for Python.
๐ [toolz.readthedocs.org](http://toolz.readthedocs.org/)
82. hhatto/autopep8 โญ 4,532
A tool that automatically formats Python code to conform to the PEP 8 style guide.
๐ [pypi.org/project/autopep8](https://pypi.org/project/autopep8/)
83. pyinvoke/invoke โญ 4,292
Pythonic task management & command execution.
๐ [pyinvoke.org](http://pyinvoke.org)
84. bogdanp/dramatiq โญ 4,120
A fast and reliable background task processing library for Python 3.
๐ [dramatiq.io](https://dramatiq.io)
85. evhub/coconut โญ 3,984
Coconut (coconut-lang.org) is a variant of Python that adds on top of Python syntax new features for simple, elegant, Pythonic functional programming.
๐ [coconut-lang.org](http://coconut-lang.org)
86. adafruit/circuitpython โญ 3,933
CircuitPython - a Python implementation for teaching coding with microcontrollers
๐ [circuitpython.org](https://circuitpython.org)
87. miguelgrinberg/python-socketio โญ 3,825
Python Socket.IO server and client
88. ashleve/lightning-hydra-template โญ 3,771
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. โก๐ฅโก
89. rspeer/python-ftfy โญ 3,724
Fixes mojibake and other glitches in Unicode text, after the fact.
๐ [ftfy.readthedocs.org](http://ftfy.readthedocs.org)
90. joblib/joblib โญ 3,707
Computing with Python functions.
๐ [joblib.readthedocs.org](http://joblib.readthedocs.org)
91. ets-labs/python-dependency-injector โญ 3,653
Dependency injection framework for Python
๐ [python-dependency-injector.ets-labs.org](https://python-dependency-injector.ets-labs.org/)
92. python-markdown/markdown โญ 3,634
A Python implementation of John Gruberโs Markdown with Extension support.
๐ [python-markdown.github.io](https://python-markdown.github.io/)
93. zeromq/pyzmq โญ 3,574
PyZMQ: Python bindings for zeromq
๐ [zguide.zeromq.org/py:all](http://zguide.zeromq.org/py:all)
94. pyinfra-dev/pyinfra โญ 3,559
pyinfra turns Python code into shell commands and runs them on your servers. Execute ad-hoc commands and write declarative operations. Target SSH servers, local machine and Docker containers. Fast and scales from one server to thousands.
๐ [pyinfra.com](https://pyinfra.com)
95. more-itertools/more-itertools โญ 3,542
More routines for operating on iterables, beyond itertools
๐ [more-itertools.rtfd.io](https://more-itertools.rtfd.io)
96. pypi/warehouse โญ 3,490
The Python Package Index
๐ [pypi.org](https://pypi.org)
97. tartley/colorama โญ 3,459
Simple cross-platform colored terminal text in Python
98. pydata/xarray โญ 3,452
N-D labeled arrays and datasets in Python
๐ [xarray.dev](https://xarray.dev)
99. osohq/oso โญ 3,427
Oso is a batteries-included framework for building authorization in your application.
๐ [docs.osohq.com](https://docs.osohq.com)
100. pyo3/maturin โญ 3,374
Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages
๐ [maturin.rs](https://maturin.rs)
101. jorisschellekens/borb โญ 3,327
borb is a library for reading, creating and manipulating PDF files in python.
๐ [borbpdf.com](https://borbpdf.com/)
102. suor/funcy โญ 3,293
A fancy and practical functional tools
103. blealtan/efficient-kan โญ 3,254
An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
104. pyserial/pyserial โญ 3,141
Python serial port access library
105. spotify/basic-pitch โญ 3,068
A lightweight yet powerful audio-to-MIDI converter with pitch bend detection
๐ [basicpitch.io](https://basicpitch.io)
106. camelot-dev/camelot โญ 2,736
A Python library to extract tabular data from PDFs
๐ [camelot-py.readthedocs.io](https://camelot-py.readthedocs.io)
107. tox-dev/pipdeptree โญ 2,712
A command line utility to display dependency tree of the installed Python packages
๐ [pypi.python.org/pypi/pipdeptree](https://pypi.python.org/pypi/pipdeptree)
108. legrandin/pycryptodome โญ 2,712
A self-contained cryptographic library for Python
๐ [www.pycryptodome.org](https://www.pycryptodome.org)
109. liiight/notifiers โญ 2,614
The easy way to send notifications
๐ [notifiers.readthedocs.io](http://notifiers.readthedocs.io/)
110. lxml/lxml โญ 2,595
The lxml XML toolkit for Python
๐ [lxml.de](https://lxml.de/)
111. whylabs/whylogs โญ 2,571
An open-source data logging library for machine learning models and data pipelines. ๐ Provides visibility into data quality & model performance over time. ๐ก๏ธ Supports privacy-preserving data collection, ensuring safety & robustness. ๐
๐ [whylogs.readthedocs.io](https://whylogs.readthedocs.io/)
112. pexpect/pexpect โญ 2,546
A Python module for controlling interactive programs in a pseudo-terminal
๐ [pexpect.readthedocs.io](http://pexpect.readthedocs.io/)
113. litl/backoff โญ 2,503
Python library providing function decorators for configurable backoff and retry
114. pyston/pyston โญ 2,501
A faster and highly-compatible implementation of the Python programming language.
๐ [www.pyston.org](https://www.pyston.org/)
115. scrapinghub/dateparser โญ 2,477
python parser for human readable dates
116. yaml/pyyaml โญ 2,456
Canonical source repository for PyYAML
117. dosisod/refurb โญ 2,454
A tool for refurbishing and modernizing Python codebases
118. cdgriffith/Box โญ 2,385
Python dictionaries with advanced dot notation access
๐ [github.com/cdgriffith/box/wiki](https://github.com/cdgriffith/Box/wiki)
119. pypa/setuptools โญ 2,351
Official project repository for the Setuptools build system
๐ [pypi.org/project/setuptools](https://pypi.org/project/setuptools/)
120. nschloe/tikzplotlib โญ 2,339
๐ Save matplotlib figures as TikZ/PGFplots for smooth integration into LaTeX.
121. hgrecco/pint โญ 2,304
Operate and manipulate physical quantities in Python
๐ [pint.readthedocs.org](http://pint.readthedocs.org/)
122. dateutil/dateutil โญ 2,265
Useful extensions to the standard Python datetime features
123. grantjenks/python-diskcache โญ 2,210
Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
๐ [www.grantjenks.com/docs/diskcache](http://www.grantjenks.com/docs/diskcache/)
124. pndurette/gTTS โญ 2,173
Python library and CLI tool to interface with Google Translate's text-to-speech API
๐ [gtts.readthedocs.org](http://gtts.readthedocs.org/)
125. kiminewt/pyshark โญ 2,155
Python wrapper for tshark, allowing python packet parsing using wireshark dissectors
126. ianmiell/shutit โญ 2,147
Automation framework for programmers
๐ [ianmiell.github.io/shutit](http://ianmiell.github.io/shutit/)
127. pyparsing/pyparsing โญ 2,130
Python library for creating PEG parsers
128. libaudioflux/audioFlux โญ 2,081
A library for audio and music analysis, feature extraction.
๐ [audioflux.top](https://audioflux.top)
129. astanin/python-tabulate โญ 2,016
Pretty-print tabular data in Python, a library and a command-line utility. Repository migrated from bitbucket.org/astanin/python-tabulate.
๐ [pypi.org/project/tabulate](https://pypi.org/project/tabulate/)
130. google/gin-config โญ 2,009
Gin provides a lightweight configuration framework for Python
131. grahamdumpleton/wrapt โญ 1,997
A Python module for decorators, wrappers and monkey patching.
132. pyfilesystem/pyfilesystem2 โญ 1,961
Python's Filesystem abstraction layer
๐ [www.pyfilesystem.org](https://www.pyfilesystem.org)
133. jcrist/msgspec โญ 1,959
A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML
๐ [jcristharif.com/msgspec](https://jcristharif.com/msgspec/)
134. nateshmbhat/pyttsx3 โญ 1,958
Offline Text To Speech synthesis for python
135. landscapeio/prospector โญ 1,914
Inspects Python source files and provides information about type and location of classes, methods etc
136. python-rope/rope โญ 1,867
a python refactoring library
137. julienpalard/Pipe โญ 1,863
A Python library to use infix notation in Python
138. numba/llvmlite โญ 1,854
A lightweight LLVM python binding for writing JIT compilers
๐ [llvmlite.pydata.org](https://llvmlite.pydata.org/)
139. chaostoolkit/chaostoolkit โญ 1,847
Chaos Engineering Toolkit & Orchestration for Developers
๐ [chaostoolkit.org](https://chaostoolkit.org)
140. omry/omegaconf โญ 1,843
Flexible Python configuration system. The last one you will ever need.
141. mitmproxy/pdoc โญ 1,840
API Documentation for Python Projects
๐ [pdoc.dev](https://pdoc.dev)
142. carpedm20/emoji โญ 1,840
emoji terminal output for Python
143. joowani/binarytree โญ 1,808
Python Library for Studying Binary Trees
๐ [binarytree.readthedocs.io](http://binarytree.readthedocs.io)
144. pydoit/doit โญ 1,802
task management & automation tool
๐ [pydoit.org](http://pydoit.org)
145. rhettbull/osxphotos โญ 1,786
Python app to work with pictures and associated metadata from Apple Photos on macOS. Also includes a package to provide programmatic access to the Photos library, pictures, and metadata.
146. pygments/pygments โญ 1,742
Pygments is a generic syntax highlighter written in Python
๐ [pygments.org](http://pygments.org/)
147. kalliope-project/kalliope โญ 1,709
Kalliope is a framework that will help you to create your own personal assistant.
๐ [kalliope-project.github.io](https://kalliope-project.github.io/)
148. konradhalas/dacite โญ 1,677
Simple creation of data classes from dictionaries.
149. home-assistant/supervisor โญ 1,663
๐ก Home Assistant Supervisor
๐ [home-assistant.io/hassio](https://home-assistant.io/hassio/)
150. open-telemetry/opentelemetry-python โญ 1,644
OpenTelemetry Python API and SDK
๐ [opentelemetry.io](https://opentelemetry.io)
151. samuelcolvin/watchfiles โญ 1,644
Simple, modern and fast file watching and code reload in python.
๐ [watchfiles.helpmanual.io](https://watchfiles.helpmanual.io)
152. p0dalirius/Coercer โญ 1,621
A python script to automatically coerce a Windows server to authenticate on an arbitrary machine through 12 methods.
๐ [podalirius.net](https://podalirius.net/)
153. rubik/radon โญ 1,609
Various code metrics for Python code
๐ [radon.readthedocs.org](http://radon.readthedocs.org/)
154. mkdocstrings/mkdocstrings โญ 1,605
๐ Automatic documentation from sources, for MkDocs.
๐ [mkdocstrings.github.io](https://mkdocstrings.github.io/)
155. hbldh/bleak โญ 1,586
A cross platform Bluetooth Low Energy Client for Python using asyncio
156. facebookincubator/Bowler โญ 1,521
Safe code refactoring for modern Python.
๐ [pybowler.io](https://pybowler.io/)
157. pydantic/logfire โญ 1,482
Uncomplicated Observability for Python and beyond! ๐ชต๐ฅ
๐ [docs.pydantic.dev/logfire](https://docs.pydantic.dev/logfire/)
158. nficano/python-lambda โญ 1,482
A toolkit for developing and deploying serverless Python code in AWS Lambda.
159. quodlibet/mutagen โญ 1,458
Python module for handling audio metadata
๐ [mutagen.readthedocs.io](https://mutagen.readthedocs.io)
160. instagram/LibCST โญ 1,447
A concrete syntax tree parser and serializer library for Python that preserves many aspects of Python's abstract syntax tree
๐ [libcst.readthedocs.io](https://libcst.readthedocs.io/)
161. fabiocaccamo/python-benedict โญ 1,436
๐ dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xls, xml, yaml), s3 support and many utilities.
162. aws-samples/aws-glue-samples โญ 1,403
AWS Glue code samples
163. lcompilers/lpython โญ 1,360
Python compiler
๐ [lpython.org](https://lpython.org/)
164. pycqa/pyflakes โญ 1,342
A simple program which checks Python source files for errors
๐ [pypi.org/project/pyflakes](https://pypi.org/project/pyflakes)
165. lidatong/dataclasses-json โญ 1,323
Easily serialize Data Classes to and from JSON
166. ossf/criticality_score โญ 1,288
Gives criticality score for an open source project
167. brandon-rhodes/python-patterns โญ 1,275
Source code behind the python-patterns.guide site by Brandon Rhodes
168. aio-libs/yarl โญ 1,254
Yet another URL library
๐ [yarl.aio-libs.org](https://yarl.aio-libs.org)
169. oracle/graalpython โญ 1,143
A Python 3 implementation built on GraalVM
170. pdoc3/pdoc โญ 1,104
๐ :arrow_right: ๐ Auto-generate API documentation for Python projects
๐ [pdoc3.github.io/pdoc](https://pdoc3.github.io/pdoc/)
171. c4urself/bump2version โญ 1,047
Version-bump your software with a single command
๐ [pypi.python.org/pypi/bump2version](https://pypi.python.org/pypi/bump2version)
172. pyo3/rust-numpy โญ 1,036
PyO3-based Rust bindings of the NumPy C-API
173. metachris/logzero โญ 1,029
Robust and effective logging for Python 2 and 3.
๐ [logzero.readthedocs.io](https://logzero.readthedocs.io)
174. anthropics/anthropic-sdk-python โญ 979
SDK providing access to Anthropic's safety-first language model APIs
175. pyfpdf/fpdf2 โญ 974
Simple PDF generation for Python
๐ [py-pdf.github.io/fpdf2](https://py-pdf.github.io/fpdf2/)
176. fsspec/filesystem_spec โญ 925
A specification that python filesystems should adhere to.
177. milvus-io/pymilvus โญ 920
Python SDK for Milvus.
178. fastai/fastcore โญ 902
Python supercharged for the fastai library
๐ [fastcore.fast.ai](http://fastcore.fast.ai)
179. lastmile-ai/aiconfig โญ 878
AIConfig saves prompts, models and model parameters as source control friendly configs. This allows you to iterate on prompts and model parameters separately from your application code.
๐ [aiconfig.lastmileai.dev](https://aiconfig.lastmileai.dev)
180. alex-sherman/unsync โญ 871
Unsynchronize asyncio
181. pypy/pypy โญ 799
PyPy is a very fast and compliant implementation of the Python language.
๐ [pypy.org](https://pypy.org)
182. samuelcolvin/dirty-equals โญ 776
Doing dirty (but extremely useful) things with equals.
๐ [dirty-equals.helpmanual.io](https://dirty-equals.helpmanual.io)
183. barracuda-fsh/pyobd โญ 757
An OBD-II compliant car diagnostic tool
184. pypa/build โญ 681
A simple, correct Python build frontend
๐ [build.pypa.io](https://build.pypa.io)
185. instagram/Fixit โญ 655
Advanced Python linting framework with auto-fixes and hierarchical configuration that makes it easy to write custom in-repo lint rules.
๐ [fixit.rtfd.io/en/latest](https://fixit.rtfd.io/en/latest/)
186. qdrant/qdrant-client โญ 649
Python client for Qdrant vector search engine
๐ [qdrant.tech](https://qdrant.tech)
187. open-telemetry/opentelemetry-python-contrib โญ 633
OpenTelemetry instrumentation for Python modules
๐ [opentelemetry.io](https://opentelemetry.io)
188. gefyrahq/gefyra โญ 633
Blazingly-fast ๐, rock-solid, local application development :arrow_right: with Kubernetes.
๐ [gefyra.dev](https://gefyra.dev)
189. modal-labs/modal-examples โญ 616
Examples of programs built using Modal
๐ [modal.com/docs](https://modal.com/docs)
190. methexis-inc/terminal-copilot โญ 566
A smart terminal assistant that helps you find the right command.
191. platformdirs/platformdirs โญ 520
A small Python module for determining appropriate platform-specific dirs, e.g. a "user data dir".
๐ [platformdirs.readthedocs.io](https://platformdirs.readthedocs.io)
192. fastai/ghapi โญ 520
A delightful and complete interface to GitHub's amazing API
๐ [ghapi.fast.ai](https://ghapi.fast.ai/)
193. argoproj-labs/hera โญ 511
Hera is an Argo Python SDK. Hera aims to make construction and submission of various Argo Project resources easy and accessible to everyone! Hera abstracts away low-level setup details while still maintaining a consistent vocabulary with Argo. โญ๏ธ Remember to star!
๐ [hera.rtfd.io](https://hera.rtfd.io)
194. steamship-core/steamship-langchain โญ 505
steamship-langchain
195. google/pyglove โญ 320
Manipulating Python Programs
## Vizualisation
Vizualisation tools and libraries. Application frameworks, 2D/3D plotting, dashboards, WebGL.
1. apache/superset โญ 59,905
Apache Superset is a Data Visualization and Data Exploration Platform
๐ [superset.apache.org](https://superset.apache.org/)
2. streamlit/streamlit โญ 32,669
Streamlit โ A faster way to build and share data apps.
๐ [streamlit.io](https://streamlit.io)
3. gradio-app/gradio โญ 30,132
Build and share delightful machine learning apps, all in Python. ๐ Star to support our work!
๐ [www.gradio.app](http://www.gradio.app)
4. plotly/dash โญ 20,713
Data Apps & Dashboards for Python. No JavaScript Required.
๐ [plotly.com/dash](https://plotly.com/dash)
5. matplotlib/matplotlib โญ 19,528
matplotlib: plotting with Python
๐ [matplotlib.org/stable](https://matplotlib.org/stable/)
6. bokeh/bokeh โญ 18,944
Interactive Data Visualization in the browser, from Python
๐ [bokeh.org](https://bokeh.org)
7. plotly/plotly.py โญ 15,509
The interactive graphing library for Python โจ This project now includes Plotly Express!
๐ [plotly.com/python](https://plotly.com/python/)
8. mwaskom/seaborn โญ 12,071
Statistical data visualization in Python
๐ [seaborn.pydata.org](https://seaborn.pydata.org)
9. visgl/deck.gl โญ 11,817
WebGL2 powered visualization framework
๐ [deck.gl](https://deck.gl)
10. marceloprates/prettymaps โญ 10,934
A small set of Python functions to draw pretty maps from OpenStreetMap data. Based on osmnx, matplotlib and shapely libraries.
11. altair-viz/altair โญ 9,002
Declarative statistical visualization library for Python
๐ [altair-viz.github.io](https://altair-viz.github.io/)
12. nvidia/TensorRT-LLM โญ 7,086
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT...
๐ [nvidia.github.io/tensorrt-llm](https://nvidia.github.io/TensorRT-LLM)
13. lux-org/lux โญ 5,046
Automatically visualize your pandas dataframe via a single print! ๐ ๐ก
14. renpy/renpy โญ 4,652
The Ren'Py Visual Novel Engine
๐ [www.renpy.org](http://www.renpy.org/)
15. man-group/dtale โญ 4,595
Visualizer for pandas data structures
๐ [alphatechadmin.pythonanywhere.com](http://alphatechadmin.pythonanywhere.com)
16. holoviz/panel โญ 4,335
Panel: The powerful data exploration & web app framework for Python
๐ [panel.holoviz.org](https://panel.holoviz.org)
17. has2k1/plotnine โญ 3,870
A Grammar of Graphics for Python
๐ [plotnine.org](https://plotnine.org)
18. residentmario/missingno โญ 3,837
missingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset.
19. pyqtgraph/pyqtgraph โญ 3,730
Fast data visualization and GUI tools for scientific / engineering applications
๐ [www.pyqtgraph.org](https://www.pyqtgraph.org)
20. vispy/vispy โญ 3,241
Main repository for Vispy
๐ [vispy.org](http://vispy.org)
21. ml-tooling/opyrator โญ 3,027
๐ช Turns your machine learning code into microservices with web API, interactive GUI, and more.
๐ [opyrator-playground.mltooling.org](https://opyrator-playground.mltooling.org)
22. netflix/flamescope โญ 2,993
FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.
23. facebookresearch/hiplot โญ 2,706
HiPlot makes understanding high dimensional data easy
๐ [facebookresearch.github.io/hiplot](https://facebookresearch.github.io/hiplot/)
24. holoviz/holoviews โญ 2,647
With Holoviews, your data visualizes itself.
๐ [holoviews.org](https://holoviews.org)
25. kozea/pygal โญ 2,611
pygal is a dynamic SVG charting library written in python.
๐ [www.pygal.org](https://www.pygal.org)
26. mckinsey/vizro โญ 2,443
Vizro is a toolkit for creating modular data visualization applications.
๐ [vizro.readthedocs.io/en/stable](https://vizro.readthedocs.io/en/stable/)
27. pyvista/pyvista โญ 2,416
3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)
๐ [docs.pyvista.org](https://docs.pyvista.org)
28. marcomusy/vedo โญ 1,961
A python module for scientific analysis of 3D data based on VTK and Numpy
๐ [vedo.embl.es](https://vedo.embl.es)
29. datapane/datapane โญ 1,357
Build and share data reports in 100% Python
๐ [datapane.com](https://datapane.com)
30. facultyai/dash-bootstrap-components โญ 1,071
Bootstrap components for Plotly Dash
๐ [dash-bootstrap-components.opensource.faculty.ai](https://dash-bootstrap-components.opensource.faculty.ai/)
31. nomic-ai/deepscatter โญ 988
Zoomable, animated scatterplots in the browser that scales over a billion points
32. hazyresearch/meerkat โญ 814
Creative interactive views of any dataset.
33. holoviz/holoviz โญ 804
High-level tools to simplify visualization in Python.
๐ [holoviz.org](https://holoviz.org/)
## Web
Web related frameworks and libraries: webapp servers, WSGI, ASGI, asyncio, HTTP, REST, user management.
1. django/django โญ 77,471
The Web framework for perfectionists with deadlines.
๐ [www.djangoproject.com](https://www.djangoproject.com/)
2. tiangolo/fastapi โญ 72,380
FastAPI framework, high performance, easy to learn, fast to code, ready for production
๐ [fastapi.tiangolo.com](https://fastapi.tiangolo.com/)
3. pallets/flask โญ 66,760
The Python micro framework for building web applications.
๐ [flask.palletsprojects.com](https://flask.palletsprojects.com)
4. sherlock-project/sherlock โญ 52,121
Hunt down social media accounts by username across social networks
๐ [sherlockproject.xyz](https://sherlockproject.xyz)
5. psf/requests โญ 51,622
A simple, yet elegant, HTTP library.
๐ [requests.readthedocs.io/en/latest](https://requests.readthedocs.io/en/latest/)
6. tornadoweb/tornado โญ 21,578
Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
๐ [www.tornadoweb.org](http://www.tornadoweb.org/)
7. huge-success/sanic โญ 17,816
Accelerate your web app development | Build fast. Run fast.
๐ [sanic.dev](https://sanic.dev)
8. pyscript/pyscript โญ 17,517
A framework that allows users to create rich Python applications in the browser using HTML's interface and the power of Pyodide, WASM, and modern web technologies.
๐ [pyscript.net](https://pyscript.net/)
9. wagtail/wagtail โญ 17,434
A Django content management system focused on flexibility and user experience
๐ [wagtail.org](https://wagtail.org)
10. reflex-dev/reflex โญ 17,394
๐ธ๏ธ Web apps in pure Python ๐
๐ [reflex.dev](https://reflex.dev)
11. aio-libs/aiohttp โญ 14,694
Asynchronous HTTP client/server framework for asyncio and Python
๐ [docs.aiohttp.org](https://docs.aiohttp.org)
12. encode/httpx โญ 12,566
A next generation HTTP client for Python. ๐ฆ
๐ [www.python-httpx.org](https://www.python-httpx.org/)
13. getpelican/pelican โญ 12,330
Static site generator that supports Markdown and reST syntax. Powered by Python.
๐ [getpelican.com](https://getpelican.com)
14. vincigit00/Scrapegraph-ai โญ 11,283
ScrapeGraphAI is a web scraping python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents
๐ [scrapegraph-ai.readthedocs.io/en/latest](https://scrapegraph-ai.readthedocs.io/en/latest/)
15. aws/chalice โญ 10,486
Python Serverless Microframework for AWS
16. flet-dev/flet โญ 9,685
Flet enables developers to easily build realtime web, mobile and desktop apps in Python. No frontend experience required.
๐ [flet.dev](https://flet.dev)
17. encode/starlette โญ 9,676
The little ASGI framework that shines. ๐
๐ [www.starlette.io](https://www.starlette.io/)
18. benoitc/gunicorn โญ 9,591
gunicorn 'Green Unicorn' is a WSGI HTTP Server for UNIX, fast clients and sleepy applications.
๐ [www.gunicorn.org](http://www.gunicorn.org)
19. falconry/falcon โญ 9,421
The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.
๐ [falcon.readthedocs.io/en/stable](https://falcon.readthedocs.io/en/stable/)
20. bottlepy/bottle โญ 8,320
bottle.py is a fast and simple micro-framework for python web-applications.
๐ [bottlepy.org](http://bottlepy.org/)
21. encode/uvicorn โญ 8,043
An ASGI web server, for Python. ๐ฆ
๐ [www.uvicorn.org](https://www.uvicorn.org/)
22. graphql-python/graphene โญ 8,003
GraphQL framework for Python
๐ [graphene-python.org](http://graphene-python.org/)
23. zauberzeug/nicegui โญ 7,900
Create web-based user interfaces with Python. The nice way.
๐ [nicegui.io](https://nicegui.io)
24. reactive-python/reactpy โญ 7,706
ReactPy is a library for building user interfaces in Python without Javascript
๐ [reactpy.dev](https://reactpy.dev)
25. pyeve/eve โญ 6,669
REST API framework designed for human beings
๐ [python-eve.org](https://python-eve.org)
26. pallets/werkzeug โญ 6,564
The comprehensive WSGI web application library.
๐ [werkzeug.palletsprojects.com](https://werkzeug.palletsprojects.com)
27. vitalik/django-ninja โญ 6,449
๐จ Fast, Async-ready, Openapi, type hints based framework for building APIs
๐ [django-ninja.dev](https://django-ninja.dev)
28. webpy/webpy โญ 5,877
web.py is a web framework for python that is as simple as it is powerful.
๐ [webpy.org](http://webpy.org)
29. stephenmcd/mezzanine โญ 4,731
CMS framework for Django
๐ [mezzanine.jupo.org](http://mezzanine.jupo.org)
30. nameko/nameko โญ 4,667
A microservices framework for Python that lets service developers concentrate on application logic and encourages testability.
๐ [www.nameko.io](https://www.nameko.io)
31. starlite-api/litestar โญ 4,621
Production-ready, Light, Flexible and Extensible ASGI API framework | Effortlessly Build Performant APIs
๐ [litestar.dev](https://litestar.dev/)
32. pywebio/PyWebIO โญ 4,388
Write interactive web app in script way.
๐ [pywebio.readthedocs.io](https://pywebio.readthedocs.io)
33. fastapi-users/fastapi-users โญ 4,200
Ready-to-use and customizable users management for FastAPI
๐ [fastapi-users.github.io/fastapi-users](https://fastapi-users.github.io/fastapi-users/)
34. pylons/pyramid โญ 3,911
Pyramid - A Python web framework
๐ [trypyramid.com](https://trypyramid.com/)
35. h2oai/wave โญ 3,884
H2O Wave is a software stack for building beautiful, low-latency, realtime, browser-based applications and dashboards entirely in Python/R without using HTML, Javascript, or CSS.
๐ [wave.h2o.ai](https://wave.h2o.ai)
36. strawberry-graphql/strawberry โญ 3,823
A GraphQL library for Python that leverages type annotations ๐
๐ [strawberry.rocks](https://strawberry.rocks)
37. websocket-client/websocket-client โญ 3,495
WebSocket client for Python
๐ [github.com/websocket-client/websocket-client](https://github.com/websocket-client/websocket-client)
38. unbit/uwsgi โญ 3,421
uWSGI application server container
๐ [projects.unbit.it/uwsgi](http://projects.unbit.it/uwsgi)
39. pallets/quart โญ 2,708
An async Python micro framework for building web applications.
๐ [quart.palletsprojects.com](https://quart.palletsprojects.com)
40. fastapi-admin/fastapi-admin โญ 2,635
A fast admin dashboard based on FastAPI and TortoiseORM with tabler ui, inspired by Django admin
๐ [fastapi-admin-docs.long2ice.io](https://fastapi-admin-docs.long2ice.io)
41. flipkart-incubator/Astra โญ 2,441
Automated Security Testing For REST API's
42. masoniteframework/masonite โญ 2,162
The Modern And Developer Centric Python Web Framework. Be sure to read the documentation and join the Discord channel for questions: https://discord.gg/TwKeFahmPZ
๐ [docs.masoniteproject.com](http://docs.masoniteproject.com)
43. dot-agent/nextpy โญ 2,142
๐คSelf-Modifying Framework from the Future ๐ฎ World's First AMS
๐ [dotagent.ai](https://dotagent.ai)
44. python-restx/flask-restx โญ 2,097
Fork of Flask-RESTPlus: Fully featured framework for fast, easy and documented API development with Flask
๐ [flask-restx.readthedocs.io/en/latest](https://flask-restx.readthedocs.io/en/latest/)
45. cherrypy/cherrypy โญ 1,797
CherryPy is a pythonic, object-oriented HTTP framework. https://cherrypy.dev
๐ [docs.cherrypy.dev](https://docs.cherrypy.dev)
46. dmontagu/fastapi-utils โญ 1,786
Reusable utilities for FastAPI: a number of utilities to help reduce boilerplate and reuse common functionality across projects
47. neoteroi/BlackSheep โญ 1,771
Fast ASGI web framework for Python
๐ [www.neoteroi.dev/blacksheep](https://www.neoteroi.dev/blacksheep/)
48. s3rius/FastAPI-template โญ 1,738
Feature rich robust FastAPI template.
49. jordaneremieff/mangum โญ 1,633
AWS Lambda support for ASGI applications
๐ [mangum.io](https://mangum.io/)
50. wtforms/wtforms โญ 1,478
A flexible forms validation and rendering library for Python.
๐ [wtforms.readthedocs.io](https://wtforms.readthedocs.io)
51. awtkns/fastapi-crudrouter โญ 1,334
A dynamic FastAPI router that automatically creates CRUD routes for your models
๐ [fastapi-crudrouter.awtkns.com](https://fastapi-crudrouter.awtkns.com)
52. magicstack/httptools โญ 1,174
Fast HTTP parser
53. long2ice/fastapi-cache โญ 1,171
fastapi-cache is a tool to cache fastapi response and function result, with backends support redis and memcached.
๐ [github.com/long2ice/fastapi-cache](https://github.com/long2ice/fastapi-cache)
54. rstudio/py-shiny โญ 1,057
Shiny for Python
๐ [shiny.posit.co/py](https://shiny.posit.co/py/)
55. whitphx/stlite โญ 1,048
A port of Streamlit to WebAssembly, powered by Pyodide.
๐ [edit.share.stlite.net](https://edit.share.stlite.net)
56. koxudaxi/fastapi-code-generator โญ 937
This code generator creates FastAPI app from an openapi file.
57. aeternalis-ingenium/FastAPI-Backend-Template โญ 577
A backend project template with FastAPI, PostgreSQL with asynchronous SQLAlchemy 2.0, Alembic for asynchronous database migration, and Docker.
---
Interactive version: [www.awesomepython.org](https://www.awesomepython.org/), Hugging Face Dataset: [awesome-python](https://huggingface.co/datasets/dylanhogg/awesome-python)
Please raise a new issue to suggest a Python repo that you would like to see added.
1,505 hand-picked awesome Python libraries and frameworks, updated 11 Jun 2024
[](https://hits.seeyoufarm.com)