{"id":14113097,"url":"https://github.com/jacob98415/awesome-python-data-science","last_synced_at":"2025-08-01T16:32:28.786Z","repository":{"id":172822039,"uuid":"649783286","full_name":"jacob98415/awesome-python-data-science","owner":"jacob98415","description":"From gitlab","archived":false,"fork":false,"pushed_at":"2023-06-05T17:13:00.000Z","size":1298,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-05-22T01:00:57.021Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc-by-4.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jacob98415.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-06-05T16:14:27.000Z","updated_at":"2023-12-12T16:06:46.000Z","dependencies_parsed_at":null,"dependency_job_id":"6b7577e7-ed28-4783-bc59-c646655c521e","html_url":"https://github.com/jacob98415/awesome-python-data-science","commit_stats":null,"previous_names":["jacob98415/awesome-python-data-science"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jacob98415%2Fawesome-python-data-science","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jacob98415%2Fawesome-python-data-science/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jacob98415%2Fawesome-python-data-science/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jacob98415%2Fawesome-python-data-science/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jacob98415","download_url":"https://codeload.github.com/jacob98415/awesome-python-data-science/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":228393599,"owners_count":17912862,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-14T10:04:03.083Z","updated_at":"2024-12-06T00:31:20.178Z","avatar_url":"https://github.com/jacob98415.png","language":null,"readme":"\u003cdiv align=\"center\"\u003e\n    \u003ca href=\"https://krzjoa.github.io/awesome-python-data-science/\"\u003e\u003cimg width=\"250\" height=\"250\" src=\"img/py-datascience.png\" alt=\"pyds\"\u003e\u003c/a\u003e\n    \u003cbr\u003e\n    \u003cbr\u003e\n    \u003cbr\u003e\n\u003c/div\u003e\n\n\u003ch1 align=\"center\"\u003e\n    Awesome Python Data Science\n\u003c/h1\u003e\n\u003cdiv align=\"center\"\u003e\u003ca href=\"https://github.com/sindresorhus/awesome\"\u003e\n\u003cimg src=\"https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg\" alt=\"Awesome\" border=\"0\"\u003e\n\u003c/a\u003e\n\u003c/div\u003e\n\u003c/br\u003e\n\n\u003e Probably the best-curated list of data science software in Python\n\n## Contents\n- [Contents](#contents)\n- [Machine Learning](#machine-learning)\n\t- [General Purpose Machine Learning](#general-purpose-machine-learning)\n\t- [Automated Machine Learning](#automated-machine-learning)\n\t- [Ensemble Methods](#ensemble-methods)\n\t- [Imbalanced Datasets](#imbalanced-datasets)\n\t- [Random Forests](#random-forests)\n\t- [Extreme Learning Machine](#extreme-learning-machine)\n\t- [Kernel Methods](#kernel-methods)\n\t- [Gradient Boosting](#gradient-boosting)\n- [Deep Learning](#deep-learning)\n\t- [PyTorch](#pytorch)\n\t- [TensorFlow](#tensorflow)\n\t- [MXNet](#mxnet)\n\t- [Others](#others)\n- [Web Scraping](#web-scraping)\n- [Data Manipulation](#data-manipulation)\n\t- [Data Frames](#data-frames)\n\t- [Pipelines](#pipelines)\n\t- [Data-centric AI](#data-centric-ai)\n\t- [Synthetic Data](#synthetic-data)\n- [Feature Engineering](#feature-engineering)\n\t- [General](#general)\n\t- [Feature Selection](#feature-selection)\n- [Visualization](#visualization)\n\t- [General Purposes](#general-purposes)\n\t- [Interactive plots](#interactive-plots)\n\t- [Map](#map)\n\t- [Automatic Plotting](#automatic-plotting)\n\t- [NLP](#nlp)\n- [Deployment](#deployment)\n- [Model Explanation](#model-explanation)\n- [Reinforcement Learning](#reinforcement-learning)\n- [Probabilistic Methods](#probabilistic-methods)\n- [Genetic Programming](#genetic-programming)\n- [Optimization](#optimization)\n- [Time Series](#time-series)\n- [Natural Language Processing](#natural-language-processing)\n- [Computer Audition](#computer-audition)\n- [Computer Vision](#computer-vision)\n- [Statistics](#statistics)\n- [Distributed Computing](#distributed-computing)\n- [Experimentation](#experimentation)\n- [Data Validation](#data-validation)\n- [Evaluation](#evaluation)\n- [Computations](#computations)\n- [Spatial Analysis](#spatial-analysis)\n- [Quantum Computing](#quantum-computing)\n- [Conversion](#conversion)\n- [Related Resources](#related-resources)\n- [Contributing](#contributing)\n- [License](#license)\n\n## Machine Learning\n\n### General Purpose Machine Learning\n* [scikit-learn](http://scikit-learn.org/stable/) - Machine learning in Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Shogun](http://www.shogun-toolbox.org/) - Machine learning toolbox.\n* [xLearn](https://github.com/aksnzhy/xlearn) - High Performance, Easy-to-use, and Scalable Machine Learning Package.\n* [cuML](https://github.com/rapidsai/cuml) - RAPIDS Machine Learning Library. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [modAL](https://github.com/cosmic-cortex/modAL) - Modular active learning framework for Python3. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Sparkit-learn](https://github.com/lensacom/sparkit-learn) - PySpark + scikit-learn = Sparkit-learn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/spark_big.png\" alt=\"Apache Spark based\"\u003e\n* [mlpack](https://github.com/mlpack/mlpack) - A scalable C++ machine learning library (Python bindings).\n* [dlib](https://github.com/davisking/dlib) - Toolkit for making real-world machine learning and data analysis applications in C++ (Python bindings).\n* [MLxtend](https://github.com/rasbt/mlxtend) - Extension and helper modules for Python's data analysis and machine learning libraries. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [hyperlearn](https://github.com/danielhanchen/hyperlearn) - 50%+ Faster, 50%+ less RAM usage, GPU support re-written Sklearn, Statsmodels. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [Reproducible Experiment Platform (REP)](https://github.com/yandex/rep) - Machine Learning toolbox for Humans. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [scikit-multilearn](https://github.com/scikit-multilearn/scikit-multilearn) - Multi-label classification for python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [seqlearn](https://github.com/larsmans/seqlearn) - Sequence classification toolkit for Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [pystruct](https://github.com/pystruct/pystruct) - Simple structured learning framework for Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [sklearn-expertsys](https://github.com/tmadl/sklearn-expertsys) - Highly interpretable classifiers for scikit learn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [RuleFit](https://github.com/christophM/rulefit) - Implementation of the rulefit. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [metric-learn](https://github.com/all-umass/metric-learn) - Metric learning algorithms in Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [pyGAM](https://github.com/dswah/pyGAM) - Generalized Additive Models in Python.\n* [Karate Club](https://github.com/benedekrozemberczki/karateclub) - An unsupervised machine learning library for graph-structured data.\n* [Little Ball of Fur](https://github.com/benedekrozemberczki/littleballoffur) - A library for sampling graph structured data.\n* [causalml](https://github.com/uber/causalml) - Uplift modeling and causal inference with machine learning algorithms. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n### Automated Machine Learning\n* [TPOT](https://github.com/rhiever/tpot) - Automated Machine Learning tool that optimizes machine learning pipelines using genetic programming. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [auto-sklearn](https://github.com/automl/auto-sklearn) - An automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [MLBox](https://github.com/AxeldeRomblay/MLBox) - A powerful Automated Machine Learning python library.\n* [AutoGluon](https://github.com/awslabs/autogluon) - AutoML for Image, Text, Tabular, Time-Series, and MultiModal Data.\n\n### Ensemble Methods\n* [ML-Ensemble](http://ml-ensemble.com/) - High performance ensemble learning. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Stacking](https://github.com/ikki407/stacking) - Simple and useful stacking library written in Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [stacked_generalization](https://github.com/fukatani/stacked_generalization) - Library for machine learning stacking generalization. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [vecstack](https://github.com/vecxoz/vecstack) - Python package for stacking (machine learning technique). \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n### Imbalanced Datasets\n* [imbalanced-learn](https://github.com/scikit-learn-contrib/imbalanced-learn) - Module to perform under-sampling and over-sampling with various techniques. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [imbalanced-algorithms](https://github.com/dialnd/imbalanced-algorithms) - Python-based implementations of algorithms for learning on imbalanced data. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n\n### Random Forests\n* [rpforest](https://github.com/lyst/rpforest) - A forest of random projection trees. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [sklearn-random-bits-forest](https://github.com/tmadl/sklearn-random-bits-forest) - Wrapper of the Random Bits Forest program written by (Wang et al., 2016).\u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [rgf_python](https://github.com/fukatani/rgf_python) - Python Wrapper of Regularized Greedy Forest. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n### Extreme Learning Machine\n* [Python-ELM](https://github.com/dclambert/Python-ELM) - Extreme Learning Machine implementation in Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Python Extreme Learning Machine (ELM)](https://github.com/acba/elm) - A machine learning technique used for classification/regression tasks.\n* [hpelm](https://github.com/akusok/hpelm) - High-performance implementation of Extreme Learning Machines (fast randomized neural networks). \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n\n### Kernel Methods\n* [pyFM](https://github.com/coreylynch/pyFM) - Factorization machines in python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [fastFM](https://github.com/ibayer/fastFM) - A library for Factorization Machines. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [tffm](https://github.com/geffy/tffm) - TensorFlow implementation of an arbitrary order Factorization Machine. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [liquidSVM](https://github.com/liquidSVM/liquidSVM) - An implementation of SVMs.\n* [scikit-rvm](https://github.com/JamesRitchie/scikit-rvm) - Relevance Vector Machine implementation using the scikit-learn API. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [ThunderSVM](https://github.com/Xtra-Computing/thundersvm) - A fast SVM Library on GPUs and CPUs. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n\n### Gradient Boosting\n* [XGBoost](https://github.com/dmlc/xgboost) - Scalable, Portable, and Distributed Gradient Boosting. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [LightGBM](https://github.com/Microsoft/LightGBM) - A fast, distributed, high-performance gradient boosting. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [CatBoost](https://github.com/catboost/catboost) - An open-source gradient boosting on decision trees library. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [ThunderGBM](https://github.com/Xtra-Computing/thundergbm) - Fast GBDTs and Random Forests on GPUs. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n\n## Deep Learning\n\n### PyTorch\n* [PyTorch](https://github.com/pytorch/pytorch) - Tensors and Dynamic neural networks in Python with strong GPU acceleration. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [pytorch-lightning](https://github.com/Lightning-AI/lightning) - PyTorch Lightning is just organized PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [torchvision](https://github.com/pytorch/vision) - Datasets, Transforms, and Models specific to Computer Vision. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [torchtext](https://github.com/pytorch/text) - Data loaders and abstractions for text and NLP. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [torchaudio](https://github.com/pytorch/audio) - An audio library for PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [ignite](https://github.com/pytorch/ignite) - High-level library to help with training neural networks in PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [skorch](https://github.com/dnouri/skorch) - A scikit-learn compatible neural network library that wraps PyTorch. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [pytorch_geometric](https://github.com/rusty1s/pytorch_geometric) - Geometric Deep Learning Extension Library for PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [Catalyst](https://github.com/catalyst-team/catalyst) - High-level utils for PyTorch DL \u0026 RL research. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [pytorch_geometric_temporal](https://github.com/benedekrozemberczki/pytorch_geometric_temporal) - Temporal Extension Library for PyTorch Geometric. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [ChemicalX](https://github.com/AstraZeneca/chemicalx) - A PyTorch-based deep learning library for drug pair scoring. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n\n### TensorFlow\n* [TensorFlow](https://github.com/tensorflow/tensorflow) - Computation using data flow graphs for scalable machine learning by Google. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [TensorLayer](https://github.com/zsdonghao/tensorlayer) - Deep Learning and Reinforcement Learning Library for Researcher and Engineer. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [TFLearn](https://github.com/tflearn/tflearn) - Deep learning library featuring a higher-level API for TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Sonnet](https://github.com/deepmind/sonnet) - TensorFlow-based neural network library. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [tensorpack](https://github.com/ppwwyyxx/tensorpack) - A Neural Net Training Interface on TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Polyaxon](https://github.com/polyaxon/polyaxon) - A platform that helps you build, manage and monitor deep learning models. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [NeuPy](https://github.com/itdxer/neupy) - NeuPy is a Python library for Artificial Neural Networks and Deep Learning (previously: \u003cimg height=\"20\" src=\"img/theano_big.png\" alt=\"Theano compatible\"\u003e). \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [tfdeploy](https://github.com/riga/tfdeploy) - Deploy TensorFlow graphs for fast evaluation and export to TensorFlow-less environments running numpy. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [tensorflow-upstream](https://github.com/ROCmSoftwarePlatform/tensorflow-upstream) - TensorFlow ROCm port. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/amd_big.png\" alt=\"Possible to run on AMD GPU\"\u003e\n* [TensorFlow Fold](https://github.com/tensorflow/fold) - Deep learning with dynamic computation graphs in TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [tensorlm](https://github.com/batzner/tensorlm) - Wrapper library for text generation/language models at char and word level with RNN. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [TensorLight](https://github.com/bsautermeister/tensorlight) - A high-level framework for TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Mesh TensorFlow](https://github.com/tensorflow/mesh) - Model Parallelism Made Easier. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Ludwig](https://github.com/uber/ludwig) - A toolbox that allows one to train and test deep learning models without the need to write code. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Keras](https://keras.io) - A high-level neural networks API running on top of TensorFlow.  \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [keras-contrib](https://github.com/keras-team/keras-contrib) - Keras community contributions. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [Hyperas](https://github.com/maxpumperla/hyperas) - Keras + Hyperopt: A straightforward wrapper for a convenient hyperparameter. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [Elephas](https://github.com/maxpumperla/elephas) - Distributed Deep learning with Keras \u0026 Spark. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [Hera](https://github.com/keplr-io/hera) - Train/evaluate a Keras model, and get metrics streamed to a dashboard in your browser. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [Spektral](https://github.com/danielegrattarola/spektral) - Deep learning on graphs. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [qkeras](https://github.com/google/qkeras) - A quantization deep learning library. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n\n### MXNet\n* [MXNet](https://github.com/apache/incubator-mxnet) - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [Gluon](https://github.com/gluon-api/gluon-api) - A clear, concise, simple yet powerful and efficient API for deep learning (now included in MXNet). \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [MXbox](https://github.com/Lyken17/mxbox) - Simple, efficient, and flexible vision toolbox for the mxnet framework. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [gluon-cv](https://github.com/dmlc/gluon-cv) - Provides implementations of the state-of-the-art  deep learning models in computer vision. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [gluon-nlp](https://github.com/dmlc/gluon-nlp) - NLP made easy. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [Xfer](https://github.com/amzn/xfer) - Transfer Learning library for Deep Neural Networks. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [MXNet](https://github.com/ROCmSoftwarePlatform/mxnet) - HIP Port of MXNet. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e \u003cimg height=\"20\" src=\"img/amd_big.png\" alt=\"Possible to run on AMD GPU\"\u003e\n\n### Others\n* [jax](https://github.com/google/jax) - Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more.\n* [Tangent](https://github.com/google/tangent) - Source-to-Source Debuggable Derivatives in Pure Python.\n* [autograd](https://github.com/HIPS/autograd) - Efficiently computes derivatives of numpy code.\n* [Myia](https://github.com/mila-udem/myia) - Deep Learning framework (pre-alpha).\n* [nnabla](https://github.com/sony/nnabla) - Neural Network Libraries by Sony.\n* [Caffe](https://github.com/BVLC/caffe) - A fast open framework for deep learning.\n* [hipCaffe](https://github.com/ROCmSoftwarePlatform/hipCaffe) - The HIP port of Caffe. \u003cimg height=\"20\" src=\"img/amd_big.png\" alt=\"Possible to run on AMD GPU\"\u003e\n\n**[DISCONTINUED PROJECTS](https://github.com/krzjoa/awesome-python-data-science/blob/master/other/deprecated.md#deep-learning)**\n\n## Web Scraping\n* [BeautifulSoup](https://www.crummy.com/software/BeautifulSoup/bs4/doc/): The easiest library to scrape static websites for beginners\n* [Scrapy](https://scrapy.org/): Fast and extensible scraping library. Can write rules and create customized scraper without touching the core\n* [Selenium](https://selenium-python.readthedocs.io/installation.html#introduction): Use Selenium Python API to access all functionalities of Selenium WebDriver in an intuitive way like a real user.\n* [Pattern](https://github.com/clips/pattern): High level scraping for well-establish websites such as Google, Twitter, and Wikipedia. Also has NLP, machine learning algorithms, and visualization\n* [twitterscraper](https://github.com/taspinar/twitterscraper): Efficient library to scrape Twitter\n\n## Data Manipulation\n\n### Data Frames\n* [pandas](https://pandas.pydata.org/pandas-docs/stable/) - Powerful Python data analysis toolkit.\n* [pandas_profiling](https://github.com/pandas-profiling/pandas-profiling) - Create HTML profiling reports from pandas DataFrame objects\n* [cuDF](https://github.com/rapidsai/cudf) - GPU DataFrame Library. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [blaze](https://github.com/blaze/blaze) - NumPy and pandas interface to Big Data. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [pandasql](https://github.com/yhat/pandasql) -  Allows you to query pandas DataFrames using SQL syntax. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [pandas-gbq](https://github.com/pydata/pandas-gbq) - pandas Google Big Query. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [xpandas](https://github.com/alan-turing-institute/xpandas) - Universal 1d/2d data containers with Transformers .functionality for data analysis by [The Alan Turing Institute](https://www.turing.ac.uk/).\n* [pysparkling](https://github.com/svenkreiss/pysparkling) - A pure Python implementation of Apache Spark's RDD and DStream interfaces. \u003cimg height=\"20\" src=\"img/spark_big.png\" alt=\"Apache Spark based\"\u003e\n* [Arctic](https://github.com/manahl/arctic) - High-performance datastore for time series and tick data.\n* [datatable](https://github.com/h2oai/datatable) - Data.table for Python. \u003cimg height=\"20\" src=\"img/R_big.png\" alt=\"R inspired/ported lib\"\u003e\n* [koalas](https://github.com/databricks/koalas) - pandas API on Apache Spark. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [modin](https://github.com/modin-project/modin) - Speed up your pandas workflows by changing a single line of code. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [swifter](https://github.com/jmcarpenter2/swifter) - A package that efficiently applies any function to a pandas dataframe or series in the fastest available manner.\n* [pandas_flavor](https://github.com/Zsailer/pandas_flavor) - A package that allows writing your own flavor of Pandas easily.\n* [pandas-log](https://github.com/eyaltrabelsi/pandas-log) - A package that allows providing feedback about basic pandas operations and finds both business logic and performance issues.\n* [vaex](https://github.com/vaexio/vaex) - Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second.\n* [xarray](https://github.com/pydata/xarray) - Xarray combines the best features of NumPy and pandas for multidimensional data selection by supplementing numerical axis labels with named dimensions for more intuitive, concise, and less error-prone indexing routines.\n* [sk-transformer](https://github.com/chrislemke/sk-transformers) - A collection of various pandas \u0026 scikit-learn compatible transformers for all kinds of preprocessing and feature engineering steps \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [polars](https://github.com/pola-rs/polars) - A fast multi-threaded, hybrid-out-of-core DataFrame library.\n\n\n### Pipelines\n* [pdpipe](https://github.com/shaypal5/pdpipe) - Sasy pipelines for pandas DataFrames.\n* [SSPipe](https://sspipe.github.io/) - Python pipe (|) operator with support for DataFrames and Numpy, and Pytorch.\n* [pandas-ply](https://github.com/coursera/pandas-ply) - Functional data manipulation for pandas. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [Dplython](https://github.com/dodger487/dplython) - Dplyr for Python. \u003cimg height=\"20\" src=\"img/R_big.png\" alt=\"R inspired/ported lib\"\u003e\n* [sklearn-pandas](https://github.com/scikit-learn-contrib/sklearn-pandas) - pandas integration with sklearn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [Dataset](https://github.com/analysiscenter/dataset) - Helps you conveniently work with random or sequential batches of your data and define data processing.\n* [pyjanitor](https://github.com/ericmjl/pyjanitor) - Clean APIs for data cleaning. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [meza](https://github.com/reubano/meza) - A Python toolkit for processing tabular data.\n* [Prodmodel](https://github.com/prodmodel/prodmodel) - Build system for data science pipelines.\n* [dopanda](https://github.com/dovpanda-dev/dovpanda) -  Hints and tips for using pandas in an analysis environment. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [Hamilton](https://github.com/stitchfix/hamilton) - A microframework for dataframe generation that applies Directed Acyclic Graphs specified by a flow of lazily evaluated Python functions.\n\n### Data-centric AI\n* [cleanlab](https://github.com/cleanlab/cleanlab) - The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.\n* [snorkel](https://github.com/snorkel-team/snorkel) - A system for quickly generating training data with weak supervision.\n* [dataprep](https://github.com/sfu-db/dataprep) - Collect, clean, and visualize your data in Python with a few lines of code.\n\n### Synthetic Data\n\n* [ydata-synthetic](https://github.com/ydataai/ydata-synthetic) - A package to generate synthetic tabular and time-series data leveraging the state-of-the-art generative models. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n\n## Feature Engineering\n\n### General\n* [Featuretools](https://github.com/Featuretools/featuretools) - Automated feature engineering.\n* [Feature Engine](https://github.com/feature-engine/feature_engine) - Feature engineering package with sklearn-like functionality. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [skl-groups](https://github.com/dougalsutherland/skl-groups) - A scikit-learn addon to operate on set/\"group\"-based features. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Feature Forge](https://github.com/machinalis/featureforge) - A set of tools for creating and testing machine learning features. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [few](https://github.com/lacava/few) - A feature engineering wrapper for sklearn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [scikit-mdr](https://github.com/EpistasisLab/scikit-mdr) - A sklearn-compatible Python implementation of Multifactor Dimensionality Reduction (MDR) for feature construction. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [tsfresh](https://github.com/blue-yonder/tsfresh) - Automatic extraction of relevant features from time series. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [dirty_cat](https://github.com/dirty-cat/dirty_cat) - Machine learning on dirty tabular data (especially: string-based variables for classifcation and regression). \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [NitroFE](https://github.com/NITRO-AI/NitroFE) - Moving window features. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n### Feature Selection\n* [scikit-feature](https://github.com/jundongl/scikit-feature) - Feature selection repository in Python.\n* [boruta_py](https://github.com/scikit-learn-contrib/boruta_py) - Implementations of the Boruta all-relevant feature selection method. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [BoostARoota](https://github.com/chasedehan/BoostARoota) - A fast xgboost feature selection algorithm. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [scikit-rebate](https://github.com/EpistasisLab/scikit-rebate) - A scikit-learn-compatible Python implementation of ReBATE, a suite of Relief-based feature selection algorithms for Machine Learning. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [zoofs](https://github.com/jaswinder9051998/zoofs) - A feature selection library based on evolutionary algorithms.\n\n## Visualization\n### General Purposes\n* [Matplotlib](https://github.com/matplotlib/matplotlib) - Plotting with Python.\n* [seaborn](https://github.com/mwaskom/seaborn) - Statistical data visualization using matplotlib.\n* [prettyplotlib](https://github.com/olgabot/prettyplotlib) - Painlessly create beautiful matplotlib plots.\n* [python-ternary](https://github.com/marcharper/python-ternary) - Ternary plotting library for Python with matplotlib.\n* [missingno](https://github.com/ResidentMario/missingno) - Missing data visualization module for Python.\n* [chartify](https://github.com/spotify/chartify/) - Python library that makes it easy for data scientists to create charts.\n* [physt](https://github.com/janpipek/physt) - Improved histograms.\n### Interactive plots\n* [animatplot](https://github.com/t-makaro/animatplot) - A python package for animating plots built on matplotlib.\n* [plotly](https://plot.ly/python/) - A Python library that makes interactive and publication-quality graphs.\n* [Bokeh](https://github.com/bokeh/bokeh) - Interactive Web Plotting for Python.\n* [Altair](https://altair-viz.github.io/) - Declarative statistical visualization library for Python. Can easily do many data transformation within the code to create graph\n* [bqplot](https://github.com/bqplot/bqplot) - Plotting library for IPython/Jupyter notebooks\n* [pyecharts](https://github.com/pyecharts/pyecharts) - Migrated from [Echarts](https://github.com/apache/echarts), a charting and visualization library, to Python's interactive visual drawing library.\u003cimg height=\"20\" src=\"img/pyecharts.png\" alt=\"pyecharts\"\u003e \u003cimg height=\"20\" src=\"img/echarts.png\" alt=\"echarts\"\u003e\n### Map\n* [folium](https://python-visualization.github.io/folium/quickstart.html#Getting-Started) - Makes it easy to visualize data on an interactive open street map\n* [geemap](https://github.com/giswqs/geemap) - Python package for interactive mapping with Google Earth Engine (GEE)\n### Automatic Plotting\n* [HoloViews](https://github.com/ioam/holoviews) - Stop plotting your data - annotate your data and let it visualize itself.\n* [AutoViz](https://github.com/AutoViML/AutoViz): Visualize data automatically with 1 line of code (ideal for machine learning)\n* [SweetViz](https://github.com/fbdesignpro/sweetviz): Visualize and compare datasets, target values and associations, with one line of code.\n\n### NLP\n* [pyLDAvis](https://github.com/bmabey/pyLDAvis): Visualize interactive topic model\n\n\n## Deployment\n* [fastapi](https://fastapi.tiangolo.com/) - Modern, fast (high-performance), a web framework for building APIs with Python\n* [streamlit](https://www.streamlit.io/) - Make it easy to deploy the machine learning model\n* [gradio](https://github.com/gradio-app/gradio) - Create UIs for your machine learning model in Python in 3 minutes.\n* [datapane](https://datapane.com/) - A collection of APIs to turn scripts and notebooks into interactive reports.\n* [binder](https://mybinder.org/) - Enable sharing and execute Jupyter Notebooks\n\n## Model Explanation\n\n* [dalex](https://github.com/ModelOriented/DALEX) - moDel Agnostic Language for Exploration and explanation. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\u003cimg height=\"20\" src=\"img/R_big.png\" alt=\"R inspired/ported lib\"\u003e\n* [Shapley](https://github.com/benedekrozemberczki/shapley) - A data-driven framework to quantify the value of classifiers in a machine learning ensemble.\n* [Alibi](https://github.com/SeldonIO/alibi) - Algorithms for monitoring and explaining machine learning models.\n* [anchor](https://github.com/marcotcr/anchor) - Code for \"High-Precision Model-Agnostic Explanations\" paper.\n* [aequitas](https://github.com/dssg/aequitas) - Bias and Fairness Audit Toolkit.\n* [Contrastive Explanation](https://github.com/MarcelRobeer/ContrastiveExplanation) - Contrastive Explanation (Foil Trees). \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [yellowbrick](https://github.com/DistrictDataLabs/yellowbrick) - Visual analysis and diagnostic tools to facilitate machine learning model selection. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [scikit-plot](https://github.com/reiinakano/scikit-plot) - An intuitive library to add plotting functionality to scikit-learn objects. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [shap](https://github.com/slundberg/shap) - A unified approach to explain the output of any machine learning model. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [ELI5](https://github.com/TeamHG-Memex/eli5) - A library for debugging/inspecting machine learning classifiers and explaining their predictions.\n* [Lime](https://github.com/marcotcr/lime) - Explaining the predictions of any machine learning classifier. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [FairML](https://github.com/adebayoj/fairml) - FairML is a python toolbox auditing the machine learning models for bias. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [L2X](https://github.com/Jianbo-Lab/L2X) - Code for replicating the experiments in the paper *Learning to Explain: An Information-Theoretic Perspective on Model Interpretation*.\n* [PDPbox](https://github.com/SauceCat/PDPbox) - Partial dependence plot toolbox.\n* [PyCEbox](https://github.com/AustinRochford/PyCEbox) - Python Individual Conditional Expectation Plot Toolbox.\n* [Skater](https://github.com/datascienceinc/Skater) - Python Library for Model Interpretation.\n* [model-analysis](https://github.com/tensorflow/model-analysis) - Model analysis tools for TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [themis-ml](https://github.com/cosmicBboy/themis-ml) - A library that implements fairness-aware machine learning algorithms. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [treeinterpreter](https://github.com/andosa/treeinterpreter) - Interpreting scikit-learn's decision tree and random forest predictions. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [AI Explainability 360](https://github.com/IBM/AIX360) - Interpretability and explainability of data and machine learning models.\n* [Auralisation](https://github.com/keunwoochoi/Auralisation) - Auralisation of learned features in CNN (for audio).\n* [CapsNet-Visualization](https://github.com/bourdakos1/CapsNet-Visualization) - A visualization of the CapsNet layers to better understand how it works.\n* [lucid](https://github.com/tensorflow/lucid) - A collection of infrastructure and tools for research in neural network interpretability.\n* [Netron](https://github.com/lutzroeder/Netron) - Visualizer for deep learning and machine learning models (no Python code, but visualizes models from most Python Deep Learning frameworks).\n* [FlashLight](https://github.com/dlguys/flashlight) - Visualization Tool for your NeuralNetwork.\n* [tensorboard-pytorch](https://github.com/lanpa/tensorboard-pytorch) - Tensorboard for PyTorch (and chainer, mxnet, numpy, ...).\n* [mxboard](https://github.com/awslabs/mxboard) - Logging MXNet data for visualization in TensorBoard. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n\n## Reinforcement Learning\n* [OpenAI Gym](https://github.com/openai/gym) - A toolkit for developing and comparing reinforcement learning algorithms.\n* [Coach](https://github.com/NervanaSystems/coach) - Easy experimentation with state-of-the-art Reinforcement Learning algorithms.\n* [garage](https://github.com/rlworkgroup/garage) - A toolkit for reproducible reinforcement learning research.\n* [OpenAI Baselines](https://github.com/openai/baselines) - High-quality implementations of reinforcement learning algorithms.\n* [Stable Baselines](https://github.com/hill-a/stable-baselines) - A set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines.\n* [RLlib](https://ray.readthedocs.io/en/latest/rllib.html) - Scalable Reinforcement Learning.\n* [Horizon](https://github.com/facebookresearch/Horizon) - A platform for Applied Reinforcement Learning.\n* [TF-Agents](https://github.com/tensorflow/agents) - A library for Reinforcement Learning in TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [TensorForce](https://github.com/reinforceio/tensorforce) - A TensorFlow library for applied reinforcement learning. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [TRFL](https://github.com/deepmind/trfl) - TensorFlow Reinforcement Learning. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [Dopamine](https://github.com/google/dopamine) - A research framework for fast prototyping of reinforcement learning algorithms.\n* [keras-rl](https://github.com/keras-rl/keras-rl) - Deep Reinforcement Learning for Keras. \u003cimg height=\"20\" src=\"img/keras_big.png\" alt=\"Keras compatible\"\u003e\n* [ChainerRL](https://github.com/chainer/chainerrl) - A deep reinforcement learning library built on top of Chainer.\n\n## Probabilistic Methods\n* [pyro](https://github.com/uber/pyro) - A flexible, scalable deep probabilistic programming library built on PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [pomegranate](https://github.com/jmschrei/pomegranate) - Probabilistic and graphical models for Python. \u003cimg height=\"20\" src=\"img/gpu_big.png\" alt=\"GPU accelerated\"\u003e\n* [ZhuSuan](http://zhusuan.readthedocs.io/en/latest/) - Bayesian Deep Learning. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [PyMC](https://github.com/pymc-devs/pymc) - Bayesian Stochastic Modelling in Python.\n* [InferPy](https://github.com/PGM-Lab/InferPy) - Deep Probabilistic Modelling Made Easy.  \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [GPflow](http://gpflow.readthedocs.io/en/latest/?badge=latest) - Gaussian processes in TensorFlow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [PyStan](https://github.com/stan-dev/pystan) - Bayesian inference using the No-U-Turn sampler (Python interface).\n* [sklearn-bayes](https://github.com/AmazaspShumik/sklearn-bayes) - Python package for Bayesian Machine Learning with scikit-learn API. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [pgmpy](https://github.com/pgmpy/pgmpy) - A python library for working with Probabilistic Graphical Models.\n* [skpro](https://github.com/alan-turing-institute/skpro) - Supervised domain-agnostic prediction framework for probabilistic modelling by [The Alan Turing Institute](https://www.turing.ac.uk/). \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [PtStat](https://github.com/stepelu/ptstat) - Probabilistic Programming and Statistical Inference in PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [PyVarInf](https://github.com/ctallec/pyvarinf) - Bayesian Deep Learning methods with Variational Inference for PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [emcee](https://github.com/dfm/emcee) - The Python ensemble sampling toolkit for affine-invariant MCMC.\n* [hsmmlearn](https://github.com/jvkersch/hsmmlearn) - A library for hidden semi-Markov models with explicit durations.\n* [pyhsmm](https://github.com/mattjj/pyhsmm) - Bayesian inference in HSMMs and HMMs.\n* [GPyTorch](https://github.com/cornellius-gp/gpytorch) - A highly efficient and modular implementation of Gaussian Processes in PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [MXFusion](https://github.com/amzn/MXFusion) - Modular Probabilistic Programming on MXNet. \u003cimg height=\"20\" src=\"img/mxnet_big.png\" alt=\"MXNet based\"\u003e\n* [sklearn-crfsuite](https://github.com/TeamHG-Memex/sklearn-crfsuite) - A scikit-learn-inspired API for CRFsuite. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n## Genetic Programming\n* [gplearn](https://github.com/trevorstephens/gplearn) - Genetic Programming in Python. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [DEAP](https://github.com/DEAP/deap) - Distributed Evolutionary Algorithms in Python.\n* [karoo_gp](https://github.com/kstaats/karoo_gp) - A Genetic Programming platform for Python with GPU support. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [monkeys](https://github.com/hchasestevens/monkeys) - A strongly-typed genetic programming framework for Python.\n* [sklearn-genetic](https://github.com/manuel-calzolari/sklearn-genetic) - Genetic feature selection module for scikit-learn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n\u003ca name=\"opt\"\u003e\u003c/a\u003e\n## Optimization\n* [Optuna](https://github.com/optuna/optuna) - A hyperparameter optimization framework.\n* [Spearmint](https://github.com/HIPS/Spearmint) - Bayesian optimization.\n* [BoTorch](https://github.com/pytorch/botorch) - Bayesian optimization in PyTorch. \u003cimg height=\"20\" src=\"img/pytorch_big2.png\" alt=\"PyTorch based/compatible\"\u003e\n* [scikit-opt](https://github.com/guofei9987/scikit-opt) - Heuristic Algorithms for optimization.\n* [sklearn-genetic-opt](https://github.com/rodrigo-arenas/Sklearn-genetic-opt) - Hyperparameters tuning and feature selection using evolutionary algorithms. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [SMAC3](https://github.com/automl/SMAC3) - Sequential Model-based Algorithm Configuration.\n* [Optunity](https://github.com/claesenm/optunity) - Is a library containing various optimizers for hyperparameter tuning.\n* [hyperopt](https://github.com/hyperopt/hyperopt) - Distributed Asynchronous Hyperparameter Optimization in Python.\n* [hyperopt-sklearn](https://github.com/hyperopt/hyperopt-sklearn) - Hyper-parameter optimization for sklearn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [sklearn-deap](https://github.com/rsteca/sklearn-deap) - Use evolutionary algorithms instead of gridsearch in scikit-learn. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [sigopt_sklearn](https://github.com/sigopt/sigopt_sklearn) - SigOpt wrappers for scikit-learn methods. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Bayesian Optimization](https://github.com/fmfn/BayesianOptimization) - A Python implementation of global optimization with gaussian processes.\n* [SafeOpt](https://github.com/befelix/SafeOpt) - Safe Bayesian Optimization.\n* [scikit-optimize](https://github.com/scikit-optimize/scikit-optimize) - Sequential model-based optimization with a `scipy.optimize` interface.\n* [Solid](https://github.com/100/Solid) - A comprehensive gradient-free optimization framework written in Python.\n* [PySwarms](https://github.com/ljvmiranda921/pyswarms) - A research toolkit for particle swarm optimization in Python.\n* [Platypus](https://github.com/Project-Platypus/Platypus) - A Free and Open Source Python Library for Multiobjective Optimization.\n* [GPflowOpt](https://github.com/GPflow/GPflowOpt) - Bayesian Optimization using GPflow. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [POT](https://github.com/rflamary/POT) - Python Optimal Transport library.\n* [Talos](https://github.com/autonomio/talos) - Hyperparameter Optimization for Keras Models.\n* [nlopt](https://github.com/stevengj/nlopt) - Library for nonlinear optimization (global and local, constrained or unconstrained).\n* [OR-Tools](https://developers.google.com/optimization) - An open-source software suite for optimization by Google; provides a unified programming interface to a half dozen solvers: SCIP, GLPK, GLOP, CP-SAT, CPLEX, and Gurobi.\n\n## Time Series\n* [sktime](https://github.com/alan-turing-institute/sktime) - A unified framework for machine learning with time series. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [darts](https://github.com/unit8co/darts) - A python library for easy manipulation and forecasting of time series.\n* [statsforecast](https://github.com/Nixtla/statsforecast) - Lightning fast forecasting with statistical and econometric models.\n* [mlforecast](https://github.com/Nixtla/mlforecast) - Scalable machine learning-based time series forecasting.\n* [neuralforecast](https://github.com/Nixtla/neuralforecast) - Scalable machine learning-based time series forecasting.\n* [tslearn](https://github.com/rtavenar/tslearn) - Machine learning toolkit dedicated to time-series data. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [tick](https://github.com/X-DataInitiative/tick) - Module for statistical learning, with a particular emphasis on time-dependent modeling.  \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [greykite](https://github.com/linkedin/greykite) - A flexible, intuitive, and fast forecasting library next.\n* [Prophet](https://github.com/facebook/prophet) - Automatic Forecasting Procedure.\n* [PyFlux](https://github.com/RJT1990/pyflux) - Open source time series library for Python.\n* [bayesloop](https://github.com/christophmark/bayesloop) - Probabilistic programming framework that facilitates objective model selection for time-varying parameter models.\n* [luminol](https://github.com/linkedin/luminol) - Anomaly Detection and Correlation library.\n* [dateutil](https://dateutil.readthedocs.io/en/stable/) - Powerful extensions to the standard datetime module\n* [maya](https://github.com/timofurrer/maya) - makes it very easy to parse a string and for changing timezones\n* [Chaos Genius](https://github.com/chaos-genius/chaos_genius) - ML powered analytics engine for outlier/anomaly detection and root cause analysis\n\n## Natural Language Processing\n* [spaCy](https://spacy.io/) - Industrial-Strength Natural Language Processing.\n* [NLTK](https://github.com/nltk/nltk) -  Modules, data sets, and tutorials supporting research and development in Natural Language Processing.\n* [CLTK](https://github.com/cltk/cltk) - The Classical Language Toolkik.\n* [gensim](https://radimrehurek.com/gensim/) - Topic Modelling for Humans.\n* [pyMorfologik](https://github.com/dmirecki/pyMorfologik) - Python binding for \u003ca href=\"https://github.com/morfologik/morfologik-stemming\"\u003eMorfologik\u003c/a\u003e.\n* [skift](https://github.com/shaypal5/skift) - Scikit-learn wrappers for Python fastText. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Phonemizer](https://github.com/bootphon/phonemizer) - Simple text-to-phonemes converter for multiple languages.\n* [flair](https://github.com/zalandoresearch/flair) - Very simple framework for state-of-the-art NLP.\n\n\n## Computer Audition\n* [librosa](https://github.com/librosa/librosa) - Python library for audio and music analysis.\n* [Yaafe](https://github.com/Yaafe/Yaafe) - Audio features extraction.\n* [aubio](https://github.com/aubio/aubio) - A library for audio and music analysis.\n* [Essentia](https://github.com/MTG/essentia) - Library for audio and music analysis, description, and synthesis.\n* [LibXtract](https://github.com/jamiebullock/LibXtract) - A simple, portable, lightweight library of audio feature extraction functions.\n* [Marsyas](https://github.com/marsyas/marsyas) - Music Analysis, Retrieval, and Synthesis for Audio Signals.\n* [muda](https://github.com/bmcfee/muda) - A library for augmenting annotated audio data.\n* [madmom](https://github.com/CPJKU/madmom) - Python audio and music signal processing library.\n\n## Computer Vision\n* [OpenCV](https://github.com/opencv/opencv) - Open Source Computer Vision Library.\n* [scikit-image](https://github.com/scikit-image/scikit-image) - Image Processing SciKit (Toolbox for SciPy).\n* [imgaug](https://github.com/aleju/imgaug) - Image augmentation for machine learning experiments.\n* [imgaug_extension](https://github.com/cadenai/imgaug_extension) - Additional augmentations for imgaug.\n* [Augmentor](https://github.com/mdbloice/Augmentor) - Image augmentation library in Python for machine learning.\n* [albumentations](https://github.com/albu/albumentations) - Fast image augmentation library and easy-to-use wrapper around other libraries.\n\n## Statistics\n* [pandas_summary](https://github.com/mouradmourafiq/pandas-summary) - Extension to pandas dataframes describe function. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [Pandas Profiling](https://github.com/pandas-profiling/pandas-profiling) - Create HTML profiling reports from pandas DataFrame objects. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [statsmodels](https://github.com/statsmodels/statsmodels) - Statistical modeling and econometrics in Python.\n* [stockstats](https://github.com/jealous/stockstats) - Supply a wrapper ``StockDataFrame`` based on the ``pandas.DataFrame`` with inline stock statistics/indicators support.\n* [weightedcalcs](https://github.com/jsvine/weightedcalcs) - A pandas-based utility to calculate weighted means, medians, distributions, standard deviations, and more.\n* [scikit-posthocs](https://github.com/maximtrp/scikit-posthocs) - Pairwise Multiple Comparisons Post-hoc Tests.\n* [Alphalens](https://github.com/quantopian/alphalens) - Performance analysis of predictive (alpha) stock factors.\n\n## Distributed Computing\n* [Horovod](https://github.com/uber/horovod) - Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. \u003cimg height=\"20\" src=\"img/tf_big2.png\" alt=\"sklearn\"\u003e\n* [PySpark](https://spark.apache.org/docs/0.9.0/python-programming-guide.html) - Exposes the Spark programming model to Python. \u003cimg height=\"20\" src=\"img/spark_big.png\" alt=\"Apache Spark based\"\u003e\n* [Veles](https://github.com/Samsung/veles) - Distributed machine learning platform.\n* [Jubatus](https://github.com/jubatus/jubatus) - Framework and Library for Distributed Online Machine Learning.\n* [DMTK](https://github.com/Microsoft/DMTK) - Microsoft Distributed Machine Learning Toolkit.\n* [PaddlePaddle](https://github.com/PaddlePaddle/Paddle) - PArallel Distributed Deep LEarning.\n* [dask-ml](https://github.com/dask/dask-ml) - Distributed and parallel machine learning. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [Distributed](https://github.com/dask/distributed) - Distributed computation in Python.\n\n## Experimentation\n* [mlflow](https://github.com/mlflow/mlflow) - Open source platform for the machine learning lifecycle.\n* [Neptune](https://neptune.ai) - A lightweight ML experiment tracking, results visualization, and management tool.\n* [dvc](https://github.com/iterative/dvc) - Data Version Control | Git for Data \u0026 Models | ML Experiments Management.\n* [envd](https://github.com/tensorchord/envd) - 🏕️ machine learning development environment for data science and AI/ML engineering teams.\n* [Sacred](https://github.com/IDSIA/sacred) - A tool to help you configure, organize, log, and reproduce experiments.\n* [Ax](https://github.com/facebook/Ax) - Adaptive Experimentation Platform. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n\n## Data Validation\n* [great_expectations](https://github.com/great-expectations/great_expectations) - Always know what to expect from your data.\n* [pandera](https://github.com/unionai-oss/pandera) - A lightweight, flexible, and expressive statistical data testing library.\n* [deepchecks](https://github.com/deepchecks/deepchecks) - Validation \u0026 testing of ML models and data during model development, deployment, and production. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [evidently](https://github.com/evidentlyai/evidently) - Evaluate and monitor ML models from validation to production.\n* [TensorFlow Data Validation](https://github.com/tensorflow/data-validation) - Library for exploring and validating machine learning data.\n\n## Evaluation\n* [recmetrics](https://github.com/statisticianinstilettos/recmetrics) - Library of useful metrics and plots for evaluating recommender systems.\n* [Metrics](https://github.com/benhamner/Metrics) - Machine learning evaluation metric.\n* [sklearn-evaluation](https://github.com/edublancas/sklearn-evaluation) - Model evaluation made easy: plots, tables, and markdown reports. \u003cimg height=\"20\" src=\"img/sklearn_big.png\" alt=\"sklearn\"\u003e\n* [AI Fairness 360](https://github.com/IBM/AIF360) - Fairness metrics for datasets and ML models, explanations, and algorithms to mitigate bias in datasets and models.\n\n## Computations\n* [numpy](http://www.numpy.org/) - The fundamental package needed for scientific computing with Python.\n* [Dask](https://github.com/dask/dask) - Parallel computing with task scheduling. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [bottleneck](https://github.com/kwgoodman/bottleneck) - Fast NumPy array functions written in C.\n* [CuPy](https://github.com/cupy/cupy) - NumPy-like API accelerated with CUDA.\n* [scikit-tensor](https://github.com/mnick/scikit-tensor) - Python library for multilinear algebra and tensor factorizations.\n* [numdifftools](https://github.com/pbrod/numdifftools) - Solve automatic numerical differentiation problems in one or more variables.\n* [quaternion](https://github.com/moble/quaternion) - Add built-in support for quaternions to numpy.\n* [adaptive](https://github.com/python-adaptive/adaptive) - Tools for adaptive and parallel samping of mathematical functions.\n* [NumExpr](https://github.com/pydata/numexpr) - A fast numerical expression evaluator for NumPy that comes with an integrated computing virtual machine to speed calculations up by avoiding memory allocation for intermediate results.\n\n## Spatial Analysis\n* [GeoPandas](https://github.com/geopandas/geopandas) - Python tools for geographic data. \u003cimg height=\"20\" src=\"img/pandas_big.png\" alt=\"pandas compatible\"\u003e\n* [PySal](https://github.com/pysal/pysal) - Python Spatial Analysis Library.\n\n## Quantum Computing\n* [qiskit](https://github.com/Qiskit/qiskit) - Qiskit is an open-source SDK for working with quantum computers at the level of circuits, algorithms, and application modules.\n* [cirq](https://github.com/quantumlib/Cirq) - A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.\n* [PennyLane](https://github.com/XanaduAI/pennylane) - Quantum machine learning, automatic differentiation, and optimization of hybrid quantum-classical computations.\n* [QML](https://github.com/qmlcode/qml) - A Python Toolkit for Quantum Machine Learning.\n\n## Conversion\n* [sklearn-porter](https://github.com/nok/sklearn-porter) - Transpile trained scikit-learn estimators to C, Java, JavaScript, and others.\n* [ONNX](https://github.com/onnx/onnx) - Open Neural Network Exchange.\n* [MMdnn](https://github.com/Microsoft/MMdnn) -  A set of tools to help users inter-operate among different deep learning frameworks.\n\n## Contributing\nContributions are welcome! :sunglasses: \u003c/br\u003e\nRead the \u003ca href=https://github.com/krzjoa/awesome-python-datascience/blob/master/CONTRIBUTING.md\u003econtribution guideline\u003c/a\u003e.\n\n## License\nThis work is licensed under the Creative Commons Attribution 4.0 International License - [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/)\n\n\u003cdiv align=\"center\"\u003e\n    \u003ca href=\"other/deprecated.md\"\u003eDeprecated Libs\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u0026nbsp;\n    \u003ca href=\"other/waiting-room.md\"\u003eWaiting Room\u003c/a\u003e\u0026nbsp;\u0026nbsp;\u0026nbsp;\n\u003cdiv\u003e\n","funding_links":[],"categories":["Other Lists"],"sub_categories":["TeX Lists"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjacob98415%2Fawesome-python-data-science","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjacob98415%2Fawesome-python-data-science","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjacob98415%2Fawesome-python-data-science/lists"}