awesome-python-data-science
From gitlab
https://github.com/jacob98415/awesome-python-data-science
Last synced: about 1 month ago
JSON representation
Filtered by python. Clear filters
Computations
NLP
- Dask - Parallel computing with task scheduling.
- CuPy - NumPy-like API accelerated with CUDA.
- quaternion - Add built-in support for quaternions to numpy.
- adaptive - Tools for adaptive and parallel samping of mathematical functions.
Computer Audition
NLP
Computer Vision
NLP
- scikit-image - Image Processing SciKit (Toolbox for SciPy).
Data Manipulation
Data-centric AI
- snorkel - A system for quickly generating training data with weak supervision.
Data Frames
- cuDF - GPU DataFrame Library.
- xpandas - Universal 1d/2d data containers with Transformers .functionality for data analysis by The Alan Turing Institute.
- pysparkling - A pure Python implementation of Apache Spark's RDD and DStream interfaces.
- datatable - Data.table for Python.
- modin - Speed up your pandas workflows by changing a single line of code.
- vaex - Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second.
- xarray - Xarray combines the best features of NumPy and pandas for multidimensional data selection by supplementing numerical axis labels with named dimensions for more intuitive, concise, and less error-prone indexing routines.
- sk-transformer - A collection of various pandas & scikit-learn compatible transformers for all kinds of preprocessing and feature engineering steps
- polars - A fast multi-threaded, hybrid-out-of-core DataFrame library.
Pipelines
- Hamilton - A microframework for dataframe generation that applies Directed Acyclic Graphs specified by a flow of lazily evaluated Python functions.
Data Validation
NLP
- deepchecks - Validation & testing of ML models and data during model development, deployment, and production.
Deep Learning
MXNet
- Xfer - Transfer Learning library for Deep Neural Networks.
PyTorch
- PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration.
- torchaudio - An audio library for PyTorch.
- ignite - High-level library to help with training neural networks in PyTorch.
- Catalyst - High-level utils for PyTorch DL & RL research.
TensorFlow
- TensorFlow - Computation using data flow graphs for scalable machine learning by Google.
- Spektral - Deep learning on graphs.
Deployment
NLP
- gradio - Create UIs for your machine learning model in Python in 3 minutes.
Distributed Computing
NLP
- PaddlePaddle - PArallel Distributed Deep LEarning.
- Distributed - Distributed computation in Python.
Experimentation
NLP
- Sacred - A tool to help you configure, organize, log, and reproduce experiments.
Feature Engineering
Feature Selection
- scikit-rebate - A scikit-learn-compatible Python implementation of ReBATE, a suite of Relief-based feature selection algorithms for Machine Learning.
- zoofs - A feature selection library based on evolutionary algorithms.
General
- Feature Engine - Feature engineering package with sklearn-like functionality.
Genetic Programming
NLP
Machine Learning
Automated Machine Learning
- AutoGluon - AutoML for Image, Text, Tabular, Time-Series, and MultiModal Data.
General Purpose Machine Learning
- Sparkit-learn - PySpark + scikit-learn = Sparkit-learn.
- dlib - Toolkit for making real-world machine learning and data analysis applications in C++ (Python bindings).
- MLxtend - Extension and helper modules for Python's data analysis and machine learning libraries.
- pyGAM - Generalized Additive Models in Python.
Gradient Boosting
- LightGBM - A fast, distributed, high-performance gradient boosting.
- CatBoost - An open-source gradient boosting on decision trees library.
Imbalanced Datasets
- imbalanced-learn - Module to perform under-sampling and over-sampling with various techniques.
- imbalanced-algorithms - Python-based implementations of algorithms for learning on imbalanced data.
Kernel Methods
- liquidSVM - An implementation of SVMs.
Model Explanation
NLP
- yellowbrick - Visual analysis and diagnostic tools to facilitate machine learning model selection.
- ELI5 - A library for debugging/inspecting machine learning classifiers and explaining their predictions.
- CapsNet-Visualization - A visualization of the CapsNet layers to better understand how it works.
Natural Language Processing
NLP
Optimization
NLP
Probabilistic Methods
NLP
- pomegranate - Probabilistic and graphical models for Python.
- PyMC - Bayesian Stochastic Modelling in Python.
- sklearn-bayes - Python package for Bayesian Machine Learning with scikit-learn API.
- pgmpy - A python library for working with Probabilistic Graphical Models.
- emcee - The Python ensemble sampling toolkit for affine-invariant MCMC.
- MXFusion - Modular Probabilistic Programming on MXNet.
Quantum Computing
NLP
Reinforcement Learning
NLP
- Stable Baselines - A set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines.
- ChainerRL - A deep reinforcement learning library built on top of Chainer.
Spatial Analysis
NLP
- GeoPandas - Python tools for geographic data.
Statistics
NLP
- statsmodels - Statistical modeling and econometrics in Python.
- scikit-posthocs - Pairwise Multiple Comparisons Post-hoc Tests.
- Alphalens - Performance analysis of predictive (alpha) stock factors.
Time Series
NLP
- darts - A python library for easy manipulation and forecasting of time series.
- statsforecast - Lightning fast forecasting with statistical and econometric models.
- mlforecast - Scalable machine learning-based time series forecasting.
- tick - Module for statistical learning, with a particular emphasis on time-dependent modeling.
- Prophet - Automatic Forecasting Procedure.
- maya - makes it very easy to parse a string and for changing timezones
- Chaos Genius - ML powered analytics engine for outlier/anomaly detection and root cause analysis
Visualization
Automatic Plotting
General Purposes
- Matplotlib - Plotting with Python.
- seaborn - Statistical data visualization using matplotlib.
- python-ternary - Ternary plotting library for Python with matplotlib.
- missingno - Missing data visualization module for Python.
- physt - Improved histograms.
Interactive plots
- animatplot - A python package for animating plots built on matplotlib.
- Bokeh - Interactive Web Plotting for Python.
- pyecharts - Migrated from Echarts, a charting and visualization library, to Python's interactive visual drawing library.
Web Scraping
Others
- Pattern - establish websites such as Google, Twitter, and Wikipedia. Also has NLP, machine learning algorithms, and visualization