An open API service indexing awesome lists of open source software.

awesome-python-data-science

From gitlab
https://github.com/jacob98415/awesome-python-data-science

Last synced: about 1 month ago
JSON representation

Filtered by python. Clear filters

Computations

NLP

  • Dask - Parallel computing with task scheduling.
  • CuPy - NumPy-like API accelerated with CUDA.
  • quaternion - Add built-in support for quaternions to numpy.
  • adaptive - Tools for adaptive and parallel samping of mathematical functions.

Computer Audition

NLP

  • librosa - Python library for audio and music analysis.
  • aubio - A library for audio and music analysis.
  • Essentia - Library for audio and music analysis, description, and synthesis.
  • muda - A library for augmenting annotated audio data.
  • madmom - Python audio and music signal processing library.

Computer Vision

NLP

  • scikit-image - Image Processing SciKit (Toolbox for SciPy).

Data Manipulation

Data-centric AI

  • snorkel - A system for quickly generating training data with weak supervision.

Data Frames

  • cuDF - GPU DataFrame Library.
  • xpandas - Universal 1d/2d data containers with Transformers .functionality for data analysis by The Alan Turing Institute.
  • pysparkling - A pure Python implementation of Apache Spark's RDD and DStream interfaces.
  • datatable - Data.table for Python.
  • modin - Speed up your pandas workflows by changing a single line of code.
  • vaex - Out-of-Core DataFrames for Python, ML, visualize and explore big tabular data at a billion rows per second.
  • xarray - Xarray combines the best features of NumPy and pandas for multidimensional data selection by supplementing numerical axis labels with named dimensions for more intuitive, concise, and less error-prone indexing routines.
  • sk-transformer - A collection of various pandas & scikit-learn compatible transformers for all kinds of preprocessing and feature engineering steps
  • polars - A fast multi-threaded, hybrid-out-of-core DataFrame library.

Pipelines

  • Hamilton - A microframework for dataframe generation that applies Directed Acyclic Graphs specified by a flow of lazily evaluated Python functions.

Data Validation

NLP

  • deepchecks - Validation & testing of ML models and data during model development, deployment, and production.

Deep Learning

MXNet

  • Xfer - Transfer Learning library for Deep Neural Networks.

PyTorch

  • PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration.
  • torchaudio - An audio library for PyTorch.
  • ignite - High-level library to help with training neural networks in PyTorch.
  • Catalyst - High-level utils for PyTorch DL & RL research.

TensorFlow

  • TensorFlow - Computation using data flow graphs for scalable machine learning by Google.
  • Spektral - Deep learning on graphs.

Deployment

NLP

  • gradio - Create UIs for your machine learning model in Python in 3 minutes.

Distributed Computing

NLP

Experimentation

NLP

  • Sacred - A tool to help you configure, organize, log, and reproduce experiments.

Feature Engineering

Feature Selection

  • scikit-rebate - A scikit-learn-compatible Python implementation of ReBATE, a suite of Relief-based feature selection algorithms for Machine Learning.
  • zoofs - A feature selection library based on evolutionary algorithms.

General

  • Feature Engine - Feature engineering package with sklearn-like functionality.

Genetic Programming

NLP

  • gplearn - Genetic Programming in Python.
  • monkeys - A strongly-typed genetic programming framework for Python.

Machine Learning

Automated Machine Learning

  • AutoGluon - AutoML for Image, Text, Tabular, Time-Series, and MultiModal Data.

General Purpose Machine Learning

  • Sparkit-learn - PySpark + scikit-learn = Sparkit-learn.
  • dlib - Toolkit for making real-world machine learning and data analysis applications in C++ (Python bindings).
  • MLxtend - Extension and helper modules for Python's data analysis and machine learning libraries.
  • pyGAM - Generalized Additive Models in Python.

Gradient Boosting

  • LightGBM - A fast, distributed, high-performance gradient boosting.
  • CatBoost - An open-source gradient boosting on decision trees library.

Imbalanced Datasets

  • imbalanced-learn - Module to perform under-sampling and over-sampling with various techniques.
  • imbalanced-algorithms - Python-based implementations of algorithms for learning on imbalanced data.

Kernel Methods

Model Explanation

NLP

  • yellowbrick - Visual analysis and diagnostic tools to facilitate machine learning model selection.
  • ELI5 - A library for debugging/inspecting machine learning classifiers and explaining their predictions.
  • CapsNet-Visualization - A visualization of the CapsNet layers to better understand how it works.

Natural Language Processing

NLP

  • NLTK - Modules, data sets, and tutorials supporting research and development in Natural Language Processing.
  • CLTK - The Classical Language Toolkik.

Optimization

NLP

  • Optuna - A hyperparameter optimization framework.
  • Solid - A comprehensive gradient-free optimization framework written in Python.
  • Platypus - A Free and Open Source Python Library for Multiobjective Optimization.

Probabilistic Methods

NLP

  • pomegranate - Probabilistic and graphical models for Python.
  • PyMC - Bayesian Stochastic Modelling in Python.
  • sklearn-bayes - Python package for Bayesian Machine Learning with scikit-learn API.
  • pgmpy - A python library for working with Probabilistic Graphical Models.
  • emcee - The Python ensemble sampling toolkit for affine-invariant MCMC.
  • MXFusion - Modular Probabilistic Programming on MXNet.

Quantum Computing

NLP

  • qiskit - Qiskit is an open-source SDK for working with quantum computers at the level of circuits, algorithms, and application modules.
  • cirq - A python framework for creating, editing, and invoking Noisy Intermediate Scale Quantum (NISQ) circuits.

Reinforcement Learning

NLP

  • Stable Baselines - A set of improved implementations of reinforcement learning algorithms based on OpenAI Baselines.
  • ChainerRL - A deep reinforcement learning library built on top of Chainer.

Spatial Analysis

NLP

  • GeoPandas - Python tools for geographic data.

Statistics

NLP

  • statsmodels - Statistical modeling and econometrics in Python.
  • scikit-posthocs - Pairwise Multiple Comparisons Post-hoc Tests.
  • Alphalens - Performance analysis of predictive (alpha) stock factors.

Time Series

NLP

  • darts - A python library for easy manipulation and forecasting of time series.
  • statsforecast - Lightning fast forecasting with statistical and econometric models.
  • mlforecast - Scalable machine learning-based time series forecasting.
  • tick - Module for statistical learning, with a particular emphasis on time-dependent modeling.
  • Prophet - Automatic Forecasting Procedure.
  • maya - makes it very easy to parse a string and for changing timezones
  • Chaos Genius - ML powered analytics engine for outlier/anomaly detection and root cause analysis

Visualization

Automatic Plotting

General Purposes

  • Matplotlib - Plotting with Python.
  • seaborn - Statistical data visualization using matplotlib.
  • python-ternary - Ternary plotting library for Python with matplotlib.
  • missingno - Missing data visualization module for Python.
  • physt - Improved histograms.

Interactive plots

  • animatplot - A python package for animating plots built on matplotlib.
  • Bokeh - Interactive Web Plotting for Python.
  • pyecharts - Migrated from Echarts, a charting and visualization library, to Python's interactive visual drawing library.

Web Scraping

Others

  • Pattern - establish websites such as Google, Twitter, and Wikipedia. Also has NLP, machine learning algorithms, and visualization