Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/datadistillr/datadistillr-python-sdk

A Python SDK for Programmatically Interacting with DataDistillr

apache-drill data data-science datadistillr jupyter sql

Last synced: 01 Jul 2025

https://github.com/firelink-sh/evolve-py

A highly efficient, composable, and lightweight ETL and data integration framework.

analytics arrow big-data data data-engineering data-integration data-science duckdb elt etl ingestion ingress ml olap pipeline polars postgresql python s3

Last synced: 10 Mar 2026

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/fmv1992/data_utilities

Data utilities library focused on machine learning and data analysis.

data-science utility-library

Last synced: 14 Mar 2025

https://github.com/eikevons/pandas-paddles

Access the parent Pandas data frame in loc[], iloc[], assign(), and others Pandas helpers

data-analysis data-exploration data-science pandas pandas-dataframe pandas-library pandas-loc

Last synced: 16 Jun 2025

https://github.com/zai-kun/2d-chess-pieces-detection

YOLO11n model for detecting 2d chess board and pieces

ai chess data-science machine-learning onnxruntime python yolov11

Last synced: 19 Jul 2025

https://github.com/praveen1664/chatbot

This is a chatbot written in python & getting inputs directly from sql database

chatbot data-science database json nlp python3 sqlite sqlite3

Last synced: 11 Jul 2025

https://github.com/davidssmith/rawarray.jl

Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage

bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage

Last synced: 10 Sep 2025

https://github.com/crissyro/base-of-ds

This repository serves as a foundation for projects in Data Science and Machine Learning.

clustering-algorithm data-science data-visualization machine-learning

Last synced: 04 Jul 2025

https://github.com/stefanrmmr/kaggle_twitter_airline_sentiment

Kaggle Twitter US Airline Sentiment, Implementation of a Tweet Text Sentiment Analysis Model, using custom trained Word Embeddings and LSTM-Deep learning [TUM-Data Analysis&ML summer 2021] @adrianbruenger @stefanrmmr

data-science deep-learning kaggle-airline-dataset kaggle-sentiment-analysis kaggle-us-airlines lstm-neural-networks python sentiment-analysis skipgram text-sentiment-classification tweepy tweet-classification tweet-sentiment-analysis twitter twitter-sentiment-analysis us-airline-dataset word2vec

Last synced: 19 Mar 2025

https://github.com/neo4j-graph-examples/contact-tracing

Contact Tracing graph for pandemic spread e.g. COVID-19 based on http://blog.bruggen.com/search/label/contact%20tracing

contact-tracing covid-data covid19 data-science dataset example-data graphdb healthcare neo4j neo4j-approved

Last synced: 18 Jul 2025

https://github.com/orkunaktas/wine-quality-prediction

๐Ÿท๐Ÿ”ฌ Wine Quality and Forecast ๐Ÿพ๐Ÿ‡

alcohol data-science logistic-regression wine-quality

Last synced: 08 Sep 2025

https://github.com/yusufcinarci/web-scraping-projects

In these project files, I will host the web scraping examples that I will make day by day.

data-analysis data-science jupyter-notebook python web-scraping

Last synced: 01 May 2025

https://github.com/rajveersinghcse/data-science

๐Ÿ‘€If you are looking for ๐Ÿ“ˆ Data Science Material. This Repository is good for you to get some basic knowledge.

data-science data-science-material

Last synced: 10 Sep 2025

https://github.com/adamvvu/snapshot_ensemble

Train TensorFlow Keras models with cosine annealing and save an ensemble of models with no additional computational expense.

data-science deep-learning keras machine-learning python tensorflow

Last synced: 28 Oct 2025

https://github.com/rishigurnani/polygnn_trainer

A Python library to automate ML model training for polymer informatics.

data-science machine-learning materials-informatics

Last synced: 23 Jun 2025

https://github.com/iguptashubham/online-retail-sales

This Power BI dashboard, designed for marketing strategists, analyzes sales trends and customer behavior. It provides key insights empowering them to identify sales opportunities and optimize marketing campaigns, ultimately boosting business sales.

dashboard data data-analysis data-analysis-project data-analysis-project-powerbi data-analysis-python data-project data-science powerbi project

Last synced: 19 Mar 2026

https://github.com/jcolechanged/josh.meanings

A k means implementation in Clojure which supports clustering on larger than memory but smaller than storage datasets.

assumption-free-k-mc clojure-library clustering data-science k-mc k-means k-means-clustering k-means-parallel k-means-plus-plus machine-learning medium-data

Last synced: 13 Apr 2025

https://github.com/pharo-ai/data-partitioners

Pharo library for partitioning a collection. Given a set of proportions (e.g. 50%, 30%, and 20%), it shuffles the collection and divides it into non-empty subsets in such a way that every element is included in exactly one subset. Can be used in machine learning and statistical analysis for splitting data into training, validation, and test sets.

data-science machine-learning pharo statistical-analysis

Last synced: 11 Apr 2025

https://github.com/jbris/stan-cmdstanr-gpu-docker

A Docker image to run Stan, cmdstanr, and brms for Bayesian statistical modelling. GPU support using OpenCL is available.

bayes bayesian-inference brms cmdstan cmdstanr data-science docker posterior probabilistic-programming projpred rstan rstanarm shinystan stan stan-gpu stan-lang stan-math-library tidybayes tidyverse

Last synced: 04 May 2025

https://github.com/hunterdii/iriswise

IrisWise is a machine learning application for predicting Iris flower species. Built with Streamlit, this app provides a user-friendly interface to input flower measurements and receive predictions using various models, including K-Nearest Neighbors, (Random Forest, SVM, and Logistic Regression) **(Working On It...)**.

classifier-model data-science flowers-recognition iris-dataset iris-recognition knn-classification machine-learning pickle python python3 streamlit streamlit-webapp

Last synced: 21 Feb 2026

https://github.com/zaman-hamza/citadel-datathon

My submission to the 2022 East Coast Datathon. The event started on the 21st of March and ended on the 28th, lasting about a whole week. I was in a team of two where we analyzed the non-conventional indicators and instigators of traffic.

citadel data-science data-visualization datathon

Last synced: 10 Apr 2025

https://github.com/nationalparkservice/qckit

QCkit provides useful functions for data quality control and manipulation including updating data to DarwinCore standards, unit conversions, and data flagging.

darwin-core data-quality data-science npsdataverse quality-control r r-package rstats

Last synced: 22 Jun 2025

https://github.com/octoenergy/s3migrate

Bulk delete/copy/move files or modify Hive/Drill/Athena partitions using pythonic pattern matching

data data-science

Last synced: 24 Jun 2025

https://github.com/vedadiyan/genql

GenQL is a generic querying language fully written in Go

data-analysis data-mapping data-processing data-science data-translation json json-data sql

Last synced: 22 Jun 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/whizsid/kddbscan-rs

A rust library inspired by kDDBSCAN clustering algorithm

clustering data-science density-based-clustering deviation machine-learning-algorithms pinned

Last synced: 10 Apr 2025

https://github.com/blmoore/summerdatachallenge

My entry for: http://summerdatachallenge.com (I came 3rd)

analytics data-science london r real-estate rstats

Last synced: 30 Apr 2025

https://github.com/leomaurodesenv/data-science-api-framework

A simple framework to test and deploy your Data Science API

api api-rest data-science dataops docker flask-api python

Last synced: 09 Sep 2025

https://github.com/marwan116/supreme-task

A prefect extension that builds on top of the task decorator to reduce negative engineering!

data-ops data-science infrastructure ml-ops orchestration prefect python workflow

Last synced: 23 Jun 2025

https://github.com/negativenagesh/whatsapp_chat_analyzer

This is an end to end project of whatsapp chat analysis, here I have used my hostel whatsapp group's chat data.

data-analysis data-science frontend modeling python streamlit

Last synced: 12 Apr 2025

https://github.com/carlos-gg/digitalgarden

NO LONGER MAINTAINED. Go to: https://aigarden.vercel.app/

artificial-intelligence data-science digital-garden knowledge-management machine-learning

Last synced: 07 May 2025

https://github.com/gjtorikian/destroy-all-monuments

This is data taken from the SPLC report titled "Whose Heritage? Public Symbols of the Confederacy" from April 21, 2016

data-science government-data social-justice

Last synced: 10 Apr 2025

https://github.com/lucasrodes/pyphoon

Tools for Digital Typhoon DL/ML Project

data-science dataset environment machine-learning tropical-cyclone

Last synced: 18 Mar 2025

https://github.com/sarincr/python-app-development-using-kivy

Kivy is a Python library that supports cross-platform development. That means you can use a single code base to create Android, iOS, and even Windows, Linux, and MacOS apps. Kivy provides flexible, modern UI elements and, of course, let's you keep using your new favorite language to build it all!

android app appdevelopment cross-platform data-science desktop-app gtk gui kivy kivy-application kivy-framework kivymd machine-learning pyqt pyqt5 pyside tensorflow tkinter tkinter-gui tkinter-python

Last synced: 12 Apr 2025

https://github.com/rahul-jha98/restauranttrends.stats

Visualise the trends in food and restaurant choices of customers in a city by scraping data from Zomato.

data-analysis data-science visualization vuejs zomato zomato-api zomato-scraper

Last synced: 08 Jul 2025

https://github.com/armanx200/gold-price-prediction

๐Ÿ” Predicting the future adjusted closing price of Gold ETF using machine learning! ๐Ÿ“ˆโœจ

arman-kianian data-science data-visualization finance gold-price-prediction machine-learning prediction-models python random-forest regression stock-market time-series-analysis

Last synced: 30 Apr 2025

https://github.com/hevalhazalkurt/exploring_the_data_of_lego_history

A data exploration project on LEGO history in Python with pandas, matplotlib etc. (WIP)

data data-analysis data-science data-visualization datascience datasets lego lego-history matplotlib pandas python python3

Last synced: 13 Apr 2025

https://github.com/polakowo/textai

Applications using state-of-the-art in NLP

bert data-science gpt-2 machine-learning nlp telegram-bot transformers

Last synced: 07 May 2025

https://github.com/chiraag-kakar/pubg

What's the best strategy to win in PUBG? Should you sit in one spot and hide your way into victory, or do you need to be the top shot? Let's let the data do the talking!

data-science feature-engineering machine-learning-algorithms project pubg-api random-forest

Last synced: 07 May 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/scicloj/tcutils

Utility functions for working with tablecloth datasets

clojure data-science scicloj tablecloth tmd

Last synced: 09 Apr 2025

https://github.com/seporaitis/hsaur-python

Various exercises from the book "Handbook of Statistical Analysis Using R" done in Python

bokeh books data-science hsaur learning-by-doing learning-pandas pandas python r seaborn statistical-analysis statistics tutorial

Last synced: 09 Apr 2025

https://github.com/ngupta23/more

This is a helper package for pandas, visualizations and scikit-learn

data-science helpers pandas python scikit-learn visualization visualizations

Last synced: 24 Oct 2025

https://github.com/feedzai/feedzai-openml-r

Implementations for Feedzai's OpenML APIs to allow for usage of machine learning models in the R programming language.

caret data-science feedzai machine-learning machine-learning-algorithms openml r rserve

Last synced: 17 Oct 2025

https://github.com/raynardj/forgebox

The deep learning tool box

data-science machine-learning nlp pandas-dataframe

Last synced: 16 Oct 2025

https://github.com/gregyjames/volumeprofiles

Use volume transactions to find significant price levels

data-science python statistics stock stock-analysis stock-price-prediction stocks stocks-prices

Last synced: 25 Apr 2025

https://github.com/joaopfonseca/ml-research

A Python library with utilities for Machine Learning research and algorithm implementations

active-learning data-science machine-learning python scikit-learn

Last synced: 26 Oct 2025

https://github.com/trafficgcn/optimal_path_dijkstra_for_data_science

Plotting the Optimal Route in Python for Data Scientists using the Dijkstra Algorithm

data-science dijkstra dijkstra-algorithm dijkstra-shortest-path map mapping open-street-map optimal-route osm osmnx python

Last synced: 27 Oct 2025

https://github.com/curiousily/simple-neural-network-with-tensorflow-js

Build a simple Neural Network model in TensorFlow.js to make a laptop buying decision. Learn why Neural Networks need activation functions and how should you initialize their weights.

artificial-intelligence data-science deep-learning javascript machine-learning neural-networks tensorflow

Last synced: 26 Apr 2025

https://github.com/hughbe/facebook.net

A WIP Facebook Graph API client for .NET, used for the Facebook Civic Insights project by The Asia Foundation's Cambodia office

asia-foundation data-science facebook facebook-api facebook-graph-api

Last synced: 17 Mar 2026

https://github.com/radanalyticsio/workshop-notebook

Basic Jupyter notebook for learning Spark and OpenShift

containers data-science jupyter openshift spark

Last synced: 05 Aug 2025

https://github.com/hritik5102/shala2020

MastAI ki paathSHALA : Data Science, Machine Learning, and Deep Learning codes with explanation and reference links ๐Ÿ‘จโ€๐Ÿ’ป

artificial-intelligence computer-vision data-science deep-learning machine-learning statistics

Last synced: 12 Oct 2025

https://github.com/pufanyi/genderrecognitionbyvoice

NTU SC1015 Group Project - Gender Recognition by Voice

data-science machine-learning voice-recognition

Last synced: 09 Feb 2026

https://github.com/rshrc/service-recommendation

E Commerce Service Recommendation Spoof in Django

data-science django python3

Last synced: 22 Apr 2025

https://github.com/ivanrs297/macfe

MACFE: Meta-learning and Causality Based Feature Engineering | https://link.springer.com/chapter/10.1007/978-3-031-19493-1_5

data-mining data-science feature-engineering machine-learning python

Last synced: 11 Jun 2025

https://github.com/caerbannogwhite/aargh

A library that helps you out of data nightmares in Go. ๐Ÿง™โ€โ™‚๏ธ

csv data data-science data-wrangling dataframe go golang html json linq statistics stats xlsx xpt

Last synced: 14 Jan 2026

https://github.com/erictleung/tutorial-tidyverse

:milky_way: Presentation on the tidyverse in R to clean and manipulate data

data-cleaning data-manipulation data-science manipulate-data presentation programming r tidyverse tutorial

Last synced: 25 Mar 2025

https://github.com/sebiwtt/flaskriver

This is a repository for the open-source project flaskriver which will make it easier to combine the lightweight web-framework flask with the online-ML library river.

data-science flask machine-learning online-learning python river streaming

Last synced: 05 Jul 2025

https://github.com/cricksmaidiene/mids_machine_learning

๐Ÿค– A unified repository of coursework fragments from UC Berkeley MIDS ML courses

coursework data-science generative-ai jupyter-notebook machine-learning numpy pandas prompt-engineering scikit-learn spark tensorflow uc-berkeley

Last synced: 10 Oct 2025

https://github.com/RDeconomist/RDeconomist.github.io

RapidCharts - a site for teaching and demonstrating Data Science and Visualisation techniques

data data-science data-visualization economics politics sports

Last synced: 08 Apr 2025

https://github.com/marianogappa/sctool

Starcraft: Remastered replay analyzer library and CLI tool

cli cli-app data-science replays starcraft starcraft-broodwar starcraft-remastered

Last synced: 17 Apr 2026

https://github.com/paulohrpinheiro/ds_from_0

Exercรญcios e experimentos para a leitura do livro 'Data Science do Zero'

data-science python3

Last synced: 10 Jul 2025

https://github.com/mine-cetinkaya-rundel/tidymodels-uscots-2021

Materials for the "Tidy up your models" workshop at USCOTS 2021

data-science modeling rstats statistics tidymiodels tidyverse

Last synced: 08 Apr 2025

https://github.com/oscarqjh/ntu_sc1015_project

A mini project for NTU's data science and artificial intelligence mod - Analysis on League of Legends competitive matches

data-science machine-learning pandas python scikit-learn

Last synced: 09 Apr 2025

https://github.com/amirhosseinhonardoust/algorithmic-empath-human-fallibility

A deep exploration of Algorithmic Empathy, the next frontier in AI understanding. This project examines how machines can learn from human fallibility, model disagreement, and align with moral reasoning. It blends psychology, fairness metrics, interpretability, and co-learning design into one framework for humane intelligence.

ai algorithmic-bias co-learning cognitive-science data-science empathy ethics fairness human-centered-ai intelligence interpretability machine-learning neural-networks neurosymbolic philosophy psychology reflective-ai research responsible-ai xai

Last synced: 28 Feb 2026

https://github.com/thavlik/doom-gameplay-dataset

A dataset of Doom 1 & 2 gameplay videos preprocessed for deep learning

data-science dataset deep-learning doom doom-gameplay machine-learning quake-gameplay-dataset videos

Last synced: 16 Jan 2026

https://github.com/ikegwukc/csc-405-605_spring_2022

Introductory Data Science Course Taught at UNCG (Spring 2022)

data-science datascience

Last synced: 09 Oct 2025

Data Science Awesome Lists
awesome-datascience 944 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 83 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-feature-engineering 69 awesome-data-agents 155 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 956 Awesome-Distributed-Deep-Learning 44 machine-learning-resources 56 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 31 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 data-science-learning-path 70 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 244 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 204 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_ๆ–‡ๆœฌ็”Ÿๆˆ_ๆ–‡ๆœฌๅฏน่ฏ 2,414 Uncategorized 1,827 Languages 1,012 ๅ‰็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 767 Books 627 The Data Science Toolbox 599 Table of Contents 593 ๅ…ถไป–_ๆœบๅ™จๅญฆไน ไธŽๆทฑๅบฆๅญฆไน  550 Machine Learning 528 100 + ๐—”๐—ฟ๐˜๐—ถ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฎ๐—น ๐—œ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜ ๐—Ÿ๐—ถ๐˜€๐˜ ๐˜„๐—ถ๐˜๐—ต ๐—ฐ๐—ผ๐—ฑ๐—ฒ 495 Research Articles and Reports 424 Python 400 Literature and Media 384 ็ฝ‘็ปœๆœๅŠก 368 Data Versioning for Machine Learning 361 Awesome Resources 356 Paper implementations 341 ๅŽ็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 319 ๅ…ถไป–_ๆœบๅ™จ่ง†่ง‰ 315 Tools 292