Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/ngupta23/more

This is a helper package for pandas, visualizations and scikit-learn

data-science helpers pandas python scikit-learn visualization visualizations

Last synced: 24 Oct 2025

https://github.com/mshenfield/subreddit_algebra

A python port and frontend to 538's subreddit analysis

data-science data-visualization reddit

Last synced: 13 Apr 2025

https://github.com/imerica/safely

An ML driven NSFW moderator for Slack ๐Ÿšจ๐Ÿ‘ฎโ€โ™‚๏ธ๐Ÿค–

artificial-intelligence content-moderation data-science deep-learning docker machine-learning neural-network python python3 slack slackbot

Last synced: 13 Apr 2025

https://github.com/gbeckers/birdwatcher

A Python computer vision library for animal behavior

animal behavior computer-vision data-science ffmpeg opencv python science

Last synced: 13 Oct 2025

https://github.com/koldlight/r4ds

R for data science course

course data-analysis data-science data-viz r

Last synced: 30 Apr 2025

https://github.com/shreyamalogi/mushroom-mystery

Can You Eat That? ๐Ÿ„ Let Data Decide.

classification data-analysis data-science eda machine-learning python

Last synced: 06 Nov 2025

https://github.com/rshrc/service-recommendation

E Commerce Service Recommendation Spoof in Django

data-science django python3

Last synced: 22 Apr 2025

https://github.com/seporaitis/hsaur-python

Various exercises from the book "Handbook of Statistical Analysis Using R" done in Python

bokeh books data-science hsaur learning-by-doing learning-pandas pandas python r seaborn statistical-analysis statistics tutorial

Last synced: 09 Apr 2025

https://github.com/octoenergy/s3migrate

Bulk delete/copy/move files or modify Hive/Drill/Athena partitions using pythonic pattern matching

data data-science

Last synced: 24 Jun 2025

https://github.com/erictleung/data-science

:computer: Repository for teaching materials and notes on machine learning and data science for freeCodeCamp

data-cleaning data-engineering data-science data-visualization freecodecamp learning machine-learning mathematics notes python statistics

Last synced: 25 Mar 2025

https://github.com/rvandewater/ReciPies

๐ŸฅงReciPys: easily define and execute preprocessing and feature engineering steps on Polars and Pandas dataframes.

data-science pandas polars python scikit-learn tidymodels

Last synced: 24 Oct 2025

https://github.com/prakalp-pande/twitter-sentiment-analysis

Analyze public opinion on Tweet by mining and processing live Twitter data. Employ machine learning to classify tweets as positive, negative, or neutral, then visualize sentiment trends and identify key influencers.

data-science twitter-sentiment-analysis

Last synced: 18 Aug 2025

https://github.com/alvarobartt/twipper

Python Twitter API Wrapper for both Free and Premium plans

api-wrapper data-science python twitter twitter-api

Last synced: 12 Apr 2025

https://github.com/getindata/quickstart-ml-starter

Kedro starterts to quickly set up new projects according to QuickStart ML Blueprints practice.

data-science machine-learning

Last synced: 30 Oct 2025

https://github.com/jackgerrits/reductionml

Reduction-based machine learning framework with a focus on contextual bandits

contextual-bandits data-science machine-learning online-learning rust

Last synced: 10 Apr 2025

https://github.com/hmiladhia/piskle

A serialization package optimized for scikit-learn

data-science machine-learning python scikit-learn serialization

Last synced: 28 Oct 2025

https://github.com/radanalyticsio/workshop-notebook

Basic Jupyter notebook for learning Spark and OpenShift

containers data-science jupyter openshift spark

Last synced: 05 Aug 2025

https://github.com/2krishnayadav/datta-vishleshan.ai

DattaVishLeshan.AI is one of the first data analysis projects developed in India, and perhaps even in the world. The name "Datta" means "data," while "Vishleshan" translates to "analysis." It is a pioneering AI project dedicated to advanced data analysis.

data-analysis data-science data-visualization database

Last synced: 03 Jul 2026

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/curiousily/linear-regression-with-tensorflow-js

Build a Linear Regression model using TensorFlow.js and use to predict house prices

artificial-intelligence data-science javascript linear-regression machine-learning tensorflow tensorflowjs

Last synced: 01 Sep 2025

https://github.com/pottekkat/bulldozer-prize-predictions

Predict the auction sale price for a piece of heavy equipment to create a "blue book" for bulldozers.

bluebook bulldozer data data-science jupyter-notebook kaggle-competition machine-learning

Last synced: 20 Jun 2026

https://github.com/richardleighdavies/prompt-engineering-in-practice

Practical code examples and implementations from the book "Prompt Engineering in Practice". Demonstrates text generation, prompt chaining, and prompt routing using Python and LangChain. Features real-world examples of interacting with OpenAI's GPT models, structured output handling, and multi-step prompt workflows.

ai artificial-intelligence chatbot data-science deep-learning gpt langchain llm machine-learning natural-language-processing nlp openai prompt-engineering pydantic python text-generation

Last synced: 15 Apr 2025

https://github.com/haloapping/cotomks

Kumpulan referensi untuk belajar mengenai pemrograman Python, Data Science, Machine Learning dan Deep Learning.

data-science deep-learning machine-learning model-evaluation probabilistic statistics time-series

Last synced: 04 Jul 2026

https://github.com/aianytime/fishvision

FishVision built using Streamlit identifies the different species of Fishes in a given image. It is trained on "A Large Scale Fish Data" available on Kaggle using the pre-trained model "MobileNetV2".

data-science deep-learning deep-neural-networks heroku heroku-deployment machine-learning machine-learning-algorithms mobilenetv2 python python3 streamlit streamlit-webapp

Last synced: 01 Sep 2025

https://github.com/abhinav-ark/mal_lyrics_analysis

Preprocessing and EDA on a Dataset of Malayalam Songs and Lyrics

data-science eda jupyter-notebook python

Last synced: 22 Jul 2025

https://github.com/datadistillr/datadistillr-python-sdk

A Python SDK for Programmatically Interacting with DataDistillr

apache-drill data data-science datadistillr jupyter sql

Last synced: 01 Jul 2025

https://github.com/makomweb/curious-moon-exercise

My notes about: A Curious Moon by Rob Conery

data data-science docker make postgres postgresql sql

Last synced: 06 Apr 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/compgeolab/temperature-data

Download and create a subset of global country-average temperature data from Berkeley Earth

climate climate-data data-science open-data temperature

Last synced: 15 Apr 2025

https://github.com/cpeoples/powerpredict

๐Ÿ”ฎ AI-powered Powerball & Mega Millions lottery number prediction using deep learning (Transformer + LSTM), Markov chains, and statistical analysis. Built with TensorFlow/Keras 3.

artificial-intelligence data-science deep-learning keras lottery-prediction lstm machine-learning markov-chain megamillions neural-network powerball python scikit-learn statistical-analysis tensorflow texas-lottery transformer

Last synced: 21 May 2026

https://github.com/sayakpaul/applied-data-science-w-python-specialization

Contains my assignments, guiding notebooks (provided as the course materials) and the datasets.

data-science matplotlib numpy pandas python3 scipy scipy-stack

Last synced: 12 May 2025

https://github.com/spsanderson/steveondata

Repository for mainly R tips and tricks for my blog. I also include some VBA, SQL, C and Linux Usage.

ai blog c data data-science linux machinelearning-r ml ms-sql r sql time-series tipoftheday vba vba-excel

Last synced: 07 Apr 2025

https://github.com/fmv1992/data_utilities

Data utilities library focused on machine learning and data analysis.

data-science utility-library

Last synced: 14 Mar 2025

https://github.com/ai-naymul/ats-catalyst

ATS Catalyst is an innovative platform designed to empower job seekers and streamline the hiring process. Leveraging advanced AI technologies, our suite of tools offers personalized feedback, resume evaluation, and job description matching to enhance your job application process.

ai application-tracking-system ats data-science langchain machine-learning open-source opensource-projects opensourceforgood python streamlit-application

Last synced: 05 May 2025

https://github.com/mribeirodantas/vidente

R package to parse and preprocess the Surveillance, Epidemiology, and End Results (SEER) Program data from NIH/NCI

cancer-patients cancer-research data-analysis data-science data-structures r-package seer

Last synced: 14 Apr 2025

https://github.com/zapier/awsjavasdk

Boilerplate rJava Access to the AWS Java SDK

awsjavasdk cran data-science

Last synced: 14 Apr 2025

https://github.com/tushar2704/store-demand-forecasting

This project predicts the sales demand for various items in different stores based on historical sales data. The objective is to develop a machine learning model that can provide accurate forecasts for future sales of each store-item combination.

artifi data-analysis data-science python sales-analysis sales-forecasting tushar2704

Last synced: 04 Nov 2025

https://github.com/timkoornstra/fintwitbert

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

ai bert cryptocurrency data-science financial-tweets fintech fintwitbert language-model machine-learning nlp python sentiment-analysis stock-market trend-prediction twitter-data

Last synced: 14 Apr 2025

https://github.com/takuti/pyhivemall

Using machine learning model from Apache Hivemall :bee: in Python :snake:

data-science hive machine-learning python

Last synced: 15 Apr 2025

https://github.com/RemiRigal/DatasetExplorer

A web tool for local dataset browsing and processing developped using the Flask + Angular stack.

ai angular data-processing data-science data-visualization dataset dataset-analysis docker docker-compose flask web-application

Last synced: 30 Jul 2025

https://github.com/chris-santiago/steps

A SciKit-Learn style feature selector using best subsets and stepwise regression.

best-subset-selection data-science python scikit-learn stepwise-selection

Last synced: 28 Jun 2025

https://github.com/redhat-na-ssa/demo-ocp-gpu

Show some magic around GPUs on OpenShift

code-server data-science gpu nvidia

Last synced: 30 Jul 2025

https://github.com/lockedata/opentrainingcontent

An MIT & CCBY4.0 licensed repository of training materials from Locke Data

data-science open-course r-stats

Last synced: 29 Jul 2025

https://github.com/frobnitzem/mpi_list

A package for working with lists distributed over MPI

data-science hpc map-reduce mpi4py

Last synced: 18 Mar 2025

https://github.com/wpanas/ml-snippets

Code snippets for faster ML development

data-science hacktoberfest machine-learning pandas python seaborn snippets

Last synced: 07 Apr 2025

https://github.com/firelink-sh/evolve-py

A highly efficient, composable, and lightweight ETL and data integration framework.

analytics arrow big-data data data-engineering data-integration data-science duckdb elt etl ingestion ingress ml olap pipeline polars postgresql python s3

Last synced: 10 Mar 2026

https://github.com/theakashshukla/r-project

๐ŸŽ“ A Collection of Programming Assignment for R Language

algorithms data-analysis data-science data-science-projects ml r

Last synced: 24 Jul 2025

https://github.com/fusky-labs/pacopanda-drawing-stats

A case study and data analysis project that collects drawings from a furry artist Paco Panda

data-science data-visualization fastapi furries furry furry-fandom pandas python

Last synced: 09 Aug 2025

https://github.com/ndleah/tsf-data-science-internship

This repository contains the tasks performed during the Data Science and Business Analytics Internship at The Sparks Foundation

data-science data-visualization exploratory-data-analysis machine-learning powerbi python virtual-internship

Last synced: 20 Sep 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/systemvll/hcaptcha-dataset-scraper

A simple nodejs script that return hcaptcha images and prompt for training AI.

ai data-science dataset hcaptcha hcaptcha-solver machine-learning

Last synced: 03 Aug 2025

https://github.com/aiscalate/aiscalator

Tools to streamline Jupyter Notebook Prototypes into robust Data Products

airflow airflow-docker data-engineering data-science jupyter jupyter-notebook jupyterlab

Last synced: 26 Sep 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/joschnitzbauer/dalymi

A lightweight, data-focused and non-opinionated pipeline manager written in and for Python.

dag data data-science pipeline python workflow

Last synced: 14 Jan 2026

https://github.com/curiousily/simple-neural-network-with-tensorflow-js

Build a simple Neural Network model in TensorFlow.js to make a laptop buying decision. Learn why Neural Networks need activation functions and how should you initialize their weights.

artificial-intelligence data-science deep-learning javascript machine-learning neural-networks tensorflow

Last synced: 26 Apr 2025

https://github.com/moykeen/supermjo-py

Python interface to Super-Mjograph

data-science graph mac matplotlib plot python visualization

Last synced: 09 Apr 2025

https://github.com/trafficgcn/optimal_path_dijkstra_for_data_science

Plotting the Optimal Route in Python for Data Scientists using the Dijkstra Algorithm

data-science dijkstra dijkstra-algorithm dijkstra-shortest-path map mapping open-street-map optimal-route osm osmnx python

Last synced: 27 Oct 2025

https://github.com/raynardj/forgebox

The deep learning tool box

data-science machine-learning nlp pandas-dataframe

Last synced: 16 Oct 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/wlongxiang/dutch_traffic_monitor

Visualize traffic on dutch high way A9 as an example

computer-vision data-science deep-learning object-detection opencv visualization

Last synced: 04 Aug 2025

https://github.com/hodgesmr/biden_nlp

Jupyter Notebook that introduces BIDEN: Binary Inference Dictionaries for Electoral NLP. It demonstrates a compression-based binary classification technique that is fast at both training and inference on common CPU hardware in Python

compression data-science machine-learning natural-language-processing nlp zstandard zstd

Last synced: 22 Jan 2026

https://github.com/oscarqjh/ntu_sc1015_project

A mini project for NTU's data science and artificial intelligence mod - Analysis on League of Legends competitive matches

data-science machine-learning pandas python scikit-learn

Last synced: 09 Apr 2025

https://github.com/ucla-biostat-203b/2023winter

Course webpage for UCLA Biostat 203B (Intro. to Data Science)

biostatistics data-science docker machine-learning r

Last synced: 07 Sep 2025

https://github.com/joaopfonseca/ml-research

A Python library with utilities for Machine Learning research and algorithm implementations

active-learning data-science machine-learning python scikit-learn

Last synced: 26 Oct 2025

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/hughbe/facebook.net

A WIP Facebook Graph API client for .NET, used for the Facebook Civic Insights project by The Asia Foundation's Cambodia office

asia-foundation data-science facebook facebook-api facebook-graph-api

Last synced: 17 Mar 2026

https://github.com/caerbannogwhite/aargh

A library that helps you out of data nightmares in Go. ๐Ÿง™โ€โ™‚๏ธ

csv data data-science data-wrangling dataframe go golang html json linq statistics stats xlsx xpt

Last synced: 14 Jan 2026

https://github.com/pfed-prog/catalonia_data

we have analyzed air quality in Catalonia by using the data from the Catalan Transparency Portal.

data-science dspyt jupyter-notebook ocean oceanprotocol python3

Last synced: 05 Oct 2025

https://github.com/emiruz/dataset-tools

Easy to use library for working with core.matrix datasets in Clojure: select, where, aggregate, join, order, cross-tab, from/to-dataset, etc

data-mining data-science dataset dsl matrix sql

Last synced: 22 Oct 2025

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

Data Science Awesome Lists
awesome-datascience 950 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 91 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-data-agents 155 awesome-feature-engineering 69 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 957 machine-learning-resources 56 Awesome-Distributed-Deep-Learning 44 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 33 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 260 data-science-learning-path 70 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 232 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_ๆ–‡ๆœฌ็”Ÿๆˆ_ๆ–‡ๆœฌๅฏน่ฏ 2,414 Uncategorized 1,774 ๅ‰็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 766 The Data Science Toolbox 593 Books 585 Table of Contents 573 ๅ…ถไป–_ๆœบๅ™จๅญฆไน ไธŽๆทฑๅบฆๅญฆไน  550 Machine Learning 534 100 + ๐—”๐—ฟ๐˜๐—ถ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฎ๐—น ๐—œ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜ ๐—Ÿ๐—ถ๐˜€๐˜ ๐˜„๐—ถ๐˜๐—ต ๐—ฐ๐—ผ๐—ฑ๐—ฒ 495 Research Articles and Reports 429 Python 399 ็ฝ‘็ปœๆœๅŠก 367 Data Versioning for Machine Learning 361 Literature and Media 351 Paper implementations 341 Awesome Resources 340 ๅŽ็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 319 ๅ…ถไป–_ๆœบๅ™จ่ง†่ง‰ 315 ๅ…ถไป–_ๅฎ‰ๅ…จไธŽๆธ—้€ 292 Tools 290