Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/waylonwalker/kedro-auto-catalog

Kedro catalog create with default configuration

data data-science kedro kedro-catalog kedro-hook kedro-plugin

Last synced: 12 Jun 2025

https://github.com/aryankeluskar/imdb-genres-analysis

Graph mean and variance of movies along the years. Then use Prophet and ARIMA to predict the average ratings by genres into the future.

data-science julia matplotlib monte-carlo python

Last synced: 08 Feb 2026

https://github.com/jamesquinlan/intro-python

Introduction to Programming and Data Science with Python

data-science nlp python python-3

Last synced: 18 Aug 2025

https://github.com/techn0man1ac/toxiccommentclassification

This project aims to develop a model capable of identifying and classifying different levels of toxicity in comments, using the power of BERT(Bidirectional Encoder Representations from Transformers) for text analysis.

analysis bert-model classifying data-science docker machine-learning python streamlit text-classification transformers-models

Last synced: 18 Aug 2025

https://github.com/timkong21/polyp-segmentation

Polyp segmentation tool utilizing U-Net for accurate medical image analysis, designed to enhance early detection and diagnosis of colorectal cancer. Features a user-friendly Streamlit web app for easy image processing and analysis, leveraging the Kvasir-SEG dataset for improved healthcare outcomes.

aws-s3 cancer-detection colonoscopy computer-vision data-augmentation data-science deep-learning diagnostics healthcare machine-learning medical-application medical-image-analysis medical-image-processing medical-image-segmentation opencv polyp-segmentation python streamlit tensorflow u-net

Last synced: 14 Apr 2025

https://github.com/rafaelpermec/live-broker-api

Um estudo sobre raspagem de dados em back-end, simulando uma corretora que realiza aรงรตes de compra e venda de ativos e fluxo de caixa de clientes em tempo real.

authentication authorization backend-api cheerio data-science express helmet jwt-authentication mysql nodejs typescript web-scraping

Last synced: 19 Apr 2025

https://github.com/miguelgfierro/miguelgfierro

I help people understand and apply AI

ai data-science machine-learning

Last synced: 03 Jan 2026

https://github.com/nhs-south-central-and-west/data-science-guides

Guides for common data science tasks, in R & Python

data-science machine-learning python r regression

Last synced: 03 May 2025

https://github.com/alexeatscake/gigaanalysis

A toolbox for processing data that can be expressed as a dependent and independent variable.

condensed-matter-physics data-science matplotlib numpy physics scipy

Last synced: 03 Jul 2025

https://github.com/mohidex/data-pipeline-on-gcp

The Real-time Ecommerce Data Collection and Processing project empowers businesses with real-time insights by efficiently extracting, processing, and storing ecommerce data from multiple sources. Combining Golang and Python, this cutting-edge solution streamlines data handling from diverse ecommerce websites.

beautifulsoup data-engineer data-pipeline data-science database datastore dependency-injection firebase firestore gcp go golang google google-cloud pubsub python solid-principles storage web-scraping

Last synced: 14 Apr 2025

https://github.com/navdeep-g/sdss-2019

Interpretable Machine Learning with rsparkling

data-science h2o-3 machine-learning r rsparkling spark sparklyr xai

Last synced: 07 Apr 2025

https://github.com/memgonzales/pisa-2018-analysis

Jupyter notebook presenting the process of data preparation, research question formulation, data analysis, and data modeling with the goal of extracting insights from the 2018 PISA Dataset

data-cleaning data-modeling data-science data-visualization exploratory-data-analysis jupyter-notebook matplotlib numpy oecd-data pandas pisa scipy statistical-inference

Last synced: 13 Jun 2025

https://github.com/m-taghizadeh/python-webinar

Our goal in this webinar is to provide a quick and practical training as your first step to becoming a professional Python programmer, so that after watching this training you will be able to gain a very good knowledge of programming with Python and using Python in artificial intelligence, machine learning, deep learning, data mining, and backend programming using Flask and Django

artificial-intelligence convolutional-neural-networks data-science deep-learning django flask machine-learning python

Last synced: 08 Sep 2025

https://github.com/bhattbhavesh91/auto-sklearn-tutorial

Small tutorial on auto-sklearn which is an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.

auto-ml auto-sklearn automl data-science machine-learning python tutorial

Last synced: 27 Oct 2025

https://github.com/surajv311/udemy_course_resources

List of course resources from my Udemy Course : "Numpy for Data Science" 2020

arrays data-science numpy numpy-tutorial python3 udemy udemy-course

Last synced: 16 May 2025

https://github.com/iamyajat/whatsapp-chat-analyzer-api

An API to analyse WhatsApp chats and generate insights

data-analysis data-science fastapi python whatsapp

Last synced: 17 Oct 2025

https://github.com/vbyan/deeva

๐Ÿš€Deeva - your smart analytics companion for Object Detection datasets

data data-science data-visualization datasets deeva machine-learning object-detection plotly python statistics streamlit visualization

Last synced: 26 Jun 2025

https://github.com/zeitsperre/canada-climate-python

A set of methods for collecting, parsing, converting, and presenting Environment Canada Weather Station data

canada climate data-science python weather

Last synced: 22 Jul 2025

https://github.com/thecoderpinar/gen-expression

Gene expression analysis is a fundamental component of genomics research, providing valuable insights into how genes are regulated and their impact on various biological processes. This project delves into the realm of gene expression data, aiming to uncover hidden patterns and relationships within complex datasets. ๐Ÿš€

bioinformatics biotechnology data-analysis data-science data-visualization genomics kaggle machine-learning pca python

Last synced: 30 Apr 2025

https://github.com/njlyon0/supportr

Support Functions for Wrangling and Visualization

data-science r-package

Last synced: 20 Mar 2025

https://github.com/tushar2704/superstore-sales-dashboard-with-streamlit

Superstore Sales with Streamlit is a data visualization and analysis project that uses the Streamlit framework to create an interactive web application for exploring and analyzing sales data from a superstore. This project aims to provide an easy-to-use interface for users to gain insights into sales trends, Sales performance, product performance,

analytics dashboard data-analytics data-science data-science-projects python streamlit streamlit-tushar2704 trend-analysis tushar2704

Last synced: 07 May 2025

https://github.com/overhash/supermarket-tracker

A supermarket aggregator for price information at New Zealand supermarkets

data-science new-zealand nz prices rust-lang supermarket

Last synced: 11 Apr 2025

https://github.com/arose13/pliablelasso

Python implementation of the pliable lasso

data-science machine-learning

Last synced: 09 May 2025

https://github.com/Badr-MOUFAD/cookiecutter-simple-DS-project

A simple cookiecutter template to structure your Data Science projects.

cookiecutter data-science project-structure python simple-ds-project

Last synced: 08 May 2025

https://github.com/john-hawkins/projit

Application for managing the structure, properties, data, experiments and build of data science projects.

data-science experiments machine-learning project-management

Last synced: 23 Jun 2025

https://github.com/doctor-phil/analyzing-economic-networks

Tutorial introduction to economic network analysis and graph clustering in python with networkx

centrality data-science economics graph-clustering networks social-network-analysis spectral-methods

Last synced: 14 Jul 2025

https://github.com/flexmonster/pivot-jupyter-notebook

Jupyter Notebook pivot table example with Flexmonster

data-analysis data-science interactive jupyter-notebook pivot-tables python

Last synced: 16 Jun 2025

https://github.com/joshwlambert/daisieprep

Extracts phylogenetic island community data from phylogenetic trees

data-science island-biogeography phylogenetics r

Last synced: 18 Mar 2025

https://github.com/mathworks-teaching-resources/probability-theory

A courseware module that covers the fundamental concepts in probability theory and their implications in data science. Topics include probability, random variables, and Bayes' Theorem.

bayesian-statistics courseware cwm data-science mathematics matlab matlab-live-script probability-theory random-variables

Last synced: 15 Jul 2025

https://github.com/negativenagesh/arogyamitra

An accessible, reliable, and efficient platform for medical information and support using LLMs

data-science embeddings flask genai knowledgebase langchain llama2 llm meta-llama-2-chat pineconedb python semantic-indexing vector-database

Last synced: 19 Jun 2025

https://github.com/juliaml/datasciencetraits.jl

Traits for data science

data-science julia

Last synced: 09 Jul 2025

https://github.com/juliusmarkwei/crypto-jacking-classificatioin

classifying network activity from various websites as either cryptojacking or not based on features related to both network-based and host-based data.

cryptojacking data-science machine-learning python

Last synced: 13 Apr 2025

https://github.com/carlomazzaferro/numerai_easy_ml

General purpose workflow for machine learning projects applied to the https://numer.ai data challenges.

data-science mahchine-leaning numerai

Last synced: 26 Mar 2025

https://github.com/coelhosilva/flight-ad

flight-ad is a Python package for anomaly detection in the aviation domain built on top of scikit-learn.

anomaly-detection data-science fdm flight-data flight-data-analysis flight-data-monitoring machine-learning python scikit-learn

Last synced: 10 Apr 2025

https://github.com/amruthpillai/machine-learning-a-z

Hands-On Python & R in Data Science - Udemy Course: https://www.udemy.com/machinelearning/learn/v4/overview

data-science machine-learning python r udemy

Last synced: 09 May 2025

https://github.com/iamantimpal/iamantimpal

๐Ÿ‘‹ Hi, I'm Antim Pal, the Founder of Optimism Educator. An online platform dedicated to empowering students with skills in Computer Science, Web Design, Graphic

data-analysis data-science data-visualization database database-design database-management datascience graphical-user-interface graphics grapic-design reading-list readme readme-badges readme-generator readme-md readme-profile readme-stats readme-template

Last synced: 10 Apr 2025

https://github.com/ndleah/transactions

๐Ÿช™ Linear regression model, predict monthly transaction amount

data-science financial-modeling linear-regression mlr transactions

Last synced: 05 May 2025

https://github.com/dayyass/extended-naive-bayes

[WIP] Extension of sklearn Naive Bayes models that allows sampling and more feature distributions.

data-science distributions generative-model machine-learning naive-bayes python sampling scikit-learn

Last synced: 13 Apr 2025

https://github.com/erp12/rica

DataFrame abstraction for Clojure data scientists.

clojure clojurescript data-science dataframe

Last synced: 11 Apr 2025

https://github.com/aflah02/nlp-albumentations-data-augmentation

This repository contains helper functions which can help you generate additional data points depending on your NLP task.

data-science nlp

Last synced: 09 Jul 2025

https://github.com/omarsar/data_mining_hw_1

Contains information for the first assignment of Data Mining 2017 Fall, NTHU.

data data-mining data-science datavisualization pandas

Last synced: 10 Apr 2025

https://github.com/barrettotte/ibmi-jupyter

Utility notebook for using Jupyter notebooks with IBMi for basic reports and visualizations.

data-science db2 db2i ibmi jupyter-notebook

Last synced: 11 Apr 2025

https://github.com/tushar2704/machinealgobox

Explore common ML algorithms, from scratch implementations to real-world use cases, Each algorithm is accompanied by clear explanations, code implementations, and real-world use cases, enabling you to grasp their underlying principles and apply them to different problem domains.

algorithms alogorithms-implemented artificial-intelligence data data-analytics data-engineering data-science deployment machine-learning-algorithms mlops python r streamlit streamlit-tushar2704 tushar2704

Last synced: 07 May 2025

https://github.com/coalio/Assistant

A data science library providing flexible dataframes for Lua 5.1+

data-analysis data-science data-structures dataframe lua

Last synced: 11 Apr 2025

https://github.com/rishigurnani/polygnn_trainer

A Python library to automate ML model training for polymer informatics.

data-science machine-learning materials-informatics

Last synced: 23 Jun 2025

https://github.com/yusufcinarci/web-scraping-projects

In these project files, I will host the web scraping examples that I will make day by day.

data-analysis data-science jupyter-notebook python web-scraping

Last synced: 01 May 2025

https://github.com/rahul-jha98/restauranttrends.stats

Visualise the trends in food and restaurant choices of customers in a city by scraping data from Zomato.

data-analysis data-science visualization vuejs zomato zomato-api zomato-scraper

Last synced: 08 Jul 2025

https://github.com/gjtorikian/destroy-all-monuments

This is data taken from the SPLC report titled "Whose Heritage? Public Symbols of the Confederacy" from April 21, 2016

data-science government-data social-justice

Last synced: 10 Apr 2025

https://github.com/zaman-hamza/citadel-datathon

My submission to the 2022 East Coast Datathon. The event started on the 21st of March and ended on the 28th, lasting about a whole week. I was in a team of two where we analyzed the non-conventional indicators and instigators of traffic.

citadel data-science data-visualization datathon

Last synced: 10 Apr 2025

https://github.com/rajveersinghcse/data-science

๐Ÿ‘€If you are looking for ๐Ÿ“ˆ Data Science Material. This Repository is good for you to get some basic knowledge.

data-science data-science-material

Last synced: 10 Sep 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/jbris/stan-cmdstanr-gpu-docker

A Docker image to run Stan, cmdstanr, and brms for Bayesian statistical modelling. GPU support using OpenCL is available.

bayes bayesian-inference brms cmdstan cmdstanr data-science docker posterior probabilistic-programming projpred rstan rstanarm shinystan stan stan-gpu stan-lang stan-math-library tidybayes tidyverse

Last synced: 04 May 2025

https://github.com/iguptashubham/online-retail-sales

This Power BI dashboard, designed for marketing strategists, analyzes sales trends and customer behavior. It provides key insights empowering them to identify sales opportunities and optimize marketing campaigns, ultimately boosting business sales.

dashboard data data-analysis data-analysis-project data-analysis-project-powerbi data-analysis-python data-project data-science powerbi project

Last synced: 19 Mar 2026

https://github.com/eikevons/pandas-paddles

Access the parent Pandas data frame in loc[], iloc[], assign(), and others Pandas helpers

data-analysis data-exploration data-science pandas pandas-dataframe pandas-library pandas-loc

Last synced: 16 Jun 2025

https://github.com/orkunaktas/wine-quality-prediction

๐Ÿท๐Ÿ”ฌ Wine Quality and Forecast ๐Ÿพ๐Ÿ‡

alcohol data-science logistic-regression wine-quality

Last synced: 08 Sep 2025

https://github.com/lucasrodes/pyphoon

Tools for Digital Typhoon DL/ML Project

data-science dataset environment machine-learning tropical-cyclone

Last synced: 18 Mar 2025

https://github.com/stefanrmmr/kaggle_twitter_airline_sentiment

Kaggle Twitter US Airline Sentiment, Implementation of a Tweet Text Sentiment Analysis Model, using custom trained Word Embeddings and LSTM-Deep learning [TUM-Data Analysis&ML summer 2021] @adrianbruenger @stefanrmmr

data-science deep-learning kaggle-airline-dataset kaggle-sentiment-analysis kaggle-us-airlines lstm-neural-networks python sentiment-analysis skipgram text-sentiment-classification tweepy tweet-classification tweet-sentiment-analysis twitter twitter-sentiment-analysis us-airline-dataset word2vec

Last synced: 19 Mar 2025

https://github.com/pharo-ai/data-partitioners

Pharo library for partitioning a collection. Given a set of proportions (e.g. 50%, 30%, and 20%), it shuffles the collection and divides it into non-empty subsets in such a way that every element is included in exactly one subset. Can be used in machine learning and statistical analysis for splitting data into training, validation, and test sets.

data-science machine-learning pharo statistical-analysis

Last synced: 11 Apr 2025

https://github.com/leomaurodesenv/data-science-api-framework

A simple framework to test and deploy your Data Science API

api api-rest data-science dataops docker flask-api python

Last synced: 09 Sep 2025

https://github.com/crissyro/base-of-ds

This repository serves as a foundation for projects in Data Science and Machine Learning.

clustering-algorithm data-science data-visualization machine-learning

Last synced: 04 Jul 2025

https://github.com/sarincr/python-app-development-using-kivy

Kivy is a Python library that supports cross-platform development. That means you can use a single code base to create Android, iOS, and even Windows, Linux, and MacOS apps. Kivy provides flexible, modern UI elements and, of course, let's you keep using your new favorite language to build it all!

android app appdevelopment cross-platform data-science desktop-app gtk gui kivy kivy-application kivy-framework kivymd machine-learning pyqt pyqt5 pyside tensorflow tkinter tkinter-gui tkinter-python

Last synced: 12 Apr 2025

https://github.com/negativenagesh/whatsapp_chat_analyzer

This is an end to end project of whatsapp chat analysis, here I have used my hostel whatsapp group's chat data.

data-analysis data-science frontend modeling python streamlit

Last synced: 12 Apr 2025

https://github.com/blmoore/summerdatachallenge

My entry for: http://summerdatachallenge.com (I came 3rd)

analytics data-science london r real-estate rstats

Last synced: 30 Apr 2025

https://github.com/carlos-gg/digitalgarden

NO LONGER MAINTAINED. Go to: https://aigarden.vercel.app/

artificial-intelligence data-science digital-garden knowledge-management machine-learning

Last synced: 07 May 2025

https://github.com/polakowo/textai

Applications using state-of-the-art in NLP

bert data-science gpt-2 machine-learning nlp telegram-bot transformers

Last synced: 07 May 2025

https://github.com/jcolechanged/josh.meanings

A k means implementation in Clojure which supports clustering on larger than memory but smaller than storage datasets.

assumption-free-k-mc clojure-library clustering data-science k-mc k-means k-means-clustering k-means-parallel k-means-plus-plus machine-learning medium-data

Last synced: 13 Apr 2025

https://github.com/praveen1664/chatbot

This is a chatbot written in python & getting inputs directly from sql database

chatbot data-science database json nlp python3 sqlite sqlite3

Last synced: 11 Jul 2025

https://github.com/hunterdii/iriswise

IrisWise is a machine learning application for predicting Iris flower species. Built with Streamlit, this app provides a user-friendly interface to input flower measurements and receive predictions using various models, including K-Nearest Neighbors, (Random Forest, SVM, and Logistic Regression) **(Working On It...)**.

classifier-model data-science flowers-recognition iris-dataset iris-recognition knn-classification machine-learning pickle python python3 streamlit streamlit-webapp

Last synced: 21 Feb 2026

https://github.com/vedadiyan/genql

GenQL is a generic querying language fully written in Go

data-analysis data-mapping data-processing data-science data-translation json json-data sql

Last synced: 22 Jun 2025

https://github.com/nationalparkservice/qckit

QCkit provides useful functions for data quality control and manipulation including updating data to DarwinCore standards, unit conversions, and data flagging.

darwin-core data-quality data-science npsdataverse quality-control r r-package rstats

Last synced: 22 Jun 2025

https://github.com/marwan116/supreme-task

A prefect extension that builds on top of the task decorator to reduce negative engineering!

data-ops data-science infrastructure ml-ops orchestration prefect python workflow

Last synced: 23 Jun 2025

Data Science Awesome Lists
awesome-datascience 944 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 83 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 CV-pretrained-model 103 awesome-data-analysis 936 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-feature-engineering 69 awesome-data-agents 155 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 956 Awesome-Distributed-Deep-Learning 44 machine-learning-resources 56 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 31 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 data-science-learning-path 70 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 244 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 204 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_ๆ–‡ๆœฌ็”Ÿๆˆ_ๆ–‡ๆœฌๅฏน่ฏ 2,414 Uncategorized 1,815 Languages 1,012 ๅ‰็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 767 Books 624 The Data Science Toolbox 601 Table of Contents 586 ๅ…ถไป–_ๆœบๅ™จๅญฆไน ไธŽๆทฑๅบฆๅญฆไน  550 Machine Learning 529 100 + ๐—”๐—ฟ๐˜๐—ถ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฎ๐—น ๐—œ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜ ๐—Ÿ๐—ถ๐˜€๐˜ ๐˜„๐—ถ๐˜๐—ต ๐—ฐ๐—ผ๐—ฑ๐—ฒ 495 Research Articles and Reports 424 Python 400 Literature and Media 384 ็ฝ‘็ปœๆœๅŠก 368 Data Versioning for Machine Learning 361 Awesome Resources 356 Paper implementations 341 ๅŽ็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 319 ๅ…ถไป–_ๆœบๅ™จ่ง†่ง‰ 315 Tools 292