Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/systemvll/hcaptcha-dataset-scraper

A simple nodejs script that return hcaptcha images and prompt for training AI.

ai data-science dataset hcaptcha hcaptcha-solver machine-learning

Last synced: 03 Aug 2025

https://github.com/prakalp-pande/twitter-sentiment-analysis

Analyze public opinion on Tweet by mining and processing live Twitter data. Employ machine learning to classify tweets as positive, negative, or neutral, then visualize sentiment trends and identify key influencers.

data-science twitter-sentiment-analysis

Last synced: 18 Aug 2025

https://github.com/boada/insight_challenges

Data Science Challenges for Insight

data-science insight-data-science

Last synced: 15 Apr 2025

https://github.com/compgeolab/temperature-data

Download and create a subset of global country-average temperature data from Berkeley Earth

climate climate-data data-science open-data temperature

Last synced: 15 Apr 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/aianytime/fishvision

FishVision built using Streamlit identifies the different species of Fishes in a given image. It is trained on "A Large Scale Fish Data" available on Kaggle using the pre-trained model "MobileNetV2".

data-science deep-learning deep-neural-networks heroku heroku-deployment machine-learning machine-learning-algorithms mobilenetv2 python python3 streamlit streamlit-webapp

Last synced: 01 Sep 2025

https://github.com/curiousily/linear-regression-with-tensorflow-js

Build a Linear Regression model using TensorFlow.js and use to predict house prices

artificial-intelligence data-science javascript linear-regression machine-learning tensorflow tensorflowjs

Last synced: 01 Sep 2025

https://github.com/datadistillr/datadistillr-python-sdk

A Python SDK for Programmatically Interacting with DataDistillr

apache-drill data data-science datadistillr jupyter sql

Last synced: 01 Jul 2025

https://github.com/spsanderson/steveondata

Repository for mainly R tips and tricks for my blog. I also include some VBA, SQL, C and Linux Usage.

ai blog c data data-science linux machinelearning-r ml ms-sql r sql time-series tipoftheday vba vba-excel

Last synced: 07 Apr 2025

https://github.com/labrijisaad/data-scientist-tools-pandas

In this hands-on training notebook, we'll see all the basics of the Pandas library used for data science/data analysis and machine learning tasks.

data-analysis data-science dataframe-objects machine-learning pandas python series-objects

Last synced: 08 Apr 2025

https://github.com/rwallan/openiziai

Interface para se comunicar com a api da OpenAI adotando as melhores prรกticas de LLM para criar e se comunicar com um agente.

data-science ia llm openai pydantic-v2 python3

Last synced: 19 Apr 2025

https://github.com/thavlik/doom-gameplay-dataset

A dataset of Doom 1 & 2 gameplay videos preprocessed for deep learning

data-science dataset deep-learning doom doom-gameplay machine-learning quake-gameplay-dataset videos

Last synced: 16 Jan 2026

https://github.com/sebiwtt/flaskriver

This is a repository for the open-source project flaskriver which will make it easier to combine the lightweight web-framework flask with the online-ML library river.

data-science flask machine-learning online-learning python river streaming

Last synced: 05 Jul 2025

https://github.com/hmiladhia/piskle

A serialization package optimized for scikit-learn

data-science machine-learning python scikit-learn serialization

Last synced: 28 Oct 2025

https://github.com/akcarsten/non_negative_matrix_factorization

From scratch Python implementation of the Non-Negative Matrix Factorization algorithm.

clustering data-science machine-learning python

Last synced: 11 Mar 2026

https://github.com/ucla-biostat-203b/2023winter

Course webpage for UCLA Biostat 203B (Intro. to Data Science)

biostatistics data-science docker machine-learning r

Last synced: 07 Sep 2025

https://github.com/ikegwukc/csc-405-605_spring_2022

Introductory Data Science Course Taught at UNCG (Spring 2022)

data-science datascience

Last synced: 09 Oct 2025

https://github.com/cricksmaidiene/mids_machine_learning

๐Ÿค– A unified repository of coursework fragments from UC Berkeley MIDS ML courses

coursework data-science generative-ai jupyter-notebook machine-learning numpy pandas prompt-engineering scikit-learn spark tensorflow uc-berkeley

Last synced: 10 Oct 2025

https://github.com/sevdanurgenc/r-programming-for-data-science-lecture-notes

In this repo, I have the course contents of R Programming For Data Science training, which will be given to Sigorta Bilgi ve Gรถzetim Merkezi by the cooperation of Academy Peak Information Technologies Training and Consultancy between 21 - 23 March 2023.

data-analysis data-science data-visualization r r-programming r-programming-projects

Last synced: 11 Oct 2025

https://github.com/brendanhcullen/rstudio-instructor-certification

My materials for the RStudio Instructor Certification Teaching Exam.

certification data-science dplyr education instructor-training r rstudio tidyverse

Last synced: 25 Apr 2025

https://github.com/ngupta23/more

This is a helper package for pandas, visualizations and scikit-learn

data-science helpers pandas python scikit-learn visualization visualizations

Last synced: 24 Oct 2025

https://github.com/sminerport/sminerport

My GitHub portfolio showcasing personal projects, coding skills, and expertise in Software Development, Data Analytics, and AI/ML. Get in touch for collaboration!

artificial-intelligence data-analytics data-science machine-learning natural-language-processing neural-networsk sequence-prediction software-development

Last synced: 15 Aug 2025

https://github.com/sanketrs/implementation-of-modern-data-engineering-architecture-with-fabric_analytics

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

azure azure-data-factory azure-fabric bi-analytics big-data-analytics big-data-projects cloud-data-warehouse cloud-dataflow data-analytics data-engineering data-engineering-pipeline data-engineering-project data-pipeline-monitoring data-science data-visualization data-warehouse etl etl-framework etl-pipeline

Last synced: 14 Apr 2026

https://github.com/gregyjames/volumeprofiles

Use volume transactions to find significant price levels

data-science python statistics stock stock-analysis stock-price-prediction stocks stocks-prices

Last synced: 25 Apr 2025

https://github.com/moindalvs/assignment_east-west_airlines

Problem Statement Perform clustering (Hierarchical,K means clustering and DBSCAN) for the airlines data to obtain optimum number of clusters

clustering-algorithm data-science dbscan-clustering epsilon-greedy hierarchical-clustering kmeans-clustering

Last synced: 23 Apr 2025

https://github.com/wlongxiang/dutch_traffic_monitor

Visualize traffic on dutch high way A9 as an example

computer-vision data-science deep-learning object-detection opencv visualization

Last synced: 04 Aug 2025

https://github.com/curiousily/simple-neural-network-with-tensorflow-js

Build a simple Neural Network model in TensorFlow.js to make a laptop buying decision. Learn why Neural Networks need activation functions and how should you initialize their weights.

artificial-intelligence data-science deep-learning javascript machine-learning neural-networks tensorflow

Last synced: 26 Apr 2025

https://github.com/seporaitis/hsaur-python

Various exercises from the book "Handbook of Statistical Analysis Using R" done in Python

bokeh books data-science hsaur learning-by-doing learning-pandas pandas python r seaborn statistical-analysis statistics tutorial

Last synced: 09 Apr 2025

https://github.com/aqafridi/data-analytics-specialization

In this Specialization of Data Analytics we will use systematic computational analysis of data or statistics using Python. (rarely Excel or Cognos)

beautifulsoup cognos-dashboard data-science data-visualization excel numpy pandas python sql

Last synced: 21 Sep 2025

https://github.com/ahammadmejbah/python-problem-statement-and-solutions

Create a Python Problem Statement to challenge programmers. Specify a task, input/output requirements, and constraints. Ensure clarity and complexity to evaluate coding skills effectively.

data-science machine machine-learning python python3

Last synced: 27 Apr 2025

https://github.com/joaopfonseca/ml-research

A Python library with utilities for Machine Learning research and algorithm implementations

active-learning data-science machine-learning python scikit-learn

Last synced: 26 Oct 2025

https://github.com/joschnitzbauer/dalymi

A lightweight, data-focused and non-opinionated pipeline manager written in and for Python.

dag data data-science pipeline python workflow

Last synced: 14 Jan 2026

https://github.com/ahammadmejbah/ultimate-data-science-resources

๐Ÿš€ Welcome to the Unlimited Data Science Resources community! Dive into a wealth of knowledge with curated tutorials, courses, and insights. Elevate your data science journey with boundless learning opportunities! ๐Ÿ“Šโœจ

data-engineering data-mining data-science data-visualization database datascience

Last synced: 26 Feb 2025

https://github.com/hodgesmr/biden_nlp

Jupyter Notebook that introduces BIDEN: Binary Inference Dictionaries for Electoral NLP. It demonstrates a compression-based binary classification technique that is fast at both training and inference on common CPU hardware in Python

compression data-science machine-learning natural-language-processing nlp zstandard zstd

Last synced: 22 Jan 2026

https://github.com/oscarqjh/ntu_sc1015_project

A mini project for NTU's data science and artificial intelligence mod - Analysis on League of Legends competitive matches

data-science machine-learning pandas python scikit-learn

Last synced: 09 Apr 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/aglove2189/appias

Machine learning workflow toolkit โœจ๐Ÿฆ‹โœจ

appias data-analysis data-science machine-learning pandas python sklearn workflow

Last synced: 19 Oct 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/rshrc/service-recommendation

E Commerce Service Recommendation Spoof in Django

data-science django python3

Last synced: 22 Apr 2025

https://github.com/ivanrs297/macfe

MACFE: Meta-learning and Causality Based Feature Engineering | https://link.springer.com/chapter/10.1007/978-3-031-19493-1_5

data-mining data-science feature-engineering machine-learning python

Last synced: 11 Jun 2025

https://github.com/erictleung/data-science

:computer: Repository for teaching materials and notes on machine learning and data science for freeCodeCamp

data-cleaning data-engineering data-science data-visualization freecodecamp learning machine-learning mathematics notes python statistics

Last synced: 25 Mar 2025

https://github.com/erictleung/tutorial-tidyverse

:milky_way: Presentation on the tidyverse in R to clean and manipulate data

data-cleaning data-manipulation data-science manipulate-data presentation programming r tidyverse tutorial

Last synced: 25 Mar 2025

https://github.com/paulohrpinheiro/ds_from_0

Exercรญcios e experimentos para a leitura do livro 'Data Science do Zero'

data-science python3

Last synced: 10 Jul 2025

https://github.com/mine-cetinkaya-rundel/tidymodels-uscots-2021

Materials for the "Tidy up your models" workshop at USCOTS 2021

data-science modeling rstats statistics tidymiodels tidyverse

Last synced: 08 Apr 2025

https://github.com/sferez/twitter_toolbox

Complete Toolbox for Scraping, Streaming, Interact with API, Cleaning, Preprocessing, Applying NLP on Twitter Data

data-collection data-science nlp preprocessing twitter twitter-api twitter-scraping twitter-streaming-api

Last synced: 10 Apr 2025

https://github.com/andersy005/dask-notebooks

Dask tutorials for Big Data Analysis and Machine Learning as Jupyter notebooks

dask data-science distributed-computing jupyter-notebook parallel-computing python

Last synced: 30 Aug 2025

https://github.com/hritik5102/shala2020

MastAI ki paathSHALA : Data Science, Machine Learning, and Deep Learning codes with explanation and reference links ๐Ÿ‘จโ€๐Ÿ’ป

artificial-intelligence computer-vision data-science deep-learning machine-learning statistics

Last synced: 12 Oct 2025

https://github.com/shreyamalogi/road-lane-detection

Road lane detection is the process of using computers to identify and highlight the lanes on a road in pictures or videos.

data-science jupyter-notebook opencv python

Last synced: 11 Apr 2025

https://github.com/flrs/build_and_test_ml_quickly

From idea to production in a day: Leveraging Azure ML and Streamlit to build and user test machine learning ideas quickly (Talk at PyCon DE & PyData Berlin 2024)

agile-development azure-application-insights azure-machine-learning data-science machine-learning streamlit streamlit-feedback

Last synced: 21 Apr 2025

https://github.com/pfed-prog/catalonia_data

we have analyzed air quality in Catalonia by using the data from the Catalan Transparency Portal.

data-science dspyt jupyter-notebook ocean oceanprotocol python3

Last synced: 05 Oct 2025

https://github.com/solarwinds/probprog-workshop

Workshop on probabilistic programming for Tech Summit 2020 (Brno, December 12 2019)

data-science machine-learning probabilistic-programming statistics

Last synced: 24 Apr 2025

https://github.com/jhermann/til-about-data-science

:mortar_board: :panda_face: Records of what I learned while exploring the waters of Data Science (using Python)

artificial-intelligence data-science know-how machine-learning matplotlib pandas python seaborn today-i-learned visualization

Last synced: 19 Apr 2025

https://github.com/taharallouche/hakeem

Flexible crowdsourced data labeling solutions for scarce and incomplete annotations

crowdsourcing data-science datalabeling python

Last synced: 10 Oct 2025

https://github.com/pottekkat/bulldozer-prize-predictions

Predict the auction sale price for a piece of heavy equipment to create a "blue book" for bulldozers.

bluebook bulldozer data data-science jupyter-notebook kaggle-competition machine-learning

Last synced: 20 Jun 2026

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/richardleighdavies/prompt-engineering-in-practice

Practical code examples and implementations from the book "Prompt Engineering in Practice". Demonstrates text generation, prompt chaining, and prompt routing using Python and LangChain. Features real-world examples of interacting with OpenAI's GPT models, structured output handling, and multi-step prompt workflows.

ai artificial-intelligence chatbot data-science deep-learning gpt langchain llm machine-learning natural-language-processing nlp openai prompt-engineering pydantic python text-generation

Last synced: 15 Apr 2025

https://github.com/fburic/pandance

Advanced relational operations for pandas DataFrames

data-analysis data-science data-wrangling pandas

Last synced: 27 Jun 2026

https://github.com/amirhosseinhonardoust/algorithmic-empath-human-fallibility

A deep exploration of Algorithmic Empathy, the next frontier in AI understanding. This project examines how machines can learn from human fallibility, model disagreement, and align with moral reasoning. It blends psychology, fairness metrics, interpretability, and co-learning design into one framework for humane intelligence.

ai algorithmic-bias co-learning cognitive-science data-science empathy ethics fairness human-centered-ai intelligence interpretability machine-learning neural-networks neurosymbolic philosophy psychology reflective-ai research responsible-ai xai

Last synced: 28 Feb 2026

https://github.com/milos-agathon/forest_map_europe

This repo demonstrates how to easily overlay community polygons on forest cover data and make a beautiful map using R and ggplot2

data-science data-visualization ggplot2 gis r satellite-imagery spatial-analysis zonal-statistics

Last synced: 04 Apr 2026

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/marianogappa/sctool

Starcraft: Remastered replay analyzer library and CLI tool

cli cli-app data-science replays starcraft starcraft-broodwar starcraft-remastered

Last synced: 17 Apr 2026

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

https://github.com/rvandewater/ReciPies

๐ŸฅงReciPys: easily define and execute preprocessing and feature engineering steps on Polars and Pandas dataframes.

data-science pandas polars python scikit-learn tidymodels

Last synced: 24 Oct 2025

https://github.com/praveen1664/chatbot

This is a chatbot written in python & getting inputs directly from sql database

chatbot data-science database json nlp python3 sqlite sqlite3

Last synced: 11 Jul 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/lucasrodes/pyphoon

Tools for Digital Typhoon DL/ML Project

data-science dataset environment machine-learning tropical-cyclone

Last synced: 18 Mar 2025

https://github.com/zaman-hamza/citadel-datathon

My submission to the 2022 East Coast Datathon. The event started on the 21st of March and ended on the 28th, lasting about a whole week. I was in a team of two where we analyzed the non-conventional indicators and instigators of traffic.

citadel data-science data-visualization datathon

Last synced: 10 Apr 2025

https://github.com/carlos-gg/digitalgarden

NO LONGER MAINTAINED. Go to: https://aigarden.vercel.app/

artificial-intelligence data-science digital-garden knowledge-management machine-learning

Last synced: 07 May 2025

Data Science Awesome Lists
awesome-datascience 944 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 83 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-feature-engineering 69 awesome-data-agents 155 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 956 Awesome-Distributed-Deep-Learning 44 machine-learning-resources 56 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 31 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 data-science-learning-path 70 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 244 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 232 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_ๆ–‡ๆœฌ็”Ÿๆˆ_ๆ–‡ๆœฌๅฏน่ฏ 2,414 Uncategorized 1,827 Languages 1,012 ๅ‰็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 767 Books 624 The Data Science Toolbox 599 Table of Contents 590 ๅ…ถไป–_ๆœบๅ™จๅญฆไน ไธŽๆทฑๅบฆๅญฆไน  550 Machine Learning 532 100 + ๐—”๐—ฟ๐˜๐—ถ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฎ๐—น ๐—œ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜ ๐—Ÿ๐—ถ๐˜€๐˜ ๐˜„๐—ถ๐˜๐—ต ๐—ฐ๐—ผ๐—ฑ๐—ฒ 495 Research Articles and Reports 424 Python 400 Literature and Media 385 ็ฝ‘็ปœๆœๅŠก 368 Data Versioning for Machine Learning 361 Awesome Resources 356 Paper implementations 341 ๅŽ็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 319 ๅ…ถไป–_ๆœบๅ™จ่ง†่ง‰ 315 Tools 295