Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/sferez/twitter_toolbox

Complete Toolbox for Scraping, Streaming, Interact with API, Cleaning, Preprocessing, Applying NLP on Twitter Data

data-collection data-science nlp preprocessing twitter twitter-api twitter-scraping twitter-streaming-api

Last synced: 10 Apr 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/zsxkib/ttds-g35-cw3

TTDS Group Project: Video Games Search Engine. Sakib Ahamed. Dan Buxton, Kenza Amira, Wini Lau, Mansoor Ahmad

corpora data-science neural-ranking-models pagerank query search-engine technologies text text-analysis text-classification ttds web-search

Last synced: 10 Apr 2025

https://github.com/gbeckers/birdwatcher

A Python computer vision library for animal behavior

animal behavior computer-vision data-science ffmpeg opencv python science

Last synced: 13 Oct 2025

https://github.com/compgeolab/temperature-data

Download and create a subset of global country-average temperature data from Berkeley Earth

climate climate-data data-science open-data temperature

Last synced: 15 Apr 2025

https://github.com/insightsengineering/nest

Website for the Nest project 🪺

clinical-trial-analysis data-science nest r shiny website

Last synced: 12 Sep 2025

https://github.com/ai-naymul/ats-catalyst

ATS Catalyst is an innovative platform designed to empower job seekers and streamline the hiring process. Leveraging advanced AI technologies, our suite of tools offers personalized feedback, resume evaluation, and job description matching to enhance your job application process.

ai application-tracking-system ats data-science langchain machine-learning open-source opensource-projects opensourceforgood python streamlit-application

Last synced: 05 May 2025

https://github.com/jhermann/til-about-data-science

:mortar_board: :panda_face: Records of what I learned while exploring the waters of Data Science (using Python)

artificial-intelligence data-science know-how machine-learning matplotlib pandas python seaborn today-i-learned visualization

Last synced: 19 Apr 2025

https://github.com/taharallouche/hakeem

Flexible crowdsourced data labeling solutions for scarce and incomplete annotations

crowdsourcing data-science datalabeling python

Last synced: 10 Oct 2025

https://github.com/jasonmdev/guidedprojects

As part of the DataQuest Curriculum, guided projects are less structured and focus more on exploration.

data-science jupyter-notebook

Last synced: 14 May 2025

https://github.com/curiousily/simple-neural-network-with-tensorflow-js

Build a simple Neural Network model in TensorFlow.js to make a laptop buying decision. Learn why Neural Networks need activation functions and how should you initialize their weights.

artificial-intelligence data-science deep-learning javascript machine-learning neural-networks tensorflow

Last synced: 26 Apr 2025

https://github.com/RDeconomist/RDeconomist.github.io

RapidCharts - a site for teaching and demonstrating Data Science and Visualisation techniques

data data-science data-visualization economics politics sports

Last synced: 08 Apr 2025

https://github.com/pfed-prog/catalonia_data

we have analyzed air quality in Catalonia by using the data from the Catalan Transparency Portal.

data-science dspyt jupyter-notebook ocean oceanprotocol python3

Last synced: 05 Oct 2025

https://github.com/sebiwtt/flaskriver

This is a repository for the open-source project flaskriver which will make it easier to combine the lightweight web-framework flask with the online-ML library river.

data-science flask machine-learning online-learning python river streaming

Last synced: 05 Jul 2025

https://github.com/ivanrs297/macfe

MACFE: Meta-learning and Causality Based Feature Engineering | https://link.springer.com/chapter/10.1007/978-3-031-19493-1_5

data-mining data-science feature-engineering machine-learning python

Last synced: 11 Jun 2025

https://github.com/getindata/quickstart-ml-starter

Kedro starterts to quickly set up new projects according to QuickStart ML Blueprints practice.

data-science machine-learning

Last synced: 30 Oct 2025

https://github.com/altescy/dacompe-27-jleague

Jリーグ観客動員数を予測せよ！【練習問題】 https://deepanalytics.jp/compe/27/

data-science

Last synced: 08 Oct 2025

https://github.com/radanalyticsio/workshop-notebook

Basic Jupyter notebook for learning Spark and OpenShift

containers data-science jupyter openshift spark

Last synced: 05 Aug 2025

https://github.com/onlyphantom/infratools

Kickstart Session: Infrastructure and Tools for Data Science workshop materials

data-science datascience workshop workshop-materials

Last synced: 14 Apr 2025

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/fmv1992/data_utilities

Data utilities library focused on machine learning and data analysis.

data-science utility-library

Last synced: 14 Mar 2025

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

https://github.com/curiousily/linear-regression-with-tensorflow-js

Build a Linear Regression model using TensorFlow.js and use to predict house prices

artificial-intelligence data-science javascript linear-regression machine-learning tensorflow tensorflowjs

Last synced: 01 Sep 2025

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/fburic/pandance

Advanced relational operations for pandas DataFrames

data-analysis data-science data-wrangling pandas

Last synced: 27 Jun 2026

https://github.com/deezinn/fecomercio-dataanalysis

Um sistema de análise de dados integra e processa informações de múltiplas fontes, convertendo dados brutos em insights valiosos.

csv data-science jupyter-notebook powerbi

Last synced: 15 Jul 2025

https://github.com/wgierke/git_better

3rd-placed solution for the informatiCup2017

data-science docker docker-image heroku machine-learning tensorboard

Last synced: 24 Mar 2025

https://github.com/davidssmith/rawarray.jl

Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage

bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage

Last synced: 10 Sep 2025

https://github.com/marwan116/supreme-task

A prefect extension that builds on top of the task decorator to reduce negative engineering!

data-ops data-science infrastructure ml-ops orchestration prefect python workflow

Last synced: 23 Jun 2025

https://github.com/ikegwukc/csc-405-605_spring_2022

Introductory Data Science Course Taught at UNCG (Spring 2022)

data-science datascience

Last synced: 09 Oct 2025

https://github.com/zapier/awsjavasdk

Boilerplate rJava Access to the AWS Java SDK

awsjavasdk cran data-science

Last synced: 14 Apr 2025

https://github.com/aglove2189/appias

Machine learning workflow toolkit ✨🦋✨

appias data-analysis data-science machine-learning pandas python sklearn workflow

Last synced: 19 Oct 2025

https://github.com/mribeirodantas/vidente

R package to parse and preprocess the Surveillance, Epidemiology, and End Results (SEER) Program data from NIH/NCI

cancer-patients cancer-research data-analysis data-science data-structures r-package seer

Last synced: 14 Apr 2025

https://github.com/labrijisaad/data-scientist-tools-pandas

In this hands-on training notebook, we'll see all the basics of the Pandas library used for data science/data analysis and machine learning tasks.

data-analysis data-science dataframe-objects machine-learning pandas python series-objects

Last synced: 08 Apr 2025

https://github.com/seporaitis/hsaur-python

Various exercises from the book "Handbook of Statistical Analysis Using R" done in Python

bokeh books data-science hsaur learning-by-doing learning-pandas pandas python r seaborn statistical-analysis statistics tutorial

Last synced: 09 Apr 2025

https://github.com/boada/insight_challenges

Data Science Challenges for Insight

data-science insight-data-science

Last synced: 15 Apr 2025

https://github.com/jackgerrits/reductionml

Reduction-based machine learning framework with a focus on contextual bandits

contextual-bandits data-science machine-learning online-learning rust

Last synced: 10 Apr 2025

https://github.com/caerbannogwhite/aargh

A library that helps you out of data nightmares in Go. 🧙‍♂️

csv data data-science data-wrangling dataframe go golang html json linq statistics stats xlsx xpt

Last synced: 14 Jan 2026

https://github.com/joaopfonseca/ml-research

A Python library with utilities for Machine Learning research and algorithm implementations

active-learning data-science machine-learning python scikit-learn

Last synced: 26 Oct 2025

https://github.com/trafficgcn/optimal_path_dijkstra_for_data_science

Plotting the Optimal Route in Python for Data Scientists using the Dijkstra Algorithm

data-science dijkstra dijkstra-algorithm dijkstra-shortest-path map mapping open-street-map optimal-route osm osmnx python

Last synced: 27 Oct 2025

https://github.com/lockedata/opentrainingcontent

An MIT & CCBY4.0 licensed repository of training materials from Locke Data

data-science open-course r-stats

Last synced: 29 Jul 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/erictleung/tutorial-tidyverse

:milky_way: Presentation on the tidyverse in R to clean and manipulate data

data-cleaning data-manipulation data-science manipulate-data presentation programming r tidyverse tutorial

Last synced: 25 Mar 2025

https://github.com/makomweb/curious-moon-exercise

My notes about: A Curious Moon by Rob Conery

data data-science docker make postgres postgresql sql

Last synced: 06 Apr 2025

https://github.com/alvarobartt/twipper

Python Twitter API Wrapper for both Free and Premium plans

api-wrapper data-science python twitter twitter-api

Last synced: 12 Apr 2025

https://github.com/sminerport/sminerport

My GitHub portfolio showcasing personal projects, coding skills, and expertise in Software Development, Data Analytics, and AI/ML. Get in touch for collaboration!

artificial-intelligence data-analytics data-science machine-learning natural-language-processing neural-networsk sequence-prediction software-development

Last synced: 15 Aug 2025

https://github.com/jestonblu/data-science

Gitbook of data science and statistics tasks I want to remember

data-science gitbook r rmarkdown statistics

Last synced: 22 Jul 2025

https://github.com/takuti/pyhivemall

Using machine learning model from Apache Hivemall :bee: in Python :snake:

data-science hive machine-learning python

Last synced: 15 Apr 2025

https://github.com/sevdanurgenc/r-programming-for-data-science-lecture-notes

In this repo, I have the course contents of R Programming For Data Science training, which will be given to Sigorta Bilgi ve Gözetim Merkezi by the cooperation of Academy Peak Information Technologies Training and Consultancy between 21 - 23 March 2023.

data-analysis data-science data-visualization r r-programming r-programming-projects

Last synced: 11 Oct 2025

https://github.com/rshrc/service-recommendation

E Commerce Service Recommendation Spoof in Django

data-science django python3

Last synced: 22 Apr 2025

https://github.com/redhat-na-ssa/demo-ocp-gpu

Show some magic around GPUs on OpenShift

code-server data-science gpu nvidia

Last synced: 30 Jul 2025

https://github.com/RemiRigal/DatasetExplorer

A web tool for local dataset browsing and processing developped using the Flask + Angular stack.

ai angular data-processing data-science data-visualization dataset dataset-analysis docker docker-compose flask web-application

Last synced: 30 Jul 2025

https://github.com/aianytime/fishvision

FishVision built using Streamlit identifies the different species of Fishes in a given image. It is trained on "A Large Scale Fish Data" available on Kaggle using the pre-trained model "MobileNetV2".

data-science deep-learning deep-neural-networks heroku heroku-deployment machine-learning machine-learning-algorithms mobilenetv2 python python3 streamlit streamlit-webapp

Last synced: 01 Sep 2025

https://github.com/ucbds-infra/ds-course-infra-guide

An educator's guide to creating a data science course

data-science jupyter jupyter-book

Last synced: 07 Oct 2025

https://github.com/sondosaabed/oil-vs-bigtech-stock-investigation

💹📈Investigating the oils market prices in addition to the stock market prices between the start of 2001 to the end of 2023. 💰📉

advanced-data-wrangling api data-analyst-nanodegree data-assessment data-gathering data-science python requests wrangling-data

Last synced: 09 Apr 2025

https://github.com/pottekkat/bulldozer-prize-predictions

Predict the auction sale price for a piece of heavy equipment to create a "blue book" for bulldozers.

bluebook bulldozer data data-science jupyter-notebook kaggle-competition machine-learning

Last synced: 20 Jun 2026

https://github.com/feedzai/feedzai-openml-r

Implementations for Feedzai's OpenML APIs to allow for usage of machine learning models in the R programming language.

caret data-science feedzai machine-learning machine-learning-algorithms openml r rserve

Last synced: 17 Oct 2025

https://github.com/spsanderson/steveondata

Repository for mainly R tips and tricks for my blog. I also include some VBA, SQL, C and Linux Usage.

ai blog c data data-science linux machinelearning-r ml ms-sql r sql time-series tipoftheday vba vba-excel

Last synced: 07 Apr 2025

https://github.com/abhinav-ark/mal_lyrics_analysis

Preprocessing and EDA on a Dataset of Malayalam Songs and Lyrics

data-science eda jupyter-notebook python

Last synced: 22 Jul 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/hritik5102/shala2020

MastAI ki paathSHALA : Data Science, Machine Learning, and Deep Learning codes with explanation and reference links 👨‍💻

artificial-intelligence computer-vision data-science deep-learning machine-learning statistics

Last synced: 12 Oct 2025

https://github.com/emiruz/dataset-tools

Easy to use library for working with core.matrix datasets in Clojure: select, where, aggregate, join, order, cross-tab, from/to-dataset, etc

data-mining data-science dataset dsl matrix sql

Last synced: 22 Oct 2025

https://github.com/kzndotsh/gang.guide

Evidence backed mapping of criminal organizations across the US — alliances, rivalries, history, and culture.

ai crime data-analysis data-science data-visualization dataset gangs konva konvajs llm organized-crime python svelte sveltekit tailwind typescript

Last synced: 03 Jul 2026

https://github.com/ngupta23/more

This is a helper package for pandas, visualizations and scikit-learn

data-science helpers pandas python scikit-learn visualization visualizations

Last synced: 24 Oct 2025

https://github.com/raynardj/forgebox

The deep learning tool box

data-science machine-learning nlp pandas-dataframe

Last synced: 16 Oct 2025

https://github.com/tuliosg/cdp

Repositório do curso "Ciência de Dados para Pesquisa".

data-analysis data-manipulation data-science data-visualization google-colab jupyter-notebook python

Last synced: 03 Mar 2026

https://github.com/milos-agathon/forest_map_europe

This repo demonstrates how to easily overlay community polygons on forest cover data and make a beautiful map using R and ggplot2

data-science data-visualization ggplot2 gis r satellite-imagery spatial-analysis zonal-statistics

Last synced: 04 Apr 2026

Data Science Awesome Lists
awesome-datascience 950 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 91 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-data-agents 155 awesome-feature-engineering 69 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 957 machine-learning-resources 56 Awesome-Distributed-Deep-Learning 44 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 33 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 260 data-science-learning-path 70 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 232 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_文本生成_文本对话 2,414 Uncategorized 1,774 前端开发框架及项目 766 The Data Science Toolbox 591 Books 576 Table of Contents 568 其他_机器学习与深度学习 550 Machine Learning 527 100 + 𝗔𝗿𝘁𝗶𝗳𝗶𝗰𝗶𝗮𝗹 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗟𝗶𝘀𝘁 𝘄𝗶𝘁𝗵 𝗰𝗼𝗱𝗲 495 Research Articles and Reports 428 Python 399 网络服务 367 Data Versioning for Machine Learning 358 Literature and Media 351 Paper implementations 341 Awesome Resources 340 后端开发框架及项目 319 其他_机器视觉 315 其他_安全与渗透 292 Tools 290