Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/rafaelpermec/live-broker-api

Um estudo sobre raspagem de dados em back-end, simulando uma corretora que realiza aรงรตes de compra e venda de ativos e fluxo de caixa de clientes em tempo real.

authentication authorization backend-api cheerio data-science express helmet jwt-authentication mysql nodejs typescript web-scraping

Last synced: 19 Apr 2025

https://github.com/memgonzales/pisa-2018-analysis

Jupyter notebook presenting the process of data preparation, research question formulation, data analysis, and data modeling with the goal of extracting insights from the 2018 PISA Dataset

data-cleaning data-modeling data-science data-visualization exploratory-data-analysis jupyter-notebook matplotlib numpy oecd-data pandas pisa scipy statistical-inference

Last synced: 13 Jun 2025

https://github.com/ZackAkil/friendlier-data-labelling

Code resources for generating a google form for labelling data.

data-science google google-apps-script google-forms google-sheets machine-learning

Last synced: 04 Apr 2025

https://github.com/lintangwisesa/javascript-on-jupyterlab

JavaScript (Node.js) kernel inside Jupyter Lab (Jupyter Notebook)

data-science javascript jupyter-lab jupyter-notebook

Last synced: 26 Apr 2025

https://github.com/vbyan/deeva

๐Ÿš€Deeva - your smart analytics companion for Object Detection datasets

data data-science data-visualization datasets deeva machine-learning object-detection plotly python statistics streamlit visualization

Last synced: 26 Jun 2025

https://github.com/mohidex/data-pipeline-on-gcp

The Real-time Ecommerce Data Collection and Processing project empowers businesses with real-time insights by efficiently extracting, processing, and storing ecommerce data from multiple sources. Combining Golang and Python, this cutting-edge solution streamlines data handling from diverse ecommerce websites.

beautifulsoup data-engineer data-pipeline data-science database datastore dependency-injection firebase firestore gcp go golang google google-cloud pubsub python solid-principles storage web-scraping

Last synced: 14 Apr 2025

https://github.com/aryankeluskar/imdb-genres-analysis

Graph mean and variance of movies along the years. Then use Prophet and ARIMA to predict the average ratings by genres into the future.

data-science julia matplotlib monte-carlo python

Last synced: 08 Feb 2026

https://github.com/ahammadmejbah/glossary-of-artificial-intelligence

A "Glossary of Artificial Intelligence" is a concise reference resource defining key terms, concepts, and terminology related to AI. It provides explanations and definitions to help individuals understand and navigate the field of artificial intelligence, making it a valuable tool for both beginners and experts in the AI domain.

artificial-intelligence data data-science deep-learning deep-learning-algorithms detection image-processing machine-learning python

Last synced: 25 Jun 2025

https://github.com/divyanshugit/66daysofdata

This repo contains the source code for a static webpage where you can find out answers to Machine Learning Interview questions.

data-science interview-questions machine-learning

Last synced: 31 Jan 2026

https://github.com/opengeos/cog-tiler-wasm

Serverless Cloud Optimized GeoTIFF (COG) dynamic tiling in WebAssembly. TiTiler-style XYZ tiles, no backend, built on whitebox-wasm.

data-science geospatial raster wasm whiteboxtools

Last synced: 19 Jul 2026

https://github.com/ramonhpr/knot-lib-python

API to get data from cloud and make some data analytics

data-science iot iot-framework web

Last synced: 26 Jun 2026

https://github.com/tchlux/util

My machine learning, optimization, and data science utilities package.

data-science machine-learning numerical-optimization python-utilities splines statistics visualization

Last synced: 02 May 2026

https://github.com/bpkaur/word-frequency-in-moby-dick

To find out the most frequent words in the novel Moby Dick using Python.

beautifulsoup data-analysis data-science moby-dick nltk notebook-jupyter python3

Last synced: 09 Nov 2025

https://github.com/ucdavisdatalab/workshop_web_maps

Learn to build an interactive web map to display spatial data

data-science geospatial-visualization teaching-materials ucdavis ucdavis-datalab workshop

Last synced: 05 Mar 2026

https://github.com/canbula/datascience

Repository for Data Science course given by Assoc. Prof. Dr. Bora Canbula at Computer Engineering Department of Manisa Celal Bayar University.

data-science machine-learning matplotlib numpy pandas python python3 scikit-learn seaborn

Last synced: 04 Apr 2026

https://github.com/mims-harvard/patient-safety

Population-scale patient safety data reveal inequalities in adverse events before and during COVID-19 pandemic

adverse-events data-science graph-algorithms graphs networks pandemic

Last synced: 10 Oct 2025

https://github.com/betaandbit/wykresy

Wykresy od kuchni

data-science wizualizacja wykresy

Last synced: 01 Feb 2026

https://github.com/thomasthaddeus/dataanalysistoolkit

DataAnalysisToolkit is a Python-based data analysis tool designed to streamline various data analysis tasks. It provides the ability to load data from CSV files, perform statistical calculations, detect outliers, clean data, and visualize data.

data-science matplotlib python python-script python3 scikit-learn

Last synced: 07 Oct 2025

https://github.com/worldbank/trend-narrative

Python package for piecewise-linear trend detection and plain-English narrative generation for time series data.

data-science natural-language-generation open-source piecewise-regression time-series trend-detection

Last synced: 02 Jun 2026

https://github.com/mine-cetinkaya-rundel/feedback-at-scale

Slides and sample learnr tutorial for rstudio::global(2021) talk

data-science gradethis learnr rstats tutorial

Last synced: 11 Feb 2026

https://github.com/f0nzie/volve-reservoir-model-evolution

Volve dataset. Reservoir model. Analyze steps and field cumulatives from Eclipse PRT file

data-science petroleum-engineering reservoir-modeling reservoir-simulation rstats

Last synced: 11 Feb 2026

https://github.com/zmoooooritz/stapy

An easy to use SensorThings API Client written in Python

api cli data-science database ogc python sensor sensor-data sensorthings sensorthings-api

Last synced: 17 Jan 2026

https://github.com/iamyajat/whatsapp-chat-analyzer-api

An API to analyse WhatsApp chats and generate insights

data-analysis data-science fastapi python whatsapp

Last synced: 17 Oct 2025

https://github.com/john-hawkins/projit

Application for managing the structure, properties, data, experiments and build of data science projects.

data-science experiments machine-learning project-management

Last synced: 23 Jun 2025

https://github.com/zMoooooritz/stapy

An easy to use SensorThings API Client written in Python

api cli data-science database ogc python sensor sensor-data sensorthings sensorthings-api

Last synced: 15 May 2025

https://github.com/tsg405/sql-for-data-science----coursera

This Repo contains - Starter files, Coursework, Programming Assignments for the course --> SQL for Data Science from University of California, Davis [COURSERA]

california chinook-database coursera data-science query-language quiz sql sqlite ucdavis-datalab yelp-dataset

Last synced: 14 Apr 2025

https://github.com/ul-mds/gecko

Python library for the generation and mutation of realistic personal identification data at scale

data-science numpy pandas python record-linkage

Last synced: 24 Apr 2025

https://github.com/lfrench03/ganaderia-en-cuba

Based on the data provided by the National Office of Statistics and Information ONEI and other alternative trusted sources mentioned in the references, our main objective is to present a detailed vision of how livestock farming has evolved in Cuba during the period until 2022.

cuba data-science dataproduct ganaderia streamlit streamlit-application timeline

Last synced: 26 Jul 2025

https://github.com/ruivieira/nim-mentat

A Nim library for data science and machine learning

data-science library machine-learning nim scientific-computing

Last synced: 10 Aug 2025

https://github.com/ryanrudes/wikimedia

A dataset comprised of over 40 million images sourced from Wikimedia Commons

computer-vision data-science data-scraping dataset datasets deep-learning gans image images machine-learning wikimedia wikimedia-commons

Last synced: 13 Sep 2025

https://github.com/nikoshet/new-york-city-taxi-fare-prediction-machine-learning

Project for course 'Machine Learning' for M.Sc. 'Data Science and Machine Learning' in NTUA

data-science keras-tensorflow machine-learning numpy pandas python

Last synced: 12 Sep 2025

https://github.com/tiagoantao/virtual-core

A data science core based on Docker containers

data-science docker

Last synced: 14 Mar 2026

https://github.com/waylonwalker/kedro-auto-catalog

Kedro catalog create with default configuration

data data-science kedro kedro-catalog kedro-hook kedro-plugin

Last synced: 12 Jun 2025

https://github.com/bhattbhavesh91/auto-sklearn-tutorial

Small tutorial on auto-sklearn which is an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator.

auto-ml auto-sklearn automl data-science machine-learning python tutorial

Last synced: 27 Oct 2025

https://github.com/techn0man1ac/toxiccommentclassification

This project aims to develop a model capable of identifying and classifying different levels of toxicity in comments, using the power of BERT(Bidirectional Encoder Representations from Transformers) for text analysis.

analysis bert-model classifying data-science docker machine-learning python streamlit text-classification transformers-models

Last synced: 18 Aug 2025

https://github.com/gosecure/orange-code-widget

:orange: Widget for Orange to visualize code sample

add-on code data-science data-visualization machine-learning orange widget

Last synced: 05 Apr 2025

https://github.com/timkong21/polyp-segmentation

Polyp segmentation tool utilizing U-Net for accurate medical image analysis, designed to enhance early detection and diagnosis of colorectal cancer. Features a user-friendly Streamlit web app for easy image processing and analysis, leveraging the Kvasir-SEG dataset for improved healthcare outcomes.

aws-s3 cancer-detection colonoscopy computer-vision data-augmentation data-science deep-learning diagnostics healthcare machine-learning medical-application medical-image-analysis medical-image-processing medical-image-segmentation opencv polyp-segmentation python streamlit tensorflow u-net

Last synced: 14 Apr 2025

https://github.com/stappit/blog

I often post solutions to textbook exercises, including: Bayesian Data Analysis (BDA) by Gelman et al; Causal Inference in Statistics Primer (CISP) by Pearl et al; Purely Functional Data Structures (PFDS) by Okasaki.

bayesian-data-analysis blog data-analysis data-science gelman hakyll haskell pearl purely-functional-data-structures solutions stan static-site statistical-inference statistics

Last synced: 14 Mar 2025

https://github.com/omarsar/data_mining_hw_1

Contains information for the first assignment of Data Mining 2017 Fall, NTHU.

data data-mining data-science datavisualization pandas

Last synced: 10 Apr 2025

https://github.com/joshwlambert/daisieprep

Extracts phylogenetic island community data from phylogenetic trees

data-science island-biogeography phylogenetics r

Last synced: 18 Mar 2025

https://github.com/coatless-textbooks/statistical-concepts-with-shiny-apps

Quarto book illustrating various statistical concepts using Shinylive.

data-science quarto quarto-book r-shiny r-shinylive statistics webr

Last synced: 12 Jun 2025

https://github.com/valohai/minihai

An open-source application for running notebooks server-side

data-science jupyter jupyter-notebook machine-learning notebook

Last synced: 02 Aug 2025

https://github.com/pchtsp/pytups

Powerful dictionaries and tuple lists for data wrangling

data data-science dictionaries optimization tuples

Last synced: 14 Apr 2025

https://github.com/thecoderpinar/gen-expression

Gene expression analysis is a fundamental component of genomics research, providing valuable insights into how genes are regulated and their impact on various biological processes. This project delves into the realm of gene expression data, aiming to uncover hidden patterns and relationships within complex datasets. ๐Ÿš€

bioinformatics biotechnology data-analysis data-science data-visualization genomics kaggle machine-learning pca python

Last synced: 30 Apr 2025

https://github.com/mdh266/crimetime

Python web application for exploring and forecasting crime rates in NYC

data-science docker flask-application forecasting-crime-rates geospatial-analysis pandas python statsmodels time-series-analysis

Last synced: 30 Jul 2025

https://github.com/erp12/rica

DataFrame abstraction for Clojure data scientists.

clojure clojurescript data-science dataframe

Last synced: 11 Apr 2025

https://github.com/miguelgfierro/miguelgfierro

I help people understand and apply AI

ai data-science machine-learning

Last synced: 03 Jan 2026

https://github.com/westlake-ai/dmt-learn

An Explainable Deep Network for Dimension Reduction

data-science dimension-reduction python

Last synced: 07 Aug 2025

https://github.com/sanvishal/Exoplanet-Explore

An Interactive data visualization of Exoplanets

animation d3js data-analysis data-science exoplanet python space visualization

Last synced: 14 Apr 2025

https://github.com/flrs/build_and_test_ml_quickly

From idea to production in a day: Leveraging Azure ML and Streamlit to build and user test machine learning ideas quickly (Talk at PyCon DE & PyData Berlin 2024)

agile-development azure-application-insights azure-machine-learning data-science machine-learning streamlit streamlit-feedback

Last synced: 21 Apr 2025

https://github.com/rvandewater/ReciPies

๐ŸฅงReciPys: easily define and execute preprocessing and feature engineering steps on Polars and Pandas dataframes.

data-science pandas polars python scikit-learn tidymodels

Last synced: 24 Oct 2025

https://github.com/mshenfield/subreddit_algebra

A python port and frontend to 538's subreddit analysis

data-science data-visualization reddit

Last synced: 13 Apr 2025

https://github.com/hmiladhia/piskle

A serialization package optimized for scikit-learn

data-science machine-learning python scikit-learn serialization

Last synced: 28 Oct 2025

https://github.com/deezinn/fecomercio-dataanalysis

Um sistema de anรกlise de dados integra e processa informaรงรตes de mรบltiplas fontes, convertendo dados brutos em insights valiosos.

csv data-science jupyter-notebook powerbi

Last synced: 15 Jul 2025

https://github.com/makomweb/curious-moon-exercise

My notes about: A Curious Moon by Rob Conery

data data-science docker make postgres postgresql sql

Last synced: 06 Apr 2025

https://github.com/chiraag-kakar/pubg

What's the best strategy to win in PUBG? Should you sit in one spot and hide your way into victory, or do you need to be the top shot? Let's let the data do the talking!

data-science feature-engineering machine-learning-algorithms project pubg-api random-forest

Last synced: 07 May 2025

https://github.com/rwallan/openiziai

Interface para se comunicar com a api da OpenAI adotando as melhores prรกticas de LLM para criar e se comunicar com um agente.

data-science ia llm openai pydantic-v2 python3

Last synced: 19 Apr 2025

https://github.com/systemvll/hcaptcha-dataset-scraper

A simple nodejs script that return hcaptcha images and prompt for training AI.

ai data-science dataset hcaptcha hcaptcha-solver machine-learning

Last synced: 03 Aug 2025

https://github.com/paulohrpinheiro/ds_from_0

Exercรญcios e experimentos para a leitura do livro 'Data Science do Zero'

data-science python3

Last synced: 10 Jul 2025

https://github.com/armanx200/gold-price-prediction

๐Ÿ” Predicting the future adjusted closing price of Gold ETF using machine learning! ๐Ÿ“ˆโœจ

arman-kianian data-science data-visualization finance gold-price-prediction machine-learning prediction-models python random-forest regression stock-market time-series-analysis

Last synced: 30 Apr 2025

https://github.com/brendanhcullen/rstudio-instructor-certification

My materials for the RStudio Instructor Certification Teaching Exam.

certification data-science dplyr education instructor-training r rstudio tidyverse

Last synced: 25 Apr 2025

https://github.com/haloapping/cotomks

Kumpulan referensi untuk belajar mengenai pemrograman Python, Data Science, Machine Learning dan Deep Learning.

data-science deep-learning machine-learning model-evaluation probabilistic statistics time-series

Last synced: 04 Jul 2026

https://github.com/davidssmith/rawarray.jl

Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage

bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage

Last synced: 10 Sep 2025

https://github.com/thavlik/doom-gameplay-dataset

A dataset of Doom 1 & 2 gameplay videos preprocessed for deep learning

data-science dataset deep-learning doom doom-gameplay machine-learning quake-gameplay-dataset videos

Last synced: 16 Jan 2026

https://github.com/wgierke/git_better

3rd-placed solution for the informatiCup2017

data-science docker docker-image heroku machine-learning tensorboard

Last synced: 24 Mar 2025

https://github.com/ai-naymul/ats-catalyst

ATS Catalyst is an innovative platform designed to empower job seekers and streamline the hiring process. Leveraging advanced AI technologies, our suite of tools offers personalized feedback, resume evaluation, and job description matching to enhance your job application process.

ai application-tracking-system ats data-science langchain machine-learning open-source opensource-projects opensourceforgood python streamlit-application

Last synced: 05 May 2025

https://github.com/ahammadmejbah/becoming-a-python-developer

Becoming a Python developer involves mastering the Python programming language, understanding its syntax, and learning popular frameworks. Gain proficiency in web development, data analysis, or automation. Collaborate on projects, build a strong portfolio, and stay updated on industry trends to excel in this dynamic and versatile field.

algorithms algorithms-and-data-structures data-science deep deep-learning deep-neural-networks machine-learning machine-learning-algorithms machinelearning python python3

Last synced: 11 Jun 2025

https://github.com/aqafridi/data-analytics-specialization

In this Specialization of Data Analytics we will use systematic computational analysis of data or statistics using Python. (rarely Excel or Cognos)

beautifulsoup cognos-dashboard data-science data-visualization excel numpy pandas python sql

Last synced: 21 Sep 2025

https://github.com/yusufcinarci/web-scraping-projects

In these project files, I will host the web scraping examples that I will make day by day.

data-analysis data-science jupyter-notebook python web-scraping

Last synced: 01 May 2025

https://github.com/unicef/magasin

Cloud native open-source end-to-end data / AI / ML platform

cloud dagster data data-pipelines data-science data-visualization helm-charts kubernetes magasin

Last synced: 21 Apr 2025

Data Science Awesome Lists
awesome-datascience 950 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 91 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-data-agents 155 awesome-feature-engineering 69 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 957 machine-learning-resources 56 Awesome-Distributed-Deep-Learning 44 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 33 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 260 data-science-learning-path 70 Data-Engineering-Roadmap 119 awesome-kubeflow 152 awesome-code-benchmark 232 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_ๆ–‡ๆœฌ็”Ÿๆˆ_ๆ–‡ๆœฌๅฏน่ฏ 2,414 Uncategorized 1,775 ๅ‰็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 766 The Data Science Toolbox 595 Books 588 ๅ…ถไป–_ๆœบๅ™จๅญฆไน ไธŽๆทฑๅบฆๅญฆไน  550 Machine Learning 535 Table of Contents 523 100 + ๐—”๐—ฟ๐˜๐—ถ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฎ๐—น ๐—œ๐—ป๐˜๐—ฒ๐—น๐—น๐—ถ๐—ด๐—ฒ๐—ป๐—ฐ๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐—ท๐—ฒ๐—ฐ๐˜ ๐—Ÿ๐—ถ๐˜€๐˜ ๐˜„๐—ถ๐˜๐—ต ๐—ฐ๐—ผ๐—ฑ๐—ฒ 495 Research Articles and Reports 411 Python 399 ็ฝ‘็ปœๆœๅŠก 367 Data Versioning for Machine Learning 361 Literature and Media 352 Paper implementations 341 Awesome Resources 340 ๅŽ็ซฏๅผ€ๅ‘ๆก†ๆžถๅŠ้กน็›ฎ 319 ๅ…ถไป–_ๆœบๅ™จ่ง†่ง‰ 315 ๅ…ถไป–_ๅฎ‰ๅ…จไธŽๆธ—้€ 292 LLMs and ChatGPT 288