Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/rahul-jha98/restauranttrends.stats

Visualise the trends in food and restaurant choices of customers in a city by scraping data from Zomato.

data-analysis data-science visualization vuejs zomato zomato-api zomato-scraper

Last synced: 08 Jul 2025

https://github.com/ndleah/tsf-data-science-internship

This repository contains the tasks performed during the Data Science and Business Analytics Internship at The Sparks Foundation

data-science data-visualization exploratory-data-analysis machine-learning powerbi python virtual-internship

Last synced: 20 Sep 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/blmoore/summerdatachallenge

My entry for: http://summerdatachallenge.com (I came 3rd)

analytics data-science london r real-estate rstats

Last synced: 30 Apr 2025

https://github.com/prakalp-pande/twitter-sentiment-analysis

Analyze public opinion on Tweet by mining and processing live Twitter data. Employ machine learning to classify tweets as positive, negative, or neutral, then visualize sentiment trends and identify key influencers.

data-science twitter-sentiment-analysis

Last synced: 18 Aug 2025

https://github.com/octoenergy/s3migrate

Bulk delete/copy/move files or modify Hive/Drill/Athena partitions using pythonic pattern matching

data data-science

Last synced: 24 Jun 2025

https://github.com/mshenfield/subreddit_algebra

A python port and frontend to 538's subreddit analysis

data-science data-visualization reddit

Last synced: 13 Apr 2025

https://github.com/vedadiyan/genql

GenQL is a generic querying language fully written in Go

data-analysis data-mapping data-processing data-science data-translation json json-data sql

Last synced: 22 Jun 2025

https://github.com/firelink-sh/evolve-py

A highly efficient, composable, and lightweight ETL and data integration framework.

analytics arrow big-data data data-engineering data-integration data-science duckdb elt etl ingestion ingress ml olap pipeline polars postgresql python s3

Last synced: 10 Mar 2026

https://github.com/nationalparkservice/qckit

QCkit provides useful functions for data quality control and manipulation including updating data to DarwinCore standards, unit conversions, and data flagging.

darwin-core data-quality data-science npsdataverse quality-control r r-package rstats

Last synced: 22 Jun 2025

https://github.com/frobnitzem/mpi_list

A package for working with lists distributed over MPI

data-science hpc map-reduce mpi4py

Last synced: 18 Mar 2025

https://github.com/chris-santiago/steps

A SciKit-Learn style feature selector using best subsets and stepwise regression.

best-subset-selection data-science python scikit-learn stepwise-selection

Last synced: 28 Jun 2025

https://github.com/deezinn/fecomercio-dataanalysis

Um sistema de análise de dados integra e processa informações de múltiplas fontes, convertendo dados brutos em insights valiosos.

csv data-science jupyter-notebook powerbi

Last synced: 15 Jul 2025

https://github.com/marwan116/supreme-task

A prefect extension that builds on top of the task decorator to reduce negative engineering!

data-ops data-science infrastructure ml-ops orchestration prefect python workflow

Last synced: 23 Jun 2025

https://github.com/rajveersinghcse/data-science

👀If you are looking for 📈 Data Science Material. This Repository is good for you to get some basic knowledge.

data-science data-science-material

Last synced: 10 Sep 2025

https://github.com/rishigurnani/polygnn_trainer

A Python library to automate ML model training for polymer informatics.

data-science machine-learning materials-informatics

Last synced: 23 Jun 2025

https://github.com/fusky-labs/pacopanda-drawing-stats

A case study and data analysis project that collects drawings from a furry artist Paco Panda

data-science data-visualization fastapi furries furry furry-fandom pandas python

Last synced: 09 Aug 2025

https://github.com/jasonmdev/guidedprojects

As part of the DataQuest Curriculum, guided projects are less structured and focus more on exploration.

data-science jupyter-notebook

Last synced: 14 May 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/adamvvu/snapshot_ensemble

Train TensorFlow Keras models with cosine annealing and save an ensemble of models with no additional computational expense.

data-science deep-learning keras machine-learning python tensorflow

Last synced: 28 Oct 2025

https://github.com/leomaurodesenv/data-science-api-framework

A simple framework to test and deploy your Data Science API

api api-rest data-science dataops docker flask-api python

Last synced: 09 Sep 2025

https://github.com/abhinav-ark/mal_lyrics_analysis

Preprocessing and EDA on a Dataset of Malayalam Songs and Lyrics

data-science eda jupyter-notebook python

Last synced: 22 Jul 2025

https://github.com/jbris/stan-cmdstanr-gpu-docker

A Docker image to run Stan, cmdstanr, and brms for Bayesian statistical modelling. GPU support using OpenCL is available.

bayes bayesian-inference brms cmdstan cmdstanr data-science docker posterior probabilistic-programming projpred rstan rstanarm shinystan stan stan-gpu stan-lang stan-math-library tidybayes tidyverse

Last synced: 04 May 2025

https://github.com/iguptashubham/online-retail-sales

This Power BI dashboard, designed for marketing strategists, analyzes sales trends and customer behavior. It provides key insights empowering them to identify sales opportunities and optimize marketing campaigns, ultimately boosting business sales.

dashboard data data-analysis data-analysis-project data-analysis-project-powerbi data-analysis-python data-project data-science powerbi project

Last synced: 19 Mar 2026

https://github.com/jestonblu/data-science

Gitbook of data science and statistics tasks I want to remember

data-science gitbook r rmarkdown statistics

Last synced: 22 Jul 2025

https://github.com/haloapping/cotomks

Kumpulan referensi untuk belajar mengenai pemrograman Python, Data Science, Machine Learning dan Deep Learning.

data-science deep-learning machine-learning model-evaluation probabilistic statistics time-series

Last synced: 04 Jul 2026

https://github.com/eikevons/pandas-paddles

Access the parent Pandas data frame in loc[], iloc[], assign(), and others Pandas helpers

data-analysis data-exploration data-science pandas pandas-dataframe pandas-library pandas-loc

Last synced: 16 Jun 2025

https://github.com/tushar2704/store-demand-forecasting

This project predicts the sales demand for various items in different stores based on historical sales data. The objective is to develop a machine learning model that can provide accurate forecasts for future sales of each store-item combination.

artifi data-analysis data-science python sales-analysis sales-forecasting tushar2704

Last synced: 04 Nov 2025

https://github.com/zapier/awsjavasdk

Boilerplate rJava Access to the AWS Java SDK

awsjavasdk cran data-science

Last synced: 14 Apr 2025

https://github.com/chiraag-kakar/pubg

What's the best strategy to win in PUBG? Should you sit in one spot and hide your way into victory, or do you need to be the top shot? Let's let the data do the talking!

data-science feature-engineering machine-learning-algorithms project pubg-api random-forest

Last synced: 07 May 2025

https://github.com/fmv1992/data_utilities

Data utilities library focused on machine learning and data analysis.

data-science utility-library

Last synced: 14 Mar 2025

https://github.com/alvarobartt/twipper

Python Twitter API Wrapper for both Free and Premium plans

api-wrapper data-science python twitter twitter-api

Last synced: 12 Apr 2025

https://github.com/hevalhazalkurt/exploring_the_data_of_lego_history

A data exploration project on LEGO history in Python with pandas, matplotlib etc. (WIP)

data data-analysis data-science data-visualization datascience datasets lego lego-history matplotlib pandas python python3

Last synced: 13 Apr 2025

https://github.com/zai-kun/2d-chess-pieces-detection

YOLO11n model for detecting 2d chess board and pieces

ai chess data-science machine-learning onnxruntime python yolov11

Last synced: 19 Jul 2025

https://github.com/onlyphantom/infratools

Kickstart Session: Infrastructure and Tools for Data Science workshop materials

data-science datascience workshop workshop-materials

Last synced: 14 Apr 2025

https://github.com/hmiladhia/piskle

A serialization package optimized for scikit-learn

data-science machine-learning python scikit-learn serialization

Last synced: 28 Oct 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/RemiRigal/DatasetExplorer

A web tool for local dataset browsing and processing developped using the Flask + Angular stack.

ai angular data-processing data-science data-visualization dataset dataset-analysis docker docker-compose flask web-application

Last synced: 30 Jul 2025

https://github.com/RDeconomist/RDeconomist.github.io

RapidCharts - a site for teaching and demonstrating Data Science and Visualisation techniques

data data-science data-visualization economics politics sports

Last synced: 08 Apr 2025

https://github.com/koldlight/r4ds

R for data science course

course data-analysis data-science data-viz r

Last synced: 30 Apr 2025

https://github.com/davidssmith/rawarray.jl

Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage

bytes complex-numbers data-science file-format julia large-dataset large-files ra-format rawarray scientific-computing storage

Last synced: 10 Sep 2025

https://github.com/mine-cetinkaya-rundel/tidymodels-uscots-2021

Materials for the "Tidy up your models" workshop at USCOTS 2021

data-science modeling rstats statistics tidymiodels tidyverse

Last synced: 08 Apr 2025

https://github.com/wgierke/git_better

3rd-placed solution for the informatiCup2017

data-science docker docker-image heroku machine-learning tensorboard

Last synced: 24 Mar 2025

https://github.com/sarincr/python-app-development-using-kivy

Kivy is a Python library that supports cross-platform development. That means you can use a single code base to create Android, iOS, and even Windows, Linux, and MacOS apps. Kivy provides flexible, modern UI elements and, of course, let's you keep using your new favorite language to build it all!

android app appdevelopment cross-platform data-science desktop-app gtk gui kivy kivy-application kivy-framework kivymd machine-learning pyqt pyqt5 pyside tensorflow tkinter tkinter-gui tkinter-python

Last synced: 12 Apr 2025

https://github.com/aianytime/fishvision

FishVision built using Streamlit identifies the different species of Fishes in a given image. It is trained on "A Large Scale Fish Data" available on Kaggle using the pre-trained model "MobileNetV2".

data-science deep-learning deep-neural-networks heroku heroku-deployment machine-learning machine-learning-algorithms mobilenetv2 python python3 streamlit streamlit-webapp

Last synced: 01 Sep 2025

https://github.com/datadistillr/datadistillr-python-sdk

A Python SDK for Programmatically Interacting with DataDistillr

apache-drill data data-science datadistillr jupyter sql

Last synced: 01 Jul 2025

https://github.com/richardleighdavies/prompt-engineering-in-practice

Practical code examples and implementations from the book "Prompt Engineering in Practice". Demonstrates text generation, prompt chaining, and prompt routing using Python and LangChain. Features real-world examples of interacting with OpenAI's GPT models, structured output handling, and multi-step prompt workflows.

ai artificial-intelligence chatbot data-science deep-learning gpt langchain llm machine-learning natural-language-processing nlp openai prompt-engineering pydantic python text-generation

Last synced: 15 Apr 2025

https://github.com/tikerlade/ml-art-spbsu-sirius-2024

Материалы одного курса по ML & Art со смены в МКН Сириус 2024

art data-science orange

Last synced: 29 Jul 2025

https://github.com/cpeoples/powerpredict

🔮 AI-powered Powerball & Mega Millions lottery number prediction using deep learning (Transformer + LSTM), Markov chains, and statistical analysis. Built with TensorFlow/Keras 3.

artificial-intelligence data-science deep-learning keras lottery-prediction lstm machine-learning markov-chain megamillions neural-network powerball python scikit-learn statistical-analysis tensorflow texas-lottery transformer

Last synced: 21 May 2026

https://github.com/boada/insight_challenges

Data Science Challenges for Insight

data-science insight-data-science

Last synced: 15 Apr 2025

https://github.com/jackgerrits/reductionml

Reduction-based machine learning framework with a focus on contextual bandits

contextual-bandits data-science machine-learning online-learning rust

Last synced: 10 Apr 2025

https://github.com/moykeen/supermjo-py

Python interface to Super-Mjograph

data-science graph mac matplotlib plot python visualization

Last synced: 09 Apr 2025

https://github.com/gregyjames/volumeprofiles

Use volume transactions to find significant price levels

data-science python statistics stock stock-analysis stock-price-prediction stocks stocks-prices

Last synced: 25 Apr 2025

https://github.com/yusufcinarci/web-scraping-projects

In these project files, I will host the web scraping examples that I will make day by day.

data-analysis data-science jupyter-notebook python web-scraping

Last synced: 01 May 2025

https://github.com/sanketrs/implementation-of-modern-data-engineering-architecture-with-fabric_analytics

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

azure azure-data-factory azure-fabric bi-analytics big-data-analytics big-data-projects cloud-data-warehouse cloud-dataflow data-analytics data-engineering data-engineering-pipeline data-engineering-project data-pipeline-monitoring data-science data-visualization data-warehouse etl etl-framework etl-pipeline

Last synced: 14 Apr 2026

https://github.com/zaman-hamza/citadel-datathon

My submission to the 2022 East Coast Datathon. The event started on the 21st of March and ended on the 28th, lasting about a whole week. I was in a team of two where we analyzed the non-conventional indicators and instigators of traffic.

citadel data-science data-visualization datathon

Last synced: 10 Apr 2025

https://github.com/timkoornstra/fintwitbert

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

ai bert cryptocurrency data-science financial-tweets fintech fintwitbert language-model machine-learning nlp python sentiment-analysis stock-market trend-prediction twitter-data

Last synced: 14 Apr 2025

https://github.com/sminerport/sminerport

My GitHub portfolio showcasing personal projects, coding skills, and expertise in Software Development, Data Analytics, and AI/ML. Get in touch for collaboration!

artificial-intelligence data-analytics data-science machine-learning natural-language-processing neural-networsk sequence-prediction software-development

Last synced: 15 Aug 2025

https://github.com/stefanrmmr/kaggle_twitter_airline_sentiment

Kaggle Twitter US Airline Sentiment, Implementation of a Tweet Text Sentiment Analysis Model, using custom trained Word Embeddings and LSTM-Deep learning [TUM-Data Analysis&ML summer 2021] @adrianbruenger @stefanrmmr

data-science deep-learning kaggle-airline-dataset kaggle-sentiment-analysis kaggle-us-airlines lstm-neural-networks python sentiment-analysis skipgram text-sentiment-classification tweepy tweet-classification tweet-sentiment-analysis twitter twitter-sentiment-analysis us-airline-dataset word2vec

Last synced: 19 Mar 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/tuliosg/cdp

Repositório do curso "Ciência de Dados para Pesquisa".

data-analysis data-manipulation data-science data-visualization google-colab jupyter-notebook python

Last synced: 03 Mar 2026

https://github.com/trafficgcn/optimal_path_dijkstra_for_data_science

Plotting the Optimal Route in Python for Data Scientists using the Dijkstra Algorithm

data-science dijkstra dijkstra-algorithm dijkstra-shortest-path map mapping open-street-map optimal-route osm osmnx python

Last synced: 27 Oct 2025

https://github.com/pufanyi/genderrecognitionbyvoice

NTU SC1015 Group Project - Gender Recognition by Voice

data-science machine-learning voice-recognition

Last synced: 09 Feb 2026

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/milos-agathon/forest_map_europe

This repo demonstrates how to easily overlay community polygons on forest cover data and make a beautiful map using R and ggplot2

data-science data-visualization ggplot2 gis r satellite-imagery spatial-analysis zonal-statistics

Last synced: 04 Apr 2026

Data Science Awesome Lists
awesome-datascience 944 Awesome-pytorch-list 707 awesome-bigdata 668 awesome-R 486 awesome-mlops 314 awesome-jupyter 208 awesome-computer-science-opportunities 153 awesome-python-data-science 382 football_analytics 56 awesome-public-real-time-datasets 83 awesome-business-intelligence 231 awesome-streamlit 101 awesome-fraud-detection-papers 225 yt-channels-DS-AI-ML-CS 195 awesome-generative-ai-data-scientist 180 awesome-google-colab 73 awesome-data-analysis 936 CV-pretrained-model 103 StarryDivineSky 108 awesome-learn-datascience 43 data-science-with-ruby 101 awesome-r-learning-resources 140 awesome-data 32 awesome-feature-engineering 69 awesome-data-agents 155 awesome-time-series-segmentation-papers 135 awesome-ai 493 DMG-Data-Science-Awesome 198 awesome-materials-informatics 133 ai-catalog 294 awesome-python 956 Awesome-Distributed-Deep-Learning 44 machine-learning-resources 56 Data-Science 71 awesome-h2o 96 awesome-data-centric-ai 31 awesome-scientific-python 131 awesome-ml-blogs 95 awesome-arcgis-developers 182 data-science-learning-path 70 100-AI-Machine-learning-Deep-learning-Computer-vision-NLP 244 Data-Engineering-Roadmap 119 awesome-code-benchmark 232 awesome-kubeflow 152 awesome-python-machine-learning-resources 1,884 awesome-data-contracts 58 awesome-Iran-datasets 82 awesome-AI-tutorials-surveys 134 recommendations-for-engineers 1,200 awesome-computer-vision-resources 307
Data Science Categories
A01_文本生成_文本对话 2,414 Uncategorized 1,827 Languages 1,012 前端开发框架及项目 767 Books 624 The Data Science Toolbox 599 Table of Contents 590 其他_机器学习与深度学习 550 Machine Learning 531 100 + 𝗔𝗿𝘁𝗶𝗳𝗶𝗰𝗶𝗮𝗹 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗟𝗶𝘀𝘁 𝘄𝗶𝘁𝗵 𝗰𝗼𝗱𝗲 495 Research Articles and Reports 424 Python 406 Literature and Media 385 网络服务 368 Data Versioning for Machine Learning 361 Awesome Resources 356 Paper implementations 341 后端开发框架及项目 319 其他_机器视觉 315 Tools 298