An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/blmoore/summerdatachallenge

My entry for: http://summerdatachallenge.com (I came 3rd)

analytics data-science london r real-estate rstats

Last synced: 30 Apr 2025

https://github.com/negativenagesh/whatsapp_chat_analyzer

This is an end to end project of whatsapp chat analysis, here I have used my hostel whatsapp group's chat data.

data-analysis data-science frontend modeling python streamlit

Last synced: 12 Apr 2025

https://github.com/octoenergy/s3migrate

Bulk delete/copy/move files or modify Hive/Drill/Athena partitions using pythonic pattern matching

data data-science

Last synced: 24 Jun 2025

https://github.com/jcolechanged/josh.meanings

A k means implementation in Clojure which supports clustering on larger than memory but smaller than storage datasets.

assumption-free-k-mc clojure-library clustering data-science k-mc k-means k-means-clustering k-means-parallel k-means-plus-plus machine-learning medium-data

Last synced: 13 Apr 2025

https://github.com/tensorsense/vlm_databuilder

This SDK generates datasets for training Video LLMs from youtube videos.

data-generation data-science llm video-llms vlm

Last synced: 11 Sep 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/eikevons/pandas-paddles

Access the parent Pandas data frame in loc[], iloc[], assign(), and others Pandas helpers

data-analysis data-exploration data-science pandas pandas-dataframe pandas-library pandas-loc

Last synced: 16 Jun 2025

https://github.com/nationalparkservice/qckit

QCkit provides useful functions for data quality control and manipulation including updating data to DarwinCore standards, unit conversions, and data flagging.

darwin-core data-quality data-science npsdataverse quality-control r r-package rstats

Last synced: 22 Jun 2025

https://github.com/adamvvu/snapshot_ensemble

Train TensorFlow Keras models with cosine annealing and save an ensemble of models with no additional computational expense.

data-science deep-learning keras machine-learning python tensorflow

Last synced: 28 Oct 2025

https://github.com/leomaurodesenv/data-science-api-framework

A simple framework to test and deploy your Data Science API

api api-rest data-science dataops docker flask-api python

Last synced: 09 Sep 2025

https://github.com/yusufcinarci/web-scraping-projects

In these project files, I will host the web scraping examples that I will make day by day.

data-analysis data-science jupyter-notebook python web-scraping

Last synced: 01 May 2025

https://github.com/hunterdii/iriswise

IrisWise is a machine learning application for predicting Iris flower species. Built with Streamlit, this app provides a user-friendly interface to input flower measurements and receive predictions using various models, including K-Nearest Neighbors, (Random Forest, SVM, and Logistic Regression) **(Working On It...)**.

classifier-model data-science flowers-recognition iris-dataset iris-recognition knn-classification machine-learning pickle python python3 streamlit streamlit-webapp

Last synced: 21 Feb 2026

https://github.com/orkunaktas/wine-quality-prediction

๐Ÿท๐Ÿ”ฌ Wine Quality and Forecast ๐Ÿพ๐Ÿ‡

alcohol data-science logistic-regression wine-quality

Last synced: 08 Sep 2025

https://github.com/jbris/stan-cmdstanr-gpu-docker

A Docker image to run Stan, cmdstanr, and brms for Bayesian statistical modelling. GPU support using OpenCL is available.

bayes bayesian-inference brms cmdstan cmdstanr data-science docker posterior probabilistic-programming projpred rstan rstanarm shinystan stan stan-gpu stan-lang stan-math-library tidybayes tidyverse

Last synced: 04 May 2025

https://github.com/polakowo/textai

Applications using state-of-the-art in NLP

bert data-science gpt-2 machine-learning nlp telegram-bot transformers

Last synced: 07 May 2025

https://github.com/stefanrmmr/kaggle_twitter_airline_sentiment

Kaggle Twitter US Airline Sentiment, Implementation of a Tweet Text Sentiment Analysis Model, using custom trained Word Embeddings and LSTM-Deep learning [TUM-Data Analysis&ML summer 2021] @adrianbruenger @stefanrmmr

data-science deep-learning kaggle-airline-dataset kaggle-sentiment-analysis kaggle-us-airlines lstm-neural-networks python sentiment-analysis skipgram text-sentiment-classification tweepy tweet-classification tweet-sentiment-analysis twitter twitter-sentiment-analysis us-airline-dataset word2vec

Last synced: 19 Mar 2025

https://github.com/vedadiyan/genql

GenQL is a generic querying language fully written in Go

data-analysis data-mapping data-processing data-science data-translation json json-data sql

Last synced: 22 Jun 2025

https://github.com/praveen1664/chatbot

This is a chatbot written in python & getting inputs directly from sql database

chatbot data-science database json nlp python3 sqlite sqlite3

Last synced: 11 Jul 2025

https://github.com/rahul-jha98/restauranttrends.stats

Visualise the trends in food and restaurant choices of customers in a city by scraping data from Zomato.

data-analysis data-science visualization vuejs zomato zomato-api zomato-scraper

Last synced: 08 Jul 2025

https://github.com/iguptashubham/online-retail-sales

This Power BI dashboard, designed for marketing strategists, analyzes sales trends and customer behavior. It provides key insights empowering them to identify sales opportunities and optimize marketing campaigns, ultimately boosting business sales.

dashboard data data-analysis data-analysis-project data-analysis-project-powerbi data-analysis-python data-project data-science powerbi project

Last synced: 19 Mar 2026

https://github.com/whizsid/kddbscan-rs

A rust library inspired by kDDBSCAN clustering algorithm

clustering data-science density-based-clustering deviation machine-learning-algorithms pinned

Last synced: 10 Apr 2025

https://github.com/hevalhazalkurt/exploring_the_data_of_lego_history

A data exploration project on LEGO history in Python with pandas, matplotlib etc. (WIP)

data data-analysis data-science data-visualization datascience datasets lego lego-history matplotlib pandas python python3

Last synced: 13 Apr 2025

https://github.com/carlos-gg/digitalgarden

NO LONGER MAINTAINED. Go to: https://aigarden.vercel.app/

artificial-intelligence data-science digital-garden knowledge-management machine-learning

Last synced: 07 May 2025

https://github.com/mshenfield/subreddit_algebra

A python port and frontend to 538's subreddit analysis

data-science data-visualization reddit

Last synced: 13 Apr 2025

https://github.com/rvandewater/ReciPies

๐ŸฅงReciPys: easily define and execute preprocessing and feature engineering steps on Polars and Pandas dataframes.

data-science pandas polars python scikit-learn tidymodels

Last synced: 24 Oct 2025

https://github.com/crissyro/base-of-ds

This repository serves as a foundation for projects in Data Science and Machine Learning.

clustering-algorithm data-science data-visualization machine-learning

Last synced: 04 Jul 2025

https://github.com/lucasrodes/pyphoon

Tools for Digital Typhoon DL/ML Project

data-science dataset environment machine-learning tropical-cyclone

Last synced: 18 Mar 2025

https://github.com/gjtorikian/destroy-all-monuments

This is data taken from the SPLC report titled "Whose Heritage? Public Symbols of the Confederacy" from April 21, 2016

data-science government-data social-justice

Last synced: 10 Apr 2025

https://github.com/kzndotsh/gang.guide

Evidence backed mapping of criminal organizations across the US โ€” alliances, rivalries, history, and culture.

ai crime data-analysis data-science data-visualization dataset gangs konva konvajs llm organized-crime python svelte sveltekit tailwind typescript

Last synced: 03 Jul 2026

https://github.com/marianogappa/sctool

Starcraft: Remastered replay analyzer library and CLI tool

cli cli-app data-science replays starcraft starcraft-broodwar starcraft-remastered

Last synced: 17 Apr 2026

https://github.com/amirhosseinhonardoust/algorithmic-empath-human-fallibility

A deep exploration of Algorithmic Empathy, the next frontier in AI understanding. This project examines how machines can learn from human fallibility, model disagreement, and align with moral reasoning. It blends psychology, fairness metrics, interpretability, and co-learning design into one framework for humane intelligence.

ai algorithmic-bias co-learning cognitive-science data-science empathy ethics fairness human-centered-ai intelligence interpretability machine-learning neural-networks neurosymbolic philosophy psychology reflective-ai research responsible-ai xai

Last synced: 28 Feb 2026

https://github.com/tuliosg/cdp

Repositรณrio do curso "Ciรชncia de Dados para Pesquisa".

data-analysis data-manipulation data-science data-visualization google-colab jupyter-notebook python

Last synced: 03 Mar 2026

https://github.com/pufanyi/genderrecognitionbyvoice

NTU SC1015 Group Project - Gender Recognition by Voice

data-science machine-learning voice-recognition

Last synced: 09 Feb 2026

https://github.com/fburic/pandance

Advanced relational operations for pandas DataFrames

data-analysis data-science data-wrangling pandas

Last synced: 27 Jun 2026

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

https://github.com/aianytime/fishvision

FishVision built using Streamlit identifies the different species of Fishes in a given image. It is trained on "A Large Scale Fish Data" available on Kaggle using the pre-trained model "MobileNetV2".

data-science deep-learning deep-neural-networks heroku heroku-deployment machine-learning machine-learning-algorithms mobilenetv2 python python3 streamlit streamlit-webapp

Last synced: 01 Sep 2025

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/curiousily/linear-regression-with-tensorflow-js

Build a Linear Regression model using TensorFlow.js and use to predict house prices

artificial-intelligence data-science javascript linear-regression machine-learning tensorflow tensorflowjs

Last synced: 01 Sep 2025

https://github.com/joschnitzbauer/dalymi

A lightweight, data-focused and non-opinionated pipeline manager written in and for Python.

dag data data-science pipeline python workflow

Last synced: 14 Jan 2026

https://github.com/akcarsten/non_negative_matrix_factorization

From scratch Python implementation of the Non-Negative Matrix Factorization algorithm.

clustering data-science machine-learning python

Last synced: 11 Mar 2026

https://github.com/jasonmdev/guidedprojects

As part of the DataQuest Curriculum, guided projects are less structured and focus more on exploration.

data-science jupyter-notebook

Last synced: 14 May 2025

https://github.com/chris-santiago/steps

A SciKit-Learn style feature selector using best subsets and stepwise regression.

best-subset-selection data-science python scikit-learn stepwise-selection

Last synced: 28 Jun 2025

https://github.com/frobnitzem/mpi_list

A package for working with lists distributed over MPI

data-science hpc map-reduce mpi4py

Last synced: 18 Mar 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/shreyamalogi/mushroom-mystery

Can You Eat That? ๐Ÿ„ Let Data Decide.

classification data-analysis data-science eda machine-learning python

Last synced: 06 Nov 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/aqafridi/data-analytics-specialization

In this Specialization of Data Analytics we will use systematic computational analysis of data or statistics using Python. (rarely Excel or Cognos)

beautifulsoup cognos-dashboard data-science data-visualization excel numpy pandas python sql

Last synced: 21 Sep 2025

https://github.com/lockedata/opentrainingcontent

An MIT & CCBY4.0 licensed repository of training materials from Locke Data

data-science open-course r-stats

Last synced: 29 Jul 2025

https://github.com/redhat-na-ssa/demo-ocp-gpu

Show some magic around GPUs on OpenShift

code-server data-science gpu nvidia

Last synced: 30 Jul 2025

https://github.com/RemiRigal/DatasetExplorer

A web tool for local dataset browsing and processing developped using the Flask + Angular stack.

ai angular data-processing data-science data-visualization dataset dataset-analysis docker docker-compose flask web-application

Last synced: 30 Jul 2025

https://github.com/jackgerrits/reductionml

Reduction-based machine learning framework with a focus on contextual bandits

contextual-bandits data-science machine-learning online-learning rust

Last synced: 10 Apr 2025

https://github.com/aiscalate/aiscalator

Tools to streamline Jupyter Notebook Prototypes into robust Data Products

airflow airflow-docker data-engineering data-science jupyter jupyter-notebook jupyterlab

Last synced: 26 Sep 2025

https://github.com/mribeirodantas/vidente

R package to parse and preprocess the Surveillance, Epidemiology, and End Results (SEER) Program data from NIH/NCI

cancer-patients cancer-research data-analysis data-science data-structures r-package seer

Last synced: 14 Apr 2025

https://github.com/systemvll/hcaptcha-dataset-scraper

A simple nodejs script that return hcaptcha images and prompt for training AI.

ai data-science dataset hcaptcha hcaptcha-solver machine-learning

Last synced: 03 Aug 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/erictleung/tutorial-tidyverse

:milky_way: Presentation on the tidyverse in R to clean and manipulate data

data-cleaning data-manipulation data-science manipulate-data presentation programming r tidyverse tutorial

Last synced: 25 Mar 2025

https://github.com/sebiwtt/flaskriver

This is a repository for the open-source project flaskriver which will make it easier to combine the lightweight web-framework flask with the online-ML library river.

data-science flask machine-learning online-learning python river streaming

Last synced: 05 Jul 2025

https://github.com/zapier/awsjavasdk

Boilerplate rJava Access to the AWS Java SDK

awsjavasdk cran data-science

Last synced: 14 Apr 2025

https://github.com/mine-cetinkaya-rundel/tidymodels-uscots-2021

Materials for the "Tidy up your models" workshop at USCOTS 2021

data-science modeling rstats statistics tidymiodels tidyverse

Last synced: 08 Apr 2025

https://github.com/ahammadmejbah/becoming-a-python-developer

Becoming a Python developer involves mastering the Python programming language, understanding its syntax, and learning popular frameworks. Gain proficiency in web development, data analysis, or automation. Collaborate on projects, build a strong portfolio, and stay updated on industry trends to excel in this dynamic and versatile field.

algorithms algorithms-and-data-structures data-science deep deep-learning deep-neural-networks machine-learning machine-learning-algorithms machinelearning python python3

Last synced: 11 Jun 2025

https://github.com/milos-agathon/create-railway-map-from-osm

Eager to use OpenStreetMap country-level data from GeoFabrik to create pretty maps but didn't know how? This repo shows 2 ways to download, process and map OSM data

data-science data-visualization geospatial ggplot2 gis maps openstreetmap r sf tidyverse

Last synced: 04 Apr 2026

https://github.com/prakalp-pande/twitter-sentiment-analysis

Analyze public opinion on Tweet by mining and processing live Twitter data. Employ machine learning to classify tweets as positive, negative, or neutral, then visualize sentiment trends and identify key influencers.

data-science twitter-sentiment-analysis

Last synced: 18 Aug 2025

https://github.com/flrs/build_and_test_ml_quickly

From idea to production in a day: Leveraging Azure ML and Streamlit to build and user test machine learning ideas quickly (Talk at PyCon DE & PyData Berlin 2024)

agile-development azure-application-insights azure-machine-learning data-science machine-learning streamlit streamlit-feedback

Last synced: 21 Apr 2025

https://github.com/rwallan/openiziai

Interface para se comunicar com a api da OpenAI adotando as melhores prรกticas de LLM para criar e se comunicar com um agente.

data-science ia llm openai pydantic-v2 python3

Last synced: 19 Apr 2025

https://github.com/richardleighdavies/prompt-engineering-in-practice

Practical code examples and implementations from the book "Prompt Engineering in Practice". Demonstrates text generation, prompt chaining, and prompt routing using Python and LangChain. Features real-world examples of interacting with OpenAI's GPT models, structured output handling, and multi-step prompt workflows.

ai artificial-intelligence chatbot data-science deep-learning gpt langchain llm machine-learning natural-language-processing nlp openai prompt-engineering pydantic python text-generation

Last synced: 15 Apr 2025

https://github.com/andersy005/dask-notebooks

Dask tutorials for Big Data Analysis and Machine Learning as Jupyter notebooks

dask data-science distributed-computing jupyter-notebook parallel-computing python

Last synced: 30 Aug 2025

https://github.com/labrijisaad/data-scientist-tools-pandas

In this hands-on training notebook, we'll see all the basics of the Pandas library used for data science/data analysis and machine learning tasks.

data-analysis data-science dataframe-objects machine-learning pandas python series-objects

Last synced: 08 Apr 2025

https://github.com/ai-naymul/ats-catalyst

ATS Catalyst is an innovative platform designed to empower job seekers and streamline the hiring process. Leveraging advanced AI technologies, our suite of tools offers personalized feedback, resume evaluation, and job description matching to enhance your job application process.

ai application-tracking-system ats data-science langchain machine-learning open-source opensource-projects opensourceforgood python streamlit-application

Last synced: 05 May 2025

https://github.com/boada/insight_challenges

Data Science Challenges for Insight

data-science insight-data-science

Last synced: 15 Apr 2025