An open API service indexing awesome lists of open source software.

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/blmoore/summerdatachallenge

My entry for: http://summerdatachallenge.com (I came 3rd)

analytics data-science london r real-estate rstats

Last synced: 30 Apr 2025

https://github.com/vedadiyan/genql

GenQL is a generic querying language fully written in Go

data-analysis data-mapping data-processing data-science data-translation json json-data sql

Last synced: 22 Jun 2025

https://github.com/octoenergy/s3migrate

Bulk delete/copy/move files or modify Hive/Drill/Athena partitions using pythonic pattern matching

data data-science

Last synced: 24 Jun 2025

https://github.com/polakowo/textai

Applications using state-of-the-art in NLP

bert data-science gpt-2 machine-learning nlp telegram-bot transformers

Last synced: 07 May 2025

https://github.com/negativenagesh/whatsapp_chat_analyzer

This is an end to end project of whatsapp chat analysis, here I have used my hostel whatsapp group's chat data.

data-analysis data-science frontend modeling python streamlit

Last synced: 12 Apr 2025

https://github.com/stefanrmmr/kaggle_twitter_airline_sentiment

Kaggle Twitter US Airline Sentiment, Implementation of a Tweet Text Sentiment Analysis Model, using custom trained Word Embeddings and LSTM-Deep learning [TUM-Data Analysis&ML summer 2021] @adrianbruenger @stefanrmmr

data-science deep-learning kaggle-airline-dataset kaggle-sentiment-analysis kaggle-us-airlines lstm-neural-networks python sentiment-analysis skipgram text-sentiment-classification tweepy tweet-classification tweet-sentiment-analysis twitter twitter-sentiment-analysis us-airline-dataset word2vec

Last synced: 19 Mar 2025

https://github.com/leomaurodesenv/data-science-api-framework

A simple framework to test and deploy your Data Science API

api api-rest data-science dataops docker flask-api python

Last synced: 09 Sep 2025

https://github.com/hevalhazalkurt/exploring_the_data_of_lego_history

A data exploration project on LEGO history in Python with pandas, matplotlib etc. (WIP)

data data-analysis data-science data-visualization datascience datasets lego lego-history matplotlib pandas python python3

Last synced: 13 Apr 2025

https://github.com/nationalparkservice/qckit

QCkit provides useful functions for data quality control and manipulation including updating data to DarwinCore standards, unit conversions, and data flagging.

darwin-core data-quality data-science npsdataverse quality-control r r-package rstats

Last synced: 22 Jun 2025

https://github.com/nikbarb810/pattern-recognition

Basic pattern recognition algorithms implemented in Python

data-science ipynb-jupyter-notebook matplotlib numpy pattern-recognition python

Last synced: 06 Mar 2026

https://github.com/rajveersinghcse/data-science

๐Ÿ‘€If you are looking for ๐Ÿ“ˆ Data Science Material. This Repository is good for you to get some basic knowledge.

data-science data-science-material

Last synced: 10 Sep 2025

https://github.com/rahul-jha98/restauranttrends.stats

Visualise the trends in food and restaurant choices of customers in a city by scraping data from Zomato.

data-analysis data-science visualization vuejs zomato zomato-api zomato-scraper

Last synced: 08 Jul 2025

https://github.com/crissyro/base-of-ds

This repository serves as a foundation for projects in Data Science and Machine Learning.

clustering-algorithm data-science data-visualization machine-learning

Last synced: 04 Jul 2025

https://github.com/praveen1664/chatbot

This is a chatbot written in python & getting inputs directly from sql database

chatbot data-science database json nlp python3 sqlite sqlite3

Last synced: 11 Jul 2025

https://github.com/gbeckers/birdwatcher

A Python computer vision library for animal behavior

animal behavior computer-vision data-science ffmpeg opencv python science

Last synced: 13 Oct 2025

https://github.com/tuliosg/cdp

Repositรณrio do curso "Ciรชncia de Dados para Pesquisa".

data-analysis data-manipulation data-science data-visualization google-colab jupyter-notebook python

Last synced: 03 Mar 2026

https://github.com/newjerseystyle/litepolis

The package manager of a Customizable e-democracy opinion collection and insight mining system. Built using Python and optimized for scalability and performance.

civic-tech data-science deliberative-democracy litepolis package-manager participatory-democracy

Last synced: 28 Feb 2026

https://github.com/hritik5102/shala2020

MastAI ki paathSHALA : Data Science, Machine Learning, and Deep Learning codes with explanation and reference links ๐Ÿ‘จโ€๐Ÿ’ป

artificial-intelligence computer-vision data-science deep-learning machine-learning statistics

Last synced: 12 Oct 2025

https://github.com/pfed-prog/catalonia_data

we have analyzed air quality in Catalonia by using the data from the Catalan Transparency Portal.

data-science dspyt jupyter-notebook ocean oceanprotocol python3

Last synced: 05 Oct 2025

https://github.com/amirhosseinhonardoust/algorithmic-empath-human-fallibility

A deep exploration of Algorithmic Empathy, the next frontier in AI understanding. This project examines how machines can learn from human fallibility, model disagreement, and align with moral reasoning. It blends psychology, fairness metrics, interpretability, and co-learning design into one framework for humane intelligence.

ai algorithmic-bias co-learning cognitive-science data-science empathy ethics fairness human-centered-ai intelligence interpretability machine-learning neural-networks neurosymbolic philosophy psychology reflective-ai research responsible-ai xai

Last synced: 28 Feb 2026

https://github.com/hodgesmr/biden_nlp

Jupyter Notebook that introduces BIDEN: Binary Inference Dictionaries for Electoral NLP. It demonstrates a compression-based binary classification technique that is fast at both training and inference on common CPU hardware in Python

compression data-science machine-learning natural-language-processing nlp zstandard zstd

Last synced: 22 Jan 2026

https://github.com/raynardj/forgebox

The deep learning tool box

data-science machine-learning nlp pandas-dataframe

Last synced: 16 Oct 2025

https://github.com/marianogappa/sctool

Starcraft: Remastered replay analyzer library and CLI tool

cli cli-app data-science replays starcraft starcraft-broodwar starcraft-remastered

Last synced: 17 Apr 2026

https://github.com/altescy/dacompe-27-jleague

Jใƒชใƒผใ‚ฐ่ฆณๅฎขๅ‹•ๅ“กๆ•ฐใ‚’ไบˆๆธฌใ›ใ‚ˆ๏ผใ€็ทด็ฟ’ๅ•้กŒใ€‘ https://deepanalytics.jp/compe/27/

data-science

Last synced: 08 Oct 2025

https://github.com/ngupta23/more

This is a helper package for pandas, visualizations and scikit-learn

data-science helpers pandas python scikit-learn visualization visualizations

Last synced: 24 Oct 2025

https://github.com/ucbds-infra/ds-course-infra-guide

An educator's guide to creating a data science course

data-science jupyter jupyter-book

Last synced: 07 Oct 2025

https://github.com/emiruz/dataset-tools

Easy to use library for working with core.matrix datasets in Clojure: select, where, aggregate, join, order, cross-tab, from/to-dataset, etc

data-mining data-science dataset dsl matrix sql

Last synced: 22 Oct 2025

https://github.com/arbaznazir/datalineagepy

86% faster data lineage tracking for pandas DataFrames with zero infrastructure. Real-time monitoring, ML anomaly detection, and enterprise compliance features.

anomaly-detection data-eng data-governance data-lineage data-quality data-science dataframes enterprise etl lineage-tracing machine-learning pandas python

Last synced: 28 Apr 2026

https://github.com/hughbe/facebook.net

A WIP Facebook Graph API client for .NET, used for the Facebook Civic Insights project by The Asia Foundation's Cambodia office

asia-foundation data-science facebook facebook-api facebook-graph-api

Last synced: 17 Mar 2026

https://github.com/milos-agathon/forest_map_europe

This repo demonstrates how to easily overlay community polygons on forest cover data and make a beautiful map using R and ggplot2

data-science data-visualization ggplot2 gis r satellite-imagery spatial-analysis zonal-statistics

Last synced: 04 Apr 2026

https://github.com/sevdanurgenc/r-programming-for-data-science-lecture-notes

In this repo, I have the course contents of R Programming For Data Science training, which will be given to Sigorta Bilgi ve Gรถzetim Merkezi by the cooperation of Academy Peak Information Technologies Training and Consultancy between 21 - 23 March 2023.

data-analysis data-science data-visualization r r-programming r-programming-projects

Last synced: 11 Oct 2025

https://github.com/tushar2704/store-demand-forecasting

This project predicts the sales demand for various items in different stores based on historical sales data. The objective is to develop a machine learning model that can provide accurate forecasts for future sales of each store-item combination.

artifi data-analysis data-science python sales-analysis sales-forecasting tushar2704

Last synced: 04 Nov 2025

https://github.com/seporaitis/hsaur-python

Various exercises from the book "Handbook of Statistical Analysis Using R" done in Python

bokeh books data-science hsaur learning-by-doing learning-pandas pandas python r seaborn statistical-analysis statistics tutorial

Last synced: 09 Apr 2025

https://github.com/timkoornstra/fintwitbert

FinTwitBERT: Specialized BERT Model for Financial Twitter Analysis. Trained on vast financial tweets, it's ideal for sentiment analysis, trend prediction, and financial NLP tasks.

ai bert cryptocurrency data-science financial-tweets fintech fintwitbert language-model machine-learning nlp python sentiment-analysis stock-market trend-prediction twitter-data

Last synced: 14 Apr 2025

https://github.com/spsanderson/steveondata

Repository for mainly R tips and tricks for my blog. I also include some VBA, SQL, C and Linux Usage.

ai blog c data data-science linux machinelearning-r ml ms-sql r sql time-series tipoftheday vba vba-excel

Last synced: 07 Apr 2025

https://github.com/erictleung/data-science

:computer: Repository for teaching materials and notes on machine learning and data science for freeCodeCamp

data-cleaning data-engineering data-science data-visualization freecodecamp learning machine-learning mathematics notes python statistics

Last synced: 25 Mar 2025

https://github.com/labrijisaad/data-scientist-tools-pandas

In this hands-on training notebook, we'll see all the basics of the Pandas library used for data science/data analysis and machine learning tasks.

data-analysis data-science dataframe-objects machine-learning pandas python series-objects

Last synced: 08 Apr 2025

https://github.com/flrs/build_and_test_ml_quickly

From idea to production in a day: Leveraging Azure ML and Streamlit to build and user test machine learning ideas quickly (Talk at PyCon DE & PyData Berlin 2024)

agile-development azure-application-insights azure-machine-learning data-science machine-learning streamlit streamlit-feedback

Last synced: 21 Apr 2025

https://github.com/raoumer/dwx

Deep Web Extractor (DWX): Deep Web Extractor system is using statistical machine learning models for crawling and data discovery from the Deep Web (i.e., massive and quality portion of World Wide Web) to build knowledge based databases.

data-discovery data-science data-visualization machine-learning python

Last synced: 09 Mar 2026

https://github.com/sondosaabed/oil-vs-bigtech-stock-investigation

๐Ÿ’น๐Ÿ“ˆInvestigating the oils market prices in addition to the stock market prices between the start of 2001 to the end of 2023. ๐Ÿ’ฐ๐Ÿ“‰

advanced-data-wrangling api data-analyst-nanodegree data-assessment data-gathering data-science python requests wrangling-data

Last synced: 09 Apr 2025

https://github.com/ivanrs297/macfe

MACFE: Meta-learning and Causality Based Feature Engineering | https://link.springer.com/chapter/10.1007/978-3-031-19493-1_5

data-mining data-science feature-engineering machine-learning python

Last synced: 11 Jun 2025

https://github.com/redhat-na-ssa/demo-ocp-gpu

Show some magic around GPUs on OpenShift

code-server data-science gpu nvidia

Last synced: 30 Jul 2025

https://github.com/shreyamalogi/road-lane-detection

Road lane detection is the process of using computers to identify and highlight the lanes on a road in pictures or videos.

data-science jupyter-notebook opencv python

Last synced: 11 Apr 2025

https://github.com/dhhruv/the-sparks-foundation-internship-tasks

This Repository is dedicated to the completion of my Task with video from The Sparks Foundation (Graduate Rotational Internship Program).

business-analytics data-science data-visualization grip gripmay21 intern internship jupyter machine-learning python task-6 task6 the-sparks-foundation thesparksfoundation tsf

Last synced: 19 Sep 2025

https://github.com/unicef/magasin

Cloud native open-source end-to-end data / AI / ML platform

cloud dagster data data-pipelines data-science data-visualization helm-charts kubernetes magasin

Last synced: 21 Apr 2025

https://github.com/ahammadmejbah/data-science-interview-question-and-solution

Data Science Interview Question: Explain the concept of regularization in machine learning. Solution: Regularization is a technique to prevent overfitting by adding a penalty term to the loss function.

data-engineering data-mining data-science data-structures data-visualization database

Last synced: 26 Feb 2025

https://github.com/sebiwtt/flaskriver

This is a repository for the open-source project flaskriver which will make it easier to combine the lightweight web-framework flask with the online-ML library river.

data-science flask machine-learning online-learning python river streaming

Last synced: 05 Jul 2025

https://github.com/scicloj/tcutils

Utility functions for working with tablecloth datasets

clojure data-science scicloj tablecloth tmd

Last synced: 09 Apr 2025

https://github.com/mine-cetinkaya-rundel/tidymodels-uscots-2021

Materials for the "Tidy up your models" workshop at USCOTS 2021

data-science modeling rstats statistics tidymiodels tidyverse

Last synced: 08 Apr 2025

https://github.com/firelink-sh/evolve-py

A highly efficient, composable, and lightweight ETL and data integration framework.

analytics arrow big-data data data-engineering data-integration data-science duckdb elt etl ingestion ingress ml olap pipeline polars postgresql python s3

Last synced: 10 Mar 2026

https://github.com/lockedata/opentrainingcontent

An MIT & CCBY4.0 licensed repository of training materials from Locke Data

data-science open-course r-stats

Last synced: 29 Jul 2025

https://github.com/jhermann/til-about-data-science

:mortar_board: :panda_face: Records of what I learned while exploring the waters of Data Science (using Python)

artificial-intelligence data-science know-how machine-learning matplotlib pandas python seaborn today-i-learned visualization

Last synced: 19 Apr 2025

https://github.com/thavlik/doom-gameplay-dataset

A dataset of Doom 1 & 2 gameplay videos preprocessed for deep learning

data-science dataset deep-learning doom doom-gameplay machine-learning quake-gameplay-dataset videos

Last synced: 16 Jan 2026

https://github.com/chris-santiago/steps

A SciKit-Learn style feature selector using best subsets and stepwise regression.

best-subset-selection data-science python scikit-learn stepwise-selection

Last synced: 28 Jun 2025

https://github.com/fmv1992/data_utilities

Data utilities library focused on machine learning and data analysis.

data-science utility-library

Last synced: 14 Mar 2025

https://github.com/aqafridi/data-analytics-specialization

In this Specialization of Data Analytics we will use systematic computational analysis of data or statistics using Python. (rarely Excel or Cognos)

beautifulsoup cognos-dashboard data-science data-visualization excel numpy pandas python sql

Last synced: 21 Sep 2025

https://github.com/boada/insight_challenges

Data Science Challenges for Insight

data-science insight-data-science

Last synced: 15 Apr 2025

https://github.com/ren294/log-analysis-project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

apache-kafka apache-nifi apache-spark big-data big-data-analytics cassandra cassandra-driver data-engineering data-science grafana hadoop hadoop-hdfs hive powerbi spark-rdd spark-sql spark-streaming

Last synced: 08 Jul 2025

https://github.com/sminerport/sminerport

My GitHub portfolio showcasing personal projects, coding skills, and expertise in Software Development, Data Analytics, and AI/ML. Get in touch for collaboration!

artificial-intelligence data-analytics data-science machine-learning natural-language-processing neural-networsk sequence-prediction software-development

Last synced: 15 Aug 2025

https://github.com/aiscalate/aiscalator

Tools to streamline Jupyter Notebook Prototypes into robust Data Products

airflow airflow-docker data-engineering data-science jupyter jupyter-notebook jupyterlab

Last synced: 26 Sep 2025

https://github.com/koldlight/r4ds

R for data science course

course data-analysis data-science data-viz r

Last synced: 30 Apr 2025

https://github.com/jasonmdev/guidedprojects

As part of the DataQuest Curriculum, guided projects are less structured and focus more on exploration.

data-science jupyter-notebook

Last synced: 14 May 2025

https://github.com/RDeconomist/RDeconomist.github.io

RapidCharts - a site for teaching and demonstrating Data Science and Visualisation techniques

data data-science data-visualization economics politics sports

Last synced: 08 Apr 2025

https://github.com/systemvll/hcaptcha-dataset-scraper

A simple nodejs script that return hcaptcha images and prompt for training AI.

ai data-science dataset hcaptcha hcaptcha-solver machine-learning

Last synced: 03 Aug 2025

https://github.com/d3group/dddex

The package 'data-driven density estimation x' (dddex) turns any standard point forecasting model into an estimator of the underlying conditional density

data-science density-estimation operations-research

Last synced: 24 Apr 2025

https://github.com/moindalvs/assignment_east-west_airlines

Problem Statement Perform clustering (Hierarchical,K means clustering and DBSCAN) for the airlines data to obtain optimum number of clusters

clustering-algorithm data-science dbscan-clustering epsilon-greedy hierarchical-clustering kmeans-clustering

Last synced: 23 Apr 2025

https://github.com/takuti/pyhivemall

Using machine learning model from Apache Hivemall :bee: in Python :snake:

data-science hive machine-learning python

Last synced: 15 Apr 2025

https://github.com/joschnitzbauer/dalymi

A lightweight, data-focused and non-opinionated pipeline manager written in and for Python.

dag data data-science pipeline python workflow

Last synced: 14 Jan 2026

https://github.com/rwallan/openiziai

Interface para se comunicar com a api da OpenAI adotando as melhores prรกticas de LLM para criar e se comunicar com um agente.

data-science ia llm openai pydantic-v2 python3

Last synced: 19 Apr 2025

https://github.com/2krishnayadav/datta-vishleshan.ai

DattaVishLeshan.AI is one of the first data analysis projects developed in India, and perhaps even in the world. The name "Datta" means "data," while "Vishleshan" translates to "analysis." It is a pioneering AI project dedicated to advanced data analysis.

data-analysis data-science data-visualization database

Last synced: 03 Jul 2026

https://github.com/wgierke/git_better

3rd-placed solution for the informatiCup2017

data-science docker docker-image heroku machine-learning tensorboard

Last synced: 24 Mar 2025