Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/scrapinghub/aduana

Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).

data-science

Last synced: 10 Nov 2024

https://github.com/tommyod/paretoset

Compute the Pareto (non-dominated) set, i.e., skyline operator/query.

data-mining data-science datascience multi-objective-optimization optimization pandas skyline-query

Last synced: 10 Feb 2025

https://github.com/datakitchen/dataops-testgen

DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data quality test generation and execution by data profiling,  new dataset hygiene review, AI generation of data quality validation tests, ongoing testing of data refreshes, & continuous anomaly monitoring

data data-engineering data-observability data-quality data-science data-testing datachecker dataops dataprofiling dataquality datavalidation mssql postgresql python redshift self-hosted snowflake

Last synced: 06 Feb 2025

https://github.com/junpenglao/planet_sakaar_data_science

A colourful collection of codes and notebooks, like Planet Sakaar

bayesian-inference data-science pymc3

Last synced: 02 Nov 2024

https://github.com/alinski29/stonks.jl

Julia library for standardizing financial data retrieval and storage from multiple APIs.

data data-mining data-science dataframe finance julia trading trading-algorithms

Last synced: 02 Nov 2024

https://github.com/stitchfix/mab

Library for multi-armed bandit selection strategies, including efficient deterministic implementations of Thompson sampling and epsilon-greedy.

data-science experimentation go golang multi-armed-bandit multi-armed-bandits multiarmed-bandits reinforcement-learning thompson thompson-sampling

Last synced: 10 Feb 2025

https://ddotta.github.io/cookbook-rpolars/

Cookbook to provide solutions to common tasks and problems in using Polars with R

benchmark cookbook data-engineering data-science datatable dplyr polars r tidyr

Last synced: 18 Nov 2024

https://github.com/fcakyon/instafake-dataset

Dataset for Intagram Fake and Automated Account Detection

bot classification data-science dataset fake instafake instagram machine-learning research

Last synced: 06 Jan 2025

https://github.com/loukesio/ggvolc

𝐠𝐠𝐯𝐨𝐥𝐜 effortlessly translates differential expression datasets and RNAseq data into informative volcano plots. Highlight genes of interest with unprecedented ease. With just a single line of code, visualize complex datasets, gaining deeper insights and simplifying data representation

bioinformatics data-science data-visualization gro-seq rna-seq

Last synced: 21 Dec 2024

https://github.com/ulikoehler/uliengineering

A python library for calculations perfomed in electronics engineering

data-analysis data-science electronics engineering python

Last synced: 10 Feb 2025

https://github.com/mikeizbicki/cmc-csci046

CMC's Data Structures and Algorithms Course Materials

cmc computer-science course data-science python3

Last synced: 07 Feb 2025

https://github.com/team-fastml/fastml

A Python package built on sklearn for running a series of classification Algorithms in a faster and easier way.

algorithms data-science deep-learning machine-learning machine-learning-algorithms neural-network python

Last synced: 04 Feb 2025

https://github.com/elshor/dstools

Javascript tools and utilities for the data scientist

data-science javascript

Last synced: 27 Oct 2024

https://github.com/dlab-berkeley/Python-Data-Wrangling-Legacy

D-Lab's 3 hour introduction to data wrangling in Python. Learn how to import and manipulate dataframes using pandas in Python.

data-science pandas python

Last synced: 11 Nov 2024

https://github.com/BojarLab/glycowork

Package for processing and analyzing glycans and their role in biology.

bioinformatics computational-biology data-science glycans glycobiology machine-learning molecular-biology open-source python

Last synced: 18 Jan 2025

https://github.com/ahmed-mohamed-sn/olliePy

OlliePy is a python package which can help data scientists in exploring their data and evaluating and analysing their machine learning experiments by utilising the power and structure of modern web applications. The data scientist only needs to provide the data and any required information and OlliePy will generate the rest.

ai analytics charts dashboard data data-analytics data-science data-scientist eda error-analysis exploratory-data-analysis machine-learning python visualization

Last synced: 15 Nov 2024

https://github.com/svilupp/awesome-generative-ai-meets-julia-language

Comprehensive guide to generative AI projects and resources in Julia.

awesome awesome-list data-science generative-ai julia

Last synced: 28 Oct 2024

https://github.com/asad70/insider-trading

This program extracts insider trading data from the sec website and stores it in excel file for the specified time frame.

algotrading data-science extract-data insider-trading insiders tickers trading trading-strategies

Last synced: 11 Nov 2024

https://github.com/zeeshanahmad4/stock-prices-prediction-ml-flask-dashboard

This program predicts the price of GOOG stock for a specific day using the Machine Learning algorithm called Support Vector Regression (SVR) Linear Regression. Importing flask module in the project is mandatory An object of Flask class is our WSGI application.

classification data-mining data-science data-visualization dataset flask flask-dashboard linear-regression ml prediction prediction-algorithm prediction-model predictive-analytics python stock-analysis stock-market stock-prices stock-prices-prediction stock-trading visualization

Last synced: 24 Jan 2025

https://github.com/shlizee/NeuroAI

NeuroAI-UW seminar, a regular weekly seminar for the UW community, organized by NeuroAI Shlizerman Lab.

ai cvpr data-science deep-learning eccv icml neural-networks neurips neuroscience-methods recurrent-neural-networks sfn

Last synced: 12 Nov 2024

https://github.com/sparkfish/shabby-pages

ShabbyPages is a state-of-the-art corpus of born-digital document images with both ground truth and distorted versions appropriate for use in training models to reverse distortions and recover to original denoised documents.

binarization born-digital computer-vision corpus data-science dataset denoising layout-detection

Last synced: 17 Dec 2024

https://github.com/rcdilorenzo/ecce

ML Prediction of Bible Topics and Passages (Python / React)

data-science fastapi fully-connected-network interactive-visualizations keras-tensorflow reactjs

Last synced: 11 Nov 2024

https://github.com/kennethleungty/end-to-end-automl-insurance

An End-to-End Implementation of AutoML with H2O, MLflow, FastAPI, and Streamlit for Insurance Cross-Sell

automl data-science fastapi h2o h2o-automl machine-learning mlflow mlops python streamlit

Last synced: 22 Nov 2024

https://github.com/jacksonburns/astartes

Better Data Splits for Machine Learning

ai data-science machine-learning ml python sampling

Last synced: 19 Dec 2024

https://github.com/kaggledatasets/kaggledatasets

Collection of Kaggle Datasets ready to use for Everyone (Looking for contributors)

data-science datasets deep-learning kaggle keras machine-learning python pytorch scikit-learn tensorflow

Last synced: 13 Oct 2024

https://github.com/zincware/ZnTrack

Create, visualize, run & benchmark DVC pipelines in Python & Jupyter notebooks.

data-science data-version-control developer-tools dvc git machine-learning python reproducibility

Last synced: 14 Nov 2024

https://github.com/daun-io/study-data-science

Practical data science notebooks that I used to study at 2016

data-science jupyter-notebook machine-learning tensorflow

Last synced: 30 Nov 2024

https://github.com/PKU-DAIR/mindware

An efficient open-source AutoML system for automating machine learning lifecycle, including feature engineering, neural architecture search, and hyper-parameter tuning.

automl-algorithms automl-pipeline bayesian-optimization blackbox-optimization data-science deep-learning distributed-systems ensemble-learning hyper-parameter-optimization knobs-tuning machine-learning meta-learning neural-architecture-search python

Last synced: 16 Nov 2024

https://github.com/nolanbconaway/pitchfork-data

Analyses on over 18,000 pitchfork reviews.

data-science ipynb jupyter music pitchfork

Last synced: 02 Jan 2025

https://github.com/daun-io/Study-Data-Science

Practical data science notebooks that I used to study at 2016

data-science jupyter-notebook machine-learning tensorflow

Last synced: 27 Nov 2024

https://github.com/jonathandinu/spark-ray-data-science

Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with Spark and Ray in the context of a data scientist's standard workflow.

artificial-intelligence data-science distributed-computing machine-learning python ray spark

Last synced: 15 Nov 2024

https://github.com/credo-ai/credoai_lens

Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community.

ai artificial-intelligence assessment data-science ethical-artificial-intelligence fairness-ai fairness-ml jupyter machine-learning ml python reporting responsible-ai visualization

Last synced: 21 Jan 2025

https://github.com/lter/lterdatasampler

LTER data samples to teach environmental data science

data-science ecology lter-science r r-package

Last synced: 27 Oct 2024

https://github.com/tatevkaren/artificial-neural-network-business_case_study

Business Case Study to predict customer churn rate based on Artificial Neural Network (ANN), with TensorFlow and Keras in Python. This is a customer churn analysis that contains training, testing, and evaluation of an ANN model. (Includes: Case Study Paper, Code)

ann ann-model artificial-neural-network artificial-neural-networks bank-customers case-study churn-analysis data-science deep-learning machine-learning prediction-model predictive-analytics python3 tensorflow-tutorials

Last synced: 12 Nov 2024

https://github.com/theengineeringworld/statistics-using-python

These files are part of Youtube Course "Statistics Using Python" Offered By The Engineering WOrld. Offered By: http://youtube.com/theengineeringworld

cleaning data-analysis data-mining data-science data-visualization database jupyter-notebooks python python3 statistics

Last synced: 08 Nov 2024

https://github.com/okfn-brasil/whistleblower

🚨A Twitter bot for publicly reporting suspicions found by Rosie, Serenata de Amor's AI

data-science facebook-messenger-bot machine-learning twitter-bot

Last synced: 31 Oct 2024

https://github.com/electronick1/stairs

Framework which helps you to make parallel/distributed calculations using data pipelines

data-engineering data-pipeline data-science distributed-computing python

Last synced: 10 Nov 2024

https://github.com/opengeos/geoai

A Python package for using Artificial Intelligence (AI) with geospatial data

ai data-science geoai geopython geospatial jupyter python

Last synced: 11 Nov 2024

https://github.com/tatevkaren/tatevkaren-data-science-portfolio

Data Science Portfolio of Tatev Karen Aslanyan including Case Studies and Research Projects that I have completed that solve business problems or introduce new products. Case Study papers, codes, and additional resources are all included.

blog case-study computer-science data-analysis data-science deep-learning econometrics machine-learning papers portfolio portfolio-website statistics

Last synced: 07 Dec 2024

https://github.com/welding-torch/excel-anonymizer

A Python script that anonymizes an Excel file and synthesizes new data in its place.

data-science microsoft nlp pandas presidio privacy

Last synced: 07 Nov 2024

https://github.com/kb22/GitHub-User-Insights-using-API

The project involves using the GitHub API using user authentication to fetch information such as commits and repositories for that specific user and store them as CSV files for data collection and analysis.

api data-analysis data-science data-scraping github-api python

Last synced: 08 Nov 2024

https://github.com/henestrosadev/sololearn

Compilation of all SoloLearn courses with their respective projects and practices and all 72 code challenges for all 7 supported languages.

code-challenge code-practice data-science programming-exercises programming-languages python sololearn sololearn-cert sololearn-solutions

Last synced: 27 Oct 2024

https://github.com/lkuffo/data-viz

Más de 50 ejemplos de visualizaciones y análisis de datos en Matplotlib, Pandas, Seaborn, Plotly, Bokeh y Networkx

data-analysis data-science dataviz geoviz jupyter jupyter-notebook matplotlib networkx pandas plotly python seaborn

Last synced: 18 Dec 2024

https://github.com/dfinke/PSDuckDB

PSDuckDB is a PowerShell module that provides seamless integration with DuckDB, enabling efficient execution of analytical SQL queries directly from the PowerShell environment.

data-analysis data-science duckdb powershell sql

Last synced: 16 Dec 2024

https://github.com/fremantle-industries/prop

An open and opinionated trading platform using productive & familiar open source libraries and tools for strategy research, execution and operation.

algo-trading data-science defi elixir grafana trading-platform

Last synced: 07 Nov 2024

https://github.com/jason2brownlee/machinelearningmischief

Machine Learning Mischief: Examples from the dark side of data science

data-science ethics hacking machine-learning statistics

Last synced: 24 Dec 2024

https://github.com/mlabonne/how-to-data-science

Scripts, notebooks, and articles about data science in general.

data-science numpy pandas pandas-dataframe python pytorch

Last synced: 02 Jan 2025

https://github.com/ropensci/rdataretriever

R interface to the Data Retriever

data data-science database datasets r r-package rstats science

Last synced: 04 Dec 2024

https://github.com/giswqs/postgis

Spatial Data Management with PostgreSQL and PostGIS https://gishub.org/sdm

data-science database geospatial postgis postgres postgresql

Last synced: 02 Nov 2024

https://github.com/google/bayesnf

Bayesian Neural Field models for prediction in large-scale spatiotemporal datasets

bayesian-inference data-science machine-learning spatiotemporal-data-analysis statistics

Last synced: 09 Jan 2025

https://github.com/soumyadip007/data-science-using-python-university-course-module

“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.

data-preparation data-preprocessing data-processing data-science data-visualization jupyter-notebook knn numpy panda plotting python

Last synced: 28 Oct 2024

https://github.com/plantinformatics/pretzel

Javascript full-stack framework for Big Data visualisation and analysis

big-data bioinformatics data-science data-visualization ember emberjs express expressjs javascript open-source

Last synced: 23 Jan 2025

https://github.com/imgcook/datacook

Machine Learning and Data Analysis in JavaScript.

data-science feature-engineering javascript machine-learning

Last synced: 13 Nov 2024

https://github.com/weiji14/deepbedmap

Going beyond BEDMAP2 using a super resolution deep neural network. Also a convenient flat file data repository for high resolution bed elevation datasets around Antarctica.

antarctica bedmap binder chainer data-science deep-neural-network digital-elevation-model flat-file-db generative-adversarial-network glaciology jupyter-notebook optuna pangeo remote-sensing super-resolution

Last synced: 07 Jan 2025

https://github.com/vida-nyu/data-polygamy

Data Polygamy is a topology-based framework that allows users to query for statistically significant relationships between spatio-temporal data sets.

data data-science nyucds

Last synced: 24 Nov 2024

https://github.com/datalab-platform/datalab

Open-source Platform for Scientific and Technical Data Processing and Visualization

data-science data-visualization image-processing opencv python scientific-computing scikit-image scipy signal-processing visualization

Last synced: 05 Feb 2025

https://github.com/ploomber/soopervisor

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.

airflow argo argo-workflows aws data-science kubeflow kubeflow-pipelines kubernetes machine-learning slurm workflow

Last synced: 19 Dec 2024

https://github.com/elysian01/data-purifier

A Python library for Automated Exploratory Data Analysis, Automated Data Cleaning, and Automated Data Preprocessing For Machine Learning and Natural Language Processing Applications in Python.

data-analysis data-cleaning data-cleaning-pipeline data-preprocessing data-science data-visualization datapurifier eda exploratory-data-analysis jupyter python-lib python-library python3

Last synced: 07 Nov 2024

https://github.com/rfordatascience/rfordatasciencewiki

Resources for the R4DS Online Learning Community, including answer keys to the text

beginner beginner-friendly beginner-tutorial-series data-science help-wanted r4ds rstats rstudio tidyverse

Last synced: 14 Nov 2024

Data Science Awesome Lists
awesome-datascience 829 Awesome-pytorch-list 704 awesome-bigdata 621 awesome-bigdata 621 awesome-R 483 awesome-mlops 297 awesome-jupyter 205 awesome-computer-science-opportunities 153 awesome-machine-learning-interpretability 1,366 awesome-python-data-science 379 awesome-business-intelligence 231 awesome-streamlit 101 football_analytics 56 awesome-fraud-detection-papers 186 awesome-google-colab 73 CV-pretrained-model 103 yt-channels-DS-AI-ML-CS 195 StarryDivineSky 12,298 data-science-with-ruby 101 awesome-public-real-time-datasets 42 awesome-learn-datascience 43 awesome-feature-engineering 69 awesome-r-learning-resources 140 awesome-ai 269 ai-catalog 71 machine-learning-resources 56 Awesome-Distributed-Deep-Learning 44 awesome-data 31 Data-Science 71 awesome-h2o 96 awesome-materials-informatics 126 awesome-time-series-segmentation-papers 105 awesome-python 1,095 data-science-learning-path 70 awesome-scientific-python 131 awesome-arcgis-developers 176 awesome-generative-ai-data-scientist 126 awesome-kubeflow 146 awesome-ml-blogs 92 awesome-data-contracts 57 dmg-data-science-awesome 158 Data-Engineering-Roadmap 119 recommendations-for-engineers 1,163 awesome-AI-kubernetes 65 awesome-AI-tutorials-surveys 134 deep-learning-resources 54 awesome-python-machine-learning-resources 1,884 awesome-cv 178 awesome-data-temporality 93 Machine-Learning 483
Data Science Categories
A01_文本生成_文本对话 1,698 Uncategorized 1,249 前端开发框架及项目 562 Community and Official Guidance Resources 552 其他_机器学习与深度学习 502 Books 391 网络服务 374 Awesome Resources 351 Machine Learning 350 Research Articles and Reports 316 Data Versioning for Machine Learning 309 The Data Science Toolbox 295 其他_机器视觉 295 Literature and Media 287 Table of Contents 286 Education Resources 281 其他 279 其他_安全与渗透 252 Pytorch & related libraries 252 NLP语料和数据集 248