Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Data Science

Data science is an inter-disciplinary field that uses scientific methods, processes, algorithms, and systems to extract knowledge from structured and unstructured data. Data scientists perform data analysis and preparation, and their findings inform high-level decisions in many organizations.

https://github.com/andrea-ballatore/open-geo-data-education

Open Geospatial Datasets for GIS Education: This is a repository of open geospatial datasets to be used in an educational context. I created these files over years of teaching Geographic Data Science and GIS. All original datasets are freely available online with open data licenses (see the dataset attribution for details). All the datasets in this repository have been selected, cleaned, harmonised, and repackaged for GIS exercises in a higher-education context. This is a pretty time-intensive process that other educators can hopefully avoid by using these versions.

data-science geojson geospatial-data geospatial-datasets gis gis-data gis-education tsv

Last synced: 27 Oct 2024

https://github.com/hemansnation/data-analyst-roadmap

Data-Analyst-Roadmap for Professionals. This roadmap contains 8 Chapters that can be completed in 8 weeks, whether you are a fresher in the field or an experienced professional who wants to transition into Data Analysis.

analytics data-analysis data-analysis-python data-analytics data-science numpy predictive-analytics project-based-learning python statistics tableau

Last synced: 08 Nov 2024

https://github.com/ropensci/gittargets

Data version control for reproducible analysis pipelines in R with {targets}.

data-science data-version-control data-versioning r r-package reproducibility reproducible-research rstats targets workflow

Last synced: 31 Oct 2024

https://github.com/imdeepmind/neuralpy

NeuralPy: A Keras like deep learning library works on top of PyTorch

data-science deep-learning keras library machine-learning neural-network neuralpy neuralpy-torch python pytorch

Last synced: 13 Nov 2024

https://github.com/FlyRanch/figurefirst

A layout-first approach to figure making

data-science inkscape inkscape-extensions matplotlib plotting python svg

Last synced: 03 Aug 2024

https://github.com/OpenSTEF/openstef

Automated Machine Learning pipelines. Builds the Open Short Term Energy Forecasting package.

data-science energy energy-forecasting forecasting machine-learning python time-series

Last synced: 03 Aug 2024

https://github.com/datakitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 12 Oct 2024

https://github.com/woz-u/DS-Student-Resources

Data Science Student Companion Notebooks and Data Lake

data-analysis data-science data-visualization machine-learning nosql python r sql statistics

Last synced: 08 Aug 2024

https://github.com/5agado/conversation-analyzer

Analyzer and statistics generator for text-based conversations. Includes Facebook scraper and parser

data-science facebook quantified-self scraper

Last synced: 08 Nov 2024

https://github.com/Invictify/Jupter-Notebook-REST-API

Run your jupyter notebooks as a REST API endpoint. This isn't a jupyter server but rather just a way to run your notebooks as a REST API Endpoint.

data-science data-science-pipelines docker dockerfile fastapi jupyter python rest-api

Last synced: 26 Oct 2024

https://github.com/zjuearthdata/geochemistrypi

an open-sourced highly automated machine learning Python framework for data-driven geochemistry discovery

dash data-science fastapi flaml geochemistry mlflow nodejs ray reactjs scikit-learn typer

Last synced: 10 Oct 2024

https://github.com/dominodatalab/domino-research

Projects developed by Domino's R&D team

data-science mlflow mlops python sagemaker

Last synced: 13 Aug 2024

https://github.com/jonrau1/SyntheticSun

SyntheticSun is a defense-in-depth security automation and monitoring framework which utilizes threat intelligence, machine learning, managed AWS security services and, serverless technologies to continuously prevent, detect and respond to threats.

anomaly-detection automation aws aws-security aws-serverless data-science data-visualization elasticsearch geolocation guardduty incident-response kibana machine-learning misp sagemaker security-automation security-tools serverless threat-detection threat-intelligence

Last synced: 04 Aug 2024

https://github.com/tirthajyoti/synthetic-data-gen

Various methods for generating synthetic data for data science and ML

classification data data-science machine-learning python regression symbolic-computation time-series

Last synced: 22 Oct 2024

https://github.com/TomasBeuzen/python-programming-for-data-science

Content from the University of British Columbia's Master of Data Science course DSCI 511.

data-manipulation data-science numpy pandas programming python teaching

Last synced: 07 Aug 2024

https://github.com/nbarrowman/vtree

An R package for calculating and drawing variable trees

data-science data-visualization exploratory-data-analysis r statistics

Last synced: 31 Oct 2024

https://github.com/microsoft/coml

Interactive coding assistant for data scientists and machine learning developers, empowered by large language models.

automated-machine automl copilot data-science hyperparameter-optimization jupyter jupyter-lab large-language-models llm machine-learning

Last synced: 07 Oct 2024

https://github.com/kianweelee/Edator

A python package that performs exploratory data analysis for users. Additionally, it generates 3 types of output files (cleaned CSV, plots and a text report).

data-analysis data-science exploratory-data-analysis

Last synced: 03 Aug 2024

https://github.com/capitalone/dataCompareR

dataCompareR is an R package that allows users to compare two datasets and view a report on the similarities and differences.

compare-data data data-analysis data-science r

Last synced: 13 Aug 2024

https://github.com/glemaitre/pyparis-2018-sklearn

PyParis tutorial on machine learning using scikit-learn

data-science machine-learn pandas scikit-learn

Last synced: 01 Nov 2024

https://github.com/MLMI2-CSSI/foundry

Simplifying the discovery and usage of machine-learning ready datasets in materials science and chemistry

chemistry data-science datasets machine-learning materials-science

Last synced: 05 Aug 2024

https://github.com/felipenoris/math-server-docker

The ideal multi-user Data Science server with Jupyterhub and RStudio, ready for Python, R and Julia languages.

data-science docker julia julia-language jupyter jupyter-kernels jupyterhub jupyterlab latex python rstudio-servers shiny-server

Last synced: 28 Oct 2024

https://github.com/manumerous/vpselector

Visual Pandas Selector: Visualize and interactively select time-series data

data-science data-visualization pandas python selector

Last synced: 29 Oct 2024

https://github.com/grailbio/bio

Bioinformatic infrastructure libraries

bioinformatics data-science golang

Last synced: 09 Nov 2024

https://github.com/siddhujetty/Product-analytics-insights-collection

My Solutions to "A Collection of Data Science Take-Home Challenges" by Giulio Palombo.

data-science machine-learning r-programming solutions take-home-test

Last synced: 13 Aug 2024

https://github.com/bcgov/bcmaps

An R package of map layers for British Columbia

data-science env r r-package rstats

Last synced: 05 Aug 2024

https://github.com/bramvanroy/spacy_conll

Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Doc and its sentences and tokens. Can also be used as a command-line tool.

conll conll-u data-science machine-learning natural-language-processing nlp pandas parser python spacy spacy-extension spacy-pipeline stanford-machine-learning stanford-nlp stanza udpipe

Last synced: 13 Nov 2024

https://github.com/xiaodaigh/jlboost.jl

A 100%-Julia implementation of Gradient-Boosting Regression Tree algorithms

catboost data-science gbdt gbrt lightgbm machine-learning tree tree-boosting-algorithms xgboost

Last synced: 08 Nov 2024

https://github.com/uc-r/Advanced-R

Advanced Analytics with R training material delivered in a 2 day format

data-science educational-materials r training-materials workshop-materials

Last synced: 13 Nov 2024

https://github.com/verynifty/RolodETH

A Rolodex for popular Ethereum chain address.

data-science ethereum ethereum-blockchain

Last synced: 03 Aug 2024

https://github.com/piquette/qtrn

A cli tool to streamline financial markets data analysis :wrench:

cli data data-science finance go golang options quotes scraper stock stock-analysis stock-market

Last synced: 04 Nov 2024

https://github.com/data-centric-ai/dcbench

A benchmark of data-centric tasks from across the machine learning lifecycle.

data-science machine-learning

Last synced: 30 Oct 2024

https://github.com/visgl/deck.gl-data

Data for the data visualization library deck.gl examples (https://uber.github.io/deck.gl/#/)

data data-science data-visualization uber

Last synced: 07 Aug 2024

https://github.com/stanfordnlp/edu-convokit

Edu-ConvoKit: An Open-Source Framework for Education Conversation Data

data data-analysis data-science education language natural-language-processing

Last synced: 08 Nov 2024

https://github.com/robertmartin8/udemyml

Templates, code and notes for Kirill Eremenko's Machine Learning course

data-science machine-learning python r tutorial udemy udemy-machine-learning

Last synced: 22 Oct 2024

https://github.com/shenxiangzhuang/pythondataanalysis

The data and code that used in my book.

data-science python3 webcrawler

Last synced: 31 Oct 2024

https://github.com/shenxiangzhuang/PythonDataAnalysis

The data and code that used in my book.

data-science python3 webcrawler

Last synced: 30 Oct 2024

https://github.com/devsgnr/breadroll

breadroll 🥟 is a simple lightweight library for data processing operations written in Typescript and powered by Bun.

bun csv csv-parser data-engineering data-science data-transformation eda exploratory-data-analysis tsv tsv-parser

Last synced: 17 Aug 2024

https://github.com/argilla-io/biome-text

Custom Natural Language Processing with big and small models 🌲🌱

allennlp data-science natural-language-processing nlp pytorch

Last synced: 30 Sep 2024

https://github.com/localcascadeensemble/lce

Random Forest or XGBoost? It is Time to Explore LCE

classification data-science machine-learning python regression scikit-learn-api

Last synced: 31 Oct 2024

https://github.com/aiwithqasim/Free-Artificial-Intelligence-Resources

Welcome, to this Open Source Repository regarding FREE ARTIFICIAL INTELLIGENCE RESOURCE. Get Benefit from the free resources mention & kindly five STAR & FORK this so that it can get maximum Fame so that Everyone can take advantage.

ai article artificial-intelligence artificial-neural-networks blog data-science datascientist deep-learning freeresources hacktoberfest hecktoberfest2021 jobs machine-learning machine-learning-algorithms natural-language-processing nlp project python3 youtube

Last synced: 02 Nov 2024

https://github.com/charmve/paperweeklyai

📚「@MaiweiAI」Studying papers in the fields of computer vision, NLP, and machine learning algorithms every week.

advanced applied-machine-learning computer-vision data-mining data-science deep-learning machine-learning machine-learning-algorithms nlp paper-with-code papers study-papers tutorials

Last synced: 28 Oct 2024

https://github.com/gitonthescene/csv-reconcile

A reconciliation service for OpenRefine serving data from a given CSV file.

data-science openrefine

Last synced: 06 Nov 2024

https://github.com/tomasonjo/graphs-network-science

Accompanying repository for my book about Graph Data Science

algorithms data-science graph graph-algorithms machine-learning

Last synced: 09 Nov 2024

https://github.com/LaihoE/did-it-spill

Check if you have training samples in your test set

computer-vision data-science deep-learning pytorch semantic-similarity time-series

Last synced: 12 Nov 2024

https://github.com/apple/ml-symphony

Symphony: Interactive Data Widgets (CHI 2022)

computational-notebooks data-science data-visualization machine-learning

Last synced: 07 Oct 2024

https://github.com/ahammadmejbah/artificial-intelligence-important-documents-collections

AI technology is significant because it allows software to do human functions—understanding, reasoning, planning, communication, and perception—increasingly effectively, efficiently, and affordably.

ai algorithms big-data computer-science computer-vision data-analyst data-engineering data-mining data-science deep-learning machine-learning mathematics python

Last synced: 11 Nov 2024

https://github.com/dayyass/qaner

Unofficial implementation of QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition.

data-science machine-learning named-entity-recognition natural-language-processing ner nlp python python3 question-answering

Last synced: 07 Nov 2024

https://github.com/renumics/sliceguard

A library for detecting problematic data segments in structured and unstructured data with few lines of code.

data-analysis data-cleaning data-curation data-exploration data-science data-visualization deep-learning eda exploratory-data-analysis machine-learning python visualization

Last synced: 27 Oct 2024

https://github.com/Desbordante/desbordante-core

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

anomaly-detection correlations data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-mining-algorithms data-preprocessing data-profiling data-science data-wrangling exploratory-data-analysis feature-engineering feature-extraction feature-selection knowledge-discovery spreadsheets tabular-data

Last synced: 04 Nov 2024

https://github.com/bnosac/crfsuite

Labelling Sequential Data in Natural Language Processing with R - using CRFsuite

chunking conditional-random-fields crf crfsuite data-science intent-classification natural-language-processing ner nlp r r-package

Last synced: 11 Nov 2024

https://github.com/DataKitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 02 Aug 2024

https://github.com/dask-contrib/dask-awkward

Native Dask collection for awkward arrays, and the library to use it.

columnar-format dask data-analysis data-science data-structure jagged-array python ragged-array

Last synced: 11 Nov 2024

https://github.com/hannansatopay/roughviz

A Python visualization library for creating sketchy/hand-drawn styled charts.

charts data-science hacktoberfest jupyter-notebook python-visualization roughviz vizualisation

Last synced: 08 Nov 2024

https://github.com/mitre/menelaus

Online and batch-based concept and data drift detection algorithms to monitor and maintain ML performance.

concept-drift data-drift data-science drift-detection machine-learning statistics

Last synced: 09 Nov 2024

Data Science Awesome Lists
awesome-datascience 842 Awesome-pytorch-list 704 awesome-bigdata 621 awesome-bigdata 621 awesome-R 482 awesome-mlops 299 awesome-jupyter 205 awesome-computer-science-opportunities 153 awesome-machine-learning-interpretability 1,199 awesome-python-data-science 379 awesome-business-intelligence 231 awesome-streamlit 101 football_analytics 56 awesome-fraud-detection-papers 186 awesome-google-colab 73 CV-pretrained-model 103 yt-channels-DS-AI-ML-CS 195 data-science-with-ruby 101 StarryDivineSky 7,717 awesome-learn-datascience 43 awesome-feature-engineering 69 awesome-r-learning-resources 139 awesome-ai 267 awesome-public-real-time-datasets 42 machine-learning-resources 56 awesome-data-science-resoruces 36 ai-catalog 70 Awesome-Distributed-Deep-Learning 44 awesome-data 31 awesome-h2o 96 Data-Science 71 awesome-materials-informatics 126 awesome-time-series-segmentation-papers 105 awesome-python 1,028 data-science-learning-path 70 awesome-scientific-python 131 awesome-arcgis-developers 176 awesome-kubeflow 139 awesome-data-contracts 57 awesome-ml-blogs 96 Data-Engineering-Roadmap 119 recommendations-for-engineers 1,163 awesome-AI-kubernetes 65 awesome-AI-tutorials-surveys 134 deep-learning-resources 54 awesome-python-machine-learning-resources 1,884 awesome-cv 178 awesome-data-temporality 93 Machine-Learning 483 awesome-generative-ai-meets-julia-language 58
Data Science Categories
文本生成、文本对话 1,107 Uncategorized 987 前端开发框架及项目 568 Community and Official Guidance Resources 555 网络服务 382 Books 379 Awesome Resources 345 Machine Learning 326 Research Articles and Reports 316 其他_机器视觉 298 Table of Contents 290 其他 289 Literature and Media 289 The Data Science Toolbox 287 Education Resources 282 其他_安全与渗透 254 Data Versioning for Machine Learning 254 NLP语料和数据集 244 Tools 237 Pytorch & related libraries 230