Ecosyste.ms: Awesome

https://github.com/data-forge/data-forge-ts

The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

csv data data-analysis data-cleaning data-cleansing data-forge data-management data-manipulation data-munging data-visualization data-wrangling javascript json linq nodejs pandas visualization

Last synced: 02 Jul 2024

https://github.com/charlesdedampierre/BunkaTopics

🗺️ Data Cleaning and Textual Data Visualization 🗺️

cartography data-cleaning explainability fine-tuning llms machine-learning natural-language-processing nlp summarization topic-modeling

Last synced: 21 Jun 2024

https://github.com/ChrisMuir/refinr

Cluster and merge similar string values: an R implementation of Open Refine clustering algorithms

approximate-string-matching clustering cran data-cleaning data-clustering fuzzy-matching ngram openrefine r rstats

Last synced: 21 Jun 2024

https://github.com/data-cleaning/errorlocate

Find and replace erroneous fields in data using validation rules

data-cleaning errors invalidation r

Last synced: 10 Jun 2024

https://github.com/the-Hull/datacleanr

Interactive and Reproducible Data Cleaning

annotation-tool data-cleaning outlier-detection outlier-removal reproducibility

Last synced: 10 Jun 2024

https://github.com/carlosstack/cleaning-data-in-r

:pick: :gem: Taking raw data and converting it to tidy data that can be used for later analysis

data-cleaning data-manipulation r-programming regular-expression

Last synced: 10 Jun 2024

https://github.com/data-cleaning/validatetools

data-cleaning r rules validation

Last synced: 04 Jun 2024

https://github.com/Nelson-Gon/mde

mde: Missing Data Explorer

data-analysis data-cleaning data-exploration data-science datacleaner datacleaning exploratory-data-analysis missing missing-data missing-value-treatment missing-values missingness omit r r-package r-stats recode replace rstats statistics

Last synced: 04 Jun 2024

https://github.com/data-cleaning/dcmodifydb

Deterministic, documented correction rules on a database

correction data-cleaning database r

Last synced: 04 Jun 2024

https://github.com/ropensci/taxa

taxonomic classes for R

data-cleaning r r-package rstats taxon taxonomy

Last synced: 04 Jun 2024

https://github.com/data-cleaning/validatesuggest

Generate validation rules from data

data-cleaning r validation

Last synced: 03 Jun 2024

https://github.com/marksweiss/sofine

Lightweight framework for creating data-collecting plugins and chaining calls to them from CLI, REST or Python to return unified data sets.

cross-language data-cleaning data-processing data-retrieval json python

Last synced: 03 Jun 2024

https://github.com/skrub-data/skrub

Prepping tables for machine learning

data data-analysis data-cleaning data-preparation data-preprocessing data-science data-wrangling dirty-data machine-learning

Last synced: 31 May 2024

https://github.com/awesome-mlops/awesome-ml-monitoring

A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

aiops concept-drift data-cleaning data-drift data-management data-monitoring data-quality data-science dataops datascience deep-learning machine-learning machine-learning-platform mlops model-drift model-explainability model-management model-monitoring model-performance

Last synced: 31 May 2024

https://github.com/msberends/clean

Fast and Easy Data Cleaning (in R)

data-cleaning r

Last synced: 20 May 2024

https://github.com/schema-inspector/schema-inspector

Schema-Inspector is a simple JavaScript object sanitization and validation module.

data-cleaning javascript sanitization validation

Last synced: 16 May 2024

https://github.com/johnkerl/miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit

Last synced: 07 May 2024

https://github.com/unionai-oss/pandera

A light-weight, flexible, and expressive statistical data testing library

assertions data-assertions data-check data-cleaning data-processing data-validation data-verification dataframe-schema dataframes hypothesis-testing pandas pandas-dataframe pandas-validation pandas-validator schema testing testing-tools validation

Last synced: 28 Apr 2024

https://github.com/cleanlab/cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

active-learning annotation data-analysis data-centric-ai data-cleaning data-curation data-labeling data-profiling data-quality data-science data-validation dataops dataquality datasets labeling llms noisy-labels out-of-distribution-detection outlier-detection weak-supervision

Last synced: 28 Apr 2024

https://github.com/hi-primus/optimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

big-data-cleaning bigdata cudf dask dask-cudf data-analysis data-cleaner data-cleaning data-cleansing data-exploration data-extraction data-preparation data-profiling data-science data-transformation data-wrangling machine-learning pyspark spark

Last synced: 28 Apr 2024

https://github.com/Desbordante/desbordante-core

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

anomaly-detection correlations data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-mining-algorithms data-preprocessing data-profiling data-science data-wrangling exploratory-data-analysis feature-engineering feature-extraction feature-selection knowledge-discovery spreadsheets tabular-data