Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with datacleaning

A curated list of projects in awesome lists tagged with datacleaning .

https://github.com/openrefine/openrefine

OpenRefine is a free, open source power tool for working with messy data and improving it

data-analysis data-science data-wrangling datacleaning datacleansing datajournalism datamining java journalism opendata reconciliation wikidata

Last synced: 11 Jan 2026

https://github.com/OpenRefine/OpenRefine

OpenRefine is a free, open source power tool for working with messy data and improving it

data-analysis data-science data-wrangling datacleaning datacleansing datajournalism datamining java journalism opendata reconciliation wikidata

Last synced: 15 Mar 2025

https://github.com/sfu-db/dataprep

Open-source low code data preparation library in python. Collect, clean and visualization your data in python with a few lines of code.

apis apiwrapper cleaning connector data-exploration data-science datacleaning dataconnector dataprep datapreparation eda exploratory-data-analysis webconnector

Last synced: 14 May 2025

https://github.com/yobulkdev/yobulkdev

🔥 🔥 🔥Open Source & AI driven Data Onboarding Platform:Free flatfile.com alternative

csv-import csv-parser csv-reader data-engineering datacleaning embeddable javascript languagemodel mongodb nextjs nodejs open-source react stream streaming

Last synced: 21 Apr 2025

https://github.com/DataKitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 05 May 2025

https://github.com/datakitchen/data-observability-installer

Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

data data-engineering data-observability data-profiling data-quality data-reliability data-science datachecker datacleaner datacleaning dataops dataquality datatesting datavalidation mssql pipeline-tests postgresql redshift self-hosted snowflake

Last synced: 06 Apr 2026

https://github.com/prasanthg3/cleantext

An open-source package for python to clean raw text data

cleaning-data cleantext datacleaning nlp python

Last synced: 18 Feb 2026

https://github.com/benchopt/benchmark_bilevel

Benchmark for bi-level optimization solvers

bilevel-optimization datacleaning hyperparameter-optimization

Last synced: 01 Aug 2025

https://github.com/mundipagg/amora-data-build-tool

Amora Data Build Tool enables analysts and engineers to transform data on the data warehouse (BigQuery) by writing Amora Models that describe the data schema using Python's "PEP484 - Type Hints" and select statements with SQLAlchemy. Amora is able to transform Python code into SQL data transformation jobs that run inside the warehouse.

analytics analytics-dashboard analytics-engineering bigquery business-intelligence data-engineering data-modeling datacleaning dataquality elt machine-learning python transformation

Last synced: 08 Sep 2025

https://github.com/data-cleaning/validatedb

Validate on a table in a DB, using dbplyr

database datacleaning validation

Last synced: 22 Oct 2025

https://github.com/mne-tools/mne-denoise

mne-denoise provides narrow-band artefact removal tailored to MNE-Python workflows. It wraps harmonic regression techniques to suppress power-line noise and other oscillatory contaminants while preserving signal rank and interpretability.

bci brain-computer-interface datacleaning dss eeg neuroscience noiseremoval python

Last synced: 14 Jun 2026

https://github.com/nirala96/bangalore-house-prediction-app

Predicts home prices of Bangalore. Used Flutter, Flask and Jupyter Notebook.

data-science datacleaning exploratory-data-analysis flask-api flutter jupyter-notebook linear-regression python

Last synced: 10 Mar 2026

https://github.com/ropensci/excluder

Checks for Exclusion Criteria in Online Data

datacleaning exclusion mturk qualtrics r r-package rstats

Last synced: 05 Mar 2026

https://github.com/salaah01/pandas-data-cleaner

A package to aid with data cleaning using pandas.

datacleaning pandas python

Last synced: 11 Aug 2025

https://github.com/divithraju/divith-raju-immigration-data-engineering

A Capstone Project that covers several aspects of Data Engineering (Data Exploration, Cleaning, Modeling, Pipelining, Processing)

apachespark bigdata bigdataprocessing bigdataproject capstone-project datacleaning dataengineering datalake datamodeling datapipeline dataprocessing dataschema dataset datawherehouse pandas sql

Last synced: 29 Apr 2026

https://github.com/mchenryspagg/google-play-store-apps-analysis-visualization

An analysis and visualization of google play store apps scraped data for the period of 2010 - 2018 . This project aims at cleaning the dataset, analyzing the given dataset, and mining informational quality insights. This project also involves visualizing the data to better and easily understand trends and different categories.

dataanalysis datacleaning datavisualization documentation mysql powerbi preprocessing python sql

Last synced: 09 May 2026

https://github.com/vijishmadhavan/parse-clip

A simple CLIP based project for combining images from multiple datasets.

clip data datacleaning dataexploration dataset fastai image python

Last synced: 14 May 2026

https://github.com/NhanAZ/DataCleaner

Clean up unnecessary data inside plugin_data folder

dataclean datacleaning php plugin pmmp pocketmine pocketmine-mp

Last synced: 09 Jul 2025

https://github.com/pavankethavath/car_dekho_car_price_prediction

A Streamlit web app utilizing Python, scikit-learn, and pandas for used car price prediction. Features data preprocessing (scaling, encoding), Random Forest model optimization with GridSearchCV, and interactive user input handling. Achieves high accuracy (R² score: 0.9028), showcasing skills in machine learning, data engineering, and deployment.

dataanalysis datacleaning datapreprocessing eda encoding feature-extraction feature-selection featureimportance fine-tuning machine-learning minmaxscaling normalization pandas pickle prediction-model python random-forest randomsearch-cv regression streamlit

Last synced: 27 Jan 2026

https://github.com/arzan101/ev--car-data-analysis

This Power BI dashboard provides an interactive and data-driven overview of the electric vehicle (EV) landscape. It visualizes key insights across various dimensions including sales trends, model performance, manufacturer comparisons, and market growth. The purpose of the dashboard is to enable stakeholders to explore and analyze development

data-analysis data-science data-visualization database datacleaning excel powerbi

Last synced: 17 Jun 2025

https://github.com/sonu275981/big-mart-sales-prediction

Using Machine Learning Algorithms for Regression Analysis to predict the sales pattern and Using Data Analysis and Data Visualizations to Support it.

bigmart-sales-prediction data-science database datacleaning feature-engineering machine-learning pandas python sales xgboost-algorithm

Last synced: 06 Aug 2025

https://github.com/johntocci/nullaxe

Nullaxe is a powerful and user-friendly Python library designed for cleaning and preprocessing data. It works seamlessly with both pandas and polars DataFrames, making it a versatile tool for data scientists and developers.

data data-analysis data-science datacleaning pandas polars python

Last synced: 06 Apr 2026

https://github.com/girish119628/girish119628

Data Enthusiast | Predictive Modeler | Turning Insights into Strategies

cross-validation data-visualization datacleaning feature-engineering modeling preprocessing

Last synced: 19 Mar 2026

https://github.com/ngambip/top-uk-youtubers-2024.githu.io

This project involves a comprehensive analysis to determine the top YouTubers in the UK for 2024, Using Excel, SQL and Power BI.

analysis dashboards datacleaning dataqualitycheck dax excel kpi mockup powerbi recommendations testing tsql

Last synced: 17 Feb 2026

https://github.com/vishrut-b/clustering-analysis-of-online-retail-data

This project leverages machine learning techniques to analyze online retail data through customer segmentation. It uses KMeans clustering to identify key customer groups and proposes tailored business strategies based on their purchasing behaviors.

clustering datacleaning exploratory-data-analysis feature-engineering kmeans-clustering machine-learning numpy online-retail pandas sciki seaborn

Last synced: 05 Feb 2026

https://github.com/mariaegbuna/road-accidents

Analyzing a road accidents dataset using Python.

data-visualization datacleaning jupyter-notebook pandas-dataframe python

Last synced: 17 May 2026

https://github.com/shuklayash02/complete_data_analysis_project

A Full Data Analysis project where a sales data is ask,prepare,process,analyze,share and act through data analysis process

data data-visualization dataanalysis database datacleaning powerbi sql

Last synced: 16 Jul 2025

https://github.com/rakumar99/power-bi-projects

This repository contains various power bi projects and dashboards of Humaan Resources , Financial Analysis using Power BI Desktop.

dashboards data-analysis data-visualization databases datacleaning datamodeling etl powerbi powerquery reports

Last synced: 04 Jun 2026

https://github.com/joyalshaji135/product-sale-report-using-power-bi

In Power BI, load the Sales and Category tables, create a relationship between them using CategoryID, and define measures like Total Sales. Build a report with visuals (e.g., bar charts, tables) to display sales data by category, format the visuals, and add slicers for dynamic filtering by category and date.

charts datacleaning powerbi

Last synced: 05 Jan 2026

https://github.com/gaurav-van/toxic-comment-web_app

Data Science Project to classify a comment into several toxicity categories. This Repository is used for deployment of the project.

classification data-science datacleaning exploratory-data-analysis machine-learning nlp nlp-machine-learning python streamlit

Last synced: 02 May 2026

https://github.com/sksubhadeep/nashville-housing-data-cleaning-project-using-sql

SQL Data Cleaning Project on Nashville Housing Dataset

data datacleaning sql

Last synced: 19 Mar 2026

https://github.com/makepath/medaprep

medaprep is a data preparation and feature engineering toolkit for geospatial applications.

data data-science datacleaning eda exploratory-data-analysis xarray

Last synced: 29 Jun 2025

https://github.com/r-mahesh45/hr---resume-text-classification

Text Classification for Resumes: Conducted Exploratory Data Analysis (EDA) on a vast collection of resumes. Organized the data using Bag of Words (BoW) and TF-IDF techniques. Built and evaluated multiple models, with Logistic Regression delivering standout performance. Created Word Clouds and Histograms.

data datacleaning extract-transform-load feature-extraction nlp nltk-tokenizer text-mining text-processing

Last synced: 12 Sep 2025

https://github.com/datarohit/data-cleaning-exercise-2

In this Exercise a partial cleaning and the reordering of column headings has been done in excel and rest cleaning done in Python.

data-cleaning datacleaning pandas

Last synced: 17 Apr 2026

https://github.com/rizz1406/customer-churn-analysis

Telco Customer Churn Analysis - Data analysis and visualization to identify churn patterns in telecom customers. Includes EDA, feature engineering, and optional machine learning modeling to predict churn and provide business insights.

churn-analysis dataanalysis dataanalysisusingpython datacleaning jupyter-notebook python visualization

Last synced: 17 Apr 2026

https://github.com/abhijit2505/coupon-redemption-prediction

A machine learning test case to predict the redemption of the coupon.

data-science datacleaning decision-trees logistic-regression machine-learning-algorithms python3

Last synced: 11 May 2026

https://github.com/simran2911/sales-analysis-dashboard

This github repository contains Comprehensive Sales Analysis Dashboard. The objective of this Tableau project is to create an interactive and insightful dashboard that provides a comprehensive analysis of sales data.

analysis datacleaning excel tableau

Last synced: 02 Mar 2026

https://github.com/shuklayash02/sales_dashboard_powerbi

Created interactive dashboard to track and analyze online sales data Used complex parameters to drill down in worksheet and customization using filters and slicers

data-visualization datacleaning excel powerbi

Last synced: 19 Mar 2026

https://github.com/shuklayash02/excel_complete_vrindastore_dataanalysis

Compltete AnalysisData Cleaning,processing and data analysis with interactive dashboard

analysis data data-visualization datacleaning excel excel-vba

Last synced: 19 Mar 2026

https://github.com/R-Mahesh45/HR---Resume-Text-Classification

Text Classification for Resumes: Conducted Exploratory Data Analysis (EDA) on a vast collection of resumes. Organized the data using Bag of Words (BoW) and TF-IDF techniques. Built and evaluated multiple models, with Logistic Regression delivering standout performance. Created Word Clouds and Histograms.

data datacleaning extract-transform-load feature-extraction nlp nltk-tokenizer text-mining text-processing

Last synced: 13 Oct 2025

https://github.com/rosanafss/alteryx-journey

Practicing for Udacity Data Track. Data analysis executed by me based on the free course | Creating an Analytical Dataset | of Udacity

aggregating alteryx cross-tabbing dataanalysis datacleaning transposing webscraping

Last synced: 27 Jan 2026

https://github.com/wakolivotes/data-processing-and-preparation

In this tutorial, we use the Titanic Data (obtained from Kaggle) to illustrate key aspects of Data Processing and Preparation by relying on useful Python Libraries

data-science datacleaning jupyter-notebook python

Last synced: 13 Apr 2026

https://github.com/cintia0528/data_cleaning_and_analytics-python

Evaluate if aggressive discounting benefits Eniac long-term, considering differing views on customer acquisition and brand positioning. Focus on data cleaning for informed decision-making.

colab-notebook data data-analysis datacleaning dataquality jupyter-notebook matplotlib pandas python seaborn

Last synced: 08 Jan 2026

https://github.com/rizz1406/superstore-sales-analysis

Power BI dashboard analyzing superstore sales trends and forecasting future sales

datacleaning datamodeling datavizualization microsoft-excel powerbi powerbidashboard salesanalysis

Last synced: 06 Mar 2026

https://github.com/shivam1808/data-cleaning-project

We take raw housing data and transform it in SQL Server to make it more usable for analysis.

analysis data datacleaning sql sqlserver

Last synced: 29 May 2026

https://github.com/jenderal92/data-cleaning-tools

This tool is simple and effective for cleaning datasets in CSV format. With its features, you can improve data quality automatically.

data-cleaing-tools datacleaning python python27 remove-duplicates remove-empty-rows

Last synced: 25 Mar 2025

https://github.com/sreejabethu/sales-data-analysis-forecasting

Welcome to the Sales Data Analysis & Forecasting project! 🚀 This repository showcases my data analysis skills through exploratory data analysis (EDA), data cleaning, and visualization of sales and customer feedback data. The goal is to extract actionable insights to drive business decisions.

analysis barchart data-visualization datacleaning exploratory-data-analysis forecasting histogram matplotlib-pyplot numpy-library pandas-library pycharm-ide sales-analysis salesdata salesdataanalysis seaborn-plots transformation

Last synced: 19 May 2026

https://github.com/cintia0528/data_science-ab_testing

Conduct a 5-way AB Test on Montana State University Library's website, comparing the original "Interact" button with new versions ("Learn," "Help," "Connect," "Services") to boost user engagement.

abtesting bonferroni chisquare-test data data-science datacleaning datavisualization hypothesis-testing mde statistics

Last synced: 31 Mar 2025

https://github.com/edochiari/retail_sales-project

The Retail Sales Analysis SQL Project uses SQL to explore, clean, and analyze retail sales data. It involves setting up a database, performing Exploratory Data Analysis (EDA), and answering business questions through advanced SQL queries, showcasing skills in data management and insight generation.

customerinsights datacleaning eda pgadmin postgresql

Last synced: 19 Jul 2025

https://github.com/codehub001/ai-driven-automation-for-data-quality-monitoring-in-cloud-data-warehouses

This project focuses on leveraging AI to automate data quality monitoring in cloud data warehouses. Traditional data validation methods often require manual intervention and fail to scale with increasing data complexity. By integrating machine learning models, this approach enables real-time anomaly detection, automated data cleansing.

csv-export csv-import dashboard data datacleaning lib modeltraining python testing-library visualization

Last synced: 13 May 2025

https://github.com/ashishsingh789/adventure-work-dashboard

Explore sales performance and customer insights with the Adventure-Work-Dashboard, a Power BI visualization project based on Udemy product data. This repository features a dynamic dashboard that provides valuable insights into sales metrics, customer behavior, and product trends.

database datacleaning excel extract powerbi sql transfer

Last synced: 17 Jul 2025

https://github.com/edochiari/customer_clustering-project

This project applies K-Means clustering to segment customers based on RFM metrics, helping identify key customer groups for targeted marketing and loyalty strategies.

dataanalysis datacleaning jupyter-notebook kmeans-clustering

Last synced: 12 Mar 2025

https://github.com/jigyasag18/financial-risk-analysis-project

The Credit Card Financial Risk Analysis Dashboard is a real-time Power BI tool designed to provide insights into credit card transactions and customer demographics. It features interactive visualizations, efficient data processing, and actionable insights to support decision-making. Utilizing data from SQL database, the dashboard tracks key metrics

data dataanalysis database datacleaning datapreprocessing dataprocessing datavisualization financial-analysis financialriskanalysis mysql powerbi sql statistical-analysis

Last synced: 06 Mar 2026

https://github.com/dinukanavaratna/swin-tdp

The scope of the project can be outlined as developing a comprehensive web dashboard that provides valuable insights by analyzing data collected through surveys, for educators, administrators, and policymakers to understand the patterns of influencers, friendships, disrespect, and advice among students within the school culture, supporting them.

analytics dashboard datacleaning datamasking deidentification echarts machine-learning networkx python sna social-network social-network-analysis socialnetworkanalysis

Last synced: 04 Apr 2025

https://github.com/bipinoli/complex-sentence-splitter-to-simple-sentences

A package to split a complex text into simple sentences.

datacleaning nlp-library nlp-parsing python

Last synced: 15 Jul 2025

https://github.com/darrendavy12/postgressql_python_retail_sales_data_pipeline_analytics

Online retail data set from kaggle, I used this for a project using PostgreSQL to demonstrate my knowledge in SQL and workarounds when using the pgadmin GUI and psql tool.

analytics data-engineering datacleaning ecommerce ingestion onlineretailanalysis postgres postgresql realistic-data sql transfrom

Last synced: 09 Jul 2025

https://github.com/matthewlabasan/cv-project

ARL WAM-V Data Recording Automation Using OpenCV and PyTesseract: Automatic data and screen recorder for a Blackbox GUI.

computervision datacleaning tesseract

Last synced: 03 Apr 2025

https://github.com/batthulavinay/divorce-status-prediction-eda-and-ml

This project focuses on analyzing data related to divorce status to uncover insights, trends, and predictive models. The analysis is conducted using Python in a Jupyter Notebook environment.

datacleaning datapreprocessing exploratory-data-analysis knn-regression logistic-regression predictive-analytics random-forest xgboost-regression

Last synced: 13 Apr 2025

https://github.com/tejaswirupa/early-prediction-of-diabetes-risk-using-machine-learning

Built a predictive model using CDC health data to identify individuals at risk of developing diabetes. Achieved 90.6% F1-score using Logistic Regression and revealed key health indicators like BMI and blood pressure as top predictors.

data-science datacleaning exploratory-data-analysis modelevaluation preprocessing-data python scikit-learn supervised-machine-learning

Last synced: 15 Jul 2025

https://github.com/edochiari/tiktok-project

This project builds a predictive model to help TikTok classify user-reported content claims, improving moderation efficiency by identifying and prioritizing content that may need review. Insights from this model enable TikTok to manage reports more effectively, ensuring a safer and more engaging platform.

content-claims dataanalysis datacleaning hypothesis-testing jupyter-notebook regression tiktok

Last synced: 29 Mar 2025

https://github.com/nel-zi/nuga_bank

Developed an automated data exploration and cleaning pipeline for Nuga Bank to streamline data preparation, ensure consistent data quality, and normalize datasets into structured databases for efficient analysis and reporting.

data data-automation data-visualization datacleaning datatransformation etl-automation etl-pipeline

Last synced: 16 May 2025

https://github.com/edochiari/automatidata-project

This project uses taxi trip data to identify key factors that influence tipping, providing insights to help drivers maximize tips through optimized service.

dataanalysis datacleaning hypothesis-testing jupyter-notebook machine-learning regression taxi tipping

Last synced: 29 Mar 2025

https://github.com/shekharkram/project

A collection of data analytics projects showcasing skills in data cleaning, exploration, visualization, and basic SQL queries. Designed to demonstrate entry-level data analyst competencies using real-world datasets and tools.

datacleaning excel jupyter-notebook mysql numpy pandas postgresql python sql

Last synced: 07 Apr 2026

https://github.com/ahmedkhaled404/data-cleaning-and-eda-layoffs-mysql

This project involves cleaning a dataset containing information about layoffs from companies around the world.

data data-analysis data-cleaning data-preprocessing datacleaning eda exploratory-data-analysis mysql sql

Last synced: 08 Jun 2026

https://github.com/nel-zi/francine_store

Built a scalable data pipeline for Francine Stores, enabling them to extract, clean, and load data from Aliexpress for real-time market trend analysis and smarter business decisions.

datacleaning dataengineering dataextraction datamodeling etl etl-pipeline pandas

Last synced: 15 May 2026

https://github.com/pranee123/supply_chain_dashboard

A Power BI Supply Chain Dashboard for analyzing purchase orders, and inventory transactions using SQL and Power BI. 🚀

datacleaning mysql-database powerbi visualization

Last synced: 06 Jul 2025

https://github.com/nel-zi/data_engineering_pretest

In this project, I analyzed supermarket datasets to uncover branch-level sales patterns, regional trends, and promotion effectiveness. This analysis provided valuable insights that helped drive data-driven strategic decisions.

businessinsights dataanalysis dataanlaytics datacleaning machine-learning machine-learning-algorithms machinelearningmodel machinelearningprojects

Last synced: 16 May 2025

https://github.com/vishwas-chakilam/hr-dashboard

This project involves creating an interactive HR Dashboard using Power BI for visualization and MySQL for data cleaning and analysis. It provides insights into employee performance, attrition, salary distribution, and hiring trends.

dashboard data datac datacleaning datavisualization mysql powerbi

Last synced: 23 Mar 2025

https://github.com/udhaya2823/dataspark-illuminating-insights-for-global-electronics

✨DataSpark✨ is a powerful analytics project transforming raw retail data into actionable insights for Global Electronics. By leveraging Python, SQL, and interactive visualizations, it uncovers trends in customer behavior, sales performance, and product popularity, driving smarter business decisions and boosting growth.

data-science data-visualization database-management datacleaning exploratory-data-analysis matplotlib numpy pandas powerbi python seaborn sql version-control

Last synced: 11 Apr 2026