https://github.com/manel15279/datamining-project

A university project that aims to explore various data mining techniques like Data Exploration, Association Rule Mining, Supervised and Unsupervised Learning, applied to real-world datasets, focusing on soil fertility analysis and COVID-19 cases evolution over time.
https://github.com/manel15279/datamining-project

covid-19 data-analysis data-mining data-visualization datascience gradio machine-learning python soil-properties

Last synced: 7 days ago
JSON representation

A university project that aims to explore various data mining techniques like Data Exploration, Association Rule Mining, Supervised and Unsupervised Learning, applied to real-world datasets, focusing on soil fertility analysis and COVID-19 cases evolution over time.

• Host: GitHub
• URL: https://github.com/manel15279/datamining-project
• Owner: manel15279
• Created: 2023-12-01T18:16:59.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-02-22T01:59:50.000Z (11 months ago)
• Last Synced: 2024-11-22T10:37:59.125Z (2 months ago)
• Topics: covid-19, data-analysis, data-mining, data-visualization, datascience, gradio, machine-learning, python, soil-properties
• Language: Jupyter Notebook
• Homepage:
• Size: 37.8 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Data Mining Project: Soil Fertility Analysis and COVID-19 Cases Evolution

## Overview

This repository contains the code and documentation for a comprehensive data mining university project focusing on soil fertility analysis and COVID-19 cases evolution. The project incorporates both static and temporal datasets and integrates various data mining techniques, including data exploration, preprocessing, visualization, clustering, classification, association rule mining, and evaluation. The project includes a **GUI** built using Gradio that provides an interactive environment for users to perform data mining tasks. 

**Note**: All methods and algorithms are implemented from scratch.

---

![GUI Screenshot](screenshots.png)

## Features

1. **Data Exploration and Preprocessing:**

   - Visualizing datasets and exploring attributes.

   - Analyzing attributes correlations and plots (scatter plot, box plot, histogram).

   - Handling missing values (methods: mode, mean).

   - Detecting and handling outliers (method: linear regression, Discretization and winsorization).

   - Normalization (methods: Min-Max, Z-score).

2. **Clustering:**

   - Implementing clustering algorithms (e.g., k-means, DBSCAN).

   - Evaluating clustering results using metrics like Silhouette Score and Inter/Intra Cluster Distances.

3. **Classification:**

   - Applying classification algorithms made from scratch (e.g., KNN, Decision Trees, Random Forest).

   - Evaluating classification models using various metrics (e.g., accuracy, precision, recall, F1-score, confusion matrix, specificity).

4. **COVID-19 Analysis:**

   - Visualizing the evolution of COVID-19 cases using custom plots (e.g., line charts, stacked bar charts).

   - Analyzing trends and distributions of COVID-19 cases by region and over time.

5. **Association Rule Mining:**

   - Extracting frequent itemsets and association rules using the Apriori algorithm.

   - Implementing a recommender system based on frequent itemsets.