An open API service indexing awesome lists of open source software.

https://github.com/estevesx10/ai-decision-trees-id3

Decision Trees - ID3 [Artificial Intelligence Course Project]
https://github.com/estevesx10/ai-decision-trees-id3

decision-trees id3-decision-tree supervised-machine-learning

Last synced: 7 months ago
JSON representation

Decision Trees - ID3 [Artificial Intelligence Course Project]

Awesome Lists containing this project

README

          

# AI | Decision Trees [ID3 with Python]





















## Project Overview

Nowadays, **Decision Trees** represent one of the most popular **Supervised Machine Learning Algorithms**. They are commonly used in **classification problems**, but yet versatile enough to address **regression tasks** as well. The core concept behind a decision tree resides in **consecutive partitions of data** using feature-based decision-making processes that can be visually represented with a tree structure. This structure consists of nodes and leaves where each internal node denotes a test on an attribute, each branch represents an outcome of the test, and each leaf node holds a **target class label**.

These can vary from:

- **ID3 Algortihm**.
- **CART Algorithm**.
- **(C4.5) Algorithm**.

And even used within **ensemble models**:

- **Random Forest** (Use of Multiple Decision Trees to make a decision).
- **AdaBoost** (Use of Stumps as Weak Learners to make a decision).
- **XGBoost** (One of the best decision trees algorithms used in real world applications).

Consequently, due to their usefullness, this [**Assignment #2**](https://github.com/EstevesX10/AI-Decision-Trees-ID3/blob/main/Decision%20Trees%20-%20ID3/Decision_Trees_ID3.ipynb) focuses on implementing one of these Algorithms:

> The ID3 Algorithm.

## Project Development (Dependencies & Execution)
As a request from our professors this project was developed using a `Notebook`. Therefore if you're looking forward to test it out yourself, keep in mind to either use a **[Anaconda Distribution](https://www.anaconda.com/)** or a 3rd party software that helps you inspect and execute it.

Therefore, for more informations regarding the **Virtual Environment** used in Anaconda, consider checking the [DEPENDENCIES.md](https://github.com/EstevesX10/AI-Decision-Trees-ID3/blob/main/DEPENDENCIES.md) file.

## Authorship

- **Authors** → [Gonçalo Esteves](https://github.com/EstevesX10) and [Nuno Gomes](https://github.com/NightF0x26)
- **Course** → Artificial Intelligence [CC2006]
- **University** → Faculty of Sciences, University of Porto


`README.md by Gonçalo Esteves`