Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/deepmancer/resnet-cifar-classification
A step-by-step implementation of a ResNet-18 model for image classification on the CIFAR-10 dataset
https://github.com/deepmancer/resnet-cifar-classification
cifar cifar10 cifar10-classification deep-neural-networks from-scratch image-classification pytorch pytorch-implementation resnet resnet-18 step-by-step-guide
Last synced: 4 days ago
JSON representation
A step-by-step implementation of a ResNet-18 model for image classification on the CIFAR-10 dataset
- Host: GitHub
- URL: https://github.com/deepmancer/resnet-cifar-classification
- Owner: deepmancer
- Created: 2022-09-16T07:31:40.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2024-08-16T13:15:13.000Z (3 months ago)
- Last Synced: 2024-10-11T20:02:08.036Z (26 days ago)
- Topics: cifar, cifar10, cifar10-classification, deep-neural-networks, from-scratch, image-classification, pytorch, pytorch-implementation, resnet, resnet-18, step-by-step-guide
- Language: Jupyter Notebook
- Homepage:
- Size: 1.98 MB
- Stars: 4
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# 🖼️ Training ResNet-18 for CIFAR-10 Image Classification
### About
This project implements ResNet-18 from scratch in PyTorch and trains it on the CIFAR-10 dataset to achieve high accuracy in image classification.
---
## 📝 Project Description
This repository provides a complete implementation of the ResNet-18 architecture, a deep residual network renowned for its simplicity and effectiveness in image classification tasks. The model is trained on the CIFAR-10 dataset, which contains 60,000 32x32 color images in 10 classes. The focus of this project is to build and train the ResNet-18 model from the ground up, achieving high accuracy, and exploring the learned feature space of the model.
### 🎯 Objectives
- **Model**: Implement the ResNet-18 architecture from scratch in PyTorch.
- **Task**: Train the model on the CIFAR-10 dataset to classify images into one of 10 categories.
- **Feature Exploration**: Visualize and analyze the feature space using t-SNE and k-Nearest Neighbors (k-NN) algorithms.
---
## 🛠️ Prerequisites
Ensure you have the following dependencies installed before running the project:
- **Python 3.6+**: The programming language used for the project.
- **PyTorch**: The deep learning framework employed for building and training ResNet-18.
- **Scikit-learn**: For implementing the t-SNE algorithm and k-NN classifiers.
Install the required libraries via pip:
```bash
pip install torch scikit-learn
```
---
## 📊 Model Performance
The ResNet-18 model, after training on the CIFAR-10 dataset, achieves the following accuracy:
| Model | Accuracy |
| ----------------- | ----------- |
| [ResNet-18](https://arxiv.org/abs/1512.03385) | **90.71%** |
---
## 🔍 Exploring Feature Space
Understanding the feature space learned by a deep network can provide insights into how the model discriminates between different classes. In this project, we explore the outputs of the penultimate layer (one layer before the final classification layer) using the following methods:
- t-SNE
- k-NN
### Feature Space Definition
The feature space refers to the high-dimensional space where the outputs of the neurons in the layer just before the final classification layer reside. Visualizing this space provides valuable insights into the model's internal representations.
### 🌀 t-SNE Visualization
t-SNE (t-distributed Stochastic Neighbor Embedding) is used to reduce the dimensionality of the feature space and project it into a 2D plane for visualization. This technique helps in understanding how well the model separates different classes in the feature space.
### 🧩 k-Nearest Neighbors (k-NN)
k-NN is applied to the feature space to explore the clustering of different classes. It helps in assessing the compactness and separability of the feature vectors generated by the model.
