{"id":19824978,"url":"https://github.com/mjahmadee/vision_transformers","last_synced_at":"2026-06-09T06:31:09.080Z","repository":{"id":181756460,"uuid":"667255053","full_name":"MJAHMADEE/Vision_Transformers","owner":"MJAHMADEE","description":"Vision Transformers","archived":false,"fork":false,"pushed_at":"2024-03-16T13:17:16.000Z","size":927,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-11T08:51:39.020Z","etag":null,"topics":["cait","image-classification","transformer","vision-transformer","vision-transformers","vit"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/MJAHMADEE.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-07-17T05:16:18.000Z","updated_at":"2023-07-28T00:03:54.000Z","dependencies_parsed_at":"2025-01-11T08:51:16.251Z","dependency_job_id":"8cd6ade4-d717-426d-aed0-f25446020c37","html_url":"https://github.com/MJAHMADEE/Vision_Transformers","commit_stats":{"total_commits":3,"total_committers":1,"mean_commits":3.0,"dds":0.0,"last_synced_commit":"11fa1cd609c8ac4299676906432d42e2ae07bae8"},"previous_names":["mjahmadee/vision_transformers"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MJAHMADEE%2FVision_Transformers","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MJAHMADEE%2FVision_Transformers/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MJAHMADEE%2FVision_Transformers/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MJAHMADEE%2FVision_Transformers/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/MJAHMADEE","download_url":"https://codeload.github.com/MJAHMADEE/Vision_Transformers/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241181394,"owners_count":19923431,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cait","image-classification","transformer","vision-transformer","vision-transformers","vit"],"created_at":"2024-11-12T11:06:38.037Z","updated_at":"2026-06-09T06:31:09.008Z","avatar_url":"https://github.com/MJAHMADEE.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Vision Transformers with PyTorch 🖼️🤖\n\n![Python](https://img.shields.io/badge/Python-3.8-blue.svg)\n![PyTorch](https://img.shields.io/badge/PyTorch-1.8.1-orange.svg)\n![License](https://img.shields.io/badge/License-MIT-green.svg)\n\nThis project implements Vision Transformers (ViT) using PyTorch to classify images from the CIFAR-10 dataset. It includes pre-trained models like ViT and CaiT, fine-tuned on CIFAR-10, demonstrating how transformers can be adapted for image classification.\n\n## Features 🌟\n- Utilizes pre-trained Vision Transformer (ViT) and Class-Attention in Image Transformers (CaiT) models.\n- Supports fine-tuning of transformer models on the CIFAR-10 dataset.\n- Visualizes training and validation loss, accuracy, and confusion matrices.\n- Demonstrates data preprocessing and augmentation techniques for image data.\n- Evaluates model performance with metrics such as F1-score, recall, accuracy, and precision.\n\n## Setup and Installation 🛠️\n1. Clone the repository from GitHub.\n2. Navigate to the project directory.\n3. Install the required dependencies listed in the `requirements.txt` file.\n\n## Dataset 📁\nThe CIFAR-10 dataset is used, consisting of 60,000 32x32 color images in 10 different classes, with 6,000 images per class. The dataset is automatically downloaded and pre-processed for training and testing.\n\n## Training the Model 🚀\nThe training process involves fine-tuning the pre-trained Vision Transformer models on the CIFAR-10 dataset. The models are adjusted to work with the smaller image size and class count of CIFAR-10.\n\n## Testing the Model 🧪\nAfter training, the model's performance is evaluated on the test set of CIFAR-10. Metrics like accuracy, F1-score, recall, and precision are computed to assess the model.\n\n## Results and Evaluation 📊\nResults are documented through confusion matrices, loss, and accuracy plots. These visualizations help in understanding the model's performance and areas of improvement.\n\n## License 📜\nThis project is licensed under the MIT License - see the LICENSE file for details.\n\n## Acknowledgements 🙌\n- Thanks to the creators of the CIFAR-10 dataset for providing the resources necessary for training and testing the model.\n- PyTorch and timm library documentation for providing comprehensive guides and tutorials.\n\n## Notebook and Copyright\n\u003ca href=\"https://colab.research.google.com/drive/1GQrqxlaq7CESXTwrdkpYbO7_vT9sRV37?usp=sharing\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"\u003e\u003c/a\u003e\n\n@misc{MJVisionTransformers2023,\n  author = {Mohammad Javad (MJ) Ahmadi},\n  title = {Vision Transformers},\n  year = {2023},\n  publisher = {GitHub},\n  journal = {GitHub repository},\n  howpublished = {\\url{https://github.com/MJAHMADEE/Vision_Transformers}}\n}\n\n---\nFor more information, please refer to the [official repository](https://github.com/MJAHMADEE/Vision_Transformers).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmjahmadee%2Fvision_transformers","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmjahmadee%2Fvision_transformers","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmjahmadee%2Fvision_transformers/lists"}