An open API service indexing awesome lists of open source software.

https://github.com/jmcheon/transformers


https://github.com/jmcheon/transformers

computer-vision natural-language-processing python3 pytorch research-paper-implementation tensorflow transformer-architecture transformer-models

Last synced: about 2 months ago
JSON representation

Awesome Lists containing this project

README

        

# Transformers

This repository contains implementations of moderne AI architectures from research papers.

## Paper Naming Convention
Each implementation follows this naming format:
`
{paper_alias}_{paper_year}
`
## 📌 Computer Vision and Pattern Recognition
- **VGG_2014** - [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://arxiv.org/pdf/1409.1556)
- **FCN_2014** - [Fully Convolutional Networks for Semantic Segmentation](https://arxiv.org/pdf/1411.4038)
- **UNet_2015** - [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://arxiv.org/abs/1505.04597)
- **SegNet_2015** - [SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation](https://arxiv.org/abs/1511.00561)
- **ResNet_2015** - [Deep Residual Learning for Image Recognition](https://arxiv.org/abs/1512.03385)
- **MobileNetV1_2017** - [MobileNets: Efficient Convolutional Nerual Networks for Mobile Vision Applications](https://arxiv.org/abs/1704.04861)
- **MobileNetV2_2018** - [MobileNetV2: Inverted Residuals and Linear Bottlenecks](https://arxiv.org/abs/1801.04381)
- **SID_2018** - [Learning to See in the Dark](https://arxiv.org/abs/1805.01934)
- **Vision_Transformer_2020** - [An Image is Wroth 16x16 Words: Transformer for Image Recognition at Scale](https://arxiv.org/abs/2010.11929)
- **Swin_Transformer_2021** - [Hierarchical Vision Transformer Using Shifted Windows](https://arxiv.org/abs/2103.14030)
- **SwinIR_2021** - [SwinIR: Image Restoration Using Swin Transformer](https://arxiv.org/abs/2108.10257)

## 📌 Computation and Languages
- **Transformer_2017** - [Attention Is All You Need](https://arxiv.org/abs/1706.03762)