https://github.com/NVIDIA/FasterTransformer

Transformer related optimization, including BERT, GPT
https://github.com/NVIDIA/FasterTransformer

bert gpt pytorch transformer

Last synced: about 2 months ago
JSON representation

Transformer related optimization, including BERT, GPT

• Host: GitHub
• URL: https://github.com/NVIDIA/FasterTransformer
• Owner: NVIDIA
• License: apache-2.0
• Created: 2021-04-02T21:36:33.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2024-03-27T11:25:30.000Z (9 months ago)
• Last Synced: 2024-10-16T11:06:39.874Z (about 2 months ago)
• Topics: bert, gpt, pytorch, transformer
• Language: C++
• Homepage:
• Size: 65.8 MB
• Stars: 5,820
• Watchers: 62
• Forks: 889
• Open Issues: 290
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-lm-system - FasterTransformer
• awesome-transformer-nlp - FasterTransformer - Transformer related optimization, including BERT and GPT. This repo provides a script and recipe to run the highly optimized transformer-based encoder and decoder component, and it is tested and maintained by NVIDIA. (Transformer Implementations By Communities / PyTorch and TensorFlow)
• awesome-huggingface - FasterTransformer - A script and recipe to run the highly optimized transformer-based encoder and decoder component on NVIDIA GPUs. (⚙️ Inference Engines)
• Awesome-Resource-Efficient-LLM-Papers - FasterTransformer: A Faster Transformer Framework
• StarryDivineSky - NVIDIA/FasterTransformer
• Awesome-LLM - FasterTransformer - NVIDIA Framework for LLM Inference(Transitioned to TensorRT-LLM) (LLM Deployment)