https://github.com/feifeibear/colossalai_bert_inference

https://github.com/feifeibear/colossalai_bert_inference

Last synced: 10 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/feifeibear/colossalai_bert_inference
• Owner: feifeibear
• Created: 2022-04-27T07:51:35.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-05-09T08:26:55.000Z (over 3 years ago)
• Last Synced: 2025-01-23T00:41:16.679Z (11 months ago)
• Language: Python
• Size: 6.84 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
## An example to show how ColossalAI helps you write distributed inference code.

the file contains a script to run 1D Tensor Parallelism (also known as Model Parallelism) on 4 GPUs.