Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/NetEase-FuXi/EET
Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model
https://github.com/NetEase-FuXi/EET
bert bert-inference-performance eet gpt2 gpt2-inference-performance
Last synced: about 2 months ago
JSON representation
Easy and Efficient Transformer : Scalable Inference Solution For Large NLP model
- Host: GitHub
- URL: https://github.com/NetEase-FuXi/EET
- Owner: NetEase-FuXi
- License: apache-2.0
- Created: 2021-03-23T02:20:56.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-07-08T09:14:51.000Z (2 months ago)
- Last Synced: 2024-07-08T11:36:05.144Z (2 months ago)
- Topics: bert, bert-inference-performance, eet, gpt2, gpt2-inference-performance
- Language: Python
- Homepage:
- Size: 43.5 MB
- Stars: 257
- Watchers: 6
- Forks: 46
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - NetEase-FuXi/EET - based大模型和长序列场景的高性能pytorch推理插件。高性能：设计高度优化的CUDA内核。灵活：提供包括op api、model api和pipelines应对不同需求。 使用： 几行代码即可完成。适配主流ai框架，包括fairseq和transformers。bert模型整体性能加速1.2x到7.x倍，gpt模型整体性能加速2.x到7.x倍。 (Transformer库与优化)