Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/intel/intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
https://github.com/intel/intel-extension-for-transformers
4-bits chatbot chatpdf cpu gaudi2 gpu habana intel-optimized-llamacpp large-language-model llm-cpu llm-inference neural-chat neural-chat-7b neurips2023 rag retrieval speculative-decoding streamingllm xeon
Last synced: about 1 month ago
JSON representation
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
- Host: GitHub
- URL: https://github.com/intel/intel-extension-for-transformers
- Owner: intel
- License: apache-2.0
- Created: 2022-11-11T05:32:27.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-13T17:32:16.000Z (5 months ago)
- Last Synced: 2024-04-14T01:52:49.742Z (5 months ago)
- Topics: 4-bits, chatbot, chatpdf, cpu, gaudi2, gpu, habana, intel-optimized-llamacpp, large-language-model, llm-cpu, llm-inference, neural-chat, neural-chat-7b, neurips2023, rag, retrieval, speculative-decoding, streamingllm, xeon
- Language: Python
- Homepage:
- Size: 543 MB
- Stars: 1,909
- Watchers: 26
- Forks: 180
- Open Issues: 56
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: docs/code_of_conduct.md
- Codeowners: .github/CODEOWNERS
- Security: SECURITY.md
Awesome Lists containing this project
- awesome-oneapi - intel-extension-for-transformers - Intel Extension for Transformers is a toolkit designed to efficiently accelerate transformer-based models on Intel platforms, optimized for 4th gen Intel Xeon Scalable Processor (codename Sapphire Rapids). (Table of Contents / AI - Frameworks and Toolkits)
- awesome-production-machine-learning - Intel® Extension for Transformers - extension-for-transformers.svg?style=social) - An Innovative Transformer-based Toolkit to Accelerate GenAI/LLM Everywhere. (Model Serving and Monitoring)
- StarryDivineSky - intel/intel-extension-for-transformers