https://github.com/intel/intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
https://github.com/intel/intel-extension-for-transformers

4-bits attention-sink chatbot chatpdf cpu gaudi2 gpu habana intel-optimized-llamacpp large-language-model llm-cpu llm-inference neural-chat neural-chat-7b neurips2023 pc speculative-decoding streamingllm xeon

Last synced: 3 months ago
JSON representation

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

• Host: GitHub
• URL: https://github.com/intel/intel-extension-for-transformers
• Owner: intel
• License: apache-2.0
• Created: 2022-11-11T05:32:27.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-17T15:14:46.000Z (5 months ago)
• Last Synced: 2024-01-17T16:07:39.409Z (5 months ago)
• Topics: 4-bits, attention-sink, chatbot, chatpdf, cpu, gaudi2, gpu, habana, intel-optimized-llamacpp, large-language-model, llm-cpu, llm-inference, neural-chat, neural-chat-7b, neurips2023, pc, speculative-decoding, streamingllm, xeon
• Language: Python
• Homepage:
• Size: 405 MB
• Stars: 1,680
• Watchers: 25
• Forks: 166
• Open Issues: 54
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Code of conduct: docs/code_of_conduct.md
  • Codeowners: .github/CODEOWNERS
  • Security: SECURITY.md

Lists

• awesome-oneapi - intel-extension-for-transformers - Intel Extension for Transformers is a toolkit designed to efficiently accelerate transformer-based models on Intel platforms, optimized for 4th gen Intel Xeon Scalable Processor (codename Sapphire Rapids). (Table of Contents / AI - Frameworks and Toolkits)
• awesome-stars - intel/intel-extension-for-transformers
• awesome-stars - intel-extension-for-transformers
• awesome-stars - intel/intel-extension-for-transformers - ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡ (Python)
• awesome - intel/intel-extension-for-transformers - ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡ (Python)
• awesome-stars - intel/intel-extension-for-transformers - ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡ (Python)
• awesome-production-machine-learning - Intel® Extension for Transformers - extension-for-transformers.svg?style=social) - An Innovative Transformer-based Toolkit to Accelerate GenAI/LLM Everywhere. (Model Serving and Monitoring)
• awesome-stars - intel/intel-extension-for-transformers - ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡ (Python)