Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with ipex

A curated list of projects in awesome lists tagged with ipex .

https://github.com/aahouzi/llama2-chatbot-cpu

A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.

4-bit-cpu bfloat16 chatbot chatbot-memory chatgpt cpu huggingface int8 intel ipex langchain llama llama2 meta meta-ai neural-compression numa optimization smooth-quantization streamlit

Last synced: 27 Oct 2024

https://github.com/rahulunair/simple_llm_inference

A simple example of LLM inference on Intel GPUs (XPUs)

intel-arc intel-gpu-max intelgpu ipex llm-inference transformers

Last synced: 14 Nov 2024

https://github.com/rahulunair/simpsons_llm_xpu

Finetune an LLM on intel discrete GPUs to generate dialogues based on the simpsons dataset

huggingface-transformers intel-arc intel-gpu intel-gpu-max ipex llm-inference llm-training lora pytorch

Last synced: 14 Nov 2024