Projects in Awesome Lists by nickpotafiy
A curated list of projects in awesome lists by nickpotafiy .
https://github.com/nickpotafiy/illama
A fast, lightweight, parallel inference server for Llama LLMs.
exllama exllamav2 flash-attention-2 inference llama llama2 llama3 llm-inference paged-attention server
Last synced: 26 Mar 2025
https://github.com/nickpotafiy/batch-inference
Fast, parallel, quantized, flash attended, Llama-friendly, OpenAI-comptabile, Exllamav2 based API inference server.
Last synced: 05 Mar 2025
https://github.com/nickpotafiy/gpu-speed-test
Utility for testing PCI speeds between GPUs
Last synced: 05 Mar 2025
https://github.com/nickpotafiy/exl2-api
JavaScript WebSocket API for ExLlamav2
api exllama javascript nodejs websocket
Last synced: 05 Mar 2025
https://github.com/nickpotafiy/unreal-vr-character
An extension of UCharacter with VR in mind
Last synced: 05 Mar 2025