Projects in Awesome Lists tagged with nf4

A curated list of projects in awesome lists tagged with nf4 .

• Sort

  • Recently synced
  • Stars

https://github.com/intel/neural-speed

An innovative library for efficient LLM inference via low-bit quantization

cpu fp4 fp8 gaudi2 gpu int1 int2 int3 int4 int5 int6 int7 int8 llamacpp llm-fine-tuning llm-inference low-bit mxformat nf4 sparsity

Last synced: 10 Feb 2025

https://github.com/rubi-du/ComfyUI-Flux-Inpainting

This repository wraps the flux fill model as ComfyUI nodes. Compared to the flux fill dev model, these nodes can use the flux fill model to perform inpainting and outpainting work under lower VRM conditions

flux flux-dev flux-fill inpaint inpainting nf4 outpaint outpainting

Last synced: 19 Dec 2024

https://github.com/edcalderin/huggingface_ragflow

This project implements a classic Retrieval-Augmented Generation (RAG) system using HuggingFace models with quantization techniques. The system processes PDF documents, extracts their content, and enables interactive question-answering through a Streamlit web application.

bitsandbytes cuda huggingface huggingface-embeddings langchain langchain-community large-language-models llm nf4 python qdrant quantization rag retrieval-augmented-generation ruff streamlit text-generation

Last synced: 21 Mar 2025