Projects in Awesome Lists tagged with gpu-memory
A curated list of projects in awesome lists tagged with gpu-memory .
https://github.com/nvidia/gdrcopy
A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology
gpu-memory gpudirect-rdma kernel-mode-driver libraries linux nvidia
Last synced: 14 May 2025
https://github.com/NVIDIA/gdrcopy
A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology
gpu-memory gpudirect-rdma kernel-mode-driver libraries linux nvidia
Last synced: 21 Apr 2025
https://github.com/eyalroz/cuda-api-wrappers
Thin, unified, C++-flavored wrappers for the CUDA APIs
api-wrapper cuda cuda-api-wrappers cuda-device cuda-driver cuda-driver-api cuda-programming cuda-runtime-api cuda-toolkit gpgpu gpgpu-computing gpu gpu-computing gpu-memory modern-cpp
Last synced: 22 Jan 2026
https://github.com/parasj/checkmate
Training neural networks in TensorFlow 2.0 with 5x less memory
compiler deep-learning distributed-systems gpu-memory memory python tensorflow tensorflow2
Last synced: 12 Apr 2025
https://github.com/liyuanlucasliu/torch-scope
A Toolkit for Training, Tracking, Saving Models and Syncing Results
gpu-memory logger pytorch tensorboard toolkit
Last synced: 06 May 2025
https://github.com/LiyuanLucasLiu/Torch-Scope
A Toolkit for Training, Tracking, Saving Models and Syncing Results
gpu-memory logger pytorch tensorboard toolkit
Last synced: 08 May 2025
https://github.com/Lin-Mao/DrGPUM
A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
cuda-programming gpu-memory gpu-memory-profiler gpu-profiler memory-management
Last synced: 22 Jul 2025
https://github.com/Fangyh09/gpustatus
A tiny, useful command-line tool to show each user gpu usage, pid under each gpu, provide more details than nvidia-smi/gpustat
command-line-tool gpu gpu-memory monitoring-tool nvidia-gpu nvidia-smi
Last synced: 08 Apr 2025
https://github.com/jonlamb-gh/rpi3-rust-fel4-workspace
Rust embedded things running on the seL4 microkernel for the Raspberry Pi 3
aarch64 cargo-fel4 dma embedded-hal fel4 gpu gpu-memory graphics raspberry-pi-3 rpi3 rust rust-embedded sel4 sel4-microkernel
Last synced: 11 Apr 2025
https://github.com/manishklach/kv_deadline_scheduler
Deadline-aware KV-cache scheduling for protecting decode-critical request-state under long-context LLM inference pressure.
ai-infrastructure cxl gpu-memory hbm inference kv-cache llm long-context memory-management memory-tiering nvme pagedattention systems-research vllm
Last synced: 19 Jun 2026
https://github.com/joe0731/hf_vram_calc
A CLI tool for estimating GPU VRAM requirements for Hugging Face models, supporting various data types, parallelization strategies, and fine-tuning scenarios like LoRA.
gpu-memory hugging-face-transformers huggingface huggingface-datasets huggingface-models memory-estimation pipeline-parallelism vram vram-calculator vram-memory-estimation vram-monitoring
Last synced: 27 May 2026
https://github.com/manishklach/ghostkv-lab
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
ai-infrastructure attention-optimization cxl flashattention gpu-memory kv-cache llm-inference long-context long-context-inference memory-systems systems-research transformer transformer-memory transformer-optimization
Last synced: 09 Jun 2026
https://github.com/elinx/llm-mem-calculator
Interactive KV cache memory calculator for LLMs — supports MLA, GQA, hybrid attention, sliding window, and linear attention architectures. Estimate GPU memory for serving any model at any context length.
calculator gpu-memory kv-cache llm llm-serving vllm
Last synced: 09 Jun 2026
