A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology
-
Updated
Mar 12, 2026 - C++
#
gpu-memory
Here are 25 public repositories matching this topic...
Thin, unified, C++-flavored wrappers for the CUDA APIs
gpu modern-cpp cuda gpgpu api-wrapper gpu-memory gpu-computing cuda-driver-api cuda-toolkit cuda-device cuda-runtime-api cuda-driver gpgpu-computing cuda-api-wrappers cuda-programming
-
Updated
May 30, 2026 - C++
Training neural networks in TensorFlow 2.0 with 5x less memory
-
Updated
Feb 21, 2022 - Python
A Toolkit for Training, Tracking, Saving Models and Syncing Results
-
Updated
Mar 12, 2020 - Python
A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
-
Updated
May 30, 2026 - Python
cuda gpu-memory gpu-acceleration cuda-kernels compression-schemes compression-algorithm compression-implementations
-
Updated
May 8, 2017 - C++
OpenCV & Spout C++ library. Shared GPU memory and processing at reach.
-
Updated
May 1, 2020 - C++
Rust embedded things running on the seL4 microkernel for the Raspberry Pi 3
rust gpu graphics gpu-memory rpi3 aarch64 dma raspberry-pi-3 sel4 rust-embedded embedded-hal fel4 sel4-microkernel cargo-fel4
-
Updated
Dec 8, 2018 - Rust
A simple tool to find out GPU VRAM requirements for running LLMs
-
Updated
Mar 23, 2026 - HTML
A tiny, useful command-line tool to show each user gpu usage, pid under each gpu, provide more details than nvidia-smi/gpustat
-
Updated
Sep 21, 2019 - Shell
Accurate VRAM calculator for Local LLMs (Llama 4, DeepSeek V3, Qwen 2.5). Calculates GGUF quantization, GQA context overhead, and offloading limits
-
Updated
Nov 27, 2025 - HTML
Demonstration of generating mini-batches in Tensorlfow from GPU memory.
-
Updated
Apr 20, 2017 - Python
-
Updated
Jun 24, 2022 - C++
A fork of Kubernetes with support of schedulable resource of NVIDIA GPU memory
-
Updated
Nov 17, 2018 - Go
Dynamic GPU Layer Swapping: Train large models on consumer GPUs with intelligent memory management
-
Updated
Sep 12, 2025 - Python
A CLI tool for estimating GPU VRAM requirements for Hugging Face models, supporting various data types, parallelization strategies, and fine-tuning scenarios like LoRA.
gpu-memory vram huggingface pipeline-parallelism memory-estimation huggingface-models hugging-face-transformers huggingface-datasets vram-monitoring vram-calculator vram-memory-estimation
-
Updated
Oct 22, 2025 - Python
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
transformer gpu-memory memory-systems kv-cache cxl long-context llm-inference transformer-memory ai-infrastructure flashattention transformer-optimization systems-research long-context-inference attention-optimization
-
Updated
May 18, 2026 - Python
Context saving when switching local LLM backends
-
Updated
May 18, 2026 - C++
Tiered GPU memory architecture for consumer AI inference. VRAM as execution cache, system RAM as passive staging layer.
inference pytorch transformer gpu-memory memory-management offloading vram llm local-ai consumer-gpu vram-optimization
-
Updated
Apr 15, 2026 - Python
📊 A command line monitoring tool (graph) for NVIDIA GPUs
-
Updated
Apr 22, 2020 - Python
Improve this page
Add a description, image, and links to the gpu-memory topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the gpu-memory topic, visit your repo's landing page and select "manage topics."