gpu-memory-management

Here are 2 public repositories matching this topic...

basnetlachu / memopt

MEMOPT: Universal Memory Fabric for AI Infrastructure. Open-sourced by Sophisticates.

ai cuda apache2 vmm kv-cache llm-inference ai-infrastructure gpu-memory-management ai-memory-system sophisticates memopt

Updated Jun 4, 2026
Python

A custom distributed training framework implementing ZeRO-1 and ZeRO-2 memory partitioning from scratch in PyTorch. Features async gradient hooks, sharded AdamW, and distributed checkpointing without relying on FSDP or HuggingFace Trainer.

pytorch autograd distributed-training backend-infrastructure gpu-memory-management zero-redundancy-optimizer

Updated Aug 4, 2026
Python

Improve this page

Add a description, image, and links to the gpu-memory-management topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpu-memory-management topic, visit your repo's landing page and select "manage topics."

Learn more

Navigation Menu

gpu-memory-management

Here are 2 public repositories matching this topic...

basnetlachu / memopt

arponbiswasanik / optzero

Improve this page

Add this topic to your repo