tlg 38e1523d7e feat: proper VRAM cleanup and admin clear-vram endpoint ...

- gc.collect() + torch.cuda.empty_cache() in unload for reliable VRAM release
- POST /admin/clear-vram endpoint unloads all models and reports GPU memory
- VRAMManager.clear_all() method for programmatic VRAM cleanup

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-05 21:03:39 +02:00

..

llmux

feat: proper VRAM cleanup and admin clear-vram endpoint

2026-04-05 21:03:39 +02:00