Commit Graph
17 Commits
Author SHA1 Message Date
Jaret Burkett 609f3e5fa5 Fix issue with memory manager on MPS devices 2026-10-23 14:37:50 -06:00
Jaret Burkett af89a27e0f Fixed issue with partial offloading torchao quants 2026-09-08 05:15:26 -06:00
Jaret Burkett ecb2bfbe5e Fixed issue where some unmanaged modules could be lefs on cpu 2026-09-02 09:22:39 -06:00
Jaret Burkett 74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett a1ddeeef13 Fixed issue with offloading text encoder on ltx 2.5 2026-08-12 10:46:58 -06:00
Jaret Burkett 682b27c6ee Reworked freeing memory manager for removing text encoder completly when not needed. 2026-08-09 07:08:24 -06:00
Jaret Burkett 4625406093 WIP working on convrot offloading 2026-07-11 15:37:28 -06:00
Jaret Burkett 1d1e21177a Add ostris linear layer to linear layer searches. 2026-07-11 14:21:16 -06:00
PlagueKind 7c1a76f336 Fix text encoder offload bug when caching embeddings (#868) 2026-06-07 14:09:32 -06:00
Jaret Burkett 0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support 2025-10-21 06:03:27 -06:00
Jaret Burkett 76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. 2025-10-20 14:54:30 -06:00
Jaret Burkett 7abf5e20be Add conv3d to memory management excluded modules 2025-10-15 10:12:06 -06:00
Jaret Burkett 1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload 2025-10-10 13:12:32 -06:00
Jaret Burkett 4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00
Jaret Burkett 3086a58e5b git status 2025-10-01 14:12:17 -06:00