Commit Graph
1501 Commits
Author SHA1 Message Date
Jaret Burkett b764c4a94e DFE cleanup 2026-09-09 06:42:24 -06:00
Jaret Burkett fb7c14b288 Version update 2026-09-08 12:25:18 -06:00
Jaret Burkett af82197907 Fix gradient checkpointing for sapiens DFE 2026-09-08 12:24:56 -06:00
Jaret Burkett 3ab6eaa3c4 Show fft loss in loss log 2026-09-08 05:16:07 -06:00
Jaret Burkett af89a27e0f Fixed issue with partial offloading torchao quants 2026-09-08 05:15:26 -06:00
Jaret Burkett 3e1cb5f67f Rework DFEs to work better with x0 models. Show their loss in the graph 2026-09-07 13:26:01 -06:00
Jaret Burkett 7690ea62c8 Add variable precision adam convrot optimizer with stochastic rounding and accumulation. 2026-09-06 10:51:35 -06:00
Jaret Burkett bbb1fda457 Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch. 2026-09-06 10:48:10 -06:00
Jaret Burkett (Ostris) fea99cf5d0 Merge pull request #813 from Booyaka101/fix/dataloader-pin-memory
perf: enable pin_memory on CUDA DataLoaders for faster CPU->GPU transfer
2026-09-05 08:09:26 -06:00
Jaret Burkett (Ostris) 2a2ca26ee8 Merge branch 'main' into fix/dataloader-pin-memory 2026-09-05 08:08:39 -06:00
Jaret Burkett b36bb3998a Version bump 2026-09-03 08:44:44 -06:00
Jaret Burkett 90515c5396 Fix issue where we gave the wrong dtype hidden states 2026-09-03 08:43:15 -06:00
Jaret Burkett ead3738773 Fixed connection cap for SSE in the ui 2026-09-02 17:08:12 -06:00
Jaret Burkett ecb2bfbe5e Fixed issue where some unmanaged modules could be lefs on cpu 2026-09-02 09:22:39 -06:00
Jaret Burkett 9d6a9a0803 Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today. 2026-08-31 15:53:58 -06:00
Jaret Burkett 6940ebf533 Skip files where caching fails in a dataset instead of crashing. 2026-08-30 16:49:12 -06:00
Jaret Burkett e98109f213 Version bump 2026-08-30 11:02:22 -06:00
Jaret Burkett 74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett 2a69c1e7de Add initial support for Minimax H3 VSA sparse attention 2026-08-30 08:24:43 -06:00
Jaret Burkett be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett 7380476b9c Version bump 2026-08-29 11:24:16 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett (Ostris) 64a20f51a6 Merge pull request #1025 from ostris/models/v2
Reworked the entire model loading to make everything testable, hot swappable, and uniform.
2026-08-29 09:06:19 -06:00
Jaret Burkett bb55d38958 Version bump 2026-08-29 08:58:15 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett 5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett 92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett 85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett 702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett 520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett 45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett 9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett 9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett 8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett 5497a001cb Fix issue where errors on qwen image omni were not being fully surfaced. 2026-08-26 20:54:24 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett 8436c407f6 Add ability to delete the loss logs from a selected range on the loss graph 2026-08-23 09:57:47 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett b96476a841 Allow overriding the batch size on a per dataset level 2026-08-21 12:56:04 -06:00
Jaret Burkett 89102f76dc Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va 2026-08-19 13:32:06 -06:00
Jaret Burkett afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett 42dfe9c661 Improve video frame reader 2026-08-16 10:21:11 -06:00
Jaret Burkett b982a03ae4 Add training adapter for MiniMax H3 ref2va and default to contrastive loss with adapter 2026-08-16 09:11:07 -06:00
Jaret Burkett 2042481914 On MiniMax H3 set the default to use both contrastive guidance and the training adapter as it is yielding better results than one or the other. 2026-08-16 08:43:31 -06:00
Jaret Burkett 61310c6397 Inprove cpu data acuisition on backend 2026-08-16 08:42:36 -06:00