Commit Graph
808 Commits
Author SHA1 Message Date
Jaret Burkett cc98c3b690 Add ability to train with just music or vocals on yue2. Doesnt work as expected though 2026-09-17 20:19:32 -06:00
Jaret Burkett a9e7752178 Add MOSS music audio captioner 2026-09-17 10:45:37 -06:00
Jaret Burkett 080873bec9 Harden ace step transcription engine to detect and break out of loops. Add melbanroformer to seperate out the vocals and music for better transcriptions. Much better results. 2026-09-17 09:49:19 -06:00
Jaret Burkett 1db6083645 Show more information about LoRAs when loading loras in generate page 2026-09-17 09:35:43 -06:00
Jaret Burkett 410206e41c Improve speed of sage sheet decoder with yue2. Recover from tracks that fail 2026-09-16 12:24:39 -06:00
Jaret Burkett ce64e65c39 Add support for Qwen 2.5 Omni and add lora loading for captioning models 2026-09-16 10:36:19 -06:00
Jaret Burkett 2977672e4b Point omni vllm to real repo 2026-09-16 09:37:21 -06:00
Jaret Burkett db8dbd68c2 Add support for training VLLMs, omni models, and LLMs 2026-09-15 17:47:02 -06:00
Jaret Burkett f9b23b40bb Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it. 2026-09-14 17:01:36 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett 82137c8ca0 Fix album art issue with music files 2026-09-13 18:08:37 -06:00
Jaret Burkett 881143cbe8 Fixed issue with EMA climbing decay instead of reducing it. 2026-09-12 21:00:31 -06:00
Jaret Burkett 737ee20733 Add lokr support to inference engine 2026-09-12 14:17:44 -06:00
Jaret Burkett 732c761231 Add lora on generate 2026-09-10 18:23:23 -06:00
Jaret Burkett 449488f6b7 Initial inference engine build out 2026-09-10 14:22:49 -06:00
Jaret Burkett f56b5a1d40 Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models. 2026-09-10 11:49:54 -06:00
Jaret Burkett b1bf3e4381 Add a config to force pure noise step at a set rate 2026-09-09 11:26:28 -06:00
Jaret Burkett 4a41f146a3 Fix feedback when doing an ema with feedback so it uses its own scale 2026-09-09 06:43:14 -06:00
Jaret Burkett b764c4a94e DFE cleanup 2026-09-09 06:42:24 -06:00
Jaret Burkett af82197907 Fix gradient checkpointing for sapiens DFE 2026-09-08 12:24:56 -06:00
Jaret Burkett af89a27e0f Fixed issue with partial offloading torchao quants 2026-09-08 05:15:26 -06:00
Jaret Burkett 3e1cb5f67f Rework DFEs to work better with x0 models. Show their loss in the graph 2026-09-07 13:26:01 -06:00
Jaret Burkett 7690ea62c8 Add variable precision adam convrot optimizer with stochastic rounding and accumulation. 2026-09-06 10:51:35 -06:00
Jaret Burkett (Ostris) 2a2ca26ee8 Merge branch 'main' into fix/dataloader-pin-memory 2026-09-05 08:08:39 -06:00
Jaret Burkett ecb2bfbe5e Fixed issue where some unmanaged modules could be lefs on cpu 2026-09-02 09:22:39 -06:00
Jaret Burkett 9d6a9a0803 Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today. 2026-08-31 15:53:58 -06:00
Jaret Burkett 6940ebf533 Skip files where caching fails in a dataset instead of crashing. 2026-08-30 16:49:12 -06:00
Jaret Burkett 74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett 5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett 92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett 85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett 702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett 520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett 45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett 9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett 9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett 8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett b96476a841 Allow overriding the batch size on a per dataset level 2026-08-21 12:56:04 -06:00
Jaret Burkett afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett 127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00