Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett e65c4d0fb6 Fix issue with Krea2 patch size when training with shift 2026-09-16 13:46:39 -06:00
Jaret Burkett 410206e41c Improve speed of sage sheet decoder with yue2. Recover from tracks that fail 2026-09-16 12:24:39 -06:00
Jaret Burkett ce64e65c39 Add support for Qwen 2.5 Omni and add lora loading for captioning models 2026-09-16 10:36:19 -06:00
Jaret Burkett 2977672e4b Point omni vllm to real repo 2026-09-16 09:37:21 -06:00
Jaret Burkett db8dbd68c2 Add support for training VLLMs, omni models, and LLMs 2026-09-15 17:47:02 -06:00
Jaret Burkett 426ccb4ec4 fix file identifier parsing of some extensions that were not being recofnized in the ui 2026-09-15 12:59:54 -06:00
Jaret Burkett 6b2526a4d7 Allow Ace Step captioner to work with different output formats like yue2 2026-09-15 12:48:15 -06:00
Jaret Burkett 8bf12e476e Fixed issue that could allow deleting and uploading items outside the restricted directories. 2026-09-15 10:13:53 -06:00
Jaret Burkett 07de70940a Fix and optimize Ace Step captioner 2026-09-15 06:49:06 -06:00
Jaret Burkett 59c7de0539 Increase the repition penalty 2026-09-15 06:12:20 -06:00
Jaret Burkett f2a2a6bea0 Make audio files in dataset be thumbnails until clicked and opened inn the viewer 2026-09-15 05:32:13 -06:00
Jaret Burkett (Ostris) d673cc5205 Merge pull request #1042 from ostris/yue2
YuE2
2026-09-14 17:55:47 -06:00
Jaret Burkett 48d6f441cc Version bump 2026-09-14 17:50:36 -06:00
Jaret Burkett 213d32cad3 Train 50% of the time with and without sheet music. 2026-09-14 17:50:15 -06:00
Jaret Burkett f9b23b40bb Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it. 2026-09-14 17:01:36 -06:00
Jaret Burkett 9ea4348d1e Normalize captions 2026-09-14 14:51:14 -06:00
Jaret Burkett 5ae240dd81 Update readme 2026-09-14 14:18:45 -06:00
Jaret Burkett b53436331c Add regularization and moden info 2026-09-14 14:14:36 -06:00
Jaret Burkett 900c0e8a67 Det the dataset dropout for yue2 2026-09-14 12:19:51 -06:00
Jaret Burkett 7bc91e91a5 Add yue2 caption options 2026-09-14 12:16:39 -06:00
Jaret Burkett 29635253cf Merge branch 'main' into yue2 2026-09-14 09:32:31 -06:00
Jaret Burkett 87f8090bb9 Force advanced editor to 2 spaces indentation 2026-09-14 09:04:30 -06:00
Jaret Burkett 1e8e9d5efe Allow to shift click samples and mass delete rows of samples 2026-09-14 08:55:07 -06:00
Jaret Burkett d44dffd7b8 Move the duration selector 2026-09-14 07:07:26 -06:00
Jaret Burkett f940e61dcd Merge branch 'main' into yue2 2026-09-14 05:21:25 -06:00
Jaret Burkett dd48f5572d Version bump 2026-09-14 05:08:00 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett 82137c8ca0 Fix album art issue with music files 2026-09-13 18:08:37 -06:00
Jaret Burkett 881143cbe8 Fixed issue with EMA climbing decay instead of reducing it. 2026-09-12 21:00:31 -06:00
Jaret Burkett 547593449b Version bump 2026-09-12 14:55:06 -06:00
Jaret Burkett 238c5dc975 Added a toggle on LoRAs on the inference engine to toggle them active or not 2026-09-12 14:28:03 -06:00
Jaret Burkett 737ee20733 Add lokr support to inference engine 2026-09-12 14:17:44 -06:00
Jaret Burkett ca097e63da Version bump 2026-09-12 13:14:47 -06:00
Jaret Burkett 68504f69fa Move engine stream to a non git ignored folder. 2026-09-12 13:14:09 -06:00
Jaret Burkett (Ostris) 24916ec09e Merge pull request #1039 from ostris/inference_engine
Add an inference engine and generation via the UI
2026-09-12 10:39:00 -06:00
Jaret Burkett 63261a9188 Resolve conflict 2026-09-12 06:43:41 -06:00
Jaret Burkett 561a0236b3 Ignore test outputs 2026-09-11 16:37:57 -06:00
Jaret Burkett 732c761231 Add lora on generate 2026-09-10 18:23:23 -06:00
Jaret Burkett 6e1b39c7a8 Improve ui and functionality 2026-09-10 15:44:00 -06:00
Jaret Burkett 449488f6b7 Initial inference engine build out 2026-09-10 14:22:49 -06:00
Jaret Burkett f56b5a1d40 Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models. 2026-09-10 11:49:54 -06:00
Jaret Burkett b1bf3e4381 Add a config to force pure noise step at a set rate 2026-09-09 11:26:28 -06:00
Jaret Burkett 4a41f146a3 Fix feedback when doing an ema with feedback so it uses its own scale 2026-09-09 06:43:14 -06:00
Jaret Burkett b764c4a94e DFE cleanup 2026-09-09 06:42:24 -06:00
Jaret Burkett fb7c14b288 Version update 2026-09-08 12:25:18 -06:00
Jaret Burkett af82197907 Fix gradient checkpointing for sapiens DFE 2026-09-08 12:24:56 -06:00
Jaret Burkett 3ab6eaa3c4 Show fft loss in loss log 2026-09-08 05:16:07 -06:00
Jaret Burkett af89a27e0f Fixed issue with partial offloading torchao quants 2026-09-08 05:15:26 -06:00
Jaret Burkett 3e1cb5f67f Rework DFEs to work better with x0 models. Show their loss in the graph 2026-09-07 13:26:01 -06:00
Jaret Burkett 7690ea62c8 Add variable precision adam convrot optimizer with stochastic rounding and accumulation. 2026-09-06 10:51:35 -06:00
Jaret Burkett bbb1fda457 Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch. 2026-09-06 10:48:10 -06:00
Jaret Burkett (Ostris) fea99cf5d0 Merge pull request #813 from Booyaka101/fix/dataloader-pin-memory
perf: enable pin_memory on CUDA DataLoaders for faster CPU->GPU transfer
2026-09-05 08:09:26 -06:00
Jaret Burkett (Ostris) 2a2ca26ee8 Merge branch 'main' into fix/dataloader-pin-memory 2026-09-05 08:08:39 -06:00
Jaret Burkett b36bb3998a Version bump 2026-09-03 08:44:44 -06:00
Jaret Burkett 90515c5396 Fix issue where we gave the wrong dtype hidden states 2026-09-03 08:43:15 -06:00
Jaret Burkett ead3738773 Fixed connection cap for SSE in the ui 2026-09-02 17:08:12 -06:00
Jaret Burkett ecb2bfbe5e Fixed issue where some unmanaged modules could be lefs on cpu 2026-09-02 09:22:39 -06:00
Jaret Burkett 9d6a9a0803 Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today. 2026-08-31 15:53:58 -06:00
Jaret Burkett 6940ebf533 Skip files where caching fails in a dataset instead of crashing. 2026-08-30 16:49:12 -06:00
Jaret Burkett e98109f213 Version bump 2026-08-30 11:02:22 -06:00
Jaret Burkett 74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett 2a69c1e7de Add initial support for Minimax H3 VSA sparse attention 2026-08-30 08:24:43 -06:00
Jaret Burkett be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett 7380476b9c Version bump 2026-08-29 11:24:16 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett (Ostris) 64a20f51a6 Merge pull request #1025 from ostris/models/v2
Reworked the entire model loading to make everything testable, hot swappable, and uniform.
2026-08-29 09:06:19 -06:00
Jaret Burkett bb55d38958 Version bump 2026-08-29 08:58:15 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett 5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett 92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett 85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett 702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett 520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett 45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett 9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett 9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett 8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett 5497a001cb Fix issue where errors on qwen image omni were not being fully surfaced. 2026-08-26 20:54:24 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett 8436c407f6 Add ability to delete the loss logs from a selected range on the loss graph 2026-08-23 09:57:47 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett b96476a841 Allow overriding the batch size on a per dataset level 2026-08-21 12:56:04 -06:00
Jaret Burkett 89102f76dc Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va 2026-08-19 13:32:06 -06:00
Jaret Burkett afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett 42dfe9c661 Improve video frame reader 2026-08-16 10:21:11 -06:00
Jaret Burkett b982a03ae4 Add training adapter for MiniMax H3 ref2va and default to contrastive loss with adapter 2026-08-16 09:11:07 -06:00
Jaret Burkett 2042481914 On MiniMax H3 set the default to use both contrastive guidance and the training adapter as it is yielding better results than one or the other. 2026-08-16 08:43:31 -06:00
Jaret Burkett 61310c6397 Inprove cpu data acuisition on backend 2026-08-16 08:42:36 -06:00
Jaret Burkett 2cbc2bb097 On minimax h3, trim cached text embeddings to max tokens if they are longer than specified 2026-08-16 08:42:01 -06:00
Jaret Burkett 0f788923ae Animate action bar so starting a job has a 'working' indicator. 2026-08-15 10:33:40 -06:00
Jaret Burkett e6cffbc002 Adjust encoded paths so filenames resolve as a basename properly when downloading with things like wget. 2026-08-15 08:56:55 -06:00
Jaret Burkett 151ad0e959 Adjust MiniMah h3 sizing for videos to downscale to match 2026-08-15 07:50:42 -06:00
Jaret Burkett 70b1089359 Version bump 2026-08-15 07:14:13 -06:00
Jaret Burkett 127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett f1faa7725b version bump 2026-08-15 06:20:32 -06:00