Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett 474948abb4 Change default guidance to 3 for qwen image. 2026-09-20 11:04:16 -06:00
Jaret Burkett f4f5d5dd58 Change qwen image 2 to use new lokr format 2026-09-20 11:02:57 -06:00
Jaret Burkett c2622ed250 Add support for Qwen Image 2.1 2026-09-20 09:50:57 -06:00
Jaret Burkett 8fa15e3569 Move the ui model cards to their own plugin folders so plugins can add custom models in the trainer/generator/ui 2026-09-19 12:07:07 -06:00
Jaret Burkett a6e3b18e8a Added a notes section for jobs 2026-09-19 10:28:29 -06:00
Jaret Burkett cc98c3b690 Add ability to train with just music or vocals on yue2. Doesnt work as expected though 2026-09-17 20:19:32 -06:00
Jaret Burkett a9e7752178 Add MOSS music audio captioner 2026-09-17 10:45:37 -06:00
Jaret Burkett 080873bec9 Harden ace step transcription engine to detect and break out of loops. Add melbanroformer to seperate out the vocals and music for better transcriptions. Much better results. 2026-09-17 09:49:19 -06:00
Jaret Burkett 1db6083645 Show more information about LoRAs when loading loras in generate page 2026-09-17 09:35:43 -06:00
Jaret Burkett ef8110cef7 Add LoRA uploader to the lora picker on the generator 2026-09-17 05:17:34 -06:00
Jaret Burkett e65c4d0fb6 Fix issue with Krea2 patch size when training with shift 2026-09-16 13:46:39 -06:00
Jaret Burkett 410206e41c Improve speed of sage sheet decoder with yue2. Recover from tracks that fail 2026-09-16 12:24:39 -06:00
Jaret Burkett ce64e65c39 Add support for Qwen 2.5 Omni and add lora loading for captioning models 2026-09-16 10:36:19 -06:00
Jaret Burkett 2977672e4b Point omni vllm to real repo 2026-09-16 09:37:21 -06:00
Jaret Burkett db8dbd68c2 Add support for training VLLMs, omni models, and LLMs 2026-09-15 17:47:02 -06:00
Jaret Burkett 426ccb4ec4 fix file identifier parsing of some extensions that were not being recofnized in the ui 2026-09-15 12:59:54 -06:00
Jaret Burkett 6b2526a4d7 Allow Ace Step captioner to work with different output formats like yue2 2026-09-15 12:48:15 -06:00
Jaret Burkett 8bf12e476e Fixed issue that could allow deleting and uploading items outside the restricted directories. 2026-09-15 10:13:53 -06:00
Jaret Burkett 07de70940a Fix and optimize Ace Step captioner 2026-09-15 06:49:06 -06:00
Jaret Burkett 59c7de0539 Increase the repition penalty 2026-09-15 06:12:20 -06:00
Jaret Burkett f2a2a6bea0 Make audio files in dataset be thumbnails until clicked and opened inn the viewer 2026-09-15 05:32:13 -06:00
Jaret Burkett (Ostris) d673cc5205 Merge pull request #1042 from ostris/yue2
YuE2
2026-09-14 17:55:47 -06:00
Jaret Burkett 48d6f441cc Version bump 2026-09-14 17:50:36 -06:00
Jaret Burkett 213d32cad3 Train 50% of the time with and without sheet music. 2026-09-14 17:50:15 -06:00
Jaret Burkett f9b23b40bb Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it. 2026-09-14 17:01:36 -06:00
Jaret Burkett 9ea4348d1e Normalize captions 2026-09-14 14:51:14 -06:00
Jaret Burkett 5ae240dd81 Update readme 2026-09-14 14:18:45 -06:00
Jaret Burkett b53436331c Add regularization and moden info 2026-09-14 14:14:36 -06:00
Jaret Burkett 900c0e8a67 Det the dataset dropout for yue2 2026-09-14 12:19:51 -06:00
Jaret Burkett 7bc91e91a5 Add yue2 caption options 2026-09-14 12:16:39 -06:00
Jaret Burkett 29635253cf Merge branch 'main' into yue2 2026-09-14 09:32:31 -06:00
Jaret Burkett 87f8090bb9 Force advanced editor to 2 spaces indentation 2026-09-14 09:04:30 -06:00
Jaret Burkett 1e8e9d5efe Allow to shift click samples and mass delete rows of samples 2026-09-14 08:55:07 -06:00
Jaret Burkett d44dffd7b8 Move the duration selector 2026-09-14 07:07:26 -06:00
Jaret Burkett f940e61dcd Merge branch 'main' into yue2 2026-09-14 05:21:25 -06:00
Jaret Burkett dd48f5572d Version bump 2026-09-14 05:08:00 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett 82137c8ca0 Fix album art issue with music files 2026-09-13 18:08:37 -06:00
Jaret Burkett 881143cbe8 Fixed issue with EMA climbing decay instead of reducing it. 2026-09-12 21:00:31 -06:00
Jaret Burkett 547593449b Version bump 2026-09-12 14:55:06 -06:00
Jaret Burkett 238c5dc975 Added a toggle on LoRAs on the inference engine to toggle them active or not 2026-09-12 14:28:03 -06:00
Jaret Burkett 737ee20733 Add lokr support to inference engine 2026-09-12 14:17:44 -06:00
Jaret Burkett ca097e63da Version bump 2026-09-12 13:14:47 -06:00
Jaret Burkett 68504f69fa Move engine stream to a non git ignored folder. 2026-09-12 13:14:09 -06:00
Jaret Burkett (Ostris) 24916ec09e Merge pull request #1039 from ostris/inference_engine
Add an inference engine and generation via the UI
2026-09-12 10:39:00 -06:00
Jaret Burkett 63261a9188 Resolve conflict 2026-09-12 06:43:41 -06:00
Jaret Burkett 561a0236b3 Ignore test outputs 2026-09-11 16:37:57 -06:00
Jaret Burkett 732c761231 Add lora on generate 2026-09-10 18:23:23 -06:00
Jaret Burkett 6e1b39c7a8 Improve ui and functionality 2026-09-10 15:44:00 -06:00
Jaret Burkett 449488f6b7 Initial inference engine build out 2026-09-10 14:22:49 -06:00
Jaret Burkett f56b5a1d40 Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models. 2026-09-10 11:49:54 -06:00
Jaret Burkett b1bf3e4381 Add a config to force pure noise step at a set rate 2026-09-09 11:26:28 -06:00
Jaret Burkett 4a41f146a3 Fix feedback when doing an ema with feedback so it uses its own scale 2026-09-09 06:43:14 -06:00
Jaret Burkett b764c4a94e DFE cleanup 2026-09-09 06:42:24 -06:00
Jaret Burkett fb7c14b288 Version update 2026-09-08 12:25:18 -06:00
Jaret Burkett af82197907 Fix gradient checkpointing for sapiens DFE 2026-09-08 12:24:56 -06:00
Jaret Burkett 3ab6eaa3c4 Show fft loss in loss log 2026-09-08 05:16:07 -06:00
Jaret Burkett af89a27e0f Fixed issue with partial offloading torchao quants 2026-09-08 05:15:26 -06:00
Jaret Burkett 3e1cb5f67f Rework DFEs to work better with x0 models. Show their loss in the graph 2026-09-07 13:26:01 -06:00
Jaret Burkett 7690ea62c8 Add variable precision adam convrot optimizer with stochastic rounding and accumulation. 2026-09-06 10:51:35 -06:00
Jaret Burkett bbb1fda457 Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch. 2026-09-06 10:48:10 -06:00
Jaret Burkett (Ostris) fea99cf5d0 Merge pull request #813 from Booyaka101/fix/dataloader-pin-memory
perf: enable pin_memory on CUDA DataLoaders for faster CPU->GPU transfer
2026-09-05 08:09:26 -06:00
Jaret Burkett (Ostris) 2a2ca26ee8 Merge branch 'main' into fix/dataloader-pin-memory 2026-09-05 08:08:39 -06:00
Jaret Burkett b36bb3998a Version bump 2026-09-03 08:44:44 -06:00
Jaret Burkett 90515c5396 Fix issue where we gave the wrong dtype hidden states 2026-09-03 08:43:15 -06:00
Jaret Burkett ead3738773 Fixed connection cap for SSE in the ui 2026-09-02 17:08:12 -06:00
Jaret Burkett ecb2bfbe5e Fixed issue where some unmanaged modules could be lefs on cpu 2026-09-02 09:22:39 -06:00
Jaret Burkett 9d6a9a0803 Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today. 2026-08-31 15:53:58 -06:00
Jaret Burkett 6940ebf533 Skip files where caching fails in a dataset instead of crashing. 2026-08-30 16:49:12 -06:00
Jaret Burkett e98109f213 Version bump 2026-08-30 11:02:22 -06:00
Jaret Burkett 74ed5fddb0 Fix issue with ltx caching 2026-08-30 11:01:52 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett 2a69c1e7de Add initial support for Minimax H3 VSA sparse attention 2026-08-30 08:24:43 -06:00
Jaret Burkett be995185f5 Fixed issue with offloading with new model loader on nvfp4 weights. 2026-08-29 12:01:40 -06:00
Jaret Burkett 7380476b9c Version bump 2026-08-29 11:24:16 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett (Ostris) 64a20f51a6 Merge pull request #1025 from ostris/models/v2
Reworked the entire model loading to make everything testable, hot swappable, and uniform.
2026-08-29 09:06:19 -06:00
Jaret Burkett bb55d38958 Version bump 2026-08-29 08:58:15 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett 5ddc5f8ca7 Optimize quantization path 2026-08-28 11:47:29 -06:00
Jaret Burkett ce3df32101 Fix speed on wan conv patch 2026-08-28 10:54:26 -06:00
Jaret Burkett 92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett 85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett 702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett 520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett 45886f01b2 Phase 2 2026-08-27 16:16:35 -06:00
Jaret Burkett 9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett 9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett 8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett 5497a001cb Fix issue where errors on qwen image omni were not being fully surfaced. 2026-08-26 20:54:24 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 8a912564ce Fix video DOP methods 2026-08-26 10:05:14 -06:00
Jaret Burkett 8436c407f6 Add ability to delete the loss logs from a selected range on the loss graph 2026-08-23 09:57:47 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett b96476a841 Allow overriding the batch size on a per dataset level 2026-08-21 12:56:04 -06:00
Jaret Burkett 89102f76dc Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va 2026-08-19 13:32:06 -06:00
Jaret Burkett afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett 42dfe9c661 Improve video frame reader 2026-08-16 10:21:11 -06:00