Commit Graph
552 Commits
Author SHA1 Message Date
Jaret Burkett 59c7de0539 Increase the repition penalty 2026-09-15 06:12:20 -06:00
Jaret Burkett 213d32cad3 Train 50% of the time with and without sheet music. 2026-09-14 17:50:15 -06:00
Jaret Burkett f9b23b40bb Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it. 2026-09-14 17:01:36 -06:00
Jaret Burkett 9ea4348d1e Normalize captions 2026-09-14 14:51:14 -06:00
Jaret Burkett b53436331c Add regularization and moden info 2026-09-14 14:14:36 -06:00
Jaret Burkett 7bc91e91a5 Add yue2 caption options 2026-09-14 12:16:39 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett 68504f69fa Move engine stream to a non git ignored folder. 2026-09-12 13:14:09 -06:00
Jaret Burkett 732c761231 Add lora on generate 2026-09-10 18:23:23 -06:00
Jaret Burkett 6e1b39c7a8 Improve ui and functionality 2026-09-10 15:44:00 -06:00
Jaret Burkett 449488f6b7 Initial inference engine build out 2026-09-10 14:22:49 -06:00
Jaret Burkett f56b5a1d40 Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models. 2026-09-10 11:49:54 -06:00
Dawn-Lcg b90cccdfb1 Fix: QwenImageEditPlusModel crashes with batch_size > 1
Pass only the current sample's caption to encode_prompt, and right-pad
per-sample embeddings before concatenating.
2026-09-10 20:31:30 +08:00
Dawn-Lcg 17e5f59f36 Fix in-place downsampling of reference images in QwenImageEditPlusModel
Copy control images to avoid mutating the original list.
2026-09-10 19:48:19 +08:00
Jaret Burkett 3ab6eaa3c4 Show fft loss in loss log 2026-09-08 05:16:07 -06:00
Jaret Burkett 3e1cb5f67f Rework DFEs to work better with x0 models. Show their loss in the graph 2026-09-07 13:26:01 -06:00
Jaret Burkett bbb1fda457 Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch. 2026-09-06 10:48:10 -06:00
Jaret Burkett 90515c5396 Fix issue where we gave the wrong dtype hidden states 2026-09-03 08:43:15 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett 2a69c1e7de Add initial support for Minimax H3 VSA sparse attention 2026-08-30 08:24:43 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett 7195abc32b Performance fixes and bug fixes 2026-08-28 22:21:09 -06:00
Jaret Burkett 92df289931 Fix quantization issues 2026-08-28 10:48:34 -06:00
Jaret Burkett 85a6880643 Move the offload and quantization to the base model 2026-08-28 08:37:56 -06:00
Jaret Burkett 702254688d Added legacy paths 2026-08-28 07:55:19 -06:00
Jaret Burkett c3bc8b0b4e Full test of ui arch compatability 2026-08-28 06:56:05 -06:00
Jaret Burkett 520d96aac3 Phase 2 2026-08-27 18:18:31 -06:00
Jaret Burkett 9113420b61 Phase 2 2026-08-27 15:37:13 -06:00
Jaret Burkett 9ed2e0b8e7 Test model loading 2026-08-27 14:31:53 -06:00
Jaret Burkett 8db198ec0a Phase 1 2026-08-27 11:53:08 -06:00
Jaret Burkett e8d9cf6d35 Models v2 - phase 0 2026-08-27 10:51:43 -06:00
Jaret Burkett 5497a001cb Fix issue where errors on qwen image omni were not being fully surfaced. 2026-08-26 20:54:24 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett 89102f76dc Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va 2026-08-19 13:32:06 -06:00
Jaret Burkett afd1d92722 Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos 2026-08-17 15:39:07 -06:00
Jaret Burkett 42dfe9c661 Improve video frame reader 2026-08-16 10:21:11 -06:00
Jaret Burkett 2cbc2bb097 On minimax h3, trim cached text embeddings to max tokens if they are longer than specified 2026-08-16 08:42:01 -06:00
Jaret Burkett 151ad0e959 Adjust MiniMah h3 sizing for videos to downscale to match 2026-08-15 07:50:42 -06:00
Jaret Burkett 127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett 97bf49edad Add support for video references in MiniMax H3 ref2va 2026-08-15 06:18:09 -06:00
Jaret Burkett 6ea281973d Add support for MiniMax H3 Ref2Vid training 2026-08-13 12:36:03 -06:00
Jaret Burkett ab18528fdb Let omni captioner handle just images as well. Set it as the new default captioner. 2026-08-13 10:30:17 -06:00
Jaret Burkett 4e91fb2d0a Add thinking and abliterated versions of qwen omni. 2026-08-13 08:56:31 -06:00
Jaret Burkett 6c88e3d138 Add layer offloading to omni captioner 2026-08-13 07:21:54 -06:00
Jaret Burkett ca42a72f4c Fixed issue with flash attention on omni captioner 2026-08-12 21:14:23 -06:00
Jaret Burkett 7f9a142dfd Generate thumbnails for dataset items so things load faster and the ui is more stable. Especially good for videos. 2026-08-12 20:33:42 -06:00
Jaret Burkett 175cc1e151 Add Qwen 3 Omni for captioning videos with sound. 2026-08-12 19:57:01 -06:00
Jaret Burkett 4b00b61257 When doing an audio loss, show the img and audio loss in the loss log 2026-08-12 18:58:54 -06:00
Jaret Burkett a1ddeeef13 Fixed issue with offloading text encoder on ltx 2.5 2026-08-12 10:46:58 -06:00