Commit Graph
29 Commits
Author SHA1 Message Date
Jaret Burkett ce64e65c39 Add support for Qwen 2.5 Omni and add lora loading for captioning models 2026-09-16 10:36:19 -06:00
Jaret Burkett 2977672e4b Point omni vllm to real repo 2026-09-16 09:37:21 -06:00
Jaret Burkett db8dbd68c2 Add support for training VLLMs, omni models, and LLMs 2026-09-15 17:47:02 -06:00
Jaret Burkett 213d32cad3 Train 50% of the time with and without sheet music. 2026-09-14 17:50:15 -06:00
Jaret Burkett f9b23b40bb Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it. 2026-09-14 17:01:36 -06:00
Jaret Burkett b53436331c Add regularization and moden info 2026-09-14 14:14:36 -06:00
Jaret Burkett 900c0e8a67 Det the dataset dropout for yue2 2026-09-14 12:19:51 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett 449488f6b7 Initial inference engine build out 2026-09-10 14:22:49 -06:00
Jaret Burkett f56b5a1d40 Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models. 2026-09-10 11:49:54 -06:00
Jaret Burkett 683fe8afc0 Stability improvements to model offloading. Added D-OPSD bleed loss as well. 2026-08-29 11:23:47 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 89102f76dc Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va 2026-08-19 13:32:06 -06:00
Jaret Burkett b982a03ae4 Add training adapter for MiniMax H3 ref2va and default to contrastive loss with adapter 2026-08-16 09:11:07 -06:00
Jaret Burkett 2042481914 On MiniMax H3 set the default to use both contrastive guidance and the training adapter as it is yielding better results than one or the other. 2026-08-16 08:43:31 -06:00
Jaret Burkett 151ad0e959 Adjust MiniMah h3 sizing for videos to downscale to match 2026-08-15 07:50:42 -06:00
Jaret Burkett 127d6f626d Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation. 2026-08-15 07:13:54 -06:00
Jaret Burkett 6ea281973d Add support for MiniMax H3 Ref2Vid training 2026-08-13 12:36:03 -06:00
Jaret Burkett 7eb65b837a Switch MiniMax H3 to default to contrastive guidance loss. Add a custom model select toggle to automatically fill out settings for the model. 2026-08-12 07:54:57 -06:00
Jaret Burkett cbf910ac02 Add support for LTX 2.5 2026-08-12 05:50:30 -06:00
Jaret Burkett 5ff8a0435a Make v1 the default training adapter 2026-08-09 14:56:39 -06:00
Jaret Burkett 9171d5ec1d Update training adapter path 2026-08-06 11:21:28 -06:00
Jaret Burkett 71625d1207 Add the alpha version of the MiniMax H3 trianing adapter and set it as the new default training method. 2026-08-06 11:11:31 -06:00
Jaret Burkett 1e1418b22c Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3 2026-08-05 13:27:12 -06:00
Jaret Burkett 9fc1f208df Remove adaln_proj from the network modules for minimax_h3 2026-08-04 16:19:46 -06:00
Jaret Burkett 183433ae8e Make MiniMax H3 default to using contrastive guidance loss to prevent distillation breakdown 2026-08-04 16:13:45 -06:00
Jaret Burkett 18f5810d6c Adjust default alpha for h3 2026-08-03 20:15:28 -06:00
Jaret Burkett 88ac27fc8f Handle images with MiniMax H3. 2026-08-03 11:58:44 -06:00
Jaret Burkett 8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00