Jaret Burkett
086b663bba
Add support for training with an alpha channel for Qwen Image 2.1
2026-09-20 14:49:53 -06:00
Jaret Burkett
c2622ed250
Add support for Qwen Image 2.1
2026-09-20 09:50:57 -06:00
Jaret Burkett
cc98c3b690
Add ability to train with just music or vocals on yue2. Doesnt work as expected though
2026-09-17 20:19:32 -06:00
Jaret Burkett
ce64e65c39
Add support for Qwen 2.5 Omni and add lora loading for captioning models
2026-09-16 10:36:19 -06:00
Jaret Burkett
2977672e4b
Point omni vllm to real repo
2026-09-16 09:37:21 -06:00
Jaret Burkett
db8dbd68c2
Add support for training VLLMs, omni models, and LLMs
2026-09-15 17:47:02 -06:00
Jaret Burkett
f9b23b40bb
Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it.
2026-09-14 17:01:36 -06:00
Jaret Burkett
e43f138ae4
Initial experimental support for yue2
2026-09-14 05:07:11 -06:00
Jaret Burkett
732c761231
Add lora on generate
2026-09-10 18:23:23 -06:00
Jaret Burkett
449488f6b7
Initial inference engine build out
2026-09-10 14:22:49 -06:00
Jaret Burkett
b764c4a94e
DFE cleanup
2026-09-09 06:42:24 -06:00
Jaret Burkett
af82197907
Fix gradient checkpointing for sapiens DFE
2026-09-08 12:24:56 -06:00
Jaret Burkett
3e1cb5f67f
Rework DFEs to work better with x0 models. Show their loss in the graph
2026-09-07 13:26:01 -06:00
Jaret Burkett
74ed5fddb0
Fix issue with ltx caching
2026-08-30 11:01:52 -06:00
Jaret Burkett
be995185f5
Fixed issue with offloading with new model loader on nvfp4 weights.
2026-08-29 12:01:40 -06:00
Jaret Burkett
683fe8afc0
Stability improvements to model offloading. Added D-OPSD bleed loss as well.
2026-08-29 11:23:47 -06:00
Jaret Burkett
7195abc32b
Performance fixes and bug fixes
2026-08-28 22:21:09 -06:00
Jaret Burkett
5ddc5f8ca7
Optimize quantization path
2026-08-28 11:47:29 -06:00
Jaret Burkett
ce3df32101
Fix speed on wan conv patch
2026-08-28 10:54:26 -06:00
Jaret Burkett
92df289931
Fix quantization issues
2026-08-28 10:48:34 -06:00
Jaret Burkett
85a6880643
Move the offload and quantization to the base model
2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d
Added legacy paths
2026-08-28 07:55:19 -06:00
Jaret Burkett
c3bc8b0b4e
Full test of ui arch compatability
2026-08-28 06:56:05 -06:00
Jaret Burkett
520d96aac3
Phase 2
2026-08-27 18:18:31 -06:00
Jaret Burkett
45886f01b2
Phase 2
2026-08-27 16:16:35 -06:00
Jaret Burkett
9113420b61
Phase 2
2026-08-27 15:37:13 -06:00
Jaret Burkett
9ed2e0b8e7
Test model loading
2026-08-27 14:31:53 -06:00
Jaret Burkett
8db198ec0a
Phase 1
2026-08-27 11:53:08 -06:00
Jaret Burkett
e8d9cf6d35
Models v2 - phase 0
2026-08-27 10:51:43 -06:00
Jaret Burkett
da79ebce99
Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va
2026-08-26 11:06:33 -06:00
Jaret Burkett
8a912564ce
Fix video DOP methods
2026-08-26 10:05:14 -06:00
Jaret Burkett
127d6f626d
Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation.
2026-08-15 07:13:54 -06:00
Jaret Burkett
97bf49edad
Add support for video references in MiniMax H3 ref2va
2026-08-15 06:18:09 -06:00
Jaret Burkett
5261d3fcca
Add checkpointing to the Wan2.1 encoder
2026-08-14 07:31:16 -06:00
Jaret Burkett
8502a845b1
Add support for MiniMax H3 T2V and I2V training
2026-08-03 10:17:39 -06:00
Jaret Burkett
5baa495585
DFE optimizations
2026-08-01 10:06:16 -06:00
Jaret Burkett
fb204b7677
Fixed for DFEs with pixelspace and video models
2026-07-27 11:12:02 -06:00
Jaret Burkett
efb58c8641
Switch to thumbnails and thumbnail creation on the sample grid page until clicked.
2026-07-25 08:40:33 -06:00
Jaret Burkett
d5612dd35c
Adjust the x0 of some DFEs
2026-07-22 10:38:40 -06:00
Zironic and Rydén Johan
a0224793ce
Restore device runtime scales for compiled adapters ( #963 )
...
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
2026-07-18 08:19:57 -06:00
Jaret Burkett
6696117a94
Fix issue where the log lone for samples would double up sometimes
2026-07-17 08:11:32 -06:00
PlagueKind
3c75735ba2
remove unicode ( #955 )
2026-07-16 16:20:16 -06:00
Jaret Burkett
5fbfb502b5
Leave the generating samples bar in the log when samples finish.
2026-07-16 12:00:45 -06:00
4ece17b71f
Fix adapter scalar handling under torch.compile ( #946 )
...
* Fix adapter scalar handling under torch.compile
* Fix instance where error could happen when merging in a lora to the base model
---------
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se >
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com >
2026-07-15 11:07:55 -06:00
PlagueKind
e44c34a955
fix lokr speed and convrot compile ( #945 )
2026-07-15 10:46:30 -06:00
Jaret Burkett
0d53e5e1f9
Fix compile with lokr on convrot
2026-07-13 19:24:57 -06:00
Jaret Burkett
a5f857ddb0
Added patch from Fatalis to fix lokr offloading with convrot
2026-07-13 18:48:56 -06:00
Jaret Burkett
28f2c0acbe
Move z_image over to the new modeling class
2026-07-13 17:12:30 -06:00
Jaret Burkett
4625406093
WIP working on convrot offloading
2026-07-11 15:37:28 -06:00
Jaret Burkett
1d1e21177a
Add ostris linear layer to linear layer searches.
2026-07-11 14:21:16 -06:00
Jaret Burkett
ZironicandRydén Johan
PlagueKind