Jaret Burkett
c6a9b56ae9
Add support for Moss Image Base
2026-10-16 09:54:38 -06:00
Jaret Burkett
80cb872a84
Fall back to an online load when a cached tokenizer/processor loads incomplete
2026-10-16 09:38:30 -06:00
Jaret Burkett
e05a3a4f2c
Add support for MOSS Image
2026-10-16 08:09:45 -06:00
Jaret Burkett
12395a103f
Load comfy files if they exist in flux.3 image
2026-10-15 11:18:14 -06:00
Jaret Burkett
4f5b5cc7ad
flux3: store DiT and VAE in the comfy layout with renamed downloads
2026-10-14 14:06:19 -06:00
Jaret Burkett
7a64fdafad
Merge in from main
2026-10-14 11:27:16 -06:00
Jaret Burkett
2fa0bd87e6
Add support for Iris-3B
2026-10-09 05:13:39 -06:00
Jaret Burkett
cb51e9a511
Add flux3 image
2026-10-09 03:08:46 -06:00
Jaret Burkett
6468a2ffa7
Fix issue loading new comfy checkpoints with ming
2026-09-26 13:32:05 -06:00
Jaret Burkett
07abdbedc7
Add match_target_res for Qwen Image 2.1 so reference images are scaled to the target's pixel area with their own aspect ratio, consistently across text-embedding caching, training, and sampling, and key the embedding cache on it.
2026-09-22 13:57:49 -06:00
Jaret Burkett
543a0d74d0
Fix issue with saving device state when a text encoder is unloaded.
2026-09-22 12:03:09 -06:00
Jaret Burkett (Ostris)
3a39d8cfc8
Merge pull request #1021 from hitoshic1982/fix/cache-text-encoder-device-preset
...
Fix cache_text_encoder device preset missing in BaseModel
2026-09-22 11:46:24 -06:00
Jaret Burkett
086b663bba
Add support for training with an alpha channel for Qwen Image 2.1
2026-09-20 14:49:53 -06:00
Jaret Burkett
c2622ed250
Add support for Qwen Image 2.1
2026-09-20 09:50:57 -06:00
Jaret Burkett
cc98c3b690
Add ability to train with just music or vocals on yue2. Doesnt work as expected though
2026-09-17 20:19:32 -06:00
Jaret Burkett
ce64e65c39
Add support for Qwen 2.5 Omni and add lora loading for captioning models
2026-09-16 10:36:19 -06:00
Jaret Burkett
2977672e4b
Point omni vllm to real repo
2026-09-16 09:37:21 -06:00
Jaret Burkett
db8dbd68c2
Add support for training VLLMs, omni models, and LLMs
2026-09-15 17:47:02 -06:00
Jaret Burkett
f9b23b40bb
Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it.
2026-09-14 17:01:36 -06:00
Jaret Burkett
e43f138ae4
Initial experimental support for yue2
2026-09-14 05:07:11 -06:00
Jaret Burkett
732c761231
Add lora on generate
2026-09-10 18:23:23 -06:00
Jaret Burkett
449488f6b7
Initial inference engine build out
2026-09-10 14:22:49 -06:00
Jaret Burkett
b764c4a94e
DFE cleanup
2026-09-09 06:42:24 -06:00
Jaret Burkett
af82197907
Fix gradient checkpointing for sapiens DFE
2026-09-08 12:24:56 -06:00
Jaret Burkett
3e1cb5f67f
Rework DFEs to work better with x0 models. Show their loss in the graph
2026-09-07 13:26:01 -06:00
Jaret Burkett
74ed5fddb0
Fix issue with ltx caching
2026-08-30 11:01:52 -06:00
Jaret Burkett
be995185f5
Fixed issue with offloading with new model loader on nvfp4 weights.
2026-08-29 12:01:40 -06:00
Jaret Burkett
683fe8afc0
Stability improvements to model offloading. Added D-OPSD bleed loss as well.
2026-08-29 11:23:47 -06:00
Jaret Burkett
7195abc32b
Performance fixes and bug fixes
2026-08-28 22:21:09 -06:00
Jaret Burkett
5ddc5f8ca7
Optimize quantization path
2026-08-28 11:47:29 -06:00
hitoshic1982
5fc8fd76de
Fix cache_text_encoder device preset missing in BaseModel
...
BaseModel.set_device_state_preset() has no branch for the
'cache_text_encoder' preset, so when TextEmbeddingCachingMixin calls
set_device_state_preset('cache_text_encoder') the active_modules list
stays empty and the text encoder is placed on CPU. With
cache_text_embeddings enabled on a BaseModel arch (e.g. chroma), every
caption is then encoded on CPU — with a quantized T5-XXL this took
~6.5 minutes per caption (~21 hours for a 205-image dataset) while the
GPU sat idle. StableDiffusion.set_device_state_preset() already has
this branch; this adds the same two lines to BaseModel.
2026-08-29 01:37:39 +08:00
Jaret Burkett
ce3df32101
Fix speed on wan conv patch
2026-08-28 10:54:26 -06:00
Jaret Burkett
92df289931
Fix quantization issues
2026-08-28 10:48:34 -06:00
Jaret Burkett
85a6880643
Move the offload and quantization to the base model
2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d
Added legacy paths
2026-08-28 07:55:19 -06:00
Jaret Burkett
c3bc8b0b4e
Full test of ui arch compatability
2026-08-28 06:56:05 -06:00
Jaret Burkett
520d96aac3
Phase 2
2026-08-27 18:18:31 -06:00
Jaret Burkett
45886f01b2
Phase 2
2026-08-27 16:16:35 -06:00
Jaret Burkett
9113420b61
Phase 2
2026-08-27 15:37:13 -06:00
Jaret Burkett
9ed2e0b8e7
Test model loading
2026-08-27 14:31:53 -06:00
Jaret Burkett
8db198ec0a
Phase 1
2026-08-27 11:53:08 -06:00
Jaret Burkett
e8d9cf6d35
Models v2 - phase 0
2026-08-27 10:51:43 -06:00
Jaret Burkett
da79ebce99
Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va
2026-08-26 11:06:33 -06:00
Jaret Burkett
8a912564ce
Fix video DOP methods
2026-08-26 10:05:14 -06:00
Jaret Burkett
127d6f626d
Rework img/video reference in Minimax H3 to more closely match the comfy ui implementation.
2026-08-15 07:13:54 -06:00
Jaret Burkett
97bf49edad
Add support for video references in MiniMax H3 ref2va
2026-08-15 06:18:09 -06:00
Jaret Burkett
5261d3fcca
Add checkpointing to the Wan2.1 encoder
2026-08-14 07:31:16 -06:00
Jaret Burkett
8502a845b1
Add support for MiniMax H3 T2V and I2V training
2026-08-03 10:17:39 -06:00
Jaret Burkett
5baa495585
DFE optimizations
2026-08-01 10:06:16 -06:00
Jaret Burkett
fb204b7677
Fixed for DFEs with pixelspace and video models
2026-07-27 11:12:02 -06:00
Jaret Burkett
hitoshic1982