Commit Graph
429 Commits
Author SHA1 Message Date
Jaret Burkett 461e798708 Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint. 2026-07-27 17:43:01 -06:00
Jaret Burkett fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett 92bdb6e473 Add support for Mage-Flow and Mage-Flow Edit 2026-07-25 11:34:20 -06:00
Jaret Burkett e8573dad34 Fix trailing progress bar print when stopping a job in the ui 2026-07-22 10:11:08 -06:00
Jaret Burkett 479c72ada2 Add replacing triggers on prompts when caching text encoder 2026-07-19 09:03:05 -06:00
Jaret Burkett f1bc6508ad Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
Jaret Burkett 988d891102 Added a Sample Next Step in the job gear dropdown to force a sample on the next step. 2026-07-17 07:59:30 -06:00
Jaret Burkett 5cb54ba9cc Allow setting weight saving flag on hidream_o1 2026-07-16 07:40:25 -06:00
DasPauluteliandJaret Burkett a92f18bf71 krea2: don't hardcode the NVIDIA-only cuDNN SDPA backend (#933)
* krea2: don't hardcode NVIDIA-only cuDNN SDPA backend

The krea2 attention() forced SDPBackend.CUDNN_ATTENTION, which is
NVIDIA-only. On non-NVIDIA backends (AMD ROCm, Intel XPU, Apple MPS)
every forward pass fails with 'RuntimeError: No available kernel.
Aborting execution.', so Krea 2 LoRA training cannot run at all there.

Pass a priority list [CUDNN, FLASH, EFFICIENT, MATH] instead. NVIDIA
still selects cuDNN; other backends fall back to flash/efficient/math.
Verified training end-to-end on an AMD Radeon 8060S (gfx1151, ROCm 7.2).

* Version bump

* Add set priority flag so CUDNN_ATTENTION is selected on cuda devices first.

---------

Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 12:44:34 -06:00
Jaret Burkett b8f8a08ba4 Fix sampling bar with anima 2026-07-15 12:17:06 -06:00
rmatifandJaret Burkett 3e6bd874c4 feat: Add Anima support (#860)
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
2026-07-15 11:59:01 -06:00
fatalisandJaret Burkett 8bbd051667 Add sample_start_step setting to configure when sampling starts (#949)
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
2026-07-15 11:15:50 -06:00
Jaret Burkett 30162c0602 Improvements for captioner quantization to speed it up. Block compile on captioners. 2026-07-15 10:25:47 -06:00
Jaret Burkett 691ddf434e Add Qwen3.6 VL captioner. 2026-07-15 07:02:33 -06:00
Jaret Burkett abba6b5845 Show better errors on captioner 2026-07-14 07:19:03 -06:00
Jaret Burkett 28f2c0acbe Move z_image over to the new modeling class 2026-07-13 17:12:30 -06:00
Jaret Burkett 7602e476eb Exclude sensative layers from quantization in krea 2026-07-13 10:14:53 -06:00
Jaret Burkett ad07b06de5 Use cached first frame for wan22_5 model 2026-07-10 10:21:34 -06:00
Jaret Burkett 886c2aec57 Allow for vae tiling onle without low vram on wan models with a model kwarg 2026-07-10 09:42:52 -06:00
Jaret Burkett fe82487187 Add tiling on vae decode for qwen image models when low vram flag is on 2026-07-10 09:07:29 -06:00
Jaret Burkett e7951ad29e Exclude sensative layers from quantization on wan models 2026-07-10 08:56:05 -06:00
Jaret Burkett 883d60eb71 Do vae tiling when decoding wan models with low vram active. 2026-07-10 08:02:32 -06:00
Jaret Burkett a4bbe167ce Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup. 2026-07-09 12:00:55 -06:00
Jaret Burkett 6233efe1bb Fix sampling issue on zimage turbo and krea2 turbo models 2026-07-08 12:34:39 -06:00
Jaret Burkett 7bceec3b07 Apply a loss mask for first frame conditioning for wan and ltx 2026-07-07 09:05:53 -06:00
Jaret Burkett bd93a312bc Load more types of comfy ui style quants for ltx2 2026-07-07 09:04:51 -06:00
Jaret Burkett b1e1a834d4 Added support to train Krea2 as an edit model 2026-07-04 09:12:39 -06:00
Jaret Burkett 4e50535478 Allow models to provide an additional loss 2026-06-28 09:49:36 -06:00
Jaret Burkett 1e12b6b73f Remove duplicate save when triggering save next step 2026-06-28 07:18:16 -06:00
Jaret Burkett 7ee1f98f6d Allow loading and saving z_image in comfy safetensors format. 2026-06-28 07:15:49 -06:00
Jaret Burkett f8667f0334 Save Krea2 even if quantized 2026-06-28 06:03:37 -06:00
Jaret Burkett 4a99ddabad Fix breaking change with diffusers qwen image 2026-06-26 10:04:35 -06:00
Jaret Burkett 5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett d14f6e567a Allow individual models to scale the loss after it is calculated. 2026-06-25 10:13:58 -06:00
Jaret Burkett 7a089fd0d7 Add support for training directly on Krea2 Turbo with a training adapter 2026-06-23 20:32:02 -06:00
Jaret Burkett a803611ec1 Enable tiling on vae when decoding with low_vram flag on krea2 2026-06-23 18:38:52 -06:00
Jaret Burkett 724e67d634 Set krea 2 to use new lokr format 2026-06-23 13:31:50 -06:00
Jaret Burkett e20b42e84a Add offloading support for krea2 2026-06-23 10:43:36 -06:00
Jaret Burkett (Ostris) 99be3d96a2 Add support for Krea2 (#906)
* Add support for krea2

* Update repo pointer to actual repo
2026-06-23 09:18:14 -06:00
Jaret Burkett 820d534d6e Add features for models that may need a non masked loss such as inpainiting. 2026-06-22 10:59:17 -06:00
Jaret Burkett 99f8fd44e3 Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner 2026-06-19 07:25:54 -06:00
Jaret Burkett 022d1c29e0 Remove color pallet for individual objects in the caption prompts 2026-06-19 06:56:18 -06:00
Jaret Burkett 60c1ac6a50 Add support for Boogu Image and Boogu Image Edit 2026-06-18 15:05:49 -06:00
Jaret Burkett e886745051 Added additional information on addine new models and some additional gotchas 2026-06-18 15:04:50 -06:00
Jaret Burkett 515b0ea5cd Remove transformer log supression from captioner 2026-06-18 10:00:30 -06:00
Jaret Burkett ad49d4ef25 Update example to cover some common issues 2026-06-18 07:54:37 -06:00
Jaret Burkett 66f7c06742 Patch away the qwen3vl conv3d that only has slow bf16 kernels 2026-06-17 14:29:20 -06:00
Jaret Burkett 92814f9e6d Apply ideogram dynamic shifting to sampling 2026-06-16 18:52:16 -06:00
Jaret Burkett 178eb5fbbe Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter. 2026-06-16 13:27:43 -06:00
Jaret Burkett f6c0104f25 Handle unconditional conditioning for ideogram 4 more in line with example code. 2026-06-16 10:23:08 -06:00