Jaret Burkett
63261a9188
Resolve conflict
2026-09-12 06:43:41 -06:00
Jaret Burkett
561a0236b3
Ignore test outputs
2026-09-11 16:37:57 -06:00
Jaret Burkett
732c761231
Add lora on generate
2026-09-10 18:23:23 -06:00
Jaret Burkett
6e1b39c7a8
Improve ui and functionality
2026-09-10 15:44:00 -06:00
Jaret Burkett
449488f6b7
Initial inference engine build out
2026-09-10 14:22:49 -06:00
Jaret Burkett
f56b5a1d40
Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models.
2026-09-10 11:49:54 -06:00
Dawn-Lcg
b90cccdfb1
Fix: QwenImageEditPlusModel crashes with batch_size > 1
...
Pass only the current sample's caption to encode_prompt, and right-pad
per-sample embeddings before concatenating.
2026-09-10 20:31:30 +08:00
Dawn-Lcg
17e5f59f36
Fix in-place downsampling of reference images in QwenImageEditPlusModel
...
Copy control images to avoid mutating the original list.
2026-09-10 19:48:19 +08:00
Jaret Burkett
b1bf3e4381
Add a config to force pure noise step at a set rate
2026-09-09 11:26:28 -06:00
Jaret Burkett
4a41f146a3
Fix feedback when doing an ema with feedback so it uses its own scale
2026-09-09 06:43:14 -06:00
Jaret Burkett
b764c4a94e
DFE cleanup
2026-09-09 06:42:24 -06:00
Jaret Burkett
fb7c14b288
Version update
2026-09-08 12:25:18 -06:00
Jaret Burkett
af82197907
Fix gradient checkpointing for sapiens DFE
2026-09-08 12:24:56 -06:00
Jaret Burkett
3ab6eaa3c4
Show fft loss in loss log
2026-09-08 05:16:07 -06:00
Jaret Burkett
af89a27e0f
Fixed issue with partial offloading torchao quants
2026-09-08 05:15:26 -06:00
Jaret Burkett
3e1cb5f67f
Rework DFEs to work better with x0 models. Show their loss in the graph
2026-09-07 13:26:01 -06:00
Jaret Burkett
7690ea62c8
Add variable precision adam convrot optimizer with stochastic rounding and accumulation.
2026-09-06 10:51:35 -06:00
Jaret Burkett
bbb1fda457
Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch.
2026-09-06 10:48:10 -06:00
Jaret Burkett (Ostris)
fea99cf5d0
Merge pull request #813 from Booyaka101/fix/dataloader-pin-memory
...
perf: enable pin_memory on CUDA DataLoaders for faster CPU->GPU transfer
2026-09-05 08:09:26 -06:00
Jaret Burkett (Ostris)
2a2ca26ee8
Merge branch 'main' into fix/dataloader-pin-memory
2026-09-05 08:08:39 -06:00
Jaret Burkett
b36bb3998a
Version bump
2026-09-03 08:44:44 -06:00
Jaret Burkett
90515c5396
Fix issue where we gave the wrong dtype hidden states
2026-09-03 08:43:15 -06:00
Jaret Burkett
ead3738773
Fixed connection cap for SSE in the ui
2026-09-02 17:08:12 -06:00
Jaret Burkett
ecb2bfbe5e
Fixed issue where some unmanaged modules could be lefs on cpu
2026-09-02 09:22:39 -06:00
Jaret Burkett
9d6a9a0803
Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today.
2026-08-31 15:53:58 -06:00
Jaret Burkett
6940ebf533
Skip files where caching fails in a dataset instead of crashing.
2026-08-30 16:49:12 -06:00
Jaret Burkett
e98109f213
Version bump
2026-08-30 11:02:22 -06:00
Jaret Burkett
74ed5fddb0
Fix issue with ltx caching
2026-08-30 11:01:52 -06:00
Jaret Burkett
764b5064fb
Migrate to a new DTO for latents to carry more information that a normal tensor such as audio.
2026-08-30 10:30:21 -06:00
Jaret Burkett
2a69c1e7de
Add initial support for Minimax H3 VSA sparse attention
2026-08-30 08:24:43 -06:00
Jaret Burkett
be995185f5
Fixed issue with offloading with new model loader on nvfp4 weights.
2026-08-29 12:01:40 -06:00
Jaret Burkett
7380476b9c
Version bump
2026-08-29 11:24:16 -06:00
Jaret Burkett
683fe8afc0
Stability improvements to model offloading. Added D-OPSD bleed loss as well.
2026-08-29 11:23:47 -06:00
Jaret Burkett (Ostris)
64a20f51a6
Merge pull request #1025 from ostris/models/v2
...
Reworked the entire model loading to make everything testable, hot swappable, and uniform.
2026-08-29 09:06:19 -06:00
Jaret Burkett
bb55d38958
Version bump
2026-08-29 08:58:15 -06:00
Jaret Burkett
7195abc32b
Performance fixes and bug fixes
2026-08-28 22:21:09 -06:00
Jaret Burkett
5ddc5f8ca7
Optimize quantization path
2026-08-28 11:47:29 -06:00
hitoshic1982
5fc8fd76de
Fix cache_text_encoder device preset missing in BaseModel
...
BaseModel.set_device_state_preset() has no branch for the
'cache_text_encoder' preset, so when TextEmbeddingCachingMixin calls
set_device_state_preset('cache_text_encoder') the active_modules list
stays empty and the text encoder is placed on CPU. With
cache_text_embeddings enabled on a BaseModel arch (e.g. chroma), every
caption is then encoded on CPU — with a quantized T5-XXL this took
~6.5 minutes per caption (~21 hours for a 205-image dataset) while the
GPU sat idle. StableDiffusion.set_device_state_preset() already has
this branch; this adds the same two lines to BaseModel.
2026-08-29 01:37:39 +08:00
Jaret Burkett
ce3df32101
Fix speed on wan conv patch
2026-08-28 10:54:26 -06:00
Jaret Burkett
92df289931
Fix quantization issues
2026-08-28 10:48:34 -06:00
Jaret Burkett
85a6880643
Move the offload and quantization to the base model
2026-08-28 08:37:56 -06:00
Jaret Burkett
702254688d
Added legacy paths
2026-08-28 07:55:19 -06:00
Jaret Burkett
c3bc8b0b4e
Full test of ui arch compatability
2026-08-28 06:56:05 -06:00
Jaret Burkett
520d96aac3
Phase 2
2026-08-27 18:18:31 -06:00
Jaret Burkett
45886f01b2
Phase 2
2026-08-27 16:16:35 -06:00
Jaret Burkett
9113420b61
Phase 2
2026-08-27 15:37:13 -06:00
Jaret Burkett
9ed2e0b8e7
Test model loading
2026-08-27 14:31:53 -06:00
Jaret Burkett
8db198ec0a
Phase 1
2026-08-27 11:53:08 -06:00
Jaret Burkett
e8d9cf6d35
Models v2 - phase 0
2026-08-27 10:51:43 -06:00
Jaret Burkett
5497a001cb
Fix issue where errors on qwen image omni were not being fully surfaced.
2026-08-26 20:54:24 -06:00
Jaret Burkett
Dawn-Lcg
hitoshic1982