 Jaret Burkett
|
e805389f1e
|
Remove print buffer. Add new line after sampling.
|
2026-07-16 11:37:23 -06:00 |
|
|
Jaret Burkett
|
b6f334e676
|
Version bump
|
2026-07-16 08:56:32 -06:00 |
|
|
Jaret Burkett
|
bbaef7852a
|
Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods.
|
2026-07-16 08:55:51 -06:00 |
|
|
Jaret Burkett
|
31c45cf37d
|
Update huggingface hub requirement. Remove forced xet removal as some models are so large it wont work without it. Hopefully the latest version of huggingface_hub doesnt have the hanging issues.
|
2026-07-16 08:52:24 -06:00 |
|
|
Jaret Burkett
|
e1e1996c16
|
Rework the logging and terminal emulator on the ui to work like an actual emulator for better output.
|
2026-07-16 08:50:40 -06:00 |
|
|
Jaret Burkett
|
5cb54ba9cc
|
Allow setting weight saving flag on hidream_o1
|
2026-07-16 07:40:25 -06:00 |
|
|
Jaret Burkett
|
fe619405f3
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2026-07-15 12:44:47 -06:00 |
|
|
Jaret Burkett
|
4f5974ffa1
|
Version bump
|
2026-07-15 12:17:35 -06:00 |
|
|
Jaret Burkett
|
b8f8a08ba4
|
Fix sampling bar with anima
|
2026-07-15 12:17:06 -06:00 |
|
|
Jaret Burkett
|
30162c0602
|
Improvements for captioner quantization to speed it up. Block compile on captioners.
|
2026-07-15 10:25:47 -06:00 |
|
|
Jaret Burkett
|
e28727d5cb
|
Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16.
|
2026-07-15 10:24:52 -06:00 |
|
|
Jaret Burkett
|
691ddf434e
|
Add Qwen3.6 VL captioner.
|
2026-07-15 07:02:33 -06:00 |
|
|
Jaret Burkett
|
18da85153b
|
Disable xet by default. Seems to be causing a lot of hanging issues.
|
2026-07-14 10:42:03 -06:00 |
|
|
Jaret Burkett
|
cf0db39ede
|
Fix some errors for specific quants. Enable saving quantizations.
|
2026-07-14 07:25:09 -06:00 |
|
|
Jaret Burkett
|
abba6b5845
|
Show better errors on captioner
|
2026-07-14 07:19:03 -06:00 |
|
|
Jaret Burkett
|
8b5bf25b13
|
Add convrot quants to captioner
|
2026-07-14 07:03:10 -06:00 |
|
|
Jaret Burkett
|
676b4f3c4c
|
Add Automagic3 optimizer to the ui
|
2026-07-14 06:39:10 -06:00 |
|
|
Jaret Burkett
|
0d53e5e1f9
|
Fix compile with lokr on convrot
|
2026-07-13 19:24:57 -06:00 |
|
|
Jaret Burkett
|
a5f857ddb0
|
Added patch from Fatalis to fix lokr offloading with convrot
|
2026-07-13 18:48:56 -06:00 |
|
|
Jaret Burkett
|
28f2c0acbe
|
Move z_image over to the new modeling class
|
2026-07-13 17:12:30 -06:00 |
|
|
Jaret Burkett
|
dcb3b329b2
|
Fix issue with the graph with sparse data when shrinking smoothing
|
2026-07-13 17:10:38 -06:00 |
|
|
Jaret Burkett
|
1f7d608e20
|
Show sparse datapoints on the loss graph.
|
2026-07-13 10:59:57 -06:00 |
|
|
Jaret Burkett
|
7602e476eb
|
Exclude sensative layers from quantization in krea
|
2026-07-13 10:14:53 -06:00 |
|
|
Jaret Burkett
|
28b05ee4ed
|
Added convrotbitnet 1.58 bit quantization
|
2026-07-13 07:52:48 -06:00 |
|
|
Jaret Burkett
|
a259fa07cd
|
Make convrot ui clearer
|
2026-07-13 06:44:27 -06:00 |
|
|
Jaret Burkett
|
0b62e516cc
|
Version Bump
|
2026-07-13 06:34:21 -06:00 |
|
|
Jaret Burkett
|
b6ff367633
|
Convrot improvements. Add argitrary bit packed byte quantizations.
|
2026-07-13 06:33:54 -06:00 |
|
|
Jaret Burkett
|
64663c8575
|
Add Boogu to the readme.
|
2026-07-11 21:03:00 -06:00 |
|
|
Jaret Burkett
|
4625406093
|
WIP working on convrot offloading
|
2026-07-11 15:37:28 -06:00 |
|
|
Jaret Burkett
|
1d1e21177a
|
Add ostris linear layer to linear layer searches.
|
2026-07-11 14:21:16 -06:00 |
|
|
Jaret Burkett
|
095d6e7418
|
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
|
2026-07-11 13:49:41 -06:00 |
|
|
Jaret Burkett
|
933ca1c517
|
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
|
2026-07-11 10:53:50 -06:00 |
|
|
Jaret Burkett
|
065ac27353
|
Fix issue with compiling convrot on some models
|
2026-07-11 09:26:12 -06:00 |
|
|
Jaret Burkett
|
96a3a06111
|
Added initial experimental support for convrot4 and convrot8 quantization.
|
2026-07-10 11:01:14 -06:00 |
|
|
Jaret Burkett
|
6fac83d068
|
Fix casting issue with orbit quant
|
2026-07-10 10:23:38 -06:00 |
|
|
Jaret Burkett
|
71c75357eb
|
Add cached conditioning recovery to wan 22 5b model
|
2026-07-10 10:22:24 -06:00 |
|
|
Jaret Burkett
|
ad07b06de5
|
Use cached first frame for wan22_5 model
|
2026-07-10 10:21:34 -06:00 |
|
|
Jaret Burkett
|
886c2aec57
|
Allow for vae tiling onle without low vram on wan models with a model kwarg
|
2026-07-10 09:42:52 -06:00 |
|
|
Jaret Burkett
|
fe82487187
|
Add tiling on vae decode for qwen image models when low vram flag is on
|
2026-07-10 09:07:29 -06:00 |
|
|
Jaret Burkett
|
e7951ad29e
|
Exclude sensative layers from quantization on wan models
|
2026-07-10 08:56:05 -06:00 |
|
|
Jaret Burkett
|
883d60eb71
|
Do vae tiling when decoding wan models with low vram active.
|
2026-07-10 08:02:32 -06:00 |
|
|
Jaret Burkett
|
fed9357234
|
Fix ui to show kv cache for krea2 edit raw
|
2026-07-09 15:48:46 -06:00 |
|
|
Jaret Burkett
|
5a9b5bde3f
|
Added experimental orbit quant
|
2026-07-09 15:14:51 -06:00 |
|
|
Jaret Burkett
|
a4bbe167ce
|
Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup.
|
2026-07-09 12:00:55 -06:00 |
|
|
Jaret Burkett
|
6233efe1bb
|
Fix sampling issue on zimage turbo and krea2 turbo models
|
2026-07-08 12:34:39 -06:00 |
|
|
Jaret Burkett
|
dd08579eda
|
Add ability to pull control images from same folder group
|
2026-07-08 05:21:31 -06:00 |
|
|
Jaret Burkett
|
7bceec3b07
|
Apply a loss mask for first frame conditioning for wan and ltx
|
2026-07-07 09:05:53 -06:00 |
|
|
Jaret Burkett
|
bd93a312bc
|
Load more types of comfy ui style quants for ltx2
|
2026-07-07 09:04:51 -06:00 |
|
|
Jaret Burkett
|
17bc302d13
|
Make log calls blocking to prevent duplicates.
|
2026-07-06 07:38:20 -06:00 |
|
|
Jaret Burkett
|
6c0d1c4679
|
Improve latency of the job list endpoint
|
2026-07-04 13:22:09 -06:00 |
|
|
Jaret Burkett
|
3a94591c89
|
Disable text encoder unload with krea2 o-edit
|
2026-07-04 09:17:15 -06:00 |
|
|
Jaret Burkett
|
b1e1a834d4
|
Added support to train Krea2 as an edit model
|
2026-07-04 09:12:39 -06:00 |
|
|
Jaret Burkett
|
f63221e577
|
Replace all sync functions with async to allow more parallel api calls
|
2026-07-01 17:12:43 -06:00 |
|
|
Jaret Burkett
|
48781f900b
|
Improve the loading and transfer speed of the dataset file lists
|
2026-07-01 16:40:01 -06:00 |
|
|
Jaret Burkett
|
b36a8e9c4b
|
Only pull the new log bytes from the ui to improve performance
|
2026-07-01 14:11:23 -06:00 |
|
|
Jaret Burkett
|
733e14cb58
|
Fix issue where the window would scroll to and hilight custom items in the select box
|
2026-07-01 13:57:56 -06:00 |
|
|
Jaret Burkett
|
4e50535478
|
Allow models to provide an additional loss
|
2026-06-28 09:49:36 -06:00 |
|
|
Jaret Burkett
|
1e12b6b73f
|
Remove duplicate save when triggering save next step
|
2026-06-28 07:18:16 -06:00 |
|
|
Jaret Burkett
|
7ee1f98f6d
|
Allow loading and saving z_image in comfy safetensors format.
|
2026-06-28 07:15:49 -06:00 |
|
|
Jaret Burkett
|
c97fc9973a
|
Fix loading pretraied lora when merging network on save
|
2026-06-28 06:04:36 -06:00 |
|
|
Jaret Burkett
|
f8667f0334
|
Save Krea2 even if quantized
|
2026-06-28 06:03:37 -06:00 |
|
|
Jaret Burkett
|
df6ea4263d
|
Version bump
|
2026-06-26 13:02:10 -06:00 |
|
|
Jaret Burkett
|
ad87aacec0
|
Add ability to set certain layers to full for loras
|
2026-06-26 13:01:48 -06:00 |
|
|
Jaret Burkett
|
4a99ddabad
|
Fix breaking change with diffusers qwen image
|
2026-06-26 10:04:35 -06:00 |
|
|
Jaret Burkett
|
5f04ae7ad5
|
Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning.
|
2026-06-25 13:19:38 -06:00 |
|
|
Jaret Burkett
|
6ecff36f26
|
Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc
|
2026-06-25 11:55:07 -06:00 |
|
|
Jaret Burkett
|
4eb0707639
|
Add a control generation script.
|
2026-06-25 10:14:24 -06:00 |
|
|
Jaret Burkett
|
d14f6e567a
|
Allow individual models to scale the loss after it is calculated.
|
2026-06-25 10:13:58 -06:00 |
|
|
Jaret Burkett
|
f743ccf7ef
|
Save before last sample
|
2026-06-24 09:13:01 -06:00 |
|
|
Jaret Burkett
|
7a089fd0d7
|
Add support for training directly on Krea2 Turbo with a training adapter
|
2026-06-23 20:32:02 -06:00 |
|
|
Jaret Burkett
|
a803611ec1
|
Enable tiling on vae when decoding with low_vram flag on krea2
|
2026-06-23 18:38:52 -06:00 |
|
|
Jaret Burkett
|
724e67d634
|
Set krea 2 to use new lokr format
|
2026-06-23 13:31:50 -06:00 |
|
|
Jaret Burkett
|
e20b42e84a
|
Add offloading support for krea2
|
2026-06-23 10:43:36 -06:00 |
|
|
Jaret Burkett (Ostris)
|
99be3d96a2
|
Add support for Krea2 (#906)
* Add support for krea2
* Update repo pointer to actual repo
|
2026-06-23 09:18:14 -06:00 |
|
|
Jaret Burkett
|
af594061ab
|
Add ability to do hidden states with tipsv2
|
2026-06-22 11:00:04 -06:00 |
|
|
Jaret Burkett
|
820d534d6e
|
Add features for models that may need a non masked loss such as inpainiting.
|
2026-06-22 10:59:17 -06:00 |
|
|
Jaret Burkett
|
c133c55cf5
|
Fix issue with mask generator revision
|
2026-06-22 08:19:27 -06:00 |
|
|
Jaret Burkett
|
d51463ca52
|
Add ability to recover from a truncated image file in the dataset
|
2026-06-22 05:07:30 -06:00 |
|
|
Jaret Burkett
|
ba0b3dbb65
|
Force batch size when bucket is too small by duplicating items in the batch
|
2026-06-21 20:01:29 -06:00 |
|
|
Jaret Burkett
|
dba092fc15
|
Keep a real git repo in the docker image
|
2026-06-21 06:54:19 -06:00 |
|
|
Jaret Burkett
|
548a286992
|
Add captioning monitoring information to the dataset page so you can just stay on that page with all the info there.
|
2026-06-19 08:00:40 -06:00 |
|
|
Jaret Burkett
|
99f8fd44e3
|
Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner
|
2026-06-19 07:25:54 -06:00 |
|
|
Jaret Burkett
|
022d1c29e0
|
Remove color pallet for individual objects in the caption prompts
|
2026-06-19 06:56:18 -06:00 |
|
|
Jaret Burkett
|
60c1ac6a50
|
Add support for Boogu Image and Boogu Image Edit
|
2026-06-18 15:05:49 -06:00 |
|
|
Jaret Burkett
|
e886745051
|
Added additional information on addine new models and some additional gotchas
|
2026-06-18 15:04:50 -06:00 |
|
|
Jaret Burkett
|
515b0ea5cd
|
Remove transformer log supression from captioner
|
2026-06-18 10:00:30 -06:00 |
|
|
Jaret Burkett
|
e8c828089a
|
Fix issue where gpu sometimes doesnt show on caption modal
|
2026-06-18 09:37:59 -06:00 |
|
|
Jaret Burkett
|
ad49d4ef25
|
Update example to cover some common issues
|
2026-06-18 07:54:37 -06:00 |
|
|
Jaret Burkett
|
66f7c06742
|
Patch away the qwen3vl conv3d that only has slow bf16 kernels
|
2026-06-17 14:29:20 -06:00 |
|
|
Jaret Burkett
|
92814f9e6d
|
Apply ideogram dynamic shifting to sampling
|
2026-06-16 18:52:16 -06:00 |
|
|
Jaret Burkett
|
178eb5fbbe
|
Add unconditional lora support so Ideogram 4 inference will more closely resemble the full pipeline results. I pushed a finetuned unconditional lora to the hub as an adapter.
|
2026-06-16 13:27:43 -06:00 |
|
|
Jaret Burkett
|
f6c0104f25
|
Handle unconditional conditioning for ideogram 4 more in line with example code.
|
2026-06-16 10:23:08 -06:00 |
|
|
Jaret Burkett
|
86b19589a0
|
Update the Ideogram 4 prompt generation/parsing/ui to handle the updated format notes better.
|
2026-06-16 09:44:38 -06:00 |
|
|
Jaret Burkett
|
fcccc0fbd2
|
Add gradient checkpointing to ideogram4 vae
|
2026-06-15 10:00:40 -06:00 |
|
|
Jaret Burkett
|
c730d64478
|
Added a flag to keep loading the image when latents are cached. Useful for DFE and other methods that target pixelspace losses.
|
2026-06-15 05:31:48 -06:00 |
|
|
Jaret Burkett
|
faa770fc79
|
Another docker thing?
|
2026-06-14 12:27:05 -06:00 |
|
|
Jaret Burkett
|
570c806924
|
Mode docker build work
|
2026-06-14 12:24:55 -06:00 |
|
|
Jaret Burkett
|
ebbb09230b
|
Add requirements base to docker build
|
2026-06-14 12:21:28 -06:00 |
|
|
Jaret Burkett
|
5df3fb69e3
|
Rework Docker image for a minimal build/pull/push footprint
|
2026-06-14 12:19:58 -06:00 |
|
|
Jaret Burkett
|
c0d600b5d6
|
Allow using flash backend for ideogram
|
2026-06-13 15:17:20 -06:00 |
|