 Jaret Burkett
|
b677cdb026
|
Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao.
|
2026-07-27 12:59:42 -06:00 |
|
|
Jaret Burkett
|
fb204b7677
|
Fixed for DFEs with pixelspace and video models
|
2026-07-27 11:12:02 -06:00 |
|
|
Jaret Burkett
|
0e17841767
|
Version bump
|
2026-07-25 11:34:33 -06:00 |
|
|
Jaret Burkett
|
92bdb6e473
|
Add support for Mage-Flow and Mage-Flow Edit
|
2026-07-25 11:34:20 -06:00 |
|
|
Jaret Burkett
|
0c3a5e6970
|
Default to lokr full rank when not passed.
|
2026-07-25 09:06:49 -06:00 |
|
|
Jaret Burkett
|
efb58c8641
|
Switch to thumbnails and thumbnail creation on the sample grid page until clicked.
|
2026-07-25 08:40:33 -06:00 |
|
|
Jaret Burkett
|
e00f3791e2
|
Update some node packages.
|
2026-07-24 13:50:06 -06:00 |
|
|
Jaret Burkett
|
be3406140b
|
Remove dev indicators
|
2026-07-24 13:30:30 -06:00 |
|
|
Jaret Burkett
|
8f2d001eae
|
Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video
|
2026-07-24 12:36:47 -06:00 |
|
|
Jaret Burkett
|
67984754c3
|
Put more information about model gating and how to solve it
|
2026-07-24 09:56:02 -06:00 |
|
|
Jaret Burkett
|
ede6f9ecee
|
Major ui speed improvements. Moved file server out of next js app and made it multithreadded. Significantly faster downloads for files, images, and videos.
|
2026-07-23 09:35:08 -06:00 |
|
|
Jaret Burkett
|
1086bd0b3e
|
Improvements to file transfer speed when downloading loras from cloud
|
2026-07-23 08:17:17 -06:00 |
|
|
Jaret Burkett
|
d5612dd35c
|
Adjust the x0 of some DFEs
|
2026-07-22 10:38:40 -06:00 |
|
|
Jaret Burkett
|
e8573dad34
|
Fix trailing progress bar print when stopping a job in the ui
|
2026-07-22 10:11:08 -06:00 |
|
|
Jaret Burkett
|
c4db100e17
|
Version bump
|
2026-07-21 11:36:36 -06:00 |
|
|
Jaret Burkett
|
3a4341dee3
|
Improve ui polling code to prevent poll buildup
|
2026-07-21 11:35:52 -06:00 |
|
|
Jaret Burkett
|
e54a0fe78c
|
Move to a single prisma client connection for the ui backend to prevent competing connections.
|
2026-07-21 11:21:28 -06:00 |
|
|
Jaret Burkett
|
9e9439015e
|
Switch sqlite database to WAL mode. It will be significantly faster with multiple writers and readers.
|
2026-07-21 11:07:18 -06:00 |
|
|
Jaret Burkett
|
088084e2c2
|
Resize validation images with the bucket sizing strategy.
|
2026-07-20 11:22:33 -06:00 |
|
|
Jaret Burkett
|
df354da23e
|
Replace trigger word in validation prompts for [trigger] tags
|
2026-07-20 07:56:04 -06:00 |
|
|
Jaret Burkett
|
6e158dd1f1
|
Adjust validation loss defaults
|
2026-07-19 19:35:33 -06:00 |
|
|
Jaret Burkett
|
1eb97b7443
|
Added validation loss
|
2026-07-19 19:33:45 -06:00 |
|
|
Jaret Burkett
|
cd677c70b5
|
Fix issue where more than 12 samples would break sample grid.
|
2026-07-19 09:21:44 -06:00 |
|
|
Jaret Burkett
|
479c72ada2
|
Add replacing triggers on prompts when caching text encoder
|
2026-07-19 09:03:05 -06:00 |
|
|
Jaret Burkett
|
cfdc9033a6
|
Add min and max LR or automagic to prefent runaway edge cases.
|
2026-07-17 14:19:53 -06:00 |
|
|
Jaret Burkett
|
f1bc6508ad
|
Fix issue with qwen image edit models.
|
2026-07-17 09:14:04 -06:00 |
|
|
Jaret Burkett
|
6696117a94
|
Fix issue where the log lone for samples would double up sometimes
|
2026-07-17 08:11:32 -06:00 |
|
|
Jaret Burkett
|
988d891102
|
Added a Sample Next Step in the job gear dropdown to force a sample on the next step.
|
2026-07-17 07:59:30 -06:00 |
|
|
Jaret Burkett
|
7a3d94ed03
|
Add caching to active job pull
|
2026-07-16 16:51:05 -06:00 |
|
|
Jaret Burkett
|
bf15b65972
|
Add caching for api calls to speed them up. Added caching for cpu and gpu stat calls
|
2026-07-16 16:47:10 -06:00 |
|
|
Jaret Burkett
|
0552d85aa7
|
Gice the loss graph more diverse colors
|
2026-07-16 16:06:05 -06:00 |
|
|
Jaret Burkett
|
5fbfb502b5
|
Leave the generating samples bar in the log when samples finish.
|
2026-07-16 12:00:45 -06:00 |
|
|
Jaret Burkett
|
e805389f1e
|
Remove print buffer. Add new line after sampling.
|
2026-07-16 11:37:23 -06:00 |
|
|
Jaret Burkett
|
b6f334e676
|
Version bump
|
2026-07-16 08:56:32 -06:00 |
|
|
Jaret Burkett
|
bbaef7852a
|
Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods.
|
2026-07-16 08:55:51 -06:00 |
|
|
Jaret Burkett
|
31c45cf37d
|
Update huggingface hub requirement. Remove forced xet removal as some models are so large it wont work without it. Hopefully the latest version of huggingface_hub doesnt have the hanging issues.
|
2026-07-16 08:52:24 -06:00 |
|
|
Jaret Burkett
|
e1e1996c16
|
Rework the logging and terminal emulator on the ui to work like an actual emulator for better output.
|
2026-07-16 08:50:40 -06:00 |
|
|
Jaret Burkett
|
5cb54ba9cc
|
Allow setting weight saving flag on hidream_o1
|
2026-07-16 07:40:25 -06:00 |
|
|
Jaret Burkett
|
fe619405f3
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2026-07-15 12:44:47 -06:00 |
|
|
Jaret Burkett
|
4f5974ffa1
|
Version bump
|
2026-07-15 12:17:35 -06:00 |
|
|
Jaret Burkett
|
b8f8a08ba4
|
Fix sampling bar with anima
|
2026-07-15 12:17:06 -06:00 |
|
|
Jaret Burkett
|
30162c0602
|
Improvements for captioner quantization to speed it up. Block compile on captioners.
|
2026-07-15 10:25:47 -06:00 |
|
|
Jaret Burkett
|
e28727d5cb
|
Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16.
|
2026-07-15 10:24:52 -06:00 |
|
|
Jaret Burkett
|
691ddf434e
|
Add Qwen3.6 VL captioner.
|
2026-07-15 07:02:33 -06:00 |
|
|
Jaret Burkett
|
18da85153b
|
Disable xet by default. Seems to be causing a lot of hanging issues.
|
2026-07-14 10:42:03 -06:00 |
|
|
Jaret Burkett
|
cf0db39ede
|
Fix some errors for specific quants. Enable saving quantizations.
|
2026-07-14 07:25:09 -06:00 |
|
|
Jaret Burkett
|
abba6b5845
|
Show better errors on captioner
|
2026-07-14 07:19:03 -06:00 |
|
|
Jaret Burkett
|
8b5bf25b13
|
Add convrot quants to captioner
|
2026-07-14 07:03:10 -06:00 |
|
|
Jaret Burkett
|
676b4f3c4c
|
Add Automagic3 optimizer to the ui
|
2026-07-14 06:39:10 -06:00 |
|
|
Jaret Burkett
|
0d53e5e1f9
|
Fix compile with lokr on convrot
|
2026-07-13 19:24:57 -06:00 |
|
|
Jaret Burkett
|
a5f857ddb0
|
Added patch from Fatalis to fix lokr offloading with convrot
|
2026-07-13 18:48:56 -06:00 |
|
|
Jaret Burkett
|
28f2c0acbe
|
Move z_image over to the new modeling class
|
2026-07-13 17:12:30 -06:00 |
|
|
Jaret Burkett
|
dcb3b329b2
|
Fix issue with the graph with sparse data when shrinking smoothing
|
2026-07-13 17:10:38 -06:00 |
|
|
Jaret Burkett
|
1f7d608e20
|
Show sparse datapoints on the loss graph.
|
2026-07-13 10:59:57 -06:00 |
|
|
Jaret Burkett
|
7602e476eb
|
Exclude sensative layers from quantization in krea
|
2026-07-13 10:14:53 -06:00 |
|
|
Jaret Burkett
|
28b05ee4ed
|
Added convrotbitnet 1.58 bit quantization
|
2026-07-13 07:52:48 -06:00 |
|
|
Jaret Burkett
|
a259fa07cd
|
Make convrot ui clearer
|
2026-07-13 06:44:27 -06:00 |
|
|
Jaret Burkett
|
0b62e516cc
|
Version Bump
|
2026-07-13 06:34:21 -06:00 |
|
|
Jaret Burkett
|
b6ff367633
|
Convrot improvements. Add argitrary bit packed byte quantizations.
|
2026-07-13 06:33:54 -06:00 |
|
|
Jaret Burkett
|
64663c8575
|
Add Boogu to the readme.
|
2026-07-11 21:03:00 -06:00 |
|
|
Jaret Burkett
|
4625406093
|
WIP working on convrot offloading
|
2026-07-11 15:37:28 -06:00 |
|
|
Jaret Burkett
|
1d1e21177a
|
Add ostris linear layer to linear layer searches.
|
2026-07-11 14:21:16 -06:00 |
|
|
Jaret Burkett
|
095d6e7418
|
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
|
2026-07-11 13:49:41 -06:00 |
|
|
Jaret Burkett
|
933ca1c517
|
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
|
2026-07-11 10:53:50 -06:00 |
|
|
Jaret Burkett
|
065ac27353
|
Fix issue with compiling convrot on some models
|
2026-07-11 09:26:12 -06:00 |
|
|
Jaret Burkett
|
96a3a06111
|
Added initial experimental support for convrot4 and convrot8 quantization.
|
2026-07-10 11:01:14 -06:00 |
|
|
Jaret Burkett
|
6fac83d068
|
Fix casting issue with orbit quant
|
2026-07-10 10:23:38 -06:00 |
|
|
Jaret Burkett
|
71c75357eb
|
Add cached conditioning recovery to wan 22 5b model
|
2026-07-10 10:22:24 -06:00 |
|
|
Jaret Burkett
|
ad07b06de5
|
Use cached first frame for wan22_5 model
|
2026-07-10 10:21:34 -06:00 |
|
|
Jaret Burkett
|
886c2aec57
|
Allow for vae tiling onle without low vram on wan models with a model kwarg
|
2026-07-10 09:42:52 -06:00 |
|
|
Jaret Burkett
|
fe82487187
|
Add tiling on vae decode for qwen image models when low vram flag is on
|
2026-07-10 09:07:29 -06:00 |
|
|
Jaret Burkett
|
e7951ad29e
|
Exclude sensative layers from quantization on wan models
|
2026-07-10 08:56:05 -06:00 |
|
|
Jaret Burkett
|
883d60eb71
|
Do vae tiling when decoding wan models with low vram active.
|
2026-07-10 08:02:32 -06:00 |
|
|
Jaret Burkett
|
fed9357234
|
Fix ui to show kv cache for krea2 edit raw
|
2026-07-09 15:48:46 -06:00 |
|
|
Jaret Burkett
|
5a9b5bde3f
|
Added experimental orbit quant
|
2026-07-09 15:14:51 -06:00 |
|
|
Jaret Burkett
|
a4bbe167ce
|
Added reference token attention isolation (kv_cache) for Krea2 edit training. Same training cost with significant inference speed up. 2x inference speedup.
|
2026-07-09 12:00:55 -06:00 |
|
|
Jaret Burkett
|
6233efe1bb
|
Fix sampling issue on zimage turbo and krea2 turbo models
|
2026-07-08 12:34:39 -06:00 |
|
|
Jaret Burkett
|
dd08579eda
|
Add ability to pull control images from same folder group
|
2026-07-08 05:21:31 -06:00 |
|
|
Jaret Burkett
|
7bceec3b07
|
Apply a loss mask for first frame conditioning for wan and ltx
|
2026-07-07 09:05:53 -06:00 |
|
|
Jaret Burkett
|
bd93a312bc
|
Load more types of comfy ui style quants for ltx2
|
2026-07-07 09:04:51 -06:00 |
|
|
Jaret Burkett
|
17bc302d13
|
Make log calls blocking to prevent duplicates.
|
2026-07-06 07:38:20 -06:00 |
|
|
Jaret Burkett
|
6c0d1c4679
|
Improve latency of the job list endpoint
|
2026-07-04 13:22:09 -06:00 |
|
|
Jaret Burkett
|
3a94591c89
|
Disable text encoder unload with krea2 o-edit
|
2026-07-04 09:17:15 -06:00 |
|
|
Jaret Burkett
|
b1e1a834d4
|
Added support to train Krea2 as an edit model
|
2026-07-04 09:12:39 -06:00 |
|
|
Jaret Burkett
|
f63221e577
|
Replace all sync functions with async to allow more parallel api calls
|
2026-07-01 17:12:43 -06:00 |
|
|
Jaret Burkett
|
48781f900b
|
Improve the loading and transfer speed of the dataset file lists
|
2026-07-01 16:40:01 -06:00 |
|
|
Jaret Burkett
|
b36a8e9c4b
|
Only pull the new log bytes from the ui to improve performance
|
2026-07-01 14:11:23 -06:00 |
|
|
Jaret Burkett
|
733e14cb58
|
Fix issue where the window would scroll to and hilight custom items in the select box
|
2026-07-01 13:57:56 -06:00 |
|
|
Jaret Burkett
|
4e50535478
|
Allow models to provide an additional loss
|
2026-06-28 09:49:36 -06:00 |
|
|
Jaret Burkett
|
1e12b6b73f
|
Remove duplicate save when triggering save next step
|
2026-06-28 07:18:16 -06:00 |
|
|
Jaret Burkett
|
7ee1f98f6d
|
Allow loading and saving z_image in comfy safetensors format.
|
2026-06-28 07:15:49 -06:00 |
|
|
Jaret Burkett
|
c97fc9973a
|
Fix loading pretraied lora when merging network on save
|
2026-06-28 06:04:36 -06:00 |
|
|
Jaret Burkett
|
f8667f0334
|
Save Krea2 even if quantized
|
2026-06-28 06:03:37 -06:00 |
|
|
Jaret Burkett
|
df6ea4263d
|
Version bump
|
2026-06-26 13:02:10 -06:00 |
|
|
Jaret Burkett
|
ad87aacec0
|
Add ability to set certain layers to full for loras
|
2026-06-26 13:01:48 -06:00 |
|
|
Jaret Burkett
|
4a99ddabad
|
Fix breaking change with diffusers qwen image
|
2026-06-26 10:04:35 -06:00 |
|
|
Jaret Burkett
|
5f04ae7ad5
|
Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning.
|
2026-06-25 13:19:38 -06:00 |
|
|
Jaret Burkett
|
6ecff36f26
|
Add a way to do full rank lora modules of non lora layers such as embeddings, norm, etc
|
2026-06-25 11:55:07 -06:00 |
|
|
Jaret Burkett
|
4eb0707639
|
Add a control generation script.
|
2026-06-25 10:14:24 -06:00 |
|
|
Jaret Burkett
|
d14f6e567a
|
Allow individual models to scale the loss after it is calculated.
|
2026-06-25 10:13:58 -06:00 |
|