evan/ai-toolkit
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,338 Commits 2 Branches 0 Tags
b677cdb02666320f1b03c747f5037a41e5a7515e
Commit Graph
1338 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jaret Burkett b677cdb026 Move uintx quantization to ostris quant with bit identical matching. Now we are not bound to an older version of torch ao. 2026-07-27 12:59:42 -06:00
Jaret Burkett fb204b7677 Fixed for DFEs with pixelspace and video models 2026-07-27 11:12:02 -06:00
Jaret Burkett 0e17841767 Version bump 2026-07-25 11:34:33 -06:00
Jaret Burkett 92bdb6e473 Add support for Mage-Flow and Mage-Flow Edit 2026-07-25 11:34:20 -06:00
Jaret Burkett 0c3a5e6970 Default to lokr full rank when not passed. 2026-07-25 09:06:49 -06:00
Jaret Burkett efb58c8641 Switch to thumbnails and thumbnail creation on the sample grid page until clicked. 2026-07-25 08:40:33 -06:00
Jaret Burkett e00f3791e2 Update some node packages. 2026-07-24 13:50:06 -06:00
Jaret Burkett be3406140b Remove dev indicators 2026-07-24 13:30:30 -06:00
Jaret Burkett 8f2d001eae Improvements to video frame loading. Added ability to cache as uint8 pixelspace for video 2026-07-24 12:36:47 -06:00
Jaret Burkett 67984754c3 Put more information about model gating and how to solve it 2026-07-24 09:56:02 -06:00
Jaret Burkett ede6f9ecee Major ui speed improvements. Moved file server out of next js app and made it multithreadded. Significantly faster downloads for files, images, and videos. 2026-07-23 09:35:08 -06:00
Jaret Burkett 1086bd0b3e Improvements to file transfer speed when downloading loras from cloud 2026-07-23 08:17:17 -06:00
Jaret Burkett d5612dd35c Adjust the x0 of some DFEs 2026-07-22 10:38:40 -06:00
Jaret Burkett e8573dad34 Fix trailing progress bar print when stopping a job in the ui 2026-07-22 10:11:08 -06:00
Jaret Burkett c4db100e17 Version bump 2026-07-21 11:36:36 -06:00
Jaret Burkett 3a4341dee3 Improve ui polling code to prevent poll buildup 2026-07-21 11:35:52 -06:00
Jaret Burkett e54a0fe78c Move to a single prisma client connection for the ui backend to prevent competing connections. 2026-07-21 11:21:28 -06:00
Jaret Burkett 9e9439015e Switch sqlite database to WAL mode. It will be significantly faster with multiple writers and readers. 2026-07-21 11:07:18 -06:00
fatalis c2864bba48 Enable val/loss by default on the loss graph (#966) 2026-07-20 11:33:03 -06:00
Jaret Burkett 088084e2c2 Resize validation images with the bucket sizing strategy. 2026-07-20 11:22:33 -06:00
Jaret Burkett df354da23e Replace trigger word in validation prompts for [trigger] tags 2026-07-20 07:56:04 -06:00
Jaret Burkett 6e158dd1f1 Adjust validation loss defaults 2026-07-19 19:35:33 -06:00
Jaret Burkett 1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
Jaret Burkett cd677c70b5 Fix issue where more than 12 samples would break sample grid. 2026-07-19 09:21:44 -06:00
Jaret Burkett 479c72ada2 Add replacing triggers on prompts when caching text encoder 2026-07-19 09:03:05 -06:00
fatalisandJaret Burkett 7ba7e35e19 Fix several cases of silent crashing on UI (#922) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-19 08:23:57 -06:00
ZironicandRydén Johan a0224793ce Restore device runtime scales for compiled adapters (#963) 
Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
 2026-07-18 08:19:57 -06:00
Jaret Burkett cfdc9033a6 Add min and max LR or automagic to prefent runaway edge cases. 2026-07-17 14:19:53 -06:00
Jaret Burkett f1bc6508ad Fix issue with qwen image edit models. 2026-07-17 09:14:04 -06:00
Jaret Burkett 6696117a94 Fix issue where the log lone for samples would double up sometimes 2026-07-17 08:11:32 -06:00
Jaret Burkett 988d891102 Added a Sample Next Step in the job gear dropdown to force a sample on the next step. 2026-07-17 07:59:30 -06:00
Jaret Burkett 7a3d94ed03 Add caching to active job pull 2026-07-16 16:51:05 -06:00
Jaret Burkett bf15b65972 Add caching for api calls to speed them up. Added caching for cpu and gpu stat calls 2026-07-16 16:47:10 -06:00
PlagueKind 3c75735ba2 remove unicode (#955) 2026-07-16 16:20:16 -06:00
Jaret Burkett 0552d85aa7 Gice the loss graph more diverse colors 2026-07-16 16:06:05 -06:00
Jaret Burkett 5fbfb502b5 Leave the generating samples bar in the log when samples finish. 2026-07-16 12:00:45 -06:00
Jaret Burkett e805389f1e Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
Jaret Burkett b6f334e676 Version bump 2026-07-16 08:56:32 -06:00
Jaret Burkett bbaef7852a Do not materalize weights on ostris quantizer when getting state dict. Require dequantization of weight like other quantization methods. 2026-07-16 08:55:51 -06:00
Jaret Burkett 31c45cf37d Update huggingface hub requirement. Remove forced xet removal as some models are so large it wont work without it. Hopefully the latest version of huggingface_hub doesnt have the hanging issues. 2026-07-16 08:52:24 -06:00
Jaret Burkett e1e1996c16 Rework the logging and terminal emulator on the ui to work like an actual emulator for better output. 2026-07-16 08:50:40 -06:00
Jaret Burkett 5cb54ba9cc Allow setting weight saving flag on hidream_o1 2026-07-16 07:40:25 -06:00
fatalis 741aeb9ce0 Clear stale return-to-queue flag when starting jobs, fixes crash loop (#920) 2026-07-15 12:48:39 -06:00
Jaret Burkett fe619405f3 Merge branch 'main' of github.com:ostris/ai-toolkit 2026-07-15 12:44:47 -06:00
DasPauluteliandJaret Burkett a92f18bf71 krea2: don't hardcode the NVIDIA-only cuDNN SDPA backend (#933) 
* krea2: don't hardcode NVIDIA-only cuDNN SDPA backend

The krea2 attention() forced SDPBackend.CUDNN_ATTENTION, which is
NVIDIA-only. On non-NVIDIA backends (AMD ROCm, Intel XPU, Apple MPS)
every forward pass fails with 'RuntimeError: No available kernel.
Aborting execution.', so Krea 2 LoRA training cannot run at all there.

Pass a priority list [CUDNN, FLASH, EFFICIENT, MATH] instead. NVIDIA
still selects cuDNN; other backends fall back to flash/efficient/math.
Verified training end-to-end on an AMD Radeon 8060S (gfx1151, ROCm 7.2).

* Version bump

* Add set priority flag so CUDNN_ATTENTION is selected on cuda devices first.

---------

Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 12:44:34 -06:00
Jaret Burkett 4f5974ffa1 Version bump 2026-07-15 12:17:35 -06:00
Jaret Burkett b8f8a08ba4 Fix sampling bar with anima 2026-07-15 12:17:06 -06:00
rmatifandJaret Burkett 3e6bd874c4 feat: Add Anima support (#860) 
* Add Anima training support

* Update Anima modular training

* Use sample guidance for Anima

* Fix Anima sampling

* Limit Anima LoRA targets

* Convert Anima LoRA exports

* Fix Anima local loading

* Update Anima default model

* Pin upstream Anima diffusers

* Adjust template defaults to be consistent with other models. Update README

---------

Co-authored-by: Jaret Burkett (Ostris) <jaretburkett@gmail.com>
 2026-07-15 11:59:01 -06:00
fatalisandJaret Burkett 8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
ZironicRydén JohanJaret Burkett
 		4ece17b71f Fix adapter scalar handling under torch.compile (#946) 
* Fix adapter scalar handling under torch.compile

* Fix instance where error could happen when merging in a lora to the base model

---------

Co-authored-by: Rydén Johan <johan.ryden@bostad.uppsala.se>
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:07:55 -06:00