evan/ai-toolkit
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,551 Commits 2 Branches 0 Tags
8fa15e356939a922b8fd3307610bf03100c803f6
Commit Graph
317 Commits
Author SHA1 Message Date
Jaret Burkett db8dbd68c2 Add support for training VLLMs, omni models, and LLMs 2026-09-15 17:47:02 -06:00
Jaret Burkett e43f138ae4 Initial experimental support for yue2 2026-09-14 05:07:11 -06:00
Jaret Burkett b1bf3e4381 Add a config to force pure noise step at a set rate 2026-09-09 11:26:28 -06:00
Jaret Burkett 4a41f146a3 Fix feedback when doing an ema with feedback so it uses its own scale 2026-09-09 06:43:14 -06:00
Jaret Burkett 764b5064fb Migrate to a new DTO for latents to carry more information that a normal tensor such as audio. 2026-08-30 10:30:21 -06:00
Jaret Burkett da79ebce99 Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va 2026-08-26 11:06:33 -06:00
Jaret Burkett 27a03a91f2 Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time 2026-08-21 13:31:02 -06:00
Jaret Burkett 257da9b586 Rework DOP so it works with caching text embeddings 2026-08-09 22:13:49 -06:00
Jaret Burkett 8502a845b1 Add support for MiniMax H3 T2V and I2V training 2026-08-03 10:17:39 -06:00
Jaret Burkett fc78b07332 Attach the ema to the base model so it can be used on specific models 2026-08-01 10:05:42 -06:00
Jaret Burkett 6e7bc81241 Allow random noise shift with video latents. 2026-07-31 05:58:08 -06:00
Jaret Burkett 088084e2c2 Resize validation images with the bucket sizing strategy. 2026-07-20 11:22:33 -06:00
Jaret Burkett df354da23e Replace trigger word in validation prompts for [trigger] tags 2026-07-20 07:56:04 -06:00
Jaret Burkett 1eb97b7443 Added validation loss 2026-07-19 19:33:45 -06:00
Jaret Burkett e805389f1e Remove print buffer. Add new line after sampling. 2026-07-16 11:37:23 -06:00
fatalisandJaret Burkett 8bbd051667 Add sample_start_step setting to configure when sampling starts (#949) 
Co-authored-by: Jaret Burkett <jaretburkett@gmail.com>
 2026-07-15 11:15:50 -06:00
Jaret Burkett 095d6e7418 Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods. 2026-07-11 13:49:41 -06:00
Jaret Burkett c97fc9973a Fix loading pretraied lora when merging network on save 2026-06-28 06:04:36 -06:00
Jaret Burkett 5f04ae7ad5 Rework merge_network_on_save to handle dequantization on merging and saving for much more efficient full finetuning. 2026-06-25 13:19:38 -06:00
Jaret Burkett f743ccf7ef Save before last sample 2026-06-24 09:13:01 -06:00
PlagueKind 089e41dd1c Compile improvements - auto cache size, fix fullgraph setting, fix triton detection (#899) 
* Compile improvements - auto cache size, fix fullgraph setting, fix triton detection

* remove forced torchao no longer needed
 2026-06-24 07:59:41 -06:00
Jaret Burkett c8cd78b1a4 Allow nested transformer block names for quantization, lora targeting, quantizing 2026-06-13 14:33:16 -06:00
PlagueKind e908d85f5e Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett 43b22b91ee Add a triton check on compile 2026-06-12 12:26:16 -06:00
Jaret Burkett 10e50d5797 Fix issue with casting unet after compilation 2026-06-12 12:16:51 -06:00
Jaret Burkett d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
PlagueKind 6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866) 
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
 2026-06-12 10:35:12 -06:00
Jaret Burkett cac3815b2c Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui 2026-06-08 13:55:47 -06:00
Jaret Burkett 82190b41e6 Fix bug where EMA was not being initialized even when setup in the config. EMA will now properly be setup and used. 2026-06-07 11:11:49 -06:00
Jaret Burkett 233e292256 Added some experimental low step things for zeta 2026-04-13 09:37:34 -06:00
Jaret Burkett bfb373c8fa Prep for future breaking changes in newer versions of transformers library 2026-04-10 12:04:32 -06:00
Jaret Burkett 78cf049c29 Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785) 
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
 2026-04-09 15:02:03 -06:00
Jaret Burkett 0dcbabf6af Fix merge nertwork ref 2026-04-01 10:38:31 -06:00
Jaret Burkett da2a79590f Add a merge network on save strength 2026-04-01 09:21:08 -06:00
Jaret Burkett 4a3251640a More work on compiling models 2026-03-31 12:11:56 -06:00
Jaret Burkett 358d684f6f Move compiiling the model after accelerate manipulation 2026-03-31 09:52:27 -06:00
Jaret Burkett 0045260af7 Fix issue where compile true did not actually compile the model 2026-03-31 09:27:54 -06:00
Jaret Burkett 171535833a Add Mac OS support for Apple Silicon (#770) 
* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI
 2026-03-30 09:37:47 -06:00
Remix 7a0bbca5b1 Fix random_noise_multiplier (#738) 
Apply random_noise_multiplier to noise.
 2026-03-23 15:22:16 -06:00
Jaret Burkett 06ef3d343a add ability to use batch noise correction during training 2026-03-10 09:05:57 -06:00
Jaret Burkett 40f995f616 Add method to do continuious lora merging in for low vram full finetuning. 2026-02-26 09:00:41 -07:00
Jaret Burkett a055947d56 Add signal_correction_noise_scale to config to scale the signal correction strength 2026-02-07 12:04:21 -07:00
Jaret Burkett 454722cc97 Add signal correction noise 2026-02-07 09:49:55 -07:00
Jaret Burkett 1422789452 Improved the method to augment random noise 2026-02-06 15:44:10 -07:00
Jaret Burkett 5c37db04f9 Added ability to activate experimental blank stabilization during training to zero out latents with blank prompts. 2026-02-04 13:00:03 -07:00
Jaret Burkett a767b82b60 Fixed issue with new logger when ooming 2025-12-25 16:57:34 +00:00
Jaret Burkett 87edca1b2b Added initial support to initiate lora training from an existing lora 2025-12-22 12:49:15 -07:00
Jaret Burkett ba00eea7d9 Add loss graph to the ui 2025-12-18 10:08:59 -07:00
Jaret Burkett 0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support 2025-10-21 06:03:27 -06:00
Jaret Burkett 76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. 2025-10-20 14:54:30 -06:00