Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett c5eb763342 Improvements to VAE trainer. Allow CLIP loss. 2025-07-24 06:50:56 -06:00
Jaret Burkett ca5cf827a1 Version bump 2025-07-20 12:20:46 -06:00
Jaret Burkett b1bff66d52 Merge pull request #343 from davertor/fix_kontext_bs
fix: Guidance incorrect shape
2025-07-20 12:00:55 -06:00
Jaret Burkett 8610c6ed7f Made it easy to add control images to the samples in the UI 2025-07-17 12:00:48 -06:00
Jaret Burkett e25d2feddf Use scale shift in vae latent space for vae trainer 2025-07-17 08:14:07 -06:00
Jaret Burkett f500b9f240 Add ability to do more advanced sample prompt objects to prepart for a UI rework on control images and other things. 2025-07-17 07:13:35 -06:00
Jaret Burkett 3916e67455 Scale target vae latent before targeting it 2025-07-17 07:12:21 -06:00
Jaret Burkett e5ed450dc7 Allow finetuning tiny autoencoder in vae trainer 2025-07-16 07:13:30 -06:00
Jaret Burkett 1930c3edea Fix naming with wan i2v new keys in lora 2025-07-14 07:34:01 -06:00
Jaret Burkett ef5149180c Switch i2v ui defaults to weighted 2025-07-12 21:30:04 -06:00
Jaret Burkett 998e8b6537 Bump version 2025-07-12 16:57:09 -06:00
Jaret Burkett 755f0e207c Fix issue with wan i2v scaling. Adjust aggressive loader to be compatable with updated diffusers. 2025-07-12 16:56:27 -06:00
Jaret Burkett 2e84b3d5b1 Update VAE trainer to handle fixed latent target. Also minor bug fixes and improvements 2025-07-12 16:55:15 -06:00
Jaret Burkett 7ab44ae0cd Fix issue with getting captions on runpod 2025-07-11 19:16:50 +00:00
Jaret Burkett 47002b067f Add path to image for datasets on the image card 2025-07-11 11:44:48 -06:00
Jaret Burkett 8537a8557f Add simple ui settings to train Wan i2v models. 2025-07-11 11:28:40 -06:00
Jaret Burkett 6e2beef8dd Version Bump 2025-07-09 13:55:33 -06:00
Jaret Burkett 611969ec1f Allow control image for omnigen training and sampling 2025-07-09 13:54:55 -06:00
Jaret Burkett bbb57de6ec Speed up omnigen TE loading 2025-07-05 09:32:00 -06:00
Jaret Burkett 5906a76666 Fixed issue with flux kontext forcing generation image sizes 2025-06-29 05:38:20 -06:00
Jaret Burkett 57a81bc0db Update base model version for kontext meta 2025-06-28 14:48:36 -06:00
Jaret Burkett 843be31138 Update readme changelog 2025-06-28 12:55:23 -06:00
Jaret Burkett 8fb01e96e4 Update sponsors 2025-06-28 10:05:17 -06:00
Jaret Burkett 01a3c8a9b1 Fix device issue 2025-06-26 19:14:25 -06:00
Jaret Burkett 4f91cb7148 Fix issue with gradient checkpointing and flux kontext 2025-06-26 19:03:12 -06:00
Jaret Burkett 446b0b6989 Remove revision for kontext 2025-06-26 16:46:58 -06:00
Jaret Burkett 60ef2f1df7 Added support for FLUX.1-Kontext-dev 2025-06-26 15:24:37 -06:00
Jaret Burkett 8d9c47316a Work on mean flow. Minor bug fixes. Omnigen improvements 2025-06-26 13:46:20 -06:00
Jaret Burkett 84c6edca7e Merge branch 'main' into dev 2025-06-25 14:10:25 -06:00
Jaret Burkett 24cd94929e Fix bug that can happen with fast processing dataset 2025-06-25 14:01:08 -06:00
Jaret Burkett 19ea8ecc38 Added support for finetuning OmniGen2. 2025-06-25 13:58:16 -06:00
Jaret Burkett 18513ec866 Merged in from main 2025-06-24 10:56:54 -06:00
Jaret Burkett 5e733764aa Update version 2025-06-24 10:37:13 -06:00
Jaret Burkett 03bc431279 Fixed an issue training lumina 2 2025-06-24 10:29:47 -06:00
Jaret Burkett f3eb1dff42 Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss 2025-06-24 08:51:29 -06:00
Jaret Burkett ba1274d99e Added a guidance burning loss. Modified DFE to work with new model. Bug fixes 2025-06-23 08:38:27 -06:00
Jaret Burkett 8602470952 Updated diffusion feature extractor 2025-06-19 15:36:10 -06:00
Jaret Burkett 4586eb5392 Added social links to sidebar 2025-06-17 13:25:24 -06:00
Jaret Burkett 989ebfaa11 Added a basic torch profiler that can be used in config during development to find some obvious issues. 2025-06-17 13:03:39 -06:00
Jaret Burkett ff617fdaea Started doing info bubble docs on the simple ui 2025-06-17 11:00:24 -06:00
Jaret Burkett 595a6f1735 Initial setup for a cron working on the ui for various tasks 2025-06-17 07:43:34 -06:00
Jaret Burkett 1cc663a664 Performance optimizations for pre processing the batch 2025-06-17 07:37:41 -06:00
Jaret Burkett 11f2eee53a Hide control images from ui image viewer 2025-06-16 07:18:43 -06:00
Jaret Burkett 1c2b7298dd More work on mean flow loss. Moved it to an adapter. Still not functioning properly though. 2025-06-16 07:17:35 -06:00
Jaret Burkett c0314ba325 Fixed some issues with training mean flow algo. Still testing WIP 2025-06-16 07:14:59 -06:00
Jaret Burkett cbf04b8d53 Fixed some issues with training mean flow algo. Still testing WIP 2025-06-14 12:24:00 -06:00
Jaret Burkett 0946a66576 Merge branch 'main' into dev 2025-06-12 08:11:19 -06:00
Jaret Burkett 3f0ae99d48 Version bump 2025-06-12 08:01:26 -06:00
Jaret Burkett fc83eb7691 WIP on mean flow loss. Still a WIP. 2025-06-12 08:00:51 -06:00
Jaret Burkett cf11f128b9 Merge pull request #304 from hameerabbasi/fix-caption-loads
Fix caption loading
2025-06-12 07:44:12 -06:00
Jaret Burkett ba5196dd4a Merge branch 'main' into dev 2025-06-10 10:26:11 -06:00
Jaret Burkett ffb5fe0667 Version bump 2025-06-10 10:04:32 -06:00
Jaret Burkett f8fb3b9c45 Added support for sdxl and sd1.5 to the ui. 2025-06-10 10:03:54 -06:00
Jaret Burkett d5c547da43 Fixed DOP typo 2025-06-10 08:44:47 -06:00
Jaret Burkett f19f7f9486 Fixed issue with wan2.1 training in ui. Name had a typo 2025-06-10 08:42:18 -06:00
Jaret Burkett 7317ed58af Adjust the ui of the sidebar 2025-06-10 08:40:51 -06:00
Jaret Burkett 517bc294fa Update support link 2025-06-10 08:28:30 -06:00
Jaret Burkett 97e101522c Increase ema feedback amount. Normalize the dfe 4 image embeds 2025-06-10 08:01:13 -06:00
Jaret Burkett eefa93f16e Various code to support experiments. 2025-06-09 11:19:21 -06:00
Jaret Burkett 22cdfadab6 Added new timestep weighing strategy 2025-06-04 01:16:02 -06:00
Jaret Burkett adc31ec77d Small updates and bug fixes for various things 2025-06-03 20:08:35 -06:00
Jaret Burkett 82b90b902e Double tap torch install to force blackwell compatability 2025-06-02 20:22:22 -06:00
Jaret Burkett 85f4b47e79 Fix issue with setup tools requirements 2025-06-02 06:54:35 -06:00
Jaret Burkett e20a869dc1 Update docker install for blacwell 2025-06-01 19:06:53 -06:00
Jaret Burkett 12fa109910 Updated cuda arch list on docker build 2025-06-01 13:37:11 -06:00
Jaret Burkett 7d76165dcf Merge branch 'main' into dev 2025-06-01 13:33:40 -06:00
Jaret Burkett b6d25fcd10 Improvements to vae trainer. Adjust denoise prediction of DFE v3 2025-05-30 12:06:47 -06:00
Jaret Burkett ffaf2f154a Fix issue with the way chroma handled gradient checkpointing. 2025-05-28 08:41:47 -06:00
Jaret Burkett 34f4c14cd6 Work on vae trainer 2025-05-28 07:42:48 -06:00
Jaret Burkett 79bb9be92b Fix issue with saving chroma full finetune. 2025-05-28 07:42:30 -06:00
Jaret Burkett 79499fa795 Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed. 2025-05-21 07:02:50 -06:00
Jaret Burkett 48e11cf843 Fallback unwrapping logic if fails 2025-05-21 03:10:33 -06:00
Jaret Burkett 7045a01375 Fixed issue saving optimizer in some instances. 2025-05-21 02:27:55 -06:00
Jaret Burkett fca7fd6c38 Merge branch 'main' of github.com:ostris/ai-toolkit 2025-05-21 02:20:06 -06:00
Jaret Burkett e5181d23cd Added some experimental training techniques. Ignore for now. Still in testing. 2025-05-21 02:19:54 -06:00
Jaret Burkett 4f896c0d8a Fixed issue where sampling fails if doing a full finetune for some models 2025-05-17 19:37:55 +00:00
Jaret Burkett 01101be196 version bump 2025-05-17 05:50:12 -06:00
Jaret Burkett 6174ba474e Fixed issue with chroma sampling 2025-05-10 18:30:23 +00:00
Jaret Burkett 64130189ce Bumped torch and cuda to support blackwell arch 2025-05-09 11:17:58 -06:00
Jaret Burkett 66a41e49d9 Bump version 2025-05-08 17:37:28 -06:00
Jaret Burkett 1210050ead Reworked control generator. It is now significantly faster. Also uses better pose model with better license. 2025-05-08 14:35:55 -06:00
Jaret Burkett 25e150b370 Added support for Flex.2 in the UI 2025-05-07 12:41:51 -06:00
Jaret Burkett 43cb5603ad Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models 2025-05-07 12:06:30 -06:00
Jaret Burkett d9700bdb99 Added initial support for f-lite model 2025-05-01 11:15:18 -06:00
Jaret Burkett 5890e67a46 Various bug fixes 2025-04-29 09:30:33 -06:00
Jaret Burkett 2b4c525489 Reworked automagic optimizer and did more testing. Starting to really like it. Working well. 2025-04-28 08:01:10 -06:00
Jaret Burkett 88b3fbae37 Various experiments and minor bug fixes for edge cases 2025-04-25 13:44:38 -06:00
Jaret Burkett 8ff85ba14f Add Flex2 training example 2025-04-22 11:59:47 -06:00
Jaret Burkett 80f73ce9c0 Update README.md 2025-04-22 10:46:51 -06:00
Jaret Burkett 9f42944056 Update Sponsors 2025-04-22 09:44:56 -06:00
Jaret Burkett add83df5cc Fixed issue with training hidream when batch size is larger than 1 2025-04-21 17:26:29 +00:00
Jaret Burkett 12e3095d8a Fixed issue with saving base model version 2025-04-19 14:34:01 -06:00
Jaret Burkett 77001ee77f Upodate model tag on loras 2025-04-19 10:41:27 -06:00
Jaret Burkett d455e76c4f Cleanup 2025-04-18 11:44:49 -06:00
Jaret Burkett 1628884254 Remove submodule install from docker 2025-04-18 10:41:52 -06:00
Jaret Burkett 9c422ac14f Bump version 2025-04-18 10:39:51 -06:00
Jaret Burkett bfe29e2151 Removed all submodules. Submodule free now, yay. 2025-04-18 10:39:15 -06:00
Jaret Burkett bd2de5b74e Remove leco submodule 2025-04-18 10:08:09 -06:00
Jaret Burkett 970fac19a5 Remove batch annotator as submodule 2025-04-18 10:03:37 -06:00
Jaret Burkett 5f312cd46b Remove ip adapter submodule 2025-04-18 09:59:42 -06:00