 Jaret Burkett
|
ffb5fe0667
|
Version bump
|
2025-06-10 10:04:32 -06:00 |
|
|
Jaret Burkett
|
f8fb3b9c45
|
Added support for sdxl and sd1.5 to the ui.
|
2025-06-10 10:03:54 -06:00 |
|
|
Jaret Burkett
|
d5c547da43
|
Fixed DOP typo
|
2025-06-10 08:44:47 -06:00 |
|
|
Jaret Burkett
|
f19f7f9486
|
Fixed issue with wan2.1 training in ui. Name had a typo
|
2025-06-10 08:42:18 -06:00 |
|
|
Jaret Burkett
|
7317ed58af
|
Adjust the ui of the sidebar
|
2025-06-10 08:40:51 -06:00 |
|
|
Jaret Burkett
|
517bc294fa
|
Update support link
|
2025-06-10 08:28:30 -06:00 |
|
|
Jaret Burkett
|
97e101522c
|
Increase ema feedback amount. Normalize the dfe 4 image embeds
|
2025-06-10 08:01:13 -06:00 |
|
|
Jaret Burkett
|
eefa93f16e
|
Various code to support experiments.
|
2025-06-09 11:19:21 -06:00 |
|
|
Jaret Burkett
|
22cdfadab6
|
Added new timestep weighing strategy
|
2025-06-04 01:16:02 -06:00 |
|
|
Jaret Burkett
|
adc31ec77d
|
Small updates and bug fixes for various things
|
2025-06-03 20:08:35 -06:00 |
|
|
Jaret Burkett
|
b6d25fcd10
|
Improvements to vae trainer. Adjust denoise prediction of DFE v3
|
2025-05-30 12:06:47 -06:00 |
|
|
Jaret Burkett
|
ffaf2f154a
|
Fix issue with the way chroma handled gradient checkpointing.
|
2025-05-28 08:41:47 -06:00 |
|
|
Jaret Burkett
|
34f4c14cd6
|
Work on vae trainer
|
2025-05-28 07:42:48 -06:00 |
|
|
Jaret Burkett
|
79bb9be92b
|
Fix issue with saving chroma full finetune.
|
2025-05-28 07:42:30 -06:00 |
|
|
Jaret Burkett
|
79499fa795
|
Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.
|
2025-05-21 07:02:50 -06:00 |
|
|
Jaret Burkett
|
48e11cf843
|
Fallback unwrapping logic if fails
|
2025-05-21 03:10:33 -06:00 |
|
|
Jaret Burkett
|
7045a01375
|
Fixed issue saving optimizer in some instances.
|
2025-05-21 02:27:55 -06:00 |
|
|
Jaret Burkett
|
fca7fd6c38
|
Merge branch 'main' of github.com:ostris/ai-toolkit
|
2025-05-21 02:20:06 -06:00 |
|
|
Jaret Burkett
|
e5181d23cd
|
Added some experimental training techniques. Ignore for now. Still in testing.
|
2025-05-21 02:19:54 -06:00 |
|
|
Jaret Burkett
|
4f896c0d8a
|
Fixed issue where sampling fails if doing a full finetune for some models
|
2025-05-17 19:37:55 +00:00 |
|
|
Jaret Burkett
|
01101be196
|
version bump
|
2025-05-17 05:50:12 -06:00 |
|
|
Jaret Burkett
|
6174ba474e
|
Fixed issue with chroma sampling
|
2025-05-10 18:30:23 +00:00 |
|
|
Jaret Burkett
|
66a41e49d9
|
Bump version
|
2025-05-08 17:37:28 -06:00 |
|
|
Jaret Burkett
|
1210050ead
|
Reworked control generator. It is now significantly faster. Also uses better pose model with better license.
|
2025-05-08 14:35:55 -06:00 |
|
|
Jaret Burkett
|
25e150b370
|
Added support for Flex.2 in the UI
|
2025-05-07 12:41:51 -06:00 |
|
|
Jaret Burkett
|
43cb5603ad
|
Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models
|
2025-05-07 12:06:30 -06:00 |
|
|
Jaret Burkett
|
d9700bdb99
|
Added initial support for f-lite model
|
2025-05-01 11:15:18 -06:00 |
|
|
Jaret Burkett
|
5890e67a46
|
Various bug fixes
|
2025-04-29 09:30:33 -06:00 |
|
|
Jaret Burkett
|
2b4c525489
|
Reworked automagic optimizer and did more testing. Starting to really like it. Working well.
|
2025-04-28 08:01:10 -06:00 |
|
|
Jaret Burkett
|
88b3fbae37
|
Various experiments and minor bug fixes for edge cases
|
2025-04-25 13:44:38 -06:00 |
|
|
Jaret Burkett
|
8ff85ba14f
|
Add Flex2 training example
|
2025-04-22 11:59:47 -06:00 |
|
|
Jaret Burkett
|
80f73ce9c0
|
Update README.md
|
2025-04-22 10:46:51 -06:00 |
|
|
Jaret Burkett
|
9f42944056
|
Update Sponsors
|
2025-04-22 09:44:56 -06:00 |
|
|
Jaret Burkett
|
add83df5cc
|
Fixed issue with training hidream when batch size is larger than 1
|
2025-04-21 17:26:29 +00:00 |
|
|
Jaret Burkett
|
12e3095d8a
|
Fixed issue with saving base model version
|
2025-04-19 14:34:01 -06:00 |
|
|
Jaret Burkett
|
77001ee77f
|
Upodate model tag on loras
|
2025-04-19 10:41:27 -06:00 |
|
|
Jaret Burkett
|
d455e76c4f
|
Cleanup
|
2025-04-18 11:44:49 -06:00 |
|
|
Jaret Burkett
|
1628884254
|
Remove submodule install from docker
|
2025-04-18 10:41:52 -06:00 |
|
|
Jaret Burkett
|
9c422ac14f
|
Bump version
|
2025-04-18 10:39:51 -06:00 |
|
|
Jaret Burkett
|
bfe29e2151
|
Removed all submodules. Submodule free now, yay.
|
2025-04-18 10:39:15 -06:00 |
|
|
Jaret Burkett
|
bd2de5b74e
|
Remove leco submodule
|
2025-04-18 10:08:09 -06:00 |
|
|
Jaret Burkett
|
970fac19a5
|
Remove batch annotator as submodule
|
2025-04-18 10:03:37 -06:00 |
|
|
Jaret Burkett
|
5f312cd46b
|
Remove ip adapter submodule
|
2025-04-18 09:59:42 -06:00 |
|
|
Jaret Burkett
|
c90615f8bb
|
Add model hooks to polarity loss
|
2025-04-17 09:00:10 -06:00 |
|
|
Jaret Burkett
|
5961ef6c9f
|
Fixed typo in linux install
|
2025-04-16 22:08:17 -06:00 |
|
|
Jaret Burkett
|
fd6026ab73
|
Merge pull request #278 from ostris/hidream
Add Hidream support
|
2025-04-16 13:48:27 -06:00 |
|
|
Jaret Burkett
|
79c87701e7
|
Add hidream to the ui
|
2025-04-16 13:45:21 -06:00 |
|
|
Jaret Burkett
|
fecc64e646
|
Update hidream defaults, pass additional information to flow guidance
|
2025-04-16 13:03:04 -06:00 |
|
|
Jaret Burkett
|
d5a64006b5
|
Added example config to train hidream
|
2025-04-16 10:18:22 -06:00 |
|
|
Jaret Burkett
|
0f99fce004
|
Adjust hidream lora names to work with comfy
|
2025-04-16 09:24:23 -06:00 |
|
|
Jaret Burkett
|
c12036df95
|
Added ability to use short captions from json caption file
|
2025-04-16 08:32:28 -06:00 |
|
|
Jaret Burkett
|
68018c908e
|
Made a script to convert diffusers to comfy just the transformer
|
2025-04-15 10:22:05 -06:00 |
|
|
Jaret Burkett
|
524bd2edfc
|
Make flash attn optional. Handle larger batch sizes.
|
2025-04-14 14:34:46 +00:00 |
|
|
Jaret Burkett
|
89c0f688db
|
Merge branch 'main' into hidream
|
2025-04-13 21:16:07 -06:00 |
|
|
Jaret Burkett
|
1e0bff653c
|
Fix new bug I accidently introduced with lora
|
2025-04-13 21:15:07 -06:00 |
|
|
Jaret Burkett
|
3a5ea2c742
|
Remove some moe stuff for finetuning. Drastically reduces vram usage
|
2025-04-14 00:57:34 +00:00 |
|
|
Jaret Burkett
|
f80cf99f40
|
Hidream is training, but has a memory leak
|
2025-04-13 23:28:18 +00:00 |
|
|
Jaret Burkett
|
594e166ca3
|
Initial support for hidream. Still a WIP
|
2025-04-13 13:50:11 -06:00 |
|
|
Jaret Burkett
|
ca3ce0f34c
|
Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range.
|
2025-04-13 13:49:13 -06:00 |
|
|
Jaret Burkett
|
6fb44db6a0
|
Finished up first frame for i2v adapter
|
2025-04-12 17:13:04 -06:00 |
|
|
Jaret Burkett
|
cd37ccfc2e
|
Use gradient checkpointing on DFE models if set
|
2025-04-11 10:45:39 -06:00 |
|
|
Jaret Burkett
|
4a43589666
|
Use a shuffled embedding as unconditional for i2v adapter
|
2025-04-11 10:44:43 -06:00 |
|
|
Jaret Burkett
|
059155174a
|
Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter
|
2025-04-10 11:50:01 -06:00 |
|
|
Jaret Burkett
|
9794416a5d
|
Fixed bug when loading video datasets
|
2025-04-10 08:16:05 -06:00 |
|
|
Jaret Burkett
|
d8bdc03256
|
Allow full control of caption extensions
|
2025-04-10 07:42:04 -06:00 |
|
|
Jaret Burkett
|
96ba2fd129
|
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
|
2025-04-09 13:35:04 -06:00 |
|
|
Jaret Burkett
|
615b0d0e94
|
Added initial support for training i2v adapter WIP
|
2025-04-09 08:06:29 -06:00 |
|
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
|
Jaret Burkett
|
38ad5a4644
|
Fixed issue with video dataset sizing
|
2025-04-07 12:46:41 -06:00 |
|
|
Jaret Burkett
|
6c8b5ab606
|
Added some more useful error handeling and logging
|
2025-04-07 08:01:37 -06:00 |
|
|
Jaret Burkett
|
7c21eac1b3
|
Added support for Lodestone Rock's Chroma model
|
2025-04-05 13:21:36 -06:00 |
|
|
Jaret Burkett
|
2b901cca39
|
Small tweaks and bug fixes and future proofing
|
2025-04-05 12:39:45 -06:00 |
|
|
Jaret Burkett
|
ead23cee88
|
Updated supporters
|
2025-04-05 12:35:01 -06:00 |
|
|
Jaret Burkett
|
ab59ca5091
|
Updated comment on control path
|
2025-04-04 10:23:06 -06:00 |
|
|
Jaret Burkett
|
eddd3c1611
|
Added finetuning/training example for redux
|
2025-04-04 10:05:41 -06:00 |
|
|
Jaret Burkett
|
b0d0466efd
|
Add better error messages if name exists when saving a job
|
2025-04-03 11:25:25 -06:00 |
|
|
Jaret Burkett
|
ac1ee559c5
|
Added bluring to mask for flex2
|
2025-04-02 07:55:51 -06:00 |
|
|
Jaret Burkett
|
77763a3e5c
|
Update divisiblity of SD3
|
2025-04-02 06:49:06 -06:00 |
|
|
Jaret Burkett
|
a42c5a1de5
|
Adjust buckets for flex2
|
2025-04-02 06:47:41 -06:00 |
|
|
Jaret Burkett
|
3d131fb27a
|
Added a file signature check on the dataset size caching system to invalidate cached dimensions if the file changes.
|
2025-04-01 07:39:36 -06:00 |
|
|
Jaret Burkett
|
5ea19b6292
|
small bug fixes
|
2025-03-30 20:09:40 -06:00 |
|
|
Jaret Burkett
|
58861005a5
|
Version bump
|
2025-03-30 09:23:30 -06:00 |
|
|
Jaret Burkett
|
c083a0e5ea
|
Allow DFE to not have a VAE
|
2025-03-30 09:23:01 -06:00 |
|
|
Jaret Burkett
|
860d892214
|
Pixel shuffle adapter. Some bug fixes thrown in
|
2025-03-29 21:15:01 -06:00 |
|
|
Jaret Burkett
|
b94d7aafea
|
Have error boundary if simple job cannot be displayed due to the job being advanced
|
2025-03-27 19:55:40 -06:00 |
|
|
Jaret Burkett
|
3c95f87a90
|
Added some missing dependencies
|
2025-03-27 18:48:48 -06:00 |
|
|
Jaret Burkett
|
1d5f387f54
|
Fix docker command to work better with runpod
|
2025-03-27 17:44:46 -06:00 |
|
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
|
Jaret Burkett
|
e9e30104d3
|
Merge pull request #271 from ostris/wavelet_loss
Added experimental wavelet loss
|
2025-03-26 19:12:09 -06:00 |
|
|
Jaret Burkett
|
ce4c5291a0
|
Added experimental wavelet loss
|
2025-03-26 18:11:23 -06:00 |
|
|
Jaret Burkett
|
c101f07834
|
Version bump
|
2025-03-26 12:16:01 -06:00 |
|
|
Jaret Burkett
|
e4526ad4a4
|
Updates to handle video in a dataset on ui
|
2025-03-26 12:15:28 -06:00 |
|
|
Jaret Burkett
|
4595965e06
|
Added an inpainting mask generator for training inpainting if inpaint mask is not provided
|
2025-03-25 12:16:10 -06:00 |
|
|
Jaret Burkett
|
41edc18750
|
Removed unnessary import
|
2025-03-25 11:54:42 -06:00 |
|
|
Jaret Burkett
|
6021a3dbc0
|
Change inpainting mask to zero out on latents instead of image for inpaint area.
|
2025-03-24 14:16:52 -06:00 |
|
|
Jaret Burkett
|
71d7a52146
|
Fixed issue with python being wrong on docker
|
2025-03-24 14:16:09 -06:00 |
|
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
|
Jaret Burkett
|
ccb66c748f
|
Update readme install directions
|
2025-03-22 15:14:04 -06:00 |
|
|
Jaret Burkett
|
2aca2883e7
|
Update windows install directions for new version of torch
|
2025-03-22 15:12:51 -06:00 |
|