Jaret Burkett
63b3181262
Added experimental support for Ideogram 4
2026-06-04 09:03:00 -06:00
Jaret Burkett
b5f21ae695
Fixed issue where the training type dropdown in the ui was not showing fully
2026-06-03 10:14:15 -06:00
Jaret Burkett
d9f26c2f87
Add gradient checkpointing to tipsv2 heads
2026-06-01 05:00:15 -06:00
Jaret Burkett
bd468727a6
Fixed issue where some image cards in samples and datasets would show gray instead of the image until you scroll.
2026-06-01 03:36:32 -06:00
Jaret Burkett
f5446c0d5f
Version bump
2026-06-01 02:16:47 -06:00
Jaret Burkett
e5439509b5
Added pure lpips dfe
2026-05-31 11:52:03 -06:00
Jaret Burkett
212cfe998a
Add ability to download or delete the optimizer state from the ui
2026-05-29 08:56:22 -06:00
Jaret Burkett
5e84bf0d0b
Fixed issue with hidream-01 that could cause a weird nan state. Took forever to track down as it was 1 in 10 starts.
2026-05-28 12:48:24 -06:00
Jaret Burkett
87bac27513
Fixed issue with new bucket scaler
2026-05-28 11:34:16 -06:00
Jaret Burkett
30886b8f92
Added a wallet indicator for Ostris Cloud
2026-05-28 11:09:51 -06:00
Jaret Burkett
3e86d81fc6
Adjust bucket sizes to achieve maximum pixels without going over.
2026-05-28 09:36:17 -06:00
Jaret Burkett
ef57c1077c
Change z image divisibility
2026-05-28 09:09:36 -06:00
Jaret Burkett
15082cfb8a
Round buckets for divisibility instead of always rounding down.
2026-05-28 09:08:21 -06:00
Jaret Burkett
c9264bdd0b
Reworked the bucketing system to precisly match model specific divisibility. The old SDXL bucket sizes needed to go.
2026-05-28 08:35:58 -06:00
Jaret Burkett
68e9b38220
Add ability to trigger a save from the ui which whill make the trainer save on the next step
2026-05-26 08:38:49 -06:00
Jaret Burkett
2aa60e4ca5
Update default agreement threshold for automagic v2 to be 0.5
2026-05-26 07:57:54 -06:00
Jaret Burkett
76c99da4e4
Add version to the ui
2026-05-26 07:30:09 -06:00
Jaret Burkett
266956068a
Add a way to delete checkpoints on the ui
2026-05-26 07:09:21 -06:00
Jaret Burkett
954c5efec8
Show job info on sidebar active job in ui
2026-05-25 11:07:29 -06:00
Jaret Burkett
083236a2a7
Drastically improve the loading speed of images in the ui by using a custom loader and abort controller to abort when images leave the view.
2026-05-25 10:04:25 -06:00
Jaret Burkett
7354def271
Added decode latent method to qwen image model
2026-05-25 10:02:09 -06:00
Jaret Burkett
3d836ac371
Show active jobs in the sidebar of the ui
2026-05-25 08:21:42 -06:00
Jaret Burkett
a798e06dd2
Updated the support button to look more like a button
2026-05-25 07:48:04 -06:00
Jaret Burkett
8042cbe9d2
Added virtulization for sample images to handle huge number of samples more efficientyly.
2026-05-25 07:22:24 -06:00
Jaret Burkett
fbac1cb7f5
Dont force flash attention on hidream 01. Causes random issues and is slower.
2026-05-24 16:05:22 -06:00
Jaret Burkett
307ff11bc5
Drastically improved the performance of the dataset viewer on large datasets by switching to virtualization. Fixed issue with images loading when they have two periods in a row ..
2026-05-24 15:13:55 -06:00
Jaret Burkett
c6a7e81a70
Added a dataset image viewer. Fixed an issue where captions would show as not saved when they were saved.
2026-05-24 14:31:06 -06:00
Jaret Burkett
12304e170f
Added some experimental loss targets
2026-05-24 14:13:23 -06:00
Jaret Burkett
644a6f9246
Fix device casting for zimage in some instances
2026-05-23 10:37:33 -06:00
Jaret Burkett
c6ecc03ccd
Fixed saving full model of z_image l2p for finetuning
2026-05-23 07:36:24 -06:00
Jaret Burkett
6102370df9
Add support for ZImage L2P
2026-05-22 14:58:28 -06:00
Jaret Burkett
6fc08a8928
Fix issue with saving images from new sample viewer
2026-05-22 11:58:32 -06:00
Jaret Burkett
5579837c3f
Add hidream o1 to the readme
2026-05-21 07:56:54 -06:00
Jaret Burkett
aecd554128
Add sapiens2 matting as a mask generator. Begin transition to model paths and model folders.
2026-05-20 08:56:16 -06:00
Jaret Burkett
15d4fb89ff
Fixed overflow issue on modal
2026-05-19 10:12:43 -06:00
Jaret Burkett
df851b3497
Made the UI mobile friendly, finally...
2026-05-19 09:27:36 -06:00
Jaret Burkett
6ecaf679dc
Add ability to run small scripts from the ui and added a merge lora script
2026-05-18 14:33:47 -06:00
Jaret Burkett
ec58dcde92
Add better gradient checkpointing to dfes
2026-05-18 09:25:23 -06:00
Jaret Burkett
b42acb988f
Remove future steps from loss log if resuming from an earlier step
2026-05-18 09:23:55 -06:00
Jaret Burkett
e03c6e4dc9
Fix potential inconsistency with different attention mentods in hidream01
2026-05-13 09:08:11 -06:00
Jaret Burkett
4bfe944792
Scale dfe 7 with velocity_equiv_weight
2026-05-13 09:06:59 -06:00
Jaret Burkett (Ostris)
fc4d6ebf39
Add support for fine-tuning Hidream O1 ( #831 )
...
* Initial support for hidream. Lora keys likely need work
* Fix saving for hidream-o1
* Remove dependence on flash attention for hidream o1
* Fix gradient checkpointing for hidream o1
* A lot of fixes for hidream. Handle loading and saving as comfy model.
* Omit layers not used in comfy. Fix issue with lora loading keys in comfy
* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett
f38de2a2fe
Add tipsv2 locally and fix gradient checkpointing for it
2026-05-10 14:47:44 -06:00
Jaret Burkett
d144cb5ea6
Switch to uplot for loss graph and rework performance of graph. It is significantly more perfromant now.
2026-05-07 07:38:00 -06:00
Jaret Burkett
a12ddd72a1
Change the velocity weight cap on dfe 9
2026-05-07 07:37:05 -06:00
Jaret Burkett
6bb8acbffc
Add agreement_threshold default of 0.6 to automagic 2
2026-05-05 19:13:00 -06:00
Jaret Burkett
963a9f42b2
Add decode latent to wan 2.1 models. Add gradinet checkpointing to wan vae.
2026-05-05 11:30:16 -06:00
Jaret Burkett
4260a3c5b6
Add optimizer test suite and make minor speed adjustments to Automagicv2
2026-05-05 10:02:30 -06:00
Jaret Burkett
aeca7fe404
Add Automagic v2 optimizer. It uses significantly less vram and is much more efficient.
2026-05-05 09:09:07 -06:00
Jaret Burkett
0d91fcee9e
Allow edit of captioning job
2026-04-30 16:00:16 -06:00
Jaret Burkett
eadc9a58af
Version bump
2026-04-30 06:00:58 -06:00
Jaret Burkett
e9ab387dfd
Fixed issue with qwen image edit models when using multiple control images when not caching text embeddings.
2026-04-30 11:59:12 +00:00
Jaret Burkett
deb409085a
Made it possible to use the flux 2 small decoder VAE when setting the vae_path manually for flux2 models
2026-04-30 05:42:31 -06:00
Jaret Burkett
7ccec8ec2c
Add checkpointing and a proper decode for flux 2 VAEs so they can be used with DFE
2026-04-30 04:27:13 -06:00
Jaret Burkett
b4f0efb025
Version Bump
2026-04-28 13:42:00 -06:00
Jaret Burkett
af6458d1b5
Enable caching of ACE step latents.
2026-04-28 13:39:20 -06:00
Jaret Burkett
77b8765939
Fix issue with hover styling on select components.
2026-04-28 10:55:20 -06:00
Jaret Burkett
43989cc19e
Add advanced config section to the captioner
2026-04-28 10:49:46 -06:00
Jaret Burkett
f972b750e6
Performance improvements to captioner. Add ability to set a default caption for ace captioner to avoid needing to caption the audio so we only transcribe
2026-04-28 10:15:11 -06:00
Jaret Burkett
acc6a36214
Scale DFE 9 to a velocity equiv weight to match flow matching gradient strength. Probably need to rework all DFEs to do this as the math checks out.
2026-04-28 09:10:02 -06:00
Jaret Burkett
1fc4ad3979
Add sapiens2 as a diffusion feature extractor
2026-04-27 15:59:03 -06:00
Jaret Burkett
67d67f8c1d
Ignore hidden files when captioning
2026-04-25 17:38:31 -06:00
Jaret Burkett
998a02f30e
Yet another pseudo_huber fix. Still drinking coffee.
2026-04-19 10:05:40 -06:00
Jaret Burkett
fc85410c9a
Fix issue with precision on pseudo_huber loss
2026-04-19 10:02:27 -06:00
Jaret Burkett
20a99258b8
Fix issue is is else on pseudo_huber loss
2026-04-19 09:59:18 -06:00
Jaret Burkett
f4445cd78c
Added psuedo_huber loss
2026-04-19 09:51:46 -06:00
Jaret Burkett
488878f354
Use hidden layers in the loss for DFE 7 and 8
2026-04-18 13:07:38 -06:00
Jaret Burkett
beb40ae29b
Add DFE8 with partial step
2026-04-17 17:40:16 -06:00
Jaret Burkett
7c4f18ce51
Fix ernie unpatchify
2026-04-17 12:03:39 -06:00
Jaret Burkett
8cb9649382
Add decode latent to ernie pipe
2026-04-17 12:01:09 -06:00
Jaret Burkett
67048df9f9
Merge branch 'main' of github.com:ostris/ai-toolkit
2026-04-17 06:05:40 -06:00
Jaret Burkett
be54094704
Version bump
2026-04-17 06:05:26 -06:00
Jaret Burkett
a513a1583e
Fixed issue where Qwen VL MOE captioner produced nonsense
2026-04-16 21:24:43 +00:00
Jaret Burkett
22ea3dd620
Fixed issue on some systems where Logger didnt have atty
2026-04-16 21:09:52 +00:00
Jaret Burkett
ab1ee4df34
Hotfix some issues with Wan models caused by diffusers and transformers updates
2026-04-16 20:53:50 +00:00
Jaret Burkett
0c18b39346
Version bump
2026-04-16 13:09:45 -06:00
Jaret Burkett
afb62b1fa5
Add support for Nucleus-Image
2026-04-16 13:09:10 -06:00
Jaret Burkett
2faba22b46
Fix issue when saving advanced prompt embeds. No such file or directory error
2026-04-16 12:22:56 -06:00
Jaret Burkett
0792352dab
version bump
2026-04-16 09:25:14 -06:00
Jaret Burkett
8f67f5022e
Version lock peft version
2026-04-15 14:17:26 -06:00
Jaret Burkett
acc3e60140
Add ernie to readme
2026-04-15 06:43:36 -06:00
Jaret Burkett
dd7074a21f
Fix issue with layer offloading on ernie
2026-04-14 19:19:02 -06:00
Jaret Burkett
e74bc9ac7b
Fix issue with concatinating advanced prompt embeds.
2026-04-14 16:04:34 -06:00
Jaret Burkett
7eb1226a6d
Fix issue with loading advanced prompt configs metadata
2026-04-14 15:42:09 -06:00
Jaret Burkett
97d8c05d75
Fix issue with captioner sometimes outputting not utf-8 characters
2026-04-14 14:37:21 -06:00
Jaret Burkett (Ostris)
3e0c904054
Add support for Baidu's ERNIE-Image ( #793 )
...
* Add support for ERNIE Image
* change float64 to float32
* Version bump
* Update ERNIE defaults
2026-04-14 09:45:12 -06:00
Jaret Burkett
233e292256
Added some experimental low step things for zeta
2026-04-13 09:37:34 -06:00
Jaret Burkett
1058ef3513
Made AdvancedPromptEmbeds that is compatable with previous PromptEmbeds functionality, but is more streamlined and can accomidate more model embedding paradigms.
2026-04-11 10:45:47 -06:00
Jaret Burkett
0d11be41fa
Adjust default sample steps.
2026-04-10 17:46:34 -06:00
Jaret Burkett
62e18427b4
Adjust default sample steps.
2026-04-10 17:46:09 -06:00
Jaret Burkett
9b4e2d1b0b
More flac support
2026-04-10 12:27:09 -06:00
Jaret Burkett
0b9c365acb
Add flac and ogg support
2026-04-10 12:10:54 -06:00
Jaret Burkett
bfb373c8fa
Prep for future breaking changes in newer versions of transformers library
2026-04-10 12:04:32 -06:00
Jaret Burkett
145144eee3
Fix issue with auto updating captions when captioning a dataset
2026-04-10 11:51:18 -06:00
Jaret Burkett
765a9d5b2e
Add a download button to music samples in in the gear menu
2026-04-10 10:07:45 -06:00
Jaret Burkett
d08ea8318f
Change default timestep type for ace step to linear
2026-04-09 17:39:00 -06:00
Jaret Burkett
78cf049c29
Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. ( #785 )
...
* Base ace step 1.5 xl added. Generating, still wip on training and ui
* Base training code done
* Fix some issues with caching text embeddings. Update sample cards to show audio
* Fix issue with quantizing ace step
* Add album artwork to samples with waveform.
* Cleanup logs
* Add album art endpoint to speed up album art loading
* Made an make video with artwork script
* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.
* Add prompt tagging system for special tagged models.
* prompt tagging processing for ui working.
* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model
* Add a captioner job with music captioner that is prepped for use with the ui
* Add basit ui setup for captioning modal and handeling captioning jobs
* Starting captioning job from ui working. Still better management for it.
* Better filtering of job options in the job view for captioning jobs
* Added qwen3 vl as a captioner for images
* Have an indicator when a dataset is being captioned.
* Adjust the way caption jobs look in the queue
* Fix a few issues. Adjust defaults.
* Version bump
* Added ace step to the readme.
2026-04-09 15:02:03 -06:00
Jaret Burkett
9ca58e9aa2
Fixed offload and quantize order of ltx 2.3 text encoder.
2026-04-07 15:11:50 -06:00
Jaret Burkett
0dcbabf6af
Fix merge nertwork ref
2026-04-01 10:38:31 -06:00
Jaret Burkett
da2a79590f
Add a merge network on save strength
2026-04-01 09:21:08 -06:00
Jaret Burkett