 Jaret Burkett
|
97bf49edad
|
Add support for video references in MiniMax H3 ref2va
|
2026-08-15 06:18:09 -06:00 |
|
|
Jaret Burkett
|
4900e5e866
|
Version bump
|
2026-08-14 19:54:51 -06:00 |
|
|
Jaret Burkett
|
5f53ecde54
|
Make the viewer thumbnails pul the thumbs
|
2026-08-14 18:14:12 -06:00 |
|
|
Jaret Burkett
|
247cb45c3e
|
Improve gpu cpu monitor efficiency.
|
2026-08-14 17:14:00 -06:00 |
|
|
Jaret Burkett
|
695b0baccf
|
Switch to a live always active gpu and cpu device monitor that can be connected to with an SSE connection for real time device information stream. Much more efficient and faster than previous method of polling.
|
2026-08-14 12:40:01 -06:00 |
|
|
Jaret Burkett
|
5261d3fcca
|
Add checkpointing to the Wan2.1 encoder
|
2026-08-14 07:31:16 -06:00 |
|
|
Jaret Burkett
|
0e4b6e8695
|
Version bump
|
2026-08-13 12:36:34 -06:00 |
|
|
Jaret Burkett
|
6ea281973d
|
Add support for MiniMax H3 Ref2Vid training
|
2026-08-13 12:36:03 -06:00 |
|
|
Jaret Burkett
|
ab18528fdb
|
Let omni captioner handle just images as well. Set it as the new default captioner.
|
2026-08-13 10:30:17 -06:00 |
|
|
Jaret Burkett
|
6b7fb60a22
|
Make contrastive guidance loss do constant instead of sigma loss schedule by default
|
2026-08-13 09:52:02 -06:00 |
|
|
Jaret Burkett
|
4e91fb2d0a
|
Add thinking and abliterated versions of qwen omni.
|
2026-08-13 08:56:31 -06:00 |
|
|
Jaret Burkett
|
6c88e3d138
|
Add layer offloading to omni captioner
|
2026-08-13 07:21:54 -06:00 |
|
|
Jaret Burkett
|
a69f3e8710
|
Version bump
|
2026-08-12 21:38:00 -06:00 |
|
|
Jaret Burkett
|
742a4c8cef
|
Added a Download Full Dataset and Download Captions option to the datasets page so they captions or dataset can be easily downloaded.
|
2026-08-12 21:37:35 -06:00 |
|
|
Jaret Burkett
|
81adcc2176
|
Add caption prompt template picker to the ui. A few styling improvements thrown in for a good time.
|
2026-08-12 21:23:28 -06:00 |
|
|
Jaret Burkett
|
ca42a72f4c
|
Fixed issue with flash attention on omni captioner
|
2026-08-12 21:14:23 -06:00 |
|
|
Jaret Burkett
|
7f9a142dfd
|
Generate thumbnails for dataset items so things load faster and the ui is more stable. Especially good for videos.
|
2026-08-12 20:33:42 -06:00 |
|
|
Jaret Burkett
|
175cc1e151
|
Add Qwen 3 Omni for captioning videos with sound.
|
2026-08-12 19:57:01 -06:00 |
|
|
Jaret Burkett
|
4b00b61257
|
When doing an audio loss, show the img and audio loss in the loss log
|
2026-08-12 18:58:54 -06:00 |
|
|
Jaret Burkett
|
e16e04f123
|
On the ui, keep the last caption job bar visible at the bottom of a dataset so it can be viewed and edited
|
2026-08-12 17:32:48 -06:00 |
|
|
Jaret Burkett
|
18645d93b7
|
Fix trailing slashes in path for settings
|
2026-08-12 17:04:22 -06:00 |
|
|
Jaret Burkett
|
a1ddeeef13
|
Fixed issue with offloading text encoder on ltx 2.5
|
2026-08-12 10:46:58 -06:00 |
|
|
Jaret Burkett
|
0fd3e61c4c
|
Expand loras to match if they are not the same size in lora merger
|
2026-08-12 10:04:44 -06:00 |
|
|
Jaret Burkett
|
0bacc88e47
|
Version Bump
|
2026-08-12 07:55:21 -06:00 |
|
|
Jaret Burkett
|
7eb65b837a
|
Switch MiniMax H3 to default to contrastive guidance loss. Add a custom model select toggle to automatically fill out settings for the model.
|
2026-08-12 07:54:57 -06:00 |
|
|
Jaret Burkett
|
cbf910ac02
|
Add support for LTX 2.5
|
2026-08-12 05:50:30 -06:00 |
|
|
Jaret Burkett
|
924c426675
|
Resolve the new ltx 2.5 path subfolder for ltx 2.5. Sill checking compatability.
|
2026-08-11 13:30:17 -06:00 |
|
|
Jaret Burkett
|
62017a915a
|
Version bump
|
2026-08-11 08:30:09 -06:00 |
|
|
Jaret Burkett
|
21dc65972d
|
Only add a blank control if the model has to have it, for unconditionals. Previously it always encoded a blank control on unconditional if the model could take one. Affects DOP and blank prompt preservations.
|
2026-08-11 08:25:23 -06:00 |
|
|
Jaret Burkett
|
f421542df4
|
When dropping out, caching, and doing DOP, make sure we select a cahced trigger word when dropped out so DOP matches the drop out embeddings.
|
2026-08-11 06:59:20 -06:00 |
|
|
Jaret Burkett
|
8d4beedd04
|
Move guidance loss target selection when given a range before preservation so it is avaliable during preservation.
|
2026-08-11 06:57:33 -06:00 |
|
|
Jaret Burkett
|
ab5fef8970
|
Fix caption dropout so it now works identically when caching text embeddings.
|
2026-08-10 18:53:33 -06:00 |
|
|
Jaret Burkett
|
356ce7e84e
|
Version bump
|
2026-08-10 09:21:27 -06:00 |
|
|
Jaret Burkett
|
257da9b586
|
Rework DOP so it works with caching text embeddings
|
2026-08-09 22:13:49 -06:00 |
|
|
Jaret Burkett
|
5ff8a0435a
|
Make v1 the default training adapter
|
2026-08-09 14:56:39 -06:00 |
|
|
Jaret Burkett
|
61da9c95d3
|
Version bump
|
2026-08-09 12:39:30 -06:00 |
|
|
Jaret Burkett
|
72623ed3d6
|
When doing auto frame count. Ensure the time is not squeezed or expanded to fit tempooral spacing. trime the few extra frames. Also fixed frame counts of buckets.
|
2026-08-09 12:31:02 -06:00 |
|
|
Jaret Burkett
|
682b27c6ee
|
Reworked freeing memory manager for removing text encoder completly when not needed.
|
2026-08-09 07:08:24 -06:00 |
|
|
Jaret Burkett
|
3a28c4b1b7
|
Keep alive cron server to prevent failed connections
|
2026-08-08 20:27:01 -06:00 |
|
|
Jaret Burkett
|
8c1a4082fd
|
Allow images to work with auto frame count, and include images in video datasets if they exist.
|
2026-08-08 20:26:28 -06:00 |
|
|
Jaret Burkett
|
6d8afa5684
|
Version bump
|
2026-08-08 18:58:11 -06:00 |
|
|
Jaret Burkett (Ostris)
|
c596d4ab27
|
Merge pull request #1002 from whatsthisaithing/codex/fix-convrot-offload-stream-lifetime
Fix offload buffer stream lifetime
|
2026-08-08 18:55:18 -06:00 |
|
|
Jaret Burkett
|
f4e9130547
|
Fix race condition that can corrupt grads under certain conditions.
|
2026-08-07 14:52:47 -06:00 |
|
|
Jaret Burkett
|
817f3dcbcb
|
Fix finite check on inverted masked prior
|
2026-08-07 09:49:12 -06:00 |
|
|
Jaret Burkett
|
685ce37a8d
|
Adjust sample timestep sigmas to be model evals for h3 for 1 extra step
|
2026-08-06 19:54:04 -06:00 |
|
|
Jaret Burkett
|
9171d5ec1d
|
Update training adapter path
|
2026-08-06 11:21:28 -06:00 |
|
|
Jaret Burkett
|
71625d1207
|
Add the alpha version of the MiniMax H3 trianing adapter and set it as the new default training method.
|
2026-08-06 11:11:31 -06:00 |
|
|
Jaret Burkett
|
b904b99705
|
varsion bump
|
2026-08-06 09:25:35 -06:00 |
|
|
Jaret Burkett
|
b811636ae4
|
Check for finite vs isnan on loss before backpropigating. to catch infinity overflows
|
2026-08-06 09:18:56 -06:00 |
|
|
Jaret Burkett
|
edacd406b3
|
Handle minimax loading of non pruned model
|
2026-08-06 09:18:00 -06:00 |
|
|
Jaret Burkett
|
7309db4d74
|
Fix layer offloaded adaln projection layer move
|
2026-08-06 08:10:20 -06:00 |
|
|
Jaret Burkett
|
139a38f5bd
|
Upcast adaln pruned layers to fp32 on h3 to prevent overflow.
|
2026-08-06 07:51:15 -06:00 |
|
|
Jaret Burkett
|
1e1418b22c
|
Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3
|
2026-08-05 13:27:12 -06:00 |
|
|
Jaret Burkett
|
9065951da3
|
Version bump
|
2026-08-04 22:14:54 -06:00 |
|
|
Jaret Burkett
|
3afa270ab5
|
Fix audio losses for DOP and other preservation losses
|
2026-08-04 22:08:48 -06:00 |
|
|
Jaret Burkett
|
0f9094db95
|
Fix audio loss when doing do_guidance_loss
|
2026-08-04 21:43:31 -06:00 |
|
|
Jaret Burkett
|
d870e9b68a
|
Fix backwards compatability for older versions of triton
|
2026-08-04 21:07:57 -06:00 |
|
|
Jaret Burkett
|
a8d67ecd90
|
Version Bump
|
2026-08-04 16:28:04 -06:00 |
|
|
Jaret Burkett
|
9fc1f208df
|
Remove adaln_proj from the network modules for minimax_h3
|
2026-08-04 16:19:46 -06:00 |
|
|
Jaret Burkett
|
183433ae8e
|
Make MiniMax H3 default to using contrastive guidance loss to prevent distillation breakdown
|
2026-08-04 16:13:45 -06:00 |
|
|
Jaret Burkett
|
00a93e3830
|
Add dataset flag to cache the raw tensors
|
2026-08-04 15:32:48 -06:00 |
|
|
Jaret Burkett
|
8a0bcf1ffe
|
Fix issue loading H3 test encoder on older GPUS
|
2026-08-04 15:30:29 -06:00 |
|
|
Jaret Burkett
|
dc29ae1187
|
Version Bump
|
2026-08-04 09:27:46 -06:00 |
|
|
Jaret Burkett
|
d20a17c10e
|
Limit max tokens to 512. Allow override with model kwargs.
|
2026-08-04 07:55:21 -06:00 |
|
|
Jaret Burkett
|
602306da77
|
Add gradient checkpointing to vae
|
2026-08-04 07:54:51 -06:00 |
|
|
Jaret Burkett
|
18f5810d6c
|
Adjust default alpha for h3
|
2026-08-03 20:15:28 -06:00 |
|
|
Jaret Burkett
|
a9a04547e9
|
Dont move encoders on and off device when caching until the first instance of needing to process a cache item.
|
2026-08-03 15:54:30 -06:00 |
|
|
Jaret Burkett
|
41676bb258
|
Queue up videos with multiple threads when caching latents so the VAE is not waiting on videos to process
|
2026-08-03 15:41:36 -06:00 |
|
|
Jaret Burkett
|
546eb7daff
|
Look for existing models in folders recursivly
|
2026-08-03 15:39:55 -06:00 |
|
|
Jaret Burkett
|
d3a3f70a2a
|
Speed up quantization processing on H3
|
2026-08-03 15:21:39 -06:00 |
|
|
Jaret Burkett
|
88ac27fc8f
|
Handle images with MiniMax H3.
|
2026-08-03 11:58:44 -06:00 |
|
|
Jaret Burkett
|
bf739ff966
|
Fix issue with layer offloading with MinMax H3
|
2026-08-03 11:32:36 -06:00 |
|
|
Jaret Burkett
|
9d614a51fb
|
Hard fail if a step in the docker build fails.
|
2026-08-03 10:38:31 -06:00 |
|
|
Jaret Burkett
|
8502a845b1
|
Add support for MiniMax H3 T2V and I2V training
|
2026-08-03 10:17:39 -06:00 |
|
|
Jaret Burkett
|
73cab2acf5
|
Reworked merge in out of loras with convrot weights for better roundtrip accuracy.
|
2026-08-02 08:29:17 -06:00 |
|
|
Jaret Burkett
|
a6f6b6b896
|
Fixed experiment opt name match
|
2026-08-01 17:43:36 -06:00 |
|
|
Jaret Burkett
|
6b95282097
|
Recover from issue when a video model first fram may not have been cached properly
|
2026-08-01 12:00:33 -06:00 |
|
|
Jaret Burkett
|
5baa495585
|
DFE optimizations
|
2026-08-01 10:06:16 -06:00 |
|
|
Jaret Burkett
|
fc78b07332
|
Attach the ema to the base model so it can be used on specific models
|
2026-08-01 10:05:42 -06:00 |
|
|
Jaret Burkett
|
c68e58083f
|
Add code for automagic experiment
|
2026-08-01 10:04:46 -06:00 |
|
|
Jaret Burkett
|
497014bf5d
|
Set i2v to default to false when omitted from the config
|
2026-07-31 19:11:58 -06:00 |
|
|
Jaret Burkett
|
038f24e8c3
|
Revert torchao back to older version
|
2026-07-31 16:34:06 -06:00 |
|
|
Jaret Burkett
|
6e7bc81241
|
Allow random noise shift with video latents.
|
2026-07-31 05:58:08 -06:00 |
|
|
Jaret Burkett
|
ddc69745fe
|
Update docker build image with newer dependencies
|
2026-07-30 14:20:31 -06:00 |
|
|
Jaret Burkett (Ostris)
|
2cab330392
|
Merge pull request #986 from ostris/dev
Add AI Toolkit Manager script that auto installs/runs/and updates AI Toolkit.
|
2026-07-30 11:55:13 -06:00 |
|
|
Jaret Burkett
|
c8636478f9
|
Version Bump
|
2026-07-30 11:48:01 -06:00 |
|
|
Jaret Burkett
|
7b2386c096
|
Handle video codecs that fail in opencv
|
2026-07-29 21:01:57 -06:00 |
|
|
Jaret Burkett
|
9021caa723
|
Merge branch 'dev' of github.com:ostris/ai-toolkit into dev
|
2026-07-29 17:50:50 -06:00 |
|
|
Jaret Burkett
|
3f8afcac7e
|
Allow dataloader to encode first frame with the text embeddings if the model needs it.
|
2026-07-29 17:50:45 -06:00 |
|
|
Jaret Burkett
|
23f1ebfb76
|
Update to high speed xet env var
|
2026-07-29 17:47:53 -06:00 |
|
|
Jaret Burkett
|
3d472de2f1
|
Reworked spawning on dataloader so windows and mac can use multiple data loader workers now
|
2026-07-29 17:47:04 -06:00 |
|
|
Jaret Burkett
|
65443cfffa
|
Add information about the new manager to the README
|
2026-07-29 10:29:36 -06:00 |
|
|
Jaret Burkett
|
3bd2119c04
|
Add flash-linear-attention package for hardware that supports it.
|
2026-07-29 09:14:37 -06:00 |
|
|
Jaret Burkett
|
1e22732db7
|
Merge branch 'dev' of https://github.com/ostris/ai-toolkit into dev
|
2026-07-28 12:27:55 -06:00 |
|
|
Jaret Burkett
|
aa762103b3
|
Add build support for Nvidia Spark
|
2026-07-28 12:27:51 -06:00 |
|
|
Jaret Burkett
|
c3afd95cc4
|
Improvements for mps convrot quants
|
2026-07-28 12:11:19 -06:00 |
|
|
Jaret Burkett
|
038270eb2f
|
Fix issue with macstats on mac
|
2026-07-28 08:27:31 -06:00 |
|
|
Jaret Burkett
|
83879ac7c2
|
Fix issue with user agent downloading ffmpeg
|
2026-07-28 08:15:28 -06:00 |
|
|
Jaret Burkett
|
6d6c5a3d91
|
Prevent overwriting package-lock.json when installing deps
|
2026-07-27 18:47:28 -06:00 |
|
|
Jaret Burkett
|
461e798708
|
Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint.
|
2026-07-27 17:43:01 -06:00 |
|