 Jaret Burkett
|
3413fa537f
|
Wan22 14b training is working, still need tons of testing and some bug fixes
|
2025-08-14 13:03:27 -06:00 |
|
|
Jaret Burkett
|
be71cc75ce
|
Switch to unified text encoder for wan models. Pred for 2.2 14b
|
2025-08-14 10:07:18 -06:00 |
|
|
Jaret Burkett
|
e12bb21780
|
Quantize blocks sequentialls without a ARA
|
2025-08-14 09:59:58 -06:00 |
|
|
Jaret Burkett
|
3ff4430e84
|
Fix issue with fake text encoder unload
|
2025-08-14 09:33:44 -06:00 |
|
|
Jaret Burkett
|
5501521c9f
|
Link to easy install script
|
2025-08-13 12:26:10 -06:00 |
|
|
Jaret Burkett
|
85bad57df3
|
Fix bug that would use EMA when set false
|
2025-08-13 11:39:40 -06:00 |
|
|
Jaret Burkett
|
259d68d440
|
Added a flushg during sampling to prevent spikes on low vram qwen
|
2025-08-12 12:57:18 -06:00 |
|
|
Jaret Burkett
|
69ee99b6e1
|
Fix issue with base model version
|
2025-08-12 09:26:48 -06:00 |
|
|
Jaret Burkett
|
77b10d884d
|
Add support for training with an accuracy recovery adapter with qwen image
|
2025-08-12 08:21:36 -06:00 |
|
|
Jaret Burkett
|
4ad18f3d00
|
Clip max token embeddings to the max rope length for qwen image to solve for an error for super long captions > 1024
|
2025-08-10 08:44:41 -06:00 |
|
|
Jaret Burkett
|
f0105c33a7
|
Fixed issue that sometimes happens in qwen image where text seq length is wrong
|
2025-08-09 16:33:05 -06:00 |
|
|
Jaret Burkett
|
ccd449ec49
|
Update supporters
|
2025-08-08 11:04:45 -06:00 |
|
|
Jaret Burkett
|
bb6db3d635
|
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
|
2025-08-07 10:27:55 -06:00 |
|
|
Jaret Burkett
|
4c4a10d439
|
Remove vision model from qwen text encoder as it is not needed for image generation currently
|
2025-08-06 11:40:02 -06:00 |
|
|
Jaret Burkett
|
14ccf2f3ce
|
Refactor qwen5b model code to be qwen 5b specific
|
2025-08-06 10:54:56 -06:00 |
|
|
Jaret Burkett
|
5d8922fca2
|
Add ability to designate a dataset as i2v or t2v for models that support it
|
2025-08-06 09:29:47 -06:00 |
|
|
Jaret Burkett
|
1755e58dd9
|
Update generation script to handle latest models.
|
2025-08-05 08:55:16 -06:00 |
|
|
Jaret Burkett
|
6bb3aed9a2
|
Merge pull request #359 from ostris/qwen_image
Add support for Qwen Image
|
2025-08-04 15:51:01 -06:00 |
|
|
Jaret Burkett
|
74b4d2d291
|
Version bump
|
2025-08-04 15:49:32 -06:00 |
|
|
Jaret Burkett
|
23327d5659
|
Add qwen image to the ui
|
2025-08-04 15:48:51 -06:00 |
|
|
Jaret Burkett
|
93202c7a2b
|
Training working for Qwen Image
|
2025-08-04 21:14:30 +00:00 |
|
|
Jaret Burkett
|
9da8b5408e
|
Initial but untested support for qwen_image
|
2025-08-04 13:29:37 -06:00 |
|
|
Jaret Burkett
|
9dfb614755
|
Initial work for training wan first and last frame
|
2025-08-04 11:37:26 -06:00 |
|
|
Jaret Burkett
|
ef1d60ba34
|
Update wan 2.2 5b timestep distribution to weighted.
|
2025-07-30 10:13:22 -06:00 |
|
|
Jaret Burkett
|
75f688766d
|
Version bump
|
2025-07-29 09:30:54 -06:00 |
|
|
Jaret Burkett
|
a558d5b68f
|
Move transformer back to device on aggresive wan 2.2 pipeline after generation.
|
2025-07-29 09:13:47 -06:00 |
|
|
Jaret Burkett
|
1d1199b15b
|
Fix bug that prevented training wan 2.2 with batch size greater than 1
|
2025-07-29 09:06:25 -06:00 |
|
|
Jaret Burkett
|
f453e28ea3
|
Fixed deprecation of lumina pipeline error
|
2025-07-29 08:26:51 -06:00 |
|
|
Jaret Burkett
|
ca7c5c950b
|
Add support for Wan2.2 5B
|
2025-07-29 05:31:54 -06:00 |
|
|
Jaret Burkett
|
e55116d8c9
|
Added hidream low vram options
|
2025-07-27 18:29:46 -06:00 |
|
|
Jaret Burkett
|
99705ec8be
|
Add support in UI for Hidream E1
|
2025-07-27 18:13:36 -06:00 |
|
|
Jaret Burkett
|
ed8d14225f
|
Add ability to set the quantization type for text encoders and transformer in the ui
|
2025-07-27 18:00:53 -06:00 |
|
|
Jaret Burkett
|
b717586ee2
|
Version bump
|
2025-07-27 15:13:28 -06:00 |
|
|
Jaret Burkett
|
cefa2ca5fe
|
Added initial support for Hidream E1 training
|
2025-07-27 15:12:56 -06:00 |
|
|
Jaret Burkett
|
3f518d9951
|
Add sharpening before losses with a split loss on vae training
|
2025-07-27 15:11:56 -06:00 |
|
|
Jaret Burkett
|
77dc38a574
|
Some work on caching text embeddings
|
2025-07-26 09:22:04 -06:00 |
|
|
Jaret Burkett
|
0d89c44624
|
Bug fixes on vae trainer. Allow to target params for vae training.
|
2025-07-26 09:20:22 -06:00 |
|
|
Jaret Burkett
|
3e14a674ac
|
Fix upload progress for datasets in the ui
|
2025-07-26 09:07:30 -06:00 |
|
|
Jaret Burkett
|
523c159579
|
Add vram flag to some models in the ui
|
2025-07-24 07:02:46 -06:00 |
|
|
Jaret Burkett
|
c5eb763342
|
Improvements to VAE trainer. Allow CLIP loss.
|
2025-07-24 06:50:56 -06:00 |
|
|
Jaret Burkett
|
ca5cf827a1
|
Version bump
|
2025-07-20 12:20:46 -06:00 |
|
|
Jaret Burkett
|
b1bff66d52
|
Merge pull request #343 from davertor/fix_kontext_bs
fix: Guidance incorrect shape
|
2025-07-20 12:00:55 -06:00 |
|
|
Jaret Burkett
|
8610c6ed7f
|
Made it easy to add control images to the samples in the UI
|
2025-07-17 12:00:48 -06:00 |
|
|
Jaret Burkett
|
e25d2feddf
|
Use scale shift in vae latent space for vae trainer
|
2025-07-17 08:14:07 -06:00 |
|
|
Jaret Burkett
|
f500b9f240
|
Add ability to do more advanced sample prompt objects to prepart for a UI rework on control images and other things.
|
2025-07-17 07:13:35 -06:00 |
|
|
Jaret Burkett
|
3916e67455
|
Scale target vae latent before targeting it
|
2025-07-17 07:12:21 -06:00 |
|
|
Jaret Burkett
|
e5ed450dc7
|
Allow finetuning tiny autoencoder in vae trainer
|
2025-07-16 07:13:30 -06:00 |
|
|
Jaret Burkett
|
1930c3edea
|
Fix naming with wan i2v new keys in lora
|
2025-07-14 07:34:01 -06:00 |
|
|
Jaret Burkett
|
ef5149180c
|
Switch i2v ui defaults to weighted
|
2025-07-12 21:30:04 -06:00 |
|
|
Jaret Burkett
|
998e8b6537
|
Bump version
|
2025-07-12 16:57:09 -06:00 |
|
|
Jaret Burkett
|
755f0e207c
|
Fix issue with wan i2v scaling. Adjust aggressive loader to be compatable with updated diffusers.
|
2025-07-12 16:56:27 -06:00 |
|
|
Jaret Burkett
|
2e84b3d5b1
|
Update VAE trainer to handle fixed latent target. Also minor bug fixes and improvements
|
2025-07-12 16:55:15 -06:00 |
|
|
Jaret Burkett
|
7ab44ae0cd
|
Fix issue with getting captions on runpod
|
2025-07-11 19:16:50 +00:00 |
|
|
Jaret Burkett
|
47002b067f
|
Add path to image for datasets on the image card
|
2025-07-11 11:44:48 -06:00 |
|
|
Jaret Burkett
|
8537a8557f
|
Add simple ui settings to train Wan i2v models.
|
2025-07-11 11:28:40 -06:00 |
|
|
Jaret Burkett
|
6e2beef8dd
|
Version Bump
|
2025-07-09 13:55:33 -06:00 |
|
|
Jaret Burkett
|
611969ec1f
|
Allow control image for omnigen training and sampling
|
2025-07-09 13:54:55 -06:00 |
|
|
Jaret Burkett
|
bbb57de6ec
|
Speed up omnigen TE loading
|
2025-07-05 09:32:00 -06:00 |
|
|
Jaret Burkett
|
5906a76666
|
Fixed issue with flux kontext forcing generation image sizes
|
2025-06-29 05:38:20 -06:00 |
|
|
Jaret Burkett
|
57a81bc0db
|
Update base model version for kontext meta
|
2025-06-28 14:48:36 -06:00 |
|
|
Jaret Burkett
|
843be31138
|
Update readme changelog
|
2025-06-28 12:55:23 -06:00 |
|
|
Jaret Burkett
|
8fb01e96e4
|
Update sponsors
|
2025-06-28 10:05:17 -06:00 |
|
|
Jaret Burkett
|
01a3c8a9b1
|
Fix device issue
|
2025-06-26 19:14:25 -06:00 |
|
|
Jaret Burkett
|
4f91cb7148
|
Fix issue with gradient checkpointing and flux kontext
|
2025-06-26 19:03:12 -06:00 |
|
|
Jaret Burkett
|
446b0b6989
|
Remove revision for kontext
|
2025-06-26 16:46:58 -06:00 |
|
|
Jaret Burkett
|
60ef2f1df7
|
Added support for FLUX.1-Kontext-dev
|
2025-06-26 15:24:37 -06:00 |
|
|
Jaret Burkett
|
8d9c47316a
|
Work on mean flow. Minor bug fixes. Omnigen improvements
|
2025-06-26 13:46:20 -06:00 |
|
|
Jaret Burkett
|
84c6edca7e
|
Merge branch 'main' into dev
|
2025-06-25 14:10:25 -06:00 |
|
|
Jaret Burkett
|
24cd94929e
|
Fix bug that can happen with fast processing dataset
|
2025-06-25 14:01:08 -06:00 |
|
|
Jaret Burkett
|
19ea8ecc38
|
Added support for finetuning OmniGen2.
|
2025-06-25 13:58:16 -06:00 |
|
|
Jaret Burkett
|
18513ec866
|
Merged in from main
|
2025-06-24 10:56:54 -06:00 |
|
|
Jaret Burkett
|
5e733764aa
|
Update version
|
2025-06-24 10:37:13 -06:00 |
|
|
Jaret Burkett
|
03bc431279
|
Fixed an issue training lumina 2
|
2025-06-24 10:29:47 -06:00 |
|
|
Jaret Burkett
|
f3eb1dff42
|
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
|
2025-06-24 08:51:29 -06:00 |
|
|
Jaret Burkett
|
ba1274d99e
|
Added a guidance burning loss. Modified DFE to work with new model. Bug fixes
|
2025-06-23 08:38:27 -06:00 |
|
|
Jaret Burkett
|
8602470952
|
Updated diffusion feature extractor
|
2025-06-19 15:36:10 -06:00 |
|
|
Jaret Burkett
|
4586eb5392
|
Added social links to sidebar
|
2025-06-17 13:25:24 -06:00 |
|
|
Jaret Burkett
|
989ebfaa11
|
Added a basic torch profiler that can be used in config during development to find some obvious issues.
|
2025-06-17 13:03:39 -06:00 |
|
|
Jaret Burkett
|
ff617fdaea
|
Started doing info bubble docs on the simple ui
|
2025-06-17 11:00:24 -06:00 |
|
|
Jaret Burkett
|
595a6f1735
|
Initial setup for a cron working on the ui for various tasks
|
2025-06-17 07:43:34 -06:00 |
|
|
Jaret Burkett
|
1cc663a664
|
Performance optimizations for pre processing the batch
|
2025-06-17 07:37:41 -06:00 |
|
|
Jaret Burkett
|
11f2eee53a
|
Hide control images from ui image viewer
|
2025-06-16 07:18:43 -06:00 |
|
|
Jaret Burkett
|
1c2b7298dd
|
More work on mean flow loss. Moved it to an adapter. Still not functioning properly though.
|
2025-06-16 07:17:35 -06:00 |
|
|
Jaret Burkett
|
c0314ba325
|
Fixed some issues with training mean flow algo. Still testing WIP
|
2025-06-16 07:14:59 -06:00 |
|
|
Jaret Burkett
|
cbf04b8d53
|
Fixed some issues with training mean flow algo. Still testing WIP
|
2025-06-14 12:24:00 -06:00 |
|
|
Jaret Burkett
|
0946a66576
|
Merge branch 'main' into dev
|
2025-06-12 08:11:19 -06:00 |
|
|
Jaret Burkett
|
3f0ae99d48
|
Version bump
|
2025-06-12 08:01:26 -06:00 |
|
|
Jaret Burkett
|
fc83eb7691
|
WIP on mean flow loss. Still a WIP.
|
2025-06-12 08:00:51 -06:00 |
|
|
Jaret Burkett
|
cf11f128b9
|
Merge pull request #304 from hameerabbasi/fix-caption-loads
Fix caption loading
|
2025-06-12 07:44:12 -06:00 |
|
|
Jaret Burkett
|
ba5196dd4a
|
Merge branch 'main' into dev
|
2025-06-10 10:26:11 -06:00 |
|
|
Jaret Burkett
|
ffb5fe0667
|
Version bump
|
2025-06-10 10:04:32 -06:00 |
|
|
Jaret Burkett
|
f8fb3b9c45
|
Added support for sdxl and sd1.5 to the ui.
|
2025-06-10 10:03:54 -06:00 |
|
|
Jaret Burkett
|
d5c547da43
|
Fixed DOP typo
|
2025-06-10 08:44:47 -06:00 |
|
|
Jaret Burkett
|
f19f7f9486
|
Fixed issue with wan2.1 training in ui. Name had a typo
|
2025-06-10 08:42:18 -06:00 |
|
|
Jaret Burkett
|
7317ed58af
|
Adjust the ui of the sidebar
|
2025-06-10 08:40:51 -06:00 |
|
|
Jaret Burkett
|
517bc294fa
|
Update support link
|
2025-06-10 08:28:30 -06:00 |
|
|
Jaret Burkett
|
97e101522c
|
Increase ema feedback amount. Normalize the dfe 4 image embeds
|
2025-06-10 08:01:13 -06:00 |
|
|
Jaret Burkett
|
eefa93f16e
|
Various code to support experiments.
|
2025-06-09 11:19:21 -06:00 |
|
|
Jaret Burkett
|
22cdfadab6
|
Added new timestep weighing strategy
|
2025-06-04 01:16:02 -06:00 |
|
|
Jaret Burkett
|
adc31ec77d
|
Small updates and bug fixes for various things
|
2025-06-03 20:08:35 -06:00 |
|