 Jaret Burkett
|
4e5707854f
|
Initial support for RamTorch. Still a WIP
|
2025-10-05 13:03:26 -06:00 |
|
|
Jaret Burkett
|
c6edd71a5b
|
Version bump
|
2025-10-01 14:13:38 -06:00 |
|
|
Jaret Burkett
|
b7c04efb44
|
A commit with the adits properly named improvements to qwen image edit plus workflow. Fixed a bug. Dont norm the cfg
|
2025-10-01 14:13:15 -06:00 |
|
|
Jaret Burkett
|
3086a58e5b
|
git status
|
2025-10-01 14:12:17 -06:00 |
|
|
Jaret Burkett
|
b07b88c46b
|
Allow trigger when caching text embeddings since it is now passed to dataset
|
2025-09-30 16:58:35 -06:00 |
|
|
Jaret Burkett
|
2ba4000704
|
Allow masked losses with video models
|
2025-09-30 14:57:07 -06:00 |
|
|
Jaret Burkett
|
67ed563e03
|
fix issue with multi batch size on qwen-image-edit-plus
|
2025-09-30 09:04:56 -06:00 |
|
|
Jaret Burkett
|
2e9de5eb50
|
Add ability to delete samples from the ui
|
2025-09-29 04:49:32 -06:00 |
|
|
Jaret Burkett
|
ebadb321e3
|
On samples page, auto scroll to bottom on load. Added a floating button to scroll to bottom.
|
2025-09-29 03:56:17 -06:00 |
|
|
Jaret Burkett
|
c233a80337
|
Reqorked visibility toggle on samples, should help when dealing with more samples
|
2025-09-28 14:13:10 -06:00 |
|
|
Jaret Burkett
|
c20240be82
|
Add advanced menu on job to allow user to do things like make a job as stopped if the status ever gets hung
|
2025-09-28 13:43:00 -06:00 |
|
|
Jaret Burkett
|
4e207d92cd
|
Add seed to the sample image modal
|
2025-09-28 12:54:34 -06:00 |
|
|
Jaret Burkett
|
f0646a0a70
|
Reworked ui sample image modal to show more information and function a lot better.
|
2025-09-27 12:50:47 -06:00 |
|
|
Jaret Burkett
|
98d35f36a9
|
Add hidream ARA
|
2025-09-27 09:31:23 -06:00 |
|
|
Jaret Burkett
|
3b1f7b0948
|
Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row.
|
2025-09-27 08:56:15 -06:00 |
|
|
Jaret Burkett
|
6da417261c
|
Add extra detachments just to be sure on qiep
|
2025-09-27 08:53:59 -06:00 |
|
|
Jaret Burkett
|
be990630b9
|
Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached.
|
2025-09-26 11:50:53 -06:00 |
|
|
Jaret Burkett
|
e04f55c553
|
Fixed scaling issue with control images
|
2025-09-26 11:49:53 -06:00 |
|
|
Jaret Burkett
|
0eaa3d2893
|
Merge pull request #434 from ostris/qwen_image_edit_plus
Add full support for Qwen-Image-Edit-2509
|
2025-09-25 11:33:18 -06:00 |
|
|
Jaret Burkett
|
1069dee0e4
|
Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui
|
2025-09-25 11:10:02 -06:00 |
|
|
Jaret Burkett
|
454be0958a
|
Initial support for qwen image edit plus
|
2025-09-24 11:39:10 -06:00 |
|
|
Jaret Burkett
|
f74475161e
|
Add stepped loss type
|
2025-09-22 15:50:12 -06:00 |
|
|
Jaret Burkett
|
28728a1e92
|
Added experimental dfe 5
|
2025-09-21 10:48:52 -06:00 |
|
|
Jaret Burkett
|
20dfe1b4d5
|
Small double tap of detach on qwen just for good measure
|
2025-09-18 08:22:04 -06:00 |
|
|
Jaret Burkett
|
390e21bec6
|
Integrate dataset level trigger words and allow them to be cached. Default to global trigger if it is set.
|
2025-09-18 03:29:18 -06:00 |
|
|
Jaret Burkett
|
3cdf50cbfc
|
Merge pull request #426 from squewel/prior_reg
Dataset-level prior regularization
|
2025-09-18 03:03:18 -06:00 |
|
|
Jaret Burkett
|
2120dc5936
|
Upgrade job to new ui trainer to fix issue with slider config showing up on old configs.
|
2025-09-17 13:41:48 -06:00 |
|
|
Jaret Burkett
|
24a576ad07
|
Regularize the slider targets.
|
2025-09-17 09:36:33 -06:00 |
|
|
Jaret Burkett
|
218f673e3d
|
Added support for new concept slider training script to CLI and UI
|
2025-09-16 10:22:34 -06:00 |
|
|
Jaret Burkett
|
3666b112a8
|
DEF for fake vae and adjust scaling
|
2025-09-12 18:09:08 -06:00 |
|
|
Jaret Burkett
|
b95c17dc17
|
Add initial support for chroma radiance
|
2025-09-10 08:41:05 -06:00 |
|
|
Jaret Burkett
|
af6fdaaaf9
|
Add ability to train a full rank LoRA. (experimental)
|
2025-09-09 07:36:25 -06:00 |
|
|
Jaret Burkett
|
645046701b
|
Comment out fast stop watcher. Could potentiallty be causing some weird issues. Need to investigate.
|
2025-09-04 08:26:57 -06:00 |
|
|
Jaret Burkett
|
f699f4be5f
|
Add ability to set transparent color for control images
|
2025-09-02 11:08:44 -06:00 |
|
|
Jaret Burkett
|
85dcae6e2b
|
Set full size control images to default true
|
2025-09-02 10:30:42 -06:00 |
|
|
Jaret Burkett
|
7040d8d73b
|
Preperation for audio
|
2025-09-02 07:26:50 -06:00 |
|
|
Jaret Burkett
|
0f2239ca23
|
Add force sample toggle to the ui
|
2025-08-31 16:58:27 -06:00 |
|
|
Jaret Burkett
|
193c1b2dfa
|
Add a watcher to constantly check for stop signal from the UI. This will force a stop within 2 seconds instead of having to wait on a long hung process.
|
2025-08-31 16:58:01 -06:00 |
|
|
Jaret Burkett
|
6fc9ec1396
|
Added example config for training wan22 14b 24GB on images
|
2025-08-28 13:08:49 -06:00 |
|
|
Jaret Burkett
|
056711d4ed
|
Fix issue with wan22 14b that woudl load both transformers temporarily resulting in oom on 24GB.
|
2025-08-28 13:06:31 -06:00 |
|
|
Jaret Burkett
|
e3349414fd
|
Updated runpod docs
|
2025-08-28 11:40:48 -06:00 |
|
|
Jaret Burkett
|
9ef425a1c5
|
Fixed issue with training qwen with cached text embeds with a batch size more than 1
|
2025-08-28 08:07:12 -06:00 |
|
|
Jaret Burkett
|
fc5b41666a
|
Switch order to save first, then sample.
|
2025-08-27 11:07:03 -06:00 |
|
|
Jaret Burkett
|
1f541bc5d8
|
Changes to handle a different DFE arch
|
2025-08-27 11:05:16 -06:00 |
|
|
Jaret Burkett
|
fd13bd73a6
|
Add a Download button on samples to download all the samples as a zip file
|
2025-08-27 09:12:46 -06:00 |
|
|
Jaret Burkett
|
5ad190b11d
|
Improve UI for sample images when there are no samples
|
2025-08-27 08:10:24 -06:00 |
|
|
Jaret Burkett
|
d0338b8b0b
|
Allow dropping images directly into dataset folder without having to open the add images modal. Improve ui flow of dataset messaging.
|
2025-08-25 14:04:48 -06:00 |
|
|
Jaret Burkett
|
37eda7b2e2
|
Add a tab to the UI to show the config file for the job. Read only.
|
2025-08-25 13:08:40 -06:00 |
|
|
Jaret Burkett
|
119653c3f2
|
Force width, height, and num frames to always be the proper sizes for Wan 2.2 models
|
2025-08-25 10:33:28 -06:00 |
|
|
Jaret Burkett
|
ea01a1c7d0
|
Fixed a bug where samples would fail if merging in lora on sampling for unquantized models. Quantize non ARA modules as uint8 when using an ARA
|
2025-08-25 09:21:40 -06:00 |
|
|
Jaret Burkett
|
f48d21caee
|
Upgrade a LoRA rank if the new one is larger so users can increase the rank on an exiting training job and continue training at a higher rank.
|
2025-08-24 13:40:25 -06:00 |
|
|
Jaret Burkett
|
24372b5e35
|
Add toggles to the UI to add flipped versions of the datasets, X, Y or both.
|
2025-08-24 13:39:04 -06:00 |
|
|
Jaret Burkett
|
5c27f89af5
|
Add example config for qwen image edit
|
2025-08-23 18:20:36 -06:00 |
|
|
Jaret Burkett
|
554dfb33bc
|
Added example config file for qwen image at 24GB
|
2025-08-23 12:37:46 -06:00 |
|
|
Jaret Burkett
|
823e690703
|
Changed auth to use the wording 'password' instead of 'token' and give information about defaults and how to change the password.
|
2025-08-23 09:30:44 -06:00 |
|
|
Jaret Burkett
|
e1fd411665
|
Added support for Chroma1 official release. Will still use single file verstion instead of the diffusers version.
|
2025-08-23 09:06:28 -06:00 |
|
|
Jaret Burkett
|
0d6d027248
|
Update supporters info
|
2025-08-23 08:58:31 -06:00 |
|
|
Jaret Burkett
|
b6f43fb7c2
|
Merge pull request #383 from ostris/qwen_image_edit
Add support for Qwen-Image-Edit
|
2025-08-22 10:29:25 -06:00 |
|
|
Jaret Burkett
|
59ff4efae5
|
Add support for training Qwen Image Edit in the UI
|
2025-08-22 10:26:46 -06:00 |
|
|
Jaret Burkett
|
aa99784b89
|
Add control to prompot encodings in the trainer when not cached
|
2025-08-21 16:52:13 -06:00 |
|
|
Jaret Burkett
|
bf2700f7be
|
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
|
2025-08-21 16:41:17 -06:00 |
|
|
Jaret Burkett
|
38d3814be7
|
Added 4bit ARAs for Wan 2.2 14b models
|
2025-08-21 08:16:07 -06:00 |
|
|
Jaret Burkett
|
83deaec417
|
Minor bug fixes
|
2025-08-21 08:05:34 -06:00 |
|
|
Jaret Burkett
|
d2bbe1872c
|
Add support for fine tuning Wan 2.2 I2V 14B
|
2025-08-18 11:43:32 -06:00 |
|
|
Jaret Burkett
|
b3e666daf4
|
Fix issue with wan22 14b where timesteps were generated not in the current boundary.
|
2025-08-16 21:16:48 -06:00 |
|
|
Jaret Burkett
|
6fffadfc0e
|
Fixed a bug that prevented training just one stage of Wan 2.2 14b
|
2025-08-16 18:07:21 -06:00 |
|
|
Jaret Burkett
|
280aca685f
|
Merge pull request #377 from ostris/wan22_14b
Wan2.2 14B T2I support
|
2025-08-16 14:25:23 -06:00 |
|
|
Jaret Burkett
|
1029fa8743
|
version bump
|
2025-08-16 13:39:40 -06:00 |
|
|
Jaret Burkett
|
8ea2cf00f6
|
Added training to the ui. Still testing, but everything seems to be working.
|
2025-08-16 05:51:37 -06:00 |
|
|
Jaret Burkett
|
ca7bfa414b
|
Increase max number of samples to 40
|
2025-08-16 05:27:38 -06:00 |
|
|
Jaret Burkett
|
1c96b95617
|
Fix issue where sometimes the transformer does not get loaded properly.
|
2025-08-14 14:24:41 -06:00 |
|
|
Jaret Burkett
|
3413fa537f
|
Wan22 14b training is working, still need tons of testing and some bug fixes
|
2025-08-14 13:03:27 -06:00 |
|
|
Jaret Burkett
|
be71cc75ce
|
Switch to unified text encoder for wan models. Pred for 2.2 14b
|
2025-08-14 10:07:18 -06:00 |
|
|
Jaret Burkett
|
e12bb21780
|
Quantize blocks sequentialls without a ARA
|
2025-08-14 09:59:58 -06:00 |
|
|
Jaret Burkett
|
3ff4430e84
|
Fix issue with fake text encoder unload
|
2025-08-14 09:33:44 -06:00 |
|
|
Jaret Burkett
|
5501521c9f
|
Link to easy install script
|
2025-08-13 12:26:10 -06:00 |
|
|
Jaret Burkett
|
85bad57df3
|
Fix bug that would use EMA when set false
|
2025-08-13 11:39:40 -06:00 |
|
|
Jaret Burkett
|
259d68d440
|
Added a flushg during sampling to prevent spikes on low vram qwen
|
2025-08-12 12:57:18 -06:00 |
|
|
Jaret Burkett
|
69ee99b6e1
|
Fix issue with base model version
|
2025-08-12 09:26:48 -06:00 |
|
|
Jaret Burkett
|
77b10d884d
|
Add support for training with an accuracy recovery adapter with qwen image
|
2025-08-12 08:21:36 -06:00 |
|
|
Jaret Burkett
|
4ad18f3d00
|
Clip max token embeddings to the max rope length for qwen image to solve for an error for super long captions > 1024
|
2025-08-10 08:44:41 -06:00 |
|
|
Jaret Burkett
|
f0105c33a7
|
Fixed issue that sometimes happens in qwen image where text seq length is wrong
|
2025-08-09 16:33:05 -06:00 |
|
|
Jaret Burkett
|
ccd449ec49
|
Update supporters
|
2025-08-08 11:04:45 -06:00 |
|
|
Jaret Burkett
|
bb6db3d635
|
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
|
2025-08-07 10:27:55 -06:00 |
|
|
Jaret Burkett
|
4c4a10d439
|
Remove vision model from qwen text encoder as it is not needed for image generation currently
|
2025-08-06 11:40:02 -06:00 |
|
|
Jaret Burkett
|
14ccf2f3ce
|
Refactor qwen5b model code to be qwen 5b specific
|
2025-08-06 10:54:56 -06:00 |
|
|
Jaret Burkett
|
5d8922fca2
|
Add ability to designate a dataset as i2v or t2v for models that support it
|
2025-08-06 09:29:47 -06:00 |
|
|
Jaret Burkett
|
1755e58dd9
|
Update generation script to handle latest models.
|
2025-08-05 08:55:16 -06:00 |
|
|
Jaret Burkett
|
6bb3aed9a2
|
Merge pull request #359 from ostris/qwen_image
Add support for Qwen Image
|
2025-08-04 15:51:01 -06:00 |
|
|
Jaret Burkett
|
74b4d2d291
|
Version bump
|
2025-08-04 15:49:32 -06:00 |
|
|
Jaret Burkett
|
23327d5659
|
Add qwen image to the ui
|
2025-08-04 15:48:51 -06:00 |
|
|
Jaret Burkett
|
93202c7a2b
|
Training working for Qwen Image
|
2025-08-04 21:14:30 +00:00 |
|
|
Jaret Burkett
|
9da8b5408e
|
Initial but untested support for qwen_image
|
2025-08-04 13:29:37 -06:00 |
|
|
Jaret Burkett
|
9dfb614755
|
Initial work for training wan first and last frame
|
2025-08-04 11:37:26 -06:00 |
|
|
Jaret Burkett
|
ef1d60ba34
|
Update wan 2.2 5b timestep distribution to weighted.
|
2025-07-30 10:13:22 -06:00 |
|
|
Jaret Burkett
|
75f688766d
|
Version bump
|
2025-07-29 09:30:54 -06:00 |
|
|
Jaret Burkett
|
a558d5b68f
|
Move transformer back to device on aggresive wan 2.2 pipeline after generation.
|
2025-07-29 09:13:47 -06:00 |
|
|
Jaret Burkett
|
1d1199b15b
|
Fix bug that prevented training wan 2.2 with batch size greater than 1
|
2025-07-29 09:06:25 -06:00 |
|
|
Jaret Burkett
|
f453e28ea3
|
Fixed deprecation of lumina pipeline error
|
2025-07-29 08:26:51 -06:00 |
|
|
Jaret Burkett
|
ca7c5c950b
|
Add support for Wan2.2 5B
|
2025-07-29 05:31:54 -06:00 |
|