Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett 8bbaa4e224 Update sponsors 2025-10-20 09:59:44 -06:00
Jaret Burkett b7f85928f3 Fix issue with chroma when not quantizing 2025-10-19 12:13:05 -06:00
Jaret Burkett d51297bcf9 Updated supporters in the Readme 2025-10-18 03:14:03 -06:00
Jaret Burkett 1f81bc4060 Fix issue where text encoder could be the wrong quantization and fail when using memory manager 2025-10-15 11:01:30 -06:00
Jaret Burkett 7abf5e20be Add conv3d to memory management excluded modules 2025-10-15 10:12:06 -06:00
Jaret Burkett 91b87e06a1 Reordered logs 2025-10-15 09:15:06 -06:00
Jaret Burkett 645c54d617 Fixed issue that may occour if no queue is built when starting one from the table. 2025-10-15 08:48:07 -06:00
Jaret Burkett b523d58699 Added ability to clone an existing job in the ui 2025-10-14 14:13:37 -06:00
Jaret Burkett 7e34a03113 Added queing system to the UI 2025-10-14 12:00:42 -06:00
Jaret Burkett 0c9e1c3deb Fixed some fringe cases for qwen image edit. 2025-10-13 17:10:46 +00:00
Jaret Burkett 77cf3b824f Version Bump 2025-10-10 22:16:50 -06:00
Jaret Burkett e9c4d94256 Allow for matching target resolution with control images for Qwen Image Edit 2509 2025-10-10 14:24:27 -06:00
Jaret Burkett 1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload 2025-10-10 13:12:32 -06:00
Jaret Burkett 2c2fbf16ea Version bump 2025-10-09 11:26:07 -06:00
Jaret Burkett 8068755b0a Fixed issue with wan 2.2 getting stuck on CPU 2025-10-09 17:24:25 +00:00
Jaret Burkett 55b8b0e23e Fix issue where ARA was not working when using memory manager 2025-10-07 13:39:44 -06:00
Jaret Burkett dfc85f0b51 Add Auto Memory for qwen models in the ui 2025-10-07 10:43:52 -06:00
Jaret Burkett 1ea50d8590 Add cpu info the the job page 2025-10-07 08:30:23 -06:00
Jaret Burkett c9f982af83 Add support for using quantized models with ramtorch 2025-10-06 13:46:57 -06:00
Jaret Burkett dc1cc3e78a Fixed issue where multi control samples didnt work when not caching 2025-10-05 14:38:53 -06:00
Jaret Burkett 4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00
Jaret Burkett c6edd71a5b Version bump 2025-10-01 14:13:38 -06:00
Jaret Burkett b7c04efb44 A commit with the adits properly named improvements to qwen image edit plus workflow. Fixed a bug. Dont norm the cfg 2025-10-01 14:13:15 -06:00
Jaret Burkett 3086a58e5b git status 2025-10-01 14:12:17 -06:00
Jaret Burkett b07b88c46b Allow trigger when caching text embeddings since it is now passed to dataset 2025-09-30 16:58:35 -06:00
Jaret Burkett 2ba4000704 Allow masked losses with video models 2025-09-30 14:57:07 -06:00
Jaret Burkett 67ed563e03 fix issue with multi batch size on qwen-image-edit-plus 2025-09-30 09:04:56 -06:00
Jaret Burkett 2e9de5eb50 Add ability to delete samples from the ui 2025-09-29 04:49:32 -06:00
Jaret Burkett ebadb321e3 On samples page, auto scroll to bottom on load. Added a floating button to scroll to bottom. 2025-09-29 03:56:17 -06:00
Jaret Burkett c233a80337 Reqorked visibility toggle on samples, should help when dealing with more samples 2025-09-28 14:13:10 -06:00
Jaret Burkett c20240be82 Add advanced menu on job to allow user to do things like make a job as stopped if the status ever gets hung 2025-09-28 13:43:00 -06:00
Jaret Burkett 4e207d92cd Add seed to the sample image modal 2025-09-28 12:54:34 -06:00
Jaret Burkett f0646a0a70 Reworked ui sample image modal to show more information and function a lot better. 2025-09-27 12:50:47 -06:00
Jaret Burkett 98d35f36a9 Add hidream ARA 2025-09-27 09:31:23 -06:00
Jaret Burkett 3b1f7b0948 Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row. 2025-09-27 08:56:15 -06:00
Jaret Burkett 6da417261c Add extra detachments just to be sure on qiep 2025-09-27 08:53:59 -06:00
Jaret Burkett be990630b9 Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached. 2025-09-26 11:50:53 -06:00
Jaret Burkett e04f55c553 Fixed scaling issue with control images 2025-09-26 11:49:53 -06:00
Jaret Burkett 0eaa3d2893 Merge pull request #434 from ostris/qwen_image_edit_plus
Add full support for Qwen-Image-Edit-2509
2025-09-25 11:33:18 -06:00
Jaret Burkett 1069dee0e4 Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui 2025-09-25 11:10:02 -06:00
Jaret Burkett 454be0958a Initial support for qwen image edit plus 2025-09-24 11:39:10 -06:00
Jaret Burkett f74475161e Add stepped loss type 2025-09-22 15:50:12 -06:00
Jaret Burkett 28728a1e92 Added experimental dfe 5 2025-09-21 10:48:52 -06:00
Jaret Burkett 20dfe1b4d5 Small double tap of detach on qwen just for good measure 2025-09-18 08:22:04 -06:00
Jaret Burkett 390e21bec6 Integrate dataset level trigger words and allow them to be cached. Default to global trigger if it is set. 2025-09-18 03:29:18 -06:00
Jaret Burkett 3cdf50cbfc Merge pull request #426 from squewel/prior_reg
Dataset-level prior regularization
2025-09-18 03:03:18 -06:00
Jaret Burkett 2120dc5936 Upgrade job to new ui trainer to fix issue with slider config showing up on old configs. 2025-09-17 13:41:48 -06:00
Jaret Burkett 24a576ad07 Regularize the slider targets. 2025-09-17 09:36:33 -06:00
Jaret Burkett 218f673e3d Added support for new concept slider training script to CLI and UI 2025-09-16 10:22:34 -06:00
Jaret Burkett 3666b112a8 DEF for fake vae and adjust scaling 2025-09-12 18:09:08 -06:00
Jaret Burkett b95c17dc17 Add initial support for chroma radiance 2025-09-10 08:41:05 -06:00
Jaret Burkett af6fdaaaf9 Add ability to train a full rank LoRA. (experimental) 2025-09-09 07:36:25 -06:00
Jaret Burkett 645046701b Comment out fast stop watcher. Could potentiallty be causing some weird issues. Need to investigate. 2025-09-04 08:26:57 -06:00
Jaret Burkett f699f4be5f Add ability to set transparent color for control images 2025-09-02 11:08:44 -06:00
Jaret Burkett 85dcae6e2b Set full size control images to default true 2025-09-02 10:30:42 -06:00
Jaret Burkett 7040d8d73b Preperation for audio 2025-09-02 07:26:50 -06:00
Jaret Burkett 0f2239ca23 Add force sample toggle to the ui 2025-08-31 16:58:27 -06:00
Jaret Burkett 193c1b2dfa Add a watcher to constantly check for stop signal from the UI. This will force a stop within 2 seconds instead of having to wait on a long hung process. 2025-08-31 16:58:01 -06:00
Jaret Burkett 6fc9ec1396 Added example config for training wan22 14b 24GB on images 2025-08-28 13:08:49 -06:00
Jaret Burkett 056711d4ed Fix issue with wan22 14b that woudl load both transformers temporarily resulting in oom on 24GB. 2025-08-28 13:06:31 -06:00
Jaret Burkett e3349414fd Updated runpod docs 2025-08-28 11:40:48 -06:00
Jaret Burkett 9ef425a1c5 Fixed issue with training qwen with cached text embeds with a batch size more than 1 2025-08-28 08:07:12 -06:00
Jaret Burkett fc5b41666a Switch order to save first, then sample. 2025-08-27 11:07:03 -06:00
Jaret Burkett 1f541bc5d8 Changes to handle a different DFE arch 2025-08-27 11:05:16 -06:00
Jaret Burkett fd13bd73a6 Add a Download button on samples to download all the samples as a zip file 2025-08-27 09:12:46 -06:00
Jaret Burkett 5ad190b11d Improve UI for sample images when there are no samples 2025-08-27 08:10:24 -06:00
Jaret Burkett d0338b8b0b Allow dropping images directly into dataset folder without having to open the add images modal. Improve ui flow of dataset messaging. 2025-08-25 14:04:48 -06:00
Jaret Burkett 37eda7b2e2 Add a tab to the UI to show the config file for the job. Read only. 2025-08-25 13:08:40 -06:00
Jaret Burkett 119653c3f2 Force width, height, and num frames to always be the proper sizes for Wan 2.2 models 2025-08-25 10:33:28 -06:00
Jaret Burkett ea01a1c7d0 Fixed a bug where samples would fail if merging in lora on sampling for unquantized models. Quantize non ARA modules as uint8 when using an ARA 2025-08-25 09:21:40 -06:00
Jaret Burkett f48d21caee Upgrade a LoRA rank if the new one is larger so users can increase the rank on an exiting training job and continue training at a higher rank. 2025-08-24 13:40:25 -06:00
Jaret Burkett 24372b5e35 Add toggles to the UI to add flipped versions of the datasets, X, Y or both. 2025-08-24 13:39:04 -06:00
Jaret Burkett 5c27f89af5 Add example config for qwen image edit 2025-08-23 18:20:36 -06:00
Jaret Burkett 554dfb33bc Added example config file for qwen image at 24GB 2025-08-23 12:37:46 -06:00
Jaret Burkett 823e690703 Changed auth to use the wording 'password' instead of 'token' and give information about defaults and how to change the password. 2025-08-23 09:30:44 -06:00
Jaret Burkett e1fd411665 Added support for Chroma1 official release. Will still use single file verstion instead of the diffusers version. 2025-08-23 09:06:28 -06:00
Jaret Burkett 0d6d027248 Update supporters info 2025-08-23 08:58:31 -06:00
Jaret Burkett b6f43fb7c2 Merge pull request #383 from ostris/qwen_image_edit
Add support for Qwen-Image-Edit
2025-08-22 10:29:25 -06:00
Jaret Burkett 59ff4efae5 Add support for training Qwen Image Edit in the UI 2025-08-22 10:26:46 -06:00
Jaret Burkett aa99784b89 Add control to prompot encodings in the trainer when not cached 2025-08-21 16:52:13 -06:00
Jaret Burkett bf2700f7be Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere. 2025-08-21 16:41:17 -06:00
Jaret Burkett 38d3814be7 Added 4bit ARAs for Wan 2.2 14b models 2025-08-21 08:16:07 -06:00
Jaret Burkett 83deaec417 Minor bug fixes 2025-08-21 08:05:34 -06:00
Jaret Burkett d2bbe1872c Add support for fine tuning Wan 2.2 I2V 14B 2025-08-18 11:43:32 -06:00
Jaret Burkett b3e666daf4 Fix issue with wan22 14b where timesteps were generated not in the current boundary. 2025-08-16 21:16:48 -06:00
Jaret Burkett 6fffadfc0e Fixed a bug that prevented training just one stage of Wan 2.2 14b 2025-08-16 18:07:21 -06:00
Jaret Burkett 280aca685f Merge pull request #377 from ostris/wan22_14b
Wan2.2 14B T2I support
2025-08-16 14:25:23 -06:00
Jaret Burkett 1029fa8743 version bump 2025-08-16 13:39:40 -06:00
Jaret Burkett 8ea2cf00f6 Added training to the ui. Still testing, but everything seems to be working. 2025-08-16 05:51:37 -06:00
Jaret Burkett ca7bfa414b Increase max number of samples to 40 2025-08-16 05:27:38 -06:00
Jaret Burkett 1c96b95617 Fix issue where sometimes the transformer does not get loaded properly. 2025-08-14 14:24:41 -06:00
Jaret Burkett 3413fa537f Wan22 14b training is working, still need tons of testing and some bug fixes 2025-08-14 13:03:27 -06:00
Jaret Burkett be71cc75ce Switch to unified text encoder for wan models. Pred for 2.2 14b 2025-08-14 10:07:18 -06:00
Jaret Burkett e12bb21780 Quantize blocks sequentialls without a ARA 2025-08-14 09:59:58 -06:00
Jaret Burkett 3ff4430e84 Fix issue with fake text encoder unload 2025-08-14 09:33:44 -06:00
Jaret Burkett 5501521c9f Link to easy install script 2025-08-13 12:26:10 -06:00
Jaret Burkett 85bad57df3 Fix bug that would use EMA when set false 2025-08-13 11:39:40 -06:00
Jaret Burkett 259d68d440 Added a flushg during sampling to prevent spikes on low vram qwen 2025-08-12 12:57:18 -06:00
Jaret Burkett 69ee99b6e1 Fix issue with base model version 2025-08-12 09:26:48 -06:00
Jaret Burkett 77b10d884d Add support for training with an accuracy recovery adapter with qwen image 2025-08-12 08:21:36 -06:00