Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett ba00eea7d9 Add loss graph to the ui 2025-12-18 10:08:59 -07:00
Jaret Burkett 3b6c1ade18 Update supporters 2025-12-17 15:20:55 -07:00
Jaret Burkett 26f4f02453 Add support for Z-Image-De-Turbo 2025-12-04 10:03:13 -07:00
Jaret Burkett 2d30dc5d52 Bump version 2025-12-02 21:29:19 -07:00
Jaret Burkett 6c85184441 Set zit training adapter to default to v2 2025-12-02 16:46:05 -07:00
Jaret Burkett e6c5aead3b Fix issue that prevented ramtorch layer offloading with z_image 2025-12-02 16:14:34 -07:00
Jaret Burkett d42f5af2fc Fixed issue with DOP when using Z-Image 2025-11-28 09:36:21 -07:00
Jaret Burkett 08a39754a4 Fixed issue that prevented caching text embeddings on z-image 2025-11-28 09:19:39 -07:00
Jaret Burkett 4e62c38df5 Add support for training Z-Image Turbo with a de-distill training adapter 2025-11-28 08:08:53 -07:00
Jaret Burkett 21bb8a2bf4 Merge pull request #525 from ostris/flux2
Add support for FLUX.2
2025-11-25 07:53:36 -08:00
Jaret Burkett 01cf480233 Add FLUX.2 official weights 2025-11-25 08:52:19 -07:00
Jaret Burkett dadbeda197 Update test weights 2025-11-23 10:51:50 -07:00
Jaret Burkett 0b5f3475e2 Merge branch 'main' into flux2 2025-11-23 08:18:35 -07:00
Jaret Burkett 50e5d99545 Fix issue where text encoder was not fully unloaded in some instances 2025-11-19 09:01:00 -07:00
Jaret Burkett 26e4b71b57 Fix issue with parsing image info for sample info on some windows machines. 2025-11-19 08:45:05 -07:00
Jaret Burkett cd607c4902 Fix a bug that can happen if you remove a gpu from your machine. 2025-11-19 08:28:48 -07:00
Jaret Burkett af8e9ea149 Add initial support for FLUX.2 2025-11-18 11:17:38 -07:00
Jaret Burkett 323b4aaf5a Do not copy pin memory if it fails, just move 2025-11-17 18:04:00 +00:00
Jaret Burkett 2e7b2d9926 Added Differential Guidance training target 2025-11-10 09:38:25 -07:00
Jaret Burkett 9b89bab8fe Version bump 2025-11-09 10:11:25 -07:00
Jaret Burkett 6f308fc46e When soing guidance loss, make CFG zero an optional target instead of a forced one. 2025-11-04 09:16:15 -07:00
Jaret Burkett c984369294 Fixed resizing of control image resolution for Qwen Image Edit 2509 when using match_target_res 2025-10-30 06:30:01 -06:00
Jaret Burkett 42e5e3cd1c Adjust DFE to handle 5 dimension latent spaces 2025-10-27 07:48:44 -06:00
Jaret Burkett 8c12977891 Fixed adafactor eps 2025-10-26 05:47:25 -06:00
Jaret Burkett 80418209b8 Fixe a variable that could nt be declared when doing blank prompt preservation 2025-10-23 16:19:56 -06:00
Jaret Burkett ee206cfa18 Added blank prompt preservation 2025-10-22 14:55:13 -06:00
Jaret Burkett ca57ffc270 When having less than 3 sample images, add spacing to the grid so images are not huge 2025-10-22 13:52:38 -06:00
Jaret Burkett ff14cd6343 Fix check for making sure vae is on the right device. 2025-10-21 14:49:20 -06:00
Jaret Burkett 5123090f6c Adjust dataloader tester to handle videos to test them 2025-10-21 14:47:23 -06:00
Jaret Burkett 0d8a33dc16 Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support 2025-10-21 06:03:27 -06:00
Jaret Burkett 76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. 2025-10-20 14:54:30 -06:00
Jaret Burkett 8bbaa4e224 Update sponsors 2025-10-20 09:59:44 -06:00
Jaret Burkett b7f85928f3 Fix issue with chroma when not quantizing 2025-10-19 12:13:05 -06:00
Jaret Burkett d51297bcf9 Updated supporters in the Readme 2025-10-18 03:14:03 -06:00
Jaret Burkett 1f81bc4060 Fix issue where text encoder could be the wrong quantization and fail when using memory manager 2025-10-15 11:01:30 -06:00
Jaret Burkett 7abf5e20be Add conv3d to memory management excluded modules 2025-10-15 10:12:06 -06:00
Jaret Burkett 91b87e06a1 Reordered logs 2025-10-15 09:15:06 -06:00
Jaret Burkett 645c54d617 Fixed issue that may occour if no queue is built when starting one from the table. 2025-10-15 08:48:07 -06:00
Jaret Burkett b523d58699 Added ability to clone an existing job in the ui 2025-10-14 14:13:37 -06:00
Jaret Burkett 7e34a03113 Added queing system to the UI 2025-10-14 12:00:42 -06:00
Jaret Burkett 0c9e1c3deb Fixed some fringe cases for qwen image edit. 2025-10-13 17:10:46 +00:00
Jaret Burkett 77cf3b824f Version Bump 2025-10-10 22:16:50 -06:00
Jaret Burkett e9c4d94256 Allow for matching target resolution with control images for Qwen Image Edit 2509 2025-10-10 14:24:27 -06:00
Jaret Burkett 1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload 2025-10-10 13:12:32 -06:00
Jaret Burkett 2c2fbf16ea Version bump 2025-10-09 11:26:07 -06:00
Jaret Burkett 8068755b0a Fixed issue with wan 2.2 getting stuck on CPU 2025-10-09 17:24:25 +00:00
Jaret Burkett 55b8b0e23e Fix issue where ARA was not working when using memory manager 2025-10-07 13:39:44 -06:00
Jaret Burkett dfc85f0b51 Add Auto Memory for qwen models in the ui 2025-10-07 10:43:52 -06:00
Jaret Burkett 1ea50d8590 Add cpu info the the job page 2025-10-07 08:30:23 -06:00
Jaret Burkett c9f982af83 Add support for using quantized models with ramtorch 2025-10-06 13:46:57 -06:00
Jaret Burkett dc1cc3e78a Fixed issue where multi control samples didnt work when not caching 2025-10-05 14:38:53 -06:00
Jaret Burkett 4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00
Jaret Burkett c6edd71a5b Version bump 2025-10-01 14:13:38 -06:00
Jaret Burkett b7c04efb44 A commit with the adits properly named improvements to qwen image edit plus workflow. Fixed a bug. Dont norm the cfg 2025-10-01 14:13:15 -06:00
Jaret Burkett 3086a58e5b git status 2025-10-01 14:12:17 -06:00
Jaret Burkett b07b88c46b Allow trigger when caching text embeddings since it is now passed to dataset 2025-09-30 16:58:35 -06:00
Jaret Burkett 2ba4000704 Allow masked losses with video models 2025-09-30 14:57:07 -06:00
Jaret Burkett 67ed563e03 fix issue with multi batch size on qwen-image-edit-plus 2025-09-30 09:04:56 -06:00
Jaret Burkett 2e9de5eb50 Add ability to delete samples from the ui 2025-09-29 04:49:32 -06:00
Jaret Burkett ebadb321e3 On samples page, auto scroll to bottom on load. Added a floating button to scroll to bottom. 2025-09-29 03:56:17 -06:00
Jaret Burkett c233a80337 Reqorked visibility toggle on samples, should help when dealing with more samples 2025-09-28 14:13:10 -06:00
Jaret Burkett c20240be82 Add advanced menu on job to allow user to do things like make a job as stopped if the status ever gets hung 2025-09-28 13:43:00 -06:00
Jaret Burkett 4e207d92cd Add seed to the sample image modal 2025-09-28 12:54:34 -06:00
Jaret Burkett f0646a0a70 Reworked ui sample image modal to show more information and function a lot better. 2025-09-27 12:50:47 -06:00
Jaret Burkett 98d35f36a9 Add hidream ARA 2025-09-27 09:31:23 -06:00
Jaret Burkett 3b1f7b0948 Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row. 2025-09-27 08:56:15 -06:00
Jaret Burkett 6da417261c Add extra detachments just to be sure on qiep 2025-09-27 08:53:59 -06:00
Jaret Burkett be990630b9 Remove dropout from cached text embeddings even if used specifies it so blank prompts are not cached. 2025-09-26 11:50:53 -06:00
Jaret Burkett e04f55c553 Fixed scaling issue with control images 2025-09-26 11:49:53 -06:00
Jaret Burkett 0eaa3d2893 Merge pull request #434 from ostris/qwen_image_edit_plus
Add full support for Qwen-Image-Edit-2509
2025-09-25 11:33:18 -06:00
Jaret Burkett 1069dee0e4 Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui 2025-09-25 11:10:02 -06:00
Jaret Burkett 454be0958a Initial support for qwen image edit plus 2025-09-24 11:39:10 -06:00
Jaret Burkett f74475161e Add stepped loss type 2025-09-22 15:50:12 -06:00
Jaret Burkett 28728a1e92 Added experimental dfe 5 2025-09-21 10:48:52 -06:00
Jaret Burkett 20dfe1b4d5 Small double tap of detach on qwen just for good measure 2025-09-18 08:22:04 -06:00
Jaret Burkett 390e21bec6 Integrate dataset level trigger words and allow them to be cached. Default to global trigger if it is set. 2025-09-18 03:29:18 -06:00
Jaret Burkett 3cdf50cbfc Merge pull request #426 from squewel/prior_reg
Dataset-level prior regularization
2025-09-18 03:03:18 -06:00
Jaret Burkett 2120dc5936 Upgrade job to new ui trainer to fix issue with slider config showing up on old configs. 2025-09-17 13:41:48 -06:00
Jaret Burkett 24a576ad07 Regularize the slider targets. 2025-09-17 09:36:33 -06:00
Jaret Burkett 218f673e3d Added support for new concept slider training script to CLI and UI 2025-09-16 10:22:34 -06:00
Jaret Burkett 3666b112a8 DEF for fake vae and adjust scaling 2025-09-12 18:09:08 -06:00
Jaret Burkett b95c17dc17 Add initial support for chroma radiance 2025-09-10 08:41:05 -06:00
Jaret Burkett af6fdaaaf9 Add ability to train a full rank LoRA. (experimental) 2025-09-09 07:36:25 -06:00
Jaret Burkett 645046701b Comment out fast stop watcher. Could potentiallty be causing some weird issues. Need to investigate. 2025-09-04 08:26:57 -06:00
Jaret Burkett f699f4be5f Add ability to set transparent color for control images 2025-09-02 11:08:44 -06:00
Jaret Burkett 85dcae6e2b Set full size control images to default true 2025-09-02 10:30:42 -06:00
Jaret Burkett 7040d8d73b Preperation for audio 2025-09-02 07:26:50 -06:00
Jaret Burkett 0f2239ca23 Add force sample toggle to the ui 2025-08-31 16:58:27 -06:00
Jaret Burkett 193c1b2dfa Add a watcher to constantly check for stop signal from the UI. This will force a stop within 2 seconds instead of having to wait on a long hung process. 2025-08-31 16:58:01 -06:00
Jaret Burkett 6fc9ec1396 Added example config for training wan22 14b 24GB on images 2025-08-28 13:08:49 -06:00
Jaret Burkett 056711d4ed Fix issue with wan22 14b that woudl load both transformers temporarily resulting in oom on 24GB. 2025-08-28 13:06:31 -06:00
Jaret Burkett e3349414fd Updated runpod docs 2025-08-28 11:40:48 -06:00
Jaret Burkett 9ef425a1c5 Fixed issue with training qwen with cached text embeds with a batch size more than 1 2025-08-28 08:07:12 -06:00
Jaret Burkett fc5b41666a Switch order to save first, then sample. 2025-08-27 11:07:03 -06:00
Jaret Burkett 1f541bc5d8 Changes to handle a different DFE arch 2025-08-27 11:05:16 -06:00
Jaret Burkett fd13bd73a6 Add a Download button on samples to download all the samples as a zip file 2025-08-27 09:12:46 -06:00
Jaret Burkett 5ad190b11d Improve UI for sample images when there are no samples 2025-08-27 08:10:24 -06:00
Jaret Burkett d0338b8b0b Allow dropping images directly into dataset folder without having to open the add images modal. Improve ui flow of dataset messaging. 2025-08-25 14:04:48 -06:00
Jaret Burkett 37eda7b2e2 Add a tab to the UI to show the config file for the job. Read only. 2025-08-25 13:08:40 -06:00
Jaret Burkett 119653c3f2 Force width, height, and num frames to always be the proper sizes for Wan 2.2 models 2025-08-25 10:33:28 -06:00