Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett 0d6d027248 Update supporters info 2025-08-23 08:58:31 -06:00
Jaret Burkett b6f43fb7c2 Merge pull request #383 from ostris/qwen_image_edit
Add support for Qwen-Image-Edit
2025-08-22 10:29:25 -06:00
Jaret Burkett 59ff4efae5 Add support for training Qwen Image Edit in the UI 2025-08-22 10:26:46 -06:00
Jaret Burkett aa99784b89 Add control to prompot encodings in the trainer when not cached 2025-08-21 16:52:13 -06:00
Jaret Burkett bf2700f7be Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere. 2025-08-21 16:41:17 -06:00
Jaret Burkett 38d3814be7 Added 4bit ARAs for Wan 2.2 14b models 2025-08-21 08:16:07 -06:00
Jaret Burkett 83deaec417 Minor bug fixes 2025-08-21 08:05:34 -06:00
Jaret Burkett d2bbe1872c Add support for fine tuning Wan 2.2 I2V 14B 2025-08-18 11:43:32 -06:00
Jaret Burkett b3e666daf4 Fix issue with wan22 14b where timesteps were generated not in the current boundary. 2025-08-16 21:16:48 -06:00
Jaret Burkett 6fffadfc0e Fixed a bug that prevented training just one stage of Wan 2.2 14b 2025-08-16 18:07:21 -06:00
Jaret Burkett 280aca685f Merge pull request #377 from ostris/wan22_14b
Wan2.2 14B T2I support
2025-08-16 14:25:23 -06:00
Jaret Burkett 1029fa8743 version bump 2025-08-16 13:39:40 -06:00
Jaret Burkett 8ea2cf00f6 Added training to the ui. Still testing, but everything seems to be working. 2025-08-16 05:51:37 -06:00
Jaret Burkett ca7bfa414b Increase max number of samples to 40 2025-08-16 05:27:38 -06:00
Jaret Burkett 1c96b95617 Fix issue where sometimes the transformer does not get loaded properly. 2025-08-14 14:24:41 -06:00
Jaret Burkett 3413fa537f Wan22 14b training is working, still need tons of testing and some bug fixes 2025-08-14 13:03:27 -06:00
Jaret Burkett be71cc75ce Switch to unified text encoder for wan models. Pred for 2.2 14b 2025-08-14 10:07:18 -06:00
Jaret Burkett e12bb21780 Quantize blocks sequentialls without a ARA 2025-08-14 09:59:58 -06:00
Jaret Burkett 3ff4430e84 Fix issue with fake text encoder unload 2025-08-14 09:33:44 -06:00
Jaret Burkett 5501521c9f Link to easy install script 2025-08-13 12:26:10 -06:00
Jaret Burkett 85bad57df3 Fix bug that would use EMA when set false 2025-08-13 11:39:40 -06:00
Jaret Burkett 259d68d440 Added a flushg during sampling to prevent spikes on low vram qwen 2025-08-12 12:57:18 -06:00
Jaret Burkett 69ee99b6e1 Fix issue with base model version 2025-08-12 09:26:48 -06:00
Jaret Burkett 77b10d884d Add support for training with an accuracy recovery adapter with qwen image 2025-08-12 08:21:36 -06:00
Jaret Burkett 4ad18f3d00 Clip max token embeddings to the max rope length for qwen image to solve for an error for super long captions > 1024 2025-08-10 08:44:41 -06:00
Jaret Burkett f0105c33a7 Fixed issue that sometimes happens in qwen image where text seq length is wrong 2025-08-09 16:33:05 -06:00
Jaret Burkett ccd449ec49 Update supporters 2025-08-08 11:04:45 -06:00
Jaret Burkett bb6db3d635 Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized 2025-08-07 10:27:55 -06:00
Jaret Burkett 4c4a10d439 Remove vision model from qwen text encoder as it is not needed for image generation currently 2025-08-06 11:40:02 -06:00
Jaret Burkett 14ccf2f3ce Refactor qwen5b model code to be qwen 5b specific 2025-08-06 10:54:56 -06:00
Jaret Burkett 5d8922fca2 Add ability to designate a dataset as i2v or t2v for models that support it 2025-08-06 09:29:47 -06:00
Jaret Burkett 1755e58dd9 Update generation script to handle latest models. 2025-08-05 08:55:16 -06:00
Jaret Burkett 6bb3aed9a2 Merge pull request #359 from ostris/qwen_image
Add support for Qwen Image
2025-08-04 15:51:01 -06:00
Jaret Burkett 74b4d2d291 Version bump 2025-08-04 15:49:32 -06:00
Jaret Burkett 23327d5659 Add qwen image to the ui 2025-08-04 15:48:51 -06:00
Jaret Burkett 93202c7a2b Training working for Qwen Image 2025-08-04 21:14:30 +00:00
Jaret Burkett 9da8b5408e Initial but untested support for qwen_image 2025-08-04 13:29:37 -06:00
Jaret Burkett 9dfb614755 Initial work for training wan first and last frame 2025-08-04 11:37:26 -06:00
Jaret Burkett ef1d60ba34 Update wan 2.2 5b timestep distribution to weighted. 2025-07-30 10:13:22 -06:00
Jaret Burkett 75f688766d Version bump 2025-07-29 09:30:54 -06:00
Jaret Burkett a558d5b68f Move transformer back to device on aggresive wan 2.2 pipeline after generation. 2025-07-29 09:13:47 -06:00
Jaret Burkett 1d1199b15b Fix bug that prevented training wan 2.2 with batch size greater than 1 2025-07-29 09:06:25 -06:00
Jaret Burkett f453e28ea3 Fixed deprecation of lumina pipeline error 2025-07-29 08:26:51 -06:00
Jaret Burkett ca7c5c950b Add support for Wan2.2 5B 2025-07-29 05:31:54 -06:00
Jaret Burkett e55116d8c9 Added hidream low vram options 2025-07-27 18:29:46 -06:00
Jaret Burkett 99705ec8be Add support in UI for Hidream E1 2025-07-27 18:13:36 -06:00
Jaret Burkett ed8d14225f Add ability to set the quantization type for text encoders and transformer in the ui 2025-07-27 18:00:53 -06:00
Jaret Burkett b717586ee2 Version bump 2025-07-27 15:13:28 -06:00
Jaret Burkett cefa2ca5fe Added initial support for Hidream E1 training 2025-07-27 15:12:56 -06:00
Jaret Burkett 3f518d9951 Add sharpening before losses with a split loss on vae training 2025-07-27 15:11:56 -06:00
Jaret Burkett 77dc38a574 Some work on caching text embeddings 2025-07-26 09:22:04 -06:00
Jaret Burkett 0d89c44624 Bug fixes on vae trainer. Allow to target params for vae training. 2025-07-26 09:20:22 -06:00
Jaret Burkett 3e14a674ac Fix upload progress for datasets in the ui 2025-07-26 09:07:30 -06:00
Jaret Burkett 523c159579 Add vram flag to some models in the ui 2025-07-24 07:02:46 -06:00
Jaret Burkett c5eb763342 Improvements to VAE trainer. Allow CLIP loss. 2025-07-24 06:50:56 -06:00
Jaret Burkett ca5cf827a1 Version bump 2025-07-20 12:20:46 -06:00
Jaret Burkett b1bff66d52 Merge pull request #343 from davertor/fix_kontext_bs
fix: Guidance incorrect shape
2025-07-20 12:00:55 -06:00
Jaret Burkett 8610c6ed7f Made it easy to add control images to the samples in the UI 2025-07-17 12:00:48 -06:00
Jaret Burkett e25d2feddf Use scale shift in vae latent space for vae trainer 2025-07-17 08:14:07 -06:00
Jaret Burkett f500b9f240 Add ability to do more advanced sample prompt objects to prepart for a UI rework on control images and other things. 2025-07-17 07:13:35 -06:00
Jaret Burkett 3916e67455 Scale target vae latent before targeting it 2025-07-17 07:12:21 -06:00
Jaret Burkett e5ed450dc7 Allow finetuning tiny autoencoder in vae trainer 2025-07-16 07:13:30 -06:00
Jaret Burkett 1930c3edea Fix naming with wan i2v new keys in lora 2025-07-14 07:34:01 -06:00
Jaret Burkett ef5149180c Switch i2v ui defaults to weighted 2025-07-12 21:30:04 -06:00
Jaret Burkett 998e8b6537 Bump version 2025-07-12 16:57:09 -06:00
Jaret Burkett 755f0e207c Fix issue with wan i2v scaling. Adjust aggressive loader to be compatable with updated diffusers. 2025-07-12 16:56:27 -06:00
Jaret Burkett 2e84b3d5b1 Update VAE trainer to handle fixed latent target. Also minor bug fixes and improvements 2025-07-12 16:55:15 -06:00
Jaret Burkett 7ab44ae0cd Fix issue with getting captions on runpod 2025-07-11 19:16:50 +00:00
Jaret Burkett 47002b067f Add path to image for datasets on the image card 2025-07-11 11:44:48 -06:00
Jaret Burkett 8537a8557f Add simple ui settings to train Wan i2v models. 2025-07-11 11:28:40 -06:00
Jaret Burkett 6e2beef8dd Version Bump 2025-07-09 13:55:33 -06:00
Jaret Burkett 611969ec1f Allow control image for omnigen training and sampling 2025-07-09 13:54:55 -06:00
Jaret Burkett bbb57de6ec Speed up omnigen TE loading 2025-07-05 09:32:00 -06:00
Jaret Burkett 5906a76666 Fixed issue with flux kontext forcing generation image sizes 2025-06-29 05:38:20 -06:00
Jaret Burkett 57a81bc0db Update base model version for kontext meta 2025-06-28 14:48:36 -06:00
Jaret Burkett 843be31138 Update readme changelog 2025-06-28 12:55:23 -06:00
Jaret Burkett 8fb01e96e4 Update sponsors 2025-06-28 10:05:17 -06:00
Jaret Burkett 01a3c8a9b1 Fix device issue 2025-06-26 19:14:25 -06:00
Jaret Burkett 4f91cb7148 Fix issue with gradient checkpointing and flux kontext 2025-06-26 19:03:12 -06:00
Jaret Burkett 446b0b6989 Remove revision for kontext 2025-06-26 16:46:58 -06:00
Jaret Burkett 60ef2f1df7 Added support for FLUX.1-Kontext-dev 2025-06-26 15:24:37 -06:00
Jaret Burkett 8d9c47316a Work on mean flow. Minor bug fixes. Omnigen improvements 2025-06-26 13:46:20 -06:00
Jaret Burkett 84c6edca7e Merge branch 'main' into dev 2025-06-25 14:10:25 -06:00
Jaret Burkett 24cd94929e Fix bug that can happen with fast processing dataset 2025-06-25 14:01:08 -06:00
Jaret Burkett 19ea8ecc38 Added support for finetuning OmniGen2. 2025-06-25 13:58:16 -06:00
Jaret Burkett 18513ec866 Merged in from main 2025-06-24 10:56:54 -06:00
Jaret Burkett 5e733764aa Update version 2025-06-24 10:37:13 -06:00
Jaret Burkett 03bc431279 Fixed an issue training lumina 2 2025-06-24 10:29:47 -06:00
Jaret Burkett f3eb1dff42 Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss 2025-06-24 08:51:29 -06:00
Jaret Burkett ba1274d99e Added a guidance burning loss. Modified DFE to work with new model. Bug fixes 2025-06-23 08:38:27 -06:00
Jaret Burkett 8602470952 Updated diffusion feature extractor 2025-06-19 15:36:10 -06:00
Jaret Burkett 4586eb5392 Added social links to sidebar 2025-06-17 13:25:24 -06:00
Jaret Burkett 989ebfaa11 Added a basic torch profiler that can be used in config during development to find some obvious issues. 2025-06-17 13:03:39 -06:00
Jaret Burkett ff617fdaea Started doing info bubble docs on the simple ui 2025-06-17 11:00:24 -06:00
Jaret Burkett 595a6f1735 Initial setup for a cron working on the ui for various tasks 2025-06-17 07:43:34 -06:00
Jaret Burkett 1cc663a664 Performance optimizations for pre processing the batch 2025-06-17 07:37:41 -06:00
Jaret Burkett 11f2eee53a Hide control images from ui image viewer 2025-06-16 07:18:43 -06:00
Jaret Burkett 1c2b7298dd More work on mean flow loss. Moved it to an adapter. Still not functioning properly though. 2025-06-16 07:17:35 -06:00
Jaret Burkett c0314ba325 Fixed some issues with training mean flow algo. Still testing WIP 2025-06-16 07:14:59 -06:00
Jaret Burkett cbf04b8d53 Fixed some issues with training mean flow algo. Still testing WIP 2025-06-14 12:24:00 -06:00