Commit Graph
100 Commits
Author SHA1 Message Date
Jaret Burkett 1d5f387f54 Fix docker command to work better with runpod 2025-03-27 17:44:46 -06:00
Jaret Burkett 5365200da1 Added ability to add models to finetune as plugins. Also added flux2 new arch via that method. 2025-03-27 16:07:00 -06:00
Jaret Burkett e9e30104d3 Merge pull request #271 from ostris/wavelet_loss
Added experimental wavelet loss
2025-03-26 19:12:09 -06:00
Jaret Burkett ce4c5291a0 Added experimental wavelet loss 2025-03-26 18:11:23 -06:00
Jaret Burkett c101f07834 Version bump 2025-03-26 12:16:01 -06:00
Jaret Burkett e4526ad4a4 Updates to handle video in a dataset on ui 2025-03-26 12:15:28 -06:00
Jaret Burkett 4595965e06 Added an inpainting mask generator for training inpainting if inpaint mask is not provided 2025-03-25 12:16:10 -06:00
Jaret Burkett 41edc18750 Removed unnessary import 2025-03-25 11:54:42 -06:00
Jaret Burkett 6021a3dbc0 Change inpainting mask to zero out on latents instead of image for inpaint area. 2025-03-24 14:16:52 -06:00
Jaret Burkett 71d7a52146 Fixed issue with python being wrong on docker 2025-03-24 14:16:09 -06:00
Jaret Burkett 45be82d5d6 Handle inpainting training for control_lora adapter 2025-03-24 13:17:47 -06:00
Jaret Burkett f10937e6da Handle multi control inputs for control lora training 2025-03-23 07:37:08 -06:00
Jaret Burkett ccb66c748f Update readme install directions 2025-03-22 15:14:04 -06:00
Jaret Burkett 2aca2883e7 Update windows install directions for new version of torch 2025-03-22 15:12:51 -06:00
Jaret Burkett 1ad58c5816 Changed control lora to only have new weights and leave other input weights alone for more flexability of using multiple ones together. 2025-03-22 10:24:52 -06:00
Jaret Burkett 6dea41b9fc Version bump 2025-03-21 11:48:03 -06:00
Jaret Burkett 9a902c067f Show the console log on the job overview in the ui. 2025-03-21 11:45:36 -06:00
Jaret Burkett 0bbc69c135 Fix issue where the job would hang in the ui if it failed to start 2025-03-21 09:46:41 -06:00
Jaret Burkett 6c5eb0cf87 Move pytorch install above cache bust to prevent reinstalling and reuploading it 2025-03-21 06:43:09 -06:00
Jaret Burkett e3373671b9 Fixed missing dependency 2025-03-21 06:25:30 -06:00
Jaret Burkett aceb3a0f25 Rework docker 2025-03-20 20:07:27 -06:00
Jaret Burkett c8049a483d Fix issue with auth token not on build time 2025-03-20 17:27:30 -06:00
Jaret Burkett f5aa4232fa Added ability to quantize with torchao 2025-03-20 16:28:54 -06:00
Jaret Burkett 3a6b24f4c8 Added a way to secure the UI. Plus various bug fixes and quality of life updates 2025-03-20 08:07:09 -06:00
Jaret Burkett bbfd6ef0fe Fixed bug that prevented using schnell training adapter 2025-03-19 10:25:12 -06:00
Jaret Burkett b829983b16 Added ability to load video datasets and train with them 2025-03-19 09:54:26 -06:00
Jaret Burkett fa187b1208 Added differential masking to targeted_flow_guidance to allow the model learn to clean up the targeted area a little more than unmasked was capable of 2025-03-17 13:25:01 -06:00
Jaret Burkett 5eb627dd9d Add targeted flow guidance training for flow based models 2025-03-17 09:21:23 -06:00
Jaret Burkett 604e76d34d Fix issue with full finetuning wan 2025-03-17 09:17:40 -06:00
Jaret Burkett 6cde96ae5f Adding files I forgot to stage to the last commit 2025-03-15 11:59:41 -06:00
Jaret Burkett 1be613ed06 Added advanced mode yaml editor to the ui 2025-03-15 11:58:59 -06:00
Jaret Burkett c52421aab7 Allow clip image to not have processor on dataloader for raw img 2025-03-15 08:27:54 -06:00
Jaret Burkett 3812957bc9 Added ability to train control loras. Other important bug fixes thrown in 2025-03-14 18:03:00 -06:00
Jaret Burkett 391329dbdc Fix issue with device placement on te 2025-03-13 20:48:12 -06:00
Jaret Burkett 3b45892b4f Update sponsors 2025-03-13 19:06:59 -06:00
Jaret Burkett cf4216e6b8 Add support for wan training in ui 2025-03-13 18:54:27 -06:00
Jaret Burkett 31e057d9a3 Fixed issue with device placement in some scenereos when doing low vram on wan 2025-03-13 10:30:27 -06:00
Jaret Burkett d507b44a7b Update sponsors 2025-03-08 22:28:20 -07:00
Jaret Burkett 242c04a0b8 Fix error with training video models with batch greater than 1 2025-03-08 18:47:27 -07:00
Jaret Burkett 386e68a422 Fixed a bug that changes all samples to webp 2025-03-08 18:02:56 -07:00
Jaret Burkett 850b8da6e5 Added siglip 2 vision encoder for custom adapter 2025-03-09 00:14:44 +00:00
Jaret Burkett 51ad19b568 Add config file examples for training Wan LoRAs on 24GB cards. 2025-03-08 13:56:21 -07:00
Jaret Burkett e6739f7eb2 Convert wan lora weights on save to be something comfy can handle 2025-03-08 12:55:11 -07:00
Jaret Burkett 7e37918fbc Double tap module casting as it doesent seem to happen every time. 2025-03-07 22:15:24 -07:00
Jaret Burkett 4d88f8f218 Fixed cuda error when not all tensors have been moved to the correct device. 2025-03-07 22:04:35 -07:00
Jaret Burkett 25341c4613 Got wan 14b training to work on 24GB card. 2025-03-07 17:04:10 -07:00
Jaret Burkett 391cf80fea Added training for Wan2.1. Not finalized, wait. 2025-03-07 13:53:44 -07:00
Jaret Burkett 4e3bda7c70 Merge pull request #264 from ostris/cogview4
Added basics for CogView4. Broken as hell though. Dont use.
2025-03-05 14:52:06 -07:00
Jaret Burkett 763128ea42 Note about cogview 2025-03-05 14:46:11 -07:00
Jaret Burkett 4fe33f51c1 Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4 2025-03-05 13:44:40 -07:00
Jaret Burkett aa44828c0c WIP more work on cogview4 2025-03-05 09:43:00 -07:00
Jaret Burkett 6f6fb90812 Added cogview4. Loss still needs work. 2025-03-04 18:43:52 -07:00
Jaret Burkett c57434ad7b Removed wan submodule stuff for now 2025-03-04 00:32:24 -07:00
Jaret Burkett 8bb47d1bfe Merge branch 'main' into wan21 2025-03-04 00:31:57 -07:00
Jaret Burkett e7dbb20f68 Removed wan submodule for now 2025-03-04 00:29:19 -07:00
Jaret Burkett c5e0c2bbe2 Fixes to allow for redux assisted training 2025-03-03 16:27:19 -07:00
Jaret Burkett 1f3f45a48d Bugfixes 2025-03-03 08:22:15 -07:00
Jaret Burkett 3c8c84f156 Added supporters to readme and a script to update it 2025-03-02 10:25:27 -07:00
Jaret Burkett b001d77efb Added LoKr instructions to the readme 2025-03-02 08:55:56 -07:00
Jaret Burkett 7ae31c9ae9 Added LoKr to the ui 2025-03-02 08:49:01 -07:00
Jaret Burkett b16819f8e7 Added LoKr support 2025-03-02 06:57:50 -07:00
Jaret Burkett f5e40dfa62 WIP on wan 2025-03-01 16:12:52 -07:00
Jaret Burkett acc79956aa WIP create new class to add new models more easily 2025-03-01 13:49:02 -07:00
Jaret Burkett 60539c0b0f Allow using prior loss with a custom adapter 2025-03-01 08:01:14 -07:00
Jaret Burkett dd700f70b3 Avoid loading state dict for automagic for now until I can sort out some issues 2025-02-26 17:03:14 -07:00
Jaret Burkett d360e76661 fixed issue with dop prompt replacement 2025-02-26 13:35:18 -07:00
Jaret Burkett 6ec23ed226 Fixed issue when doing inverted masked prior with flowmatching algos 2025-02-26 12:12:32 -07:00
Jaret Burkett f6e16e582a Added Differential Output Preservation Loss to trainer and ui 2025-02-25 20:12:36 -07:00
Jaret Burkett 259ded9602 Fixed issue with trigger word saving in ui 2025-02-24 11:04:24 -07:00
Jaret Burkett 440ba5fb3d Spawn windows in an cmd terminal. Should be working now, but not sure on my system 2025-02-24 08:54:56 -07:00
Jaret Burkett 093f14ac19 UI Bug fixes and initial windows support 2025-02-24 08:15:22 -07:00
Jaret Burkett f0fbd8bb53 Merge pull request #256 from ostris/ui
Added AI-Toolkit UI
2025-02-23 16:10:49 -07:00
Jaret Burkett 0a981bea2b Fixed typo 2025-02-23 16:07:38 -07:00
Jaret Burkett 1d0e3a4498 Fixed some build issues for now. Added info to the readme 2025-02-23 15:59:17 -07:00
Jaret Burkett 3c7daf49f3 Add HF token to env when spawing via ui 2025-02-23 14:52:12 -07:00
Jaret Burkett 56d8d6bd81 Capture speed from the timer for the ui 2025-02-23 14:38:46 -07:00
Jaret Burkett 3e49337a58 Set step to the last step saved at when exiting 2025-02-23 13:21:22 -07:00
Jaret Burkett 60f848a877 Send more data when loading the model to the ui 2025-02-23 12:49:54 -07:00
Jaret Burkett b366e46f1c Added more settings to the training config 2025-02-23 12:34:52 -07:00
Jaret Burkett a280f78c69 Added checkpoint downloader 2025-02-22 16:48:15 -07:00
Jaret Burkett 6e19e7449e Fixed some issues with gpu info refreshing 2025-02-22 14:14:23 -07:00
Jaret Burkett a6d46ad9ae Cleanup of job page 2025-02-22 13:54:06 -07:00
Jaret Burkett f3725578dd Cleaned up dashboard 2025-02-22 13:23:26 -07:00
Jaret Burkett ed99c3c0c8 Moved gpu to its own widget 2025-02-22 12:43:20 -07:00
Jaret Burkett ed84c19205 Moved the job action bar to a shred component 2025-02-22 12:20:14 -07:00
Jaret Burkett a7a9c11d9e Fixed add image dropbox 2025-02-22 11:59:21 -07:00
Jaret Burkett f60698d0ee Fixed some bugs with ui and lock job name to prevent issues with continuing training. 2025-02-22 11:49:36 -07:00
Jaret Burkett 5f094fb17a Added controls to the jobs table 2025-02-22 10:57:53 -07:00
Jaret Burkett a5227cba7b Switched to a universal table library 2025-02-22 09:59:17 -07:00
Jaret Burkett 77a5e01301 Added proper icon 2025-02-22 09:05:55 -07:00
Jaret Burkett 4ef5a668c0 Make left arrow browsing only hit last image max 2025-02-21 22:04:53 -07:00
Jaret Burkett f081d14527 Preview samples full screen and use arrow keys to navigate them 2025-02-21 21:52:24 -07:00
Jaret Burkett 710c6de1c9 Samples work in ui now 2025-02-21 20:28:52 -07:00
Jaret Burkett 2b6e66e0cb Mor ui work 2025-02-21 12:40:17 -07:00
Jaret Burkett ab641e014f Added funding github stuff 2025-02-21 17:13:36 +00:00
Jaret Burkett ad87f72384 Start, stop, monitor jobs from ui working. 2025-02-21 09:49:28 -07:00
Jaret Burkett d0214c0df9 Make ui more uniform 2025-02-21 06:18:27 -07:00
Jaret Burkett adcf884c0f Built out the ui trainer plugin with db comminication 2025-02-21 05:53:35 -07:00
Jaret Burkett f778d979b5 Saving captions is working 2025-02-20 16:17:00 -07:00
Jaret Burkett db3ccbba33 Handle image deletion 2025-02-20 15:58:10 -07:00