Commit Graph

Select branches

Hide Pull Requests

evan_dev

main

Mono Color

• 6e19e7449e Fixed some issues with gpu info refreshing Jaret Burkett 2025-02-22 14:14:23 -07:00
• a6d46ad9ae Cleanup of job page Jaret Burkett 2025-02-22 13:54:06 -07:00
• f3725578dd Cleaned up dashboard Jaret Burkett 2025-02-22 13:23:26 -07:00
• ed99c3c0c8 Moved gpu to its own widget Jaret Burkett 2025-02-22 12:43:20 -07:00
• ed84c19205 Moved the job action bar to a shred component Jaret Burkett 2025-02-22 12:20:14 -07:00
• a7a9c11d9e Fixed add image dropbox Jaret Burkett 2025-02-22 11:59:21 -07:00
• f60698d0ee Fixed some bugs with ui and lock job name to prevent issues with continuing training. Jaret Burkett 2025-02-22 11:49:36 -07:00
• 5f094fb17a Added controls to the jobs table Jaret Burkett 2025-02-22 10:57:53 -07:00
• a5227cba7b Switched to a universal table library Jaret Burkett 2025-02-22 09:59:17 -07:00
• 77a5e01301 Added proper icon Jaret Burkett 2025-02-22 09:05:55 -07:00
• 4ef5a668c0 Make left arrow browsing only hit last image max Jaret Burkett 2025-02-21 22:04:53 -07:00
• f081d14527 Preview samples full screen and use arrow keys to navigate them Jaret Burkett 2025-02-21 21:52:24 -07:00
• 710c6de1c9 Samples work in ui now Jaret Burkett 2025-02-21 20:28:52 -07:00
• 2b6e66e0cb Mor ui work Jaret Burkett 2025-02-21 12:40:17 -07:00
• ab641e014f Added funding github stuff Jaret Burkett 2025-02-21 17:13:36 +00:00
• ad87f72384 Start, stop, monitor jobs from ui working. Jaret Burkett 2025-02-21 09:49:28 -07:00
• d0214c0df9 Make ui more uniform Jaret Burkett 2025-02-21 06:18:27 -07:00
• adcf884c0f Built out the ui trainer plugin with db comminication Jaret Burkett 2025-02-21 05:53:35 -07:00
• f778d979b5 Saving captions is working Jaret Burkett 2025-02-20 16:17:00 -07:00
• db3ccbba33 Handle image deletion Jaret Burkett 2025-02-20 15:58:10 -07:00
• 0d2be18a9b Delete datasets Jaret Burkett 2025-02-20 14:49:03 -07:00
• bbc340e545 Cleanup and add hooks Jaret Burkett 2025-02-20 13:38:58 -07:00
• 33fdfd6091 Added beginning or lokr Jaret Burkett 2025-02-20 12:47:42 -07:00
• 9f6030620f Dataset uploads working Jaret Burkett 2025-02-20 12:47:01 -07:00
• b5252b5028 More ui work Jaret Burkett 2025-02-20 11:19:01 -07:00
• b0d8fc220d More ui more ui Jaret Burkett 2025-02-19 20:54:02 -07:00
• cef7d9e594 Config ui section is coming along Jaret Burkett 2025-02-19 07:52:24 -07:00
• b13fcc1039 Setup a very basic ui Jaret Burkett 2025-02-18 10:57:14 -07:00
• b32d7e552b Shamelessly beg for money Jaret Burkett 2025-02-18 05:15:29 -07:00
• 4af6c5cf30 Work on supporting flex.2 potential arch Jaret Burkett 2025-02-17 14:10:25 -07:00
• 1f7784510d WIP Flex 2 pipeline Jaret Burkett 2025-02-16 14:54:29 -07:00
• 87e557cf1e Bug fixes and improvements to llmadapter Jaret Burkett 2025-02-15 07:18:07 -07:00
• bd8d7dc081 fixed various issues with llm attention masking. Added block training on the llm adapter. Jaret Burkett 2025-02-14 11:24:01 -07:00
• 2be6926398 Added back syustem prompt for llm and remove those tokens from the embeddings Jaret Burkett 2025-02-14 07:23:37 -07:00
• 87ac031859 Remove system prompt, shouldnt be necessary fo rhow it works. Jaret Burkett 2025-02-13 08:42:48 -07:00
• 7679105d52 Added llm text encoder adapter Jaret Burkett 2025-02-13 08:28:32 -07:00
• 2622de1e01 DFE tweaks. Adding support for more llms as text encoders Jaret Burkett 2025-02-13 04:31:49 -07:00
• 8450aca10e Fixed missed merge conflice and locked diffusers version Jaret Burkett 2025-02-12 09:40:02 -07:00
• 0b8a32def7 merged in lumina2 branch Jaret Burkett 2025-02-12 09:33:03 -07:00
• 787bb37e76 Small fixed for DFE, polar guidance, and other things Jaret Burkett 2025-02-12 09:27:44 -07:00
• 10aa7e9d5e Fixed some breaking changes with diffusers gradient checkpointing. Jaret Burkett 2025-02-10 09:35:31 -07:00
• ed1deb71c4 Added examples for training lumina2 Jaret Burkett 2025-02-08 16:13:18 -07:00
• 4de6a825fa Update lumina requirements Jaret Burkett 2025-02-08 15:16:35 -07:00
• 9a7266275d Wokr on lumina2 Jaret Burkett 2025-02-08 14:52:39 -07:00
• d138f07365 Imitial lumina3 support Jaret Burkett 2025-02-08 10:59:53 -07:00
• c6d8eedb94 Added ability to use consistent noise for each image in a dataset by hashing the path and using that as a seed. Jaret Burkett 2025-02-08 07:13:48 -07:00
• af5e760be1 Merge pull request #249 from ostris/accelerate-multi-gpu Jaret Burkett 2025-02-08 07:11:10 -07:00
• ff3d54bb5b Make the mean of the mask multiplier be 1.0 for a more balanced loss. Jaret Burkett 2025-02-06 10:57:06 +00:00
• 0e75724b4d Lock version of diffusers Jaret Burkett 2025-02-05 18:14:59 +00:00
• 376bb1bf6f Lock torch version due to breaking changes Jaret Burkett 2025-02-04 23:00:57 +00:00
• 216ab164ce Experimental features and bug fixes Jaret Burkett 2025-02-04 13:36:34 -07:00
• e6180d1e1d Bug fixes Jaret Burkett 2025-01-31 13:23:01 -07:00
• 15a57bc89f Add new version of DFE. Kitchen sink Jaret Burkett 2025-01-31 11:42:27 -07:00
• e5355bf8d5 Added train catch to the blank network Jaret Burkett 2025-01-30 16:15:45 +00:00
• 34a1c6947a Added flux_shift as timestep type Jaret Burkett 2025-01-27 07:35:00 -07:00
• 2141c6e06c Merge remote-tracking branch 'origin/main' into accelerate-multi-gpu Jaret Burkett 2025-01-26 11:19:34 -07:00
• 1188cf1e8a Adjust flux sample sampler to handle some new breaking changes in diffusers. Jaret Burkett 2025-01-26 18:09:21 +00:00
• 5e663746b8 Working multi gpu training. Still need a lot of tweaks and testing. Jaret Burkett 2025-01-25 16:46:20 -07:00
• 441474e81f Added a flag to lora extraction script to do a full transformer extraction. Jaret Burkett 2025-01-24 09:34:13 -07:00
• a6a690f796 Update full fine tune example to only train transformer blocks. Jaret Burkett 2025-01-24 09:28:34 -07:00
• 6191f19e55 Added script to convert diffusers model to ComfyUI variant Jaret Burkett 2025-01-23 21:30:23 -07:00
• bbfba0c188 Added v2 of dfp Jaret Burkett 2025-01-22 16:32:13 -07:00
• e1549ad54d Update dfe model arch Jaret Burkett 2025-01-22 10:37:23 -07:00
• 04abe57c76 Added weighing to DFE Jaret Burkett 2025-01-22 08:50:57 -07:00
• 89dd041b97 Added ability to pair samples with a closer noise with optimal_noise_pairing_samples Jaret Burkett 2025-01-21 18:30:10 -07:00
• 29122b1a54 Added code to handle diffusion feature extraction loss Jaret Burkett 2025-01-21 14:21:34 -07:00
• 6a8e3d8610 Added a config file for full finetuning flex. Added a lora extraction script for flex Jaret Burkett 2025-01-20 10:09:01 -07:00
• 4c8a9e1b88 Added example config to train Flex Jaret Burkett 2025-01-18 18:03:20 -07:00
• fadb2f3a76 Allow quantizing the te independently on flux. added lognorm_blend timestep schedule Jaret Burkett 2025-01-18 18:02:31 -07:00
• 4723f23c0d Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules. Jaret Burkett 2024-12-31 07:06:55 -07:00
• 8ef07a9c36 Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications Jaret Burkett 2024-12-15 08:59:27 -07:00
• 92ce93140e Adjustments to defaults for automagic Jaret Burkett 2024-11-29 10:28:06 -07:00
• f213996aa5 Fixed saving and displaying for automagic Jaret Burkett 2024-11-29 08:00:22 -07:00
• cbe31eaf0a Initial work on a auto adjusting optimizer Jaret Burkett 2024-11-29 04:48:58 -07:00
• 67c2e44edb Added support for training flux redux adapters Jaret Burkett 2024-11-21 20:01:52 -07:00
• 96d418bb95 Added support for full finetuning flux with randomized param activation. Examples coming soon Jaret Burkett 2024-11-21 13:05:32 -07:00
• 894374b2e9 Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use) Jaret Burkett 2024-11-20 09:16:55 -07:00
• 6509ba4484 Fix seed generation to make it deterministic so it is consistant from gpu to gpu Jaret Burkett 2024-11-15 12:11:13 -07:00
• 025ee3dd3d Added ability for adafactor to fully fine tune quantized model. Jaret Burkett 2024-10-30 16:38:07 -06:00
• 58f9d01c2b Added adafactor implementation that handles stochastic rounding of update and accumulation Jaret Burkett 2024-10-30 05:25:57 -06:00
• e72b59a8e9 Added experimental 8bit version of prodigy with stochastic rounding and stochastic gradient accumulation. Still testing. Jaret Burkett 2024-10-29 14:28:28 -06:00
• 4aa19b5c1d Only quantize flux T5 is also quantizing model. Load TE from original name and path if fine tuning. Jaret Burkett 2024-10-29 14:25:31 -06:00
• 4747716867 Fixed issue with adapters not providing gradients with new grad activator Jaret Burkett 2024-10-29 14:22:10 -06:00
• 22cd40d7b9 Improvements for full tuning flux. Added debugging launch config for vscode Jaret Burkett 2024-10-29 04:54:08 -06:00
• 3400882a80 Added preliminary support for SD3.5-large lora training Jaret Burkett 2024-10-22 12:21:36 -06:00
• 9f94c7b61e Added experimental param multiplier to the ema module Jaret Burkett 2024-10-22 09:25:52 -06:00
• bedb8197a2 Fixed issue with sizes for some images being loaded sideways resulting in squished images. Jaret Burkett 2024-10-20 11:51:29 -06:00
• e3ebd73610 Add a projection layer on vision direct when doing image embeds Jaret Burkett 2024-10-20 10:48:23 -06:00
• dd931757cd Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2024-10-20 07:04:29 -06:00
• 0640cdf569 Handle errors in loading size database Jaret Burkett 2024-10-20 07:04:19 -06:00
• 0b048d0dde Locked version of quanto as it breaks in later versions Jaret Burkett 2024-10-16 22:41:04 +00:00
• 473d455f44 Process empty clip image if there is not one for reg images when training a custom adapter Jaret Burkett 2024-10-15 08:28:04 -06:00
• ce759ebd8c Normalize the image embeddings on vd adapter forward Jaret Burkett 2024-10-12 15:09:48 +00:00
• 628a7923a3 Remove norm on image embeds on custom adapter Jaret Burkett 2024-10-12 00:43:18 +00:00
• 3922981996 Added some additional experimental things to the vision direct encoder Jaret Burkett 2024-10-10 19:42:26 +00:00
• ab22674980 Allow for a default caption file in the folder. Minor bug fixes. Jaret Burkett 2024-10-10 07:31:33 -06:00
• 9452929300 Apply a mask to the embeds for SD if using T5 encoder Jaret Burkett 2024-10-04 10:55:20 -06:00
• a800c9d19e Add a method to have an inference only lora Jaret Burkett 2024-10-04 10:06:53 -06:00
• 28e6f00790 Fixed bug in returning clip image embed to actually return it Jaret Burkett 2024-10-03 10:49:09 -06:00
• 67e0aca750 Added ability to load clip pairs randomly from folder. Other small bug fixes Jaret Burkett 2024-10-03 10:03:49 -06:00