Commit Graph
31 Commits
Author SHA1 Message Date
martintomov 34db804c76 Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115)
* issue #76, load_checkpoint_and_dispatch() 'force_hooks'

https://github.com/ostris/ai-toolkit/issues/76

* RunPod cloud config

https://github.com/ostris/ai-toolkit/issues/90

* change 2x A40 to 1x A40 and price per hour

referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929

* include missed FLUX.1-schnell setup guide in last commit

* huggingface-cli login required auth

* #92 peft, #114 colab, schnell training in colab

* modal cloud - run_modal.py and .yaml configs

* run_modal.py mount path example

* modal_examples renamed to modal

* Training in Modal README.md setup guide

* rename run command in title for consistency
2024-08-22 21:25:44 -06:00
martintomov 5603f9e004 issue #76, and RunPod cloud training setup #90 (#80)
* issue #76, load_checkpoint_and_dispatch() 'force_hooks'

https://github.com/ostris/ai-toolkit/issues/76

* RunPod cloud config

https://github.com/ostris/ai-toolkit/issues/90

* change 2x A40 to 1x A40 and price per hour

referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929

* include missed FLUX.1-schnell setup guide in last commit

* huggingface-cli login required auth
2024-08-18 15:43:45 -06:00
Jaret Burkett 88acc28d7f Prep for runpod docker 2024-08-03 12:41:06 -06:00
Jaret Burkett de2da96a81 Updat4ed requirements 2024-08-03 09:50:18 -06:00
Jaret Burkett acb06d6ff3 Bug fixes 2024-07-03 10:56:34 -06:00
Jaret Burkett 7165f2d25a Work to omprove pixart training 2024-06-23 20:46:48 +00:00
Jaret Burkett bd10d2d668 Some work on sd3 training. Not working 2024-06-13 12:19:16 -06:00
Jaret Burkett 3f3636b788 Bug fixes and little improvements here and there. 2024-06-08 06:24:20 -06:00
Jaret Burkett 5da3613e0b Bug fixes and minor features 2024-04-25 06:14:31 -06:00
Jaret Burkett 89f4bcad2e Lock diffusers to 0.26.3 until I can figure out why future versions break LoRA code 2024-03-18 10:17:55 -06:00
Jaret Burkett 0d5943af91 Update readme for torch requirements 2023-11-28 12:52:55 -07:00
Jaret Burkett be815f9c47 updated requirements 2023-11-28 10:43:17 -07:00
Jaret Burkett a899ec91c8 Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff. 2023-11-01 06:52:21 -06:00
Jaret Burkett 9636194c09 Added fuyu captioning 2023-10-25 14:14:53 -06:00
Jaret Burkett 34eb563d55 Added dataset tagging and management tools using llava 2023-10-24 10:11:47 -06:00
Jaret Burkett 8d9450ad7c Compatability fixes 2023-09-29 14:07:37 -06:00
Jaret Burkett 27f343fc08 Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps. 2023-09-16 08:30:38 -06:00
Jaret Burkett e8583860ad Upgraded to dev for t2i on diffusers. Minor migrations to make it work. 2023-09-11 14:46:06 -06:00
Jaret Burkett 3feb663a51 Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see 2023-09-07 13:06:18 -06:00
Jaret Burkett 2a40937b4f reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl 2023-09-03 07:56:09 -06:00
Jaret Burkett 1a92e97c6d Added missing deps 2023-08-13 13:15:04 -06:00
Jaret Burkett 64fbd4c92a Fix some windows dependency issues 2023-08-05 20:28:49 -06:00
Jaret Burkett b865ac8b24 Various windows bug fixes 2023-08-04 05:51:58 -06:00
Jaret Burkett 2305e55c82 Moving over to a highly difussers flow for xl 2023-07-26 18:25:01 -06:00
Jaret Burkett d3ad195b51 Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird 2023-07-26 16:19:50 -06:00
Jaret Burkett cb70c03273 SDXL should be working, but I broke something where it is not converging. 2023-07-25 13:50:59 -06:00
Jaret Burkett ddcd9069e1 Base for loopback lora training setup, still working on proper sliders 2023-07-21 18:26:02 -06:00
Jaret Burkett 6ada328d8d Fixed issues with vgg19 preprocessing. Added yaml support on config file 2023-07-19 06:12:57 -06:00
Jaret Burkett 439310e4dc Made a very basic vae trainer. 2023-07-17 19:03:50 -06:00
Jaret Burkett 57f14e5ef2 WIP implementing training 2023-07-12 08:23:46 -06:00
Jaret Burkett e4de8983c9 Initial commit 2023-07-05 16:44:58 -06:00