evan/ai-toolkit
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
604 Commits 2 Branches 0 Tags
9a902c067fc8205ee1ad86343cb0eead3344eea7
Commit Graph
50 Commits
Author SHA1 Message Date
Jaret Burkett e3373671b9 Fixed missing dependency 2025-03-21 06:25:30 -06:00
Jaret Burkett f5aa4232fa Added ability to quantize with torchao 2025-03-20 16:28:54 -06:00
Jaret Burkett b829983b16 Added ability to load video datasets and train with them 2025-03-19 09:54:26 -06:00
Jaret Burkett 391cf80fea Added training for Wan2.1. Not finalized, wait. 2025-03-07 13:53:44 -07:00
Jaret Burkett aa44828c0c WIP more work on cogview4 2025-03-05 09:43:00 -07:00
Jaret Burkett 6f6fb90812 Added cogview4. Loss still needs work. 2025-03-04 18:43:52 -07:00
Jaret Burkett f5e40dfa62 WIP on wan 2025-03-01 16:12:52 -07:00
Jaret Burkett acc79956aa WIP create new class to add new models more easily 2025-03-01 13:49:02 -07:00
Jaret Burkett 093f14ac19 UI Bug fixes and initial windows support 2025-02-24 08:15:22 -07:00
Jaret Burkett adcf884c0f Built out the ui trainer plugin with db comminication 2025-02-21 05:53:35 -07:00
Jaret Burkett 8450aca10e Fixed missed merge conflice and locked diffusers version 2025-02-12 09:40:02 -07:00
Jaret Burkett 4de6a825fa Update lumina requirements 2025-02-08 15:16:35 -07:00
Jaret Burkett 0e75724b4d Lock version of diffusers 2025-02-05 18:14:59 +00:00
Jaret Burkett 376bb1bf6f Lock torch version due to breaking changes 2025-02-04 23:00:57 +00:00
Jaret Burkett 0b048d0dde Locked version of quanto as it breaks in later versions 2024-10-16 22:41:04 +00:00
Jaret Burkett b4f64de4c2 Quick patch to scope xformer imports until a better solution 2024-09-28 15:36:42 -06:00
Jaret Burkett 2e5f6668dc Add xformers ad a dependency 2024-09-28 15:30:14 -06:00
Jaret Burkett d97c55cd96 Updated requirements to lock version of albucore, which had breaking changes. 2024-09-21 11:19:13 -06:00
apolinárioandmultimodalart f84bd6d7a6 Add Gradio UI for ai-toolkit (#141) 
* Add Gradio UI for FLUX.1

* small text changes

* no flash-attn? no problem!

* bye flash-attn!

* fixes for windows

---------

Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com>
 2024-08-30 06:29:51 -06:00
martintomov 34db804c76 Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115) 
* issue #76, load_checkpoint_and_dispatch() 'force_hooks'

https://github.com/ostris/ai-toolkit/issues/76

* RunPod cloud config

https://github.com/ostris/ai-toolkit/issues/90

* change 2x A40 to 1x A40 and price per hour

referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929

* include missed FLUX.1-schnell setup guide in last commit

* huggingface-cli login required auth

* #92 peft, #114 colab, schnell training in colab

* modal cloud - run_modal.py and .yaml configs

* run_modal.py mount path example

* modal_examples renamed to modal

* Training in Modal README.md setup guide

* rename run command in title for consistency
 2024-08-22 21:25:44 -06:00
martintomov 5603f9e004 issue #76, and RunPod cloud training setup #90 (#80) 
* issue #76, load_checkpoint_and_dispatch() 'force_hooks'

https://github.com/ostris/ai-toolkit/issues/76

* RunPod cloud config

https://github.com/ostris/ai-toolkit/issues/90

* change 2x A40 to 1x A40 and price per hour

referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929

* include missed FLUX.1-schnell setup guide in last commit

* huggingface-cli login required auth
 2024-08-18 15:43:45 -06:00
Jaret Burkett 88acc28d7f Prep for runpod docker 2024-08-03 12:41:06 -06:00
Jaret Burkett de2da96a81 Updat4ed requirements 2024-08-03 09:50:18 -06:00
Jaret Burkett acb06d6ff3 Bug fixes 2024-07-03 10:56:34 -06:00
Jaret Burkett 7165f2d25a Work to omprove pixart training 2024-06-23 20:46:48 +00:00
Jaret Burkett bd10d2d668 Some work on sd3 training. Not working 2024-06-13 12:19:16 -06:00
Jaret Burkett 3f3636b788 Bug fixes and little improvements here and there. 2024-06-08 06:24:20 -06:00
Jaret Burkett 5da3613e0b Bug fixes and minor features 2024-04-25 06:14:31 -06:00
Jaret Burkett 89f4bcad2e Lock diffusers to 0.26.3 until I can figure out why future versions break LoRA code 2024-03-18 10:17:55 -06:00
Jaret Burkett 0d5943af91 Update readme for torch requirements 2023-11-28 12:52:55 -07:00
Jaret Burkett be815f9c47 updated requirements 2023-11-28 10:43:17 -07:00
Jaret Burkett a899ec91c8 Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff. 2023-11-01 06:52:21 -06:00
Jaret Burkett 9636194c09 Added fuyu captioning 2023-10-25 14:14:53 -06:00
Jaret Burkett 34eb563d55 Added dataset tagging and management tools using llava 2023-10-24 10:11:47 -06:00
Jaret Burkett 8d9450ad7c Compatability fixes 2023-09-29 14:07:37 -06:00
Jaret Burkett 27f343fc08 Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps. 2023-09-16 08:30:38 -06:00
Jaret Burkett e8583860ad Upgraded to dev for t2i on diffusers. Minor migrations to make it work. 2023-09-11 14:46:06 -06:00
Jaret Burkett 3feb663a51 Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see 2023-09-07 13:06:18 -06:00
Jaret Burkett 2a40937b4f reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl 2023-09-03 07:56:09 -06:00
Jaret Burkett 1a92e97c6d Added missing deps 2023-08-13 13:15:04 -06:00
Jaret Burkett 64fbd4c92a Fix some windows dependency issues 2023-08-05 20:28:49 -06:00
Jaret Burkett b865ac8b24 Various windows bug fixes 2023-08-04 05:51:58 -06:00
Jaret Burkett 2305e55c82 Moving over to a highly difussers flow for xl 2023-07-26 18:25:01 -06:00
Jaret Burkett d3ad195b51 Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird 2023-07-26 16:19:50 -06:00
Jaret Burkett cb70c03273 SDXL should be working, but I broke something where it is not converging. 2023-07-25 13:50:59 -06:00
Jaret Burkett ddcd9069e1 Base for loopback lora training setup, still working on proper sliders 2023-07-21 18:26:02 -06:00
Jaret Burkett 6ada328d8d Fixed issues with vgg19 preprocessing. Added yaml support on config file 2023-07-19 06:12:57 -06:00
Jaret Burkett 439310e4dc Made a very basic vae trainer. 2023-07-17 19:03:50 -06:00
Jaret Burkett 57f14e5ef2 WIP implementing training 2023-07-12 08:23:46 -06:00
Jaret Burkett e4de8983c9 Initial commit 2023-07-05 16:44:58 -06:00