evan/ai-toolkit
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
138 Commits 2 Branches 0 Tags
408c50ead13cf61bfba21aa76ea2a09b17e85936
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jaret Burkett 408c50ead1 actually got gradient checkpointing working, again, again, maybe 2023-09-09 11:27:42 -06:00
Jaret Burkett 4ed03a8d92 Fixed issue with buckets scaling. again 2023-09-08 16:32:14 -06:00
Jaret Burkett b01ab5d375 FINALLY fixed gradient checkpointing issue. Big batches baby. 2023-09-08 15:21:46 -06:00
Jaret Burkett cb91b0d6da Changed model download from HF to fp16 2023-09-08 07:57:19 -06:00
Jaret Burkett ce4f9fe02a Bug fixes and improvements to token injection 2023-09-08 06:10:59 -06:00
Jaret Burkett 92a086d5a5 Fixed issue with token replacements 2023-09-07 13:42:39 -06:00
Jaret Burkett 3feb663a51 Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see 2023-09-07 13:06:18 -06:00
Jaret Burkett 436bf0c6a3 Added experimental concept replacer, replicate converter, bucket maker, and other goodies 2023-09-06 18:50:32 -06:00
Jaret Burkett f84500159c Fixed issue with lora layer check 2023-09-04 14:27:37 -06:00
Jaret Burkett 64a5441832 Fully tested and now supporting locon on sdxl. If you have the ram 2023-09-04 14:05:10 -06:00
Jaret Burkett a4c3507a62 Added LoCON from LyCORIS 2023-09-04 08:48:07 -06:00
Jaret Burkett fa8fc32c0a Corrected key saving and loading to better match kohya 2023-09-04 00:22:34 -06:00
Jaret Burkett 22ed539321 Allow special args for schedulers 2023-09-03 20:38:44 -06:00
Jaret Burkett 7cd6945082 Added my annotator/preprocessor and improved network jitter on reference trainer 2023-09-03 16:43:51 -06:00
Jaret Burkett 2a40937b4f reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl 2023-09-03 07:56:09 -06:00
Jaret Burkett 4ca819a05e Fixes for dataloader 2023-08-31 04:54:10 -06:00
Jaret Burkett addf024630 Fixed issue with omitting square pictures 2023-08-30 15:00:22 -06:00
Jaret Burkett 33267e117c Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant 2023-08-30 14:52:12 -06:00
Jaret Burkett d401348c2e Make data loader resiliant to bad headers in meta 2023-08-29 18:56:06 -06:00
Jaret Burkett 836fee47a6 Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol 2023-08-29 15:20:03 -06:00
Jaret Burkett 14ff51ceb4 fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving. 2023-08-29 12:31:19 -06:00
Jaret Burkett 714854ee86 Hude rework to move the batch to a DTO to make it far more modular to the future ui 2023-08-29 10:22:19 -06:00
Jaret Burkett bd758ff203 Cleanup and small bug fixes 2023-08-29 05:45:49 -06:00
Jaret Burkett a008d9e63b Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum 2023-08-28 17:56:30 -06:00
Jaret Burkett b79ced3e10 Merge branch 'main' into development 2023-08-28 16:21:51 -06:00
Jaret Burkett bee0b6a235 Added converters for all stable diffusion models to convert back to ldm format from diffusers. 2023-08-28 16:12:32 -06:00
Jaret Burkett 2ecb5cf024 Merge branch 'main' into development 2023-08-28 14:01:44 -06:00
Jaret Burkett fab7c2b04a Fixed issue with key mapping from diffusers back to ldm 2023-08-28 14:01:26 -06:00
Jaret Burkett e866c75638 Built base interfaces for a DTO to handle batch infomation transports for the dataloader 2023-08-28 12:43:31 -06:00
Jaret Burkett 71da78c8af improved normalization for a network with varrying batch network weights 2023-08-28 12:42:57 -06:00
Jaret Burkett c446f768ea Huge memory optimizations, many big fixes 2023-08-27 17:48:02 -06:00
Jaret Burkett cc49786ee9 Dataloader bug fixes 2023-08-27 14:36:38 -06:00
Jaret Burkett 9b164a8688 Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs 2023-08-27 09:40:01 -06:00
Jaret Burkett 6bd3851058 Fixed issue with prompt token replace adding more than one replacement 2023-08-26 18:52:23 -06:00
Jaret Burkett fd338e67bb Fixed bug with dataloader not seperating mulitple datasets 2023-08-26 18:07:24 -06:00
Jaret Burkett 8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice 2023-08-26 16:36:32 -06:00
Jaret Burkett 2cb27c3f57 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-26 08:55:09 -06:00
Jaret Burkett 3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling 2023-08-26 08:55:00 -06:00
Jaret Burkett 24f46ea7d6 Merge pull request #9 from FoundSol/patch-1 
Update README.md
 2023-08-25 20:05:51 -06:00
Jaret Burkett aeaca13d69 Fixed issue with shuffeling permutations 2023-08-23 22:02:00 -06:00
Jaret Burkett b408f9f3eb Fixed issue with timestep I broke for sliders 2023-08-23 16:15:30 -06:00
Jaret Burkett 7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs 2023-08-23 15:37:00 -06:00
Jaret Burkett e2c547f6c2 Fixed typo 2023-08-23 13:33:48 -06:00
Jaret Burkett 7b770bc305 Merge pull request #7 from ostris/textual_inversion 
Textual inversion training
 2023-08-23 13:31:37 -06:00
Jaret Burkett f200cf36c5 Added train example to ti 2023-08-23 13:30:29 -06:00
Jaret Burkett d298240cec Tied in ant tested TI script 2023-08-23 13:26:28 -06:00
Jaret Burkett 2e6c55c720 WIP creating textual inversion training script 2023-08-22 21:02:38 -06:00
Jaret Burkett 36ba08d3fa Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly 2023-08-21 16:22:01 -06:00
Jaret Burkett e8667f856f Fix issue with there being an extra . on gene 2023-08-20 15:54:38 -06:00
Jaret Burkett bef5551ea5 Ultimate slider training built, still needs tuning 2023-08-19 18:54:34 -06:00
Jaret Burkett b77b9acc0b Added base for ultimate slider. WIP 2023-08-19 15:35:24 -06:00
Jaret Burkett c6675e2801 Added shuffeling to prompts 2023-08-19 07:57:30 -06:00
Jaret Burkett 90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun 2023-08-19 05:54:22 -06:00
Jaret Burkett 80e2f4a2a4 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-18 11:45:00 -06:00
Jaret Burkett d51c4ca704 Added ability to use two seperate folders for datasets when doing image reference sliders 2023-08-18 11:44:33 -06:00
Jaret Burkett c7ec132d5d third times a charm 2023-08-16 20:54:00 -06:00
Jaret Burkett ed9607e8da Update SliderTraining.ipynb 
I should be doing this the right way
 2023-08-16 20:49:09 -06:00
Jaret Burkett d44f8ac508 Update SliderTraining.ipynb 
fixed code block
 2023-08-16 20:47:56 -06:00
Jaret Burkett 8d09eb44ec Fixed an issue with CFG time embeds on SDXL 2023-08-15 18:02:14 -06:00
Jaret Burkett 55a5fcc7d9 Added method to get specific keys from model 2023-08-15 14:51:04 -06:00
Jaret Burkett e96874241d Added slider colab to readme 2023-08-13 13:55:38 -06:00
Jaret Burkett e3be1a1758 Added WIP slider training colab 2023-08-13 13:52:38 -06:00
Jaret Burkett 1a92e97c6d Added missing deps 2023-08-13 13:15:04 -06:00
Jaret Burkett 355c80df07 Added ability to use civit ai url ar model name and built a model downloader and cache manager for it 2023-08-13 13:09:51 -06:00
Jaret Burkett 1487d13191 Moved the run job command 2023-08-13 10:25:56 -06:00
Jaret Burkett 383bad958d Added a way to run as a library by passing job dict 2023-08-13 09:54:39 -06:00
Jaret Burkett 196b693cf0 Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though 2023-08-12 17:59:24 -06:00
Jaret Burkett fd95e7b60c Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-12 05:59:58 -06:00
Jaret Burkett 379992d89e Various bug fixes and improvements 2023-08-12 05:59:50 -06:00
Jaret Burkett c7054d714f Finally muted the annoying safety checker notification 2023-08-12 01:38:18 -06:00
Jaret Burkett 67dfd9ced0 Added inbuild plugins and made one for image referenced. WIP 2023-08-10 16:20:38 -06:00
Jaret Burkett 1a7e346b41 Added inbuild plugins and made one for image referenced. WIP 2023-08-10 16:02:44 -06:00
Jaret Burkett df48f0a843 Moved some of the job config into base process so it will be easier to extend extensions 2023-08-10 12:14:05 -06:00
Jaret Burkett fbc8a87a05 Reworked the sd rescaler script 2023-08-09 08:57:27 -06:00
Jaret Burkett bf90740b59 Fixed numerous issues with traing ESRGAN 2023-08-08 20:03:19 -06:00
Jaret Burkett ff2c9f3d04 Merge branch 'main' of github.com:ostris/ai-toolkit 2023-08-07 18:05:03 -06:00
Jaret Burkett 8bd536df7e Added training for a custom version of ERSGAN arcitecture. Testing training now 2023-08-07 18:04:23 -06:00
Jaret Burkett 64fbd4c92a Fix some windows dependency issues 2023-08-05 20:28:49 -06:00
Jaret Burkett 8c90fa86c6 Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take 2023-08-05 18:46:08 -06:00
Jaret Burkett 7e4e660663 Added extensions and an example extension that merges models 2023-08-04 09:37:24 -06:00
Jaret Burkett b865ac8b24 Various windows bug fixes 2023-08-04 05:51:58 -06:00
Jaret Burkett 66c6f0f6f7 Big refactor of SD runner and added image generator 2023-08-03 14:51:25 -06:00
Jaret Burkett 75ec5d9292 Hotfix to handle latest transformers clip model missing key suddenly 2023-08-02 12:26:18 -06:00
Jaret Burkett 1a25b275c8 Did some work on SD rescaler. Need to run a long test on it eventually. 2023-08-02 07:59:27 -06:00
Jaret Burkett 2bf3e529ce Set gradient checkpointing on unet enabled by default. Help out immensly with sdxl backprop spikes 2023-08-01 15:43:27 -06:00
Jaret Burkett f53fd08690 Fixed issue with rescaled loras only saving af fp32 2023-08-01 14:08:22 -06:00
Jaret Burkett 8b8d53888d Added Model rescale and prepared a release upgrade 2023-08-01 13:49:54 -06:00
Jaret Burkett 63cacf4362 Merge remote-tracking branch 'origin/main' into WIP 2023-07-31 15:14:28 -06:00
Jaret Burkett c1b1e800df Updated module names to be compatable with ney koyha unet 2023-07-31 13:16:29 -06:00
Jaret Burkett 7726911562 Allow name to be passed through command line 2023-07-31 11:56:57 -06:00
Jaret Burkett c01673f1b5 Added random weight adjuster to prevent overfitting 2023-07-29 19:30:14 -06:00
Jaret Burkett c35b78f0d4 Added random weight adjuster to prevent overfitting 2023-07-29 17:14:14 -06:00
Jaret Burkett 8ba1b11557 Merge branch 'sdxl' into WIP 
# Conflicts:
#	jobs/process/BaseSDTrainProcess.py
#	jobs/process/TrainSliderProcess.py
 2023-07-29 14:29:18 -06:00
Jaret Burkett 9cdf2dd6e4 Bug fixes 2023-07-29 13:39:57 -06:00
Jaret Burkett 1e50b39442 Work on slider rework 2023-07-28 18:11:10 -06:00
Jaret Burkett 5fc2bb5d9c Information trainer 2023-07-28 08:16:29 -06:00
Jaret Burkett c7640b0865 WIP diffusers pipeline is weird. Starting to hate sdxl 2023-07-27 17:35:24 -06:00
Jaret Burkett b2e2e4bf47 Added sd1.5 and 2.1 do the diffusers pipeline flow 2023-07-27 12:34:48 -06:00
Jaret Burkett 596e57a6a6 Pipelines working on SDXL for noise prediction 2023-07-27 11:24:33 -06:00
Jaret Burkett 6ab8b8b0f1 WIP. just need to put it here 2023-07-27 01:46:30 -06:00