apolinário and multimodalart
4d35a29c97
Add push_to_hub to the trainer ( #109 )
...
* add push_to_hub
* fix indentation
* indent again
* model_config
* allow samples to not exist
* repo creation fix
* dont show empty [] if widget doesnt exist
* dont submit the config and optimizer
* Unsafe to have tokens saved in the yaml file
* make sure to catch only the latest samples
* change name to slug
* formatting
* formatting
---------
Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com >
2024-08-22 21:18:56 -06:00
Jaret Burkett
00bd3d54a3
Actually use the save dtype from the config file.
2024-08-13 17:08:27 -06:00
Jaret Burkett
af108bb964
Bug fix with dataloader. Added a flag to completly disable sampling
2024-08-12 09:19:40 -06:00
Jaret Burkett
a6aa4b2c7d
Added ability to set timesteps to linear for flowmatching schedule
2024-08-11 13:06:08 -06:00
Jaret Burkett
ec1ea7aa0e
Added support for training on primary gpu with low_vram flag. Updated example script to remove creepy horse sample at that seed
2024-08-11 09:54:30 -06:00
Jaret Burkett
2308ef2868
Added flux training instructions
2024-08-10 14:10:02 -06:00
Jaret Burkett
acafe9984f
Adjustments to loading of flux. Added a feedback to ema
2024-08-07 13:17:26 -06:00
Jaret Burkett
c2424087d6
8 bit training working on flux
2024-08-06 11:53:27 -06:00
Jaret Burkett
272c8608c2
Make a CFG version of flux pipeline
2024-08-05 16:35:53 -06:00
Jaret Burkett
187663ab55
Use peft format for flux loras so they are compatible with diffusers. allow loading an assistant lora
2024-08-05 14:34:37 -06:00
Jaret Burkett
87ba867fdc
Added flux training. Still a WIP. Wont train right without rectified flow working right
2024-08-02 15:00:30 -06:00
Jaret Burkett
03613c523f
Bugfixes and cleanup
2024-08-01 11:45:12 -06:00
Jaret Burkett
47744373f2
Change img multiplier math
2024-07-30 11:33:41 -06:00
Jaret Burkett
e81e19fd0f
Added target_norm_std which is a game changer
2024-07-28 16:08:33 -06:00
Jaret Burkett
0bc4d555c7
A lot of pixart sigma training tweaks
2024-07-28 11:23:18 -06:00
Jaret Burkett
80aa2dbb80
New image generation img2img. various tweaks and fixes
2024-07-24 04:13:41 -06:00
Jaret Burkett
c2c4e8cf34
Added ability to target parts of lora for ilora
2024-07-20 22:45:52 +00:00
Jaret Burkett
22d2f6e28f
Fixed issue with grad scaling
2024-07-20 08:21:57 -06:00
Jaret Burkett
11e426fdf1
Various features and fixes. Too much brain fog to do a proper description
2024-07-18 07:34:14 -06:00
Jaret Burkett
e4558dff4b
Partial implementation for training auraflow.
2024-07-12 12:11:38 -06:00
Jaret Burkett
c062b7716c
Varous bug fixes
2024-07-10 15:20:04 -06:00
Jaret Burkett
3072d20f17
Add ability to include conv_in and conv_out to full train when doing a lora
2024-06-29 14:54:50 -06:00
Jaret Burkett
603ceca3ca
added ema
2024-06-28 10:03:26 -06:00
Jaret Burkett
8407c4deea
Merge branch 'main' of github.com:ostris/ai-toolkit
2024-06-23 14:47:43 -06:00
Jaret Burkett
64f2b085b7
Minor fixes
2024-06-23 14:47:40 -06:00
Jaret Burkett
7165f2d25a
Work to omprove pixart training
2024-06-23 20:46:48 +00:00
Jaret Burkett
37cebd9458
WIP Ilora
2024-06-14 09:31:01 -06:00
Jaret Burkett
bd10d2d668
Some work on sd3 training. Not working
2024-06-13 12:19:16 -06:00
Jaret Burkett
cb5d28cba9
Added working ilora trainer
2024-06-12 09:33:45 -06:00
Jaret Burkett
3f3636b788
Bug fixes and little improvements here and there.
2024-06-08 06:24:20 -06:00
Jaret Burkett
833c833f28
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
2024-05-27 10:50:24 -06:00
Jaret Burkett
5a45c709cd
Work on ipadapters and custom adapters
2024-05-13 06:37:54 -06:00
Jaret Burkett
10e1ecf1e8
Added single value adapter training
2024-04-28 06:04:47 -06:00
Jaret Burkett
b96913d73c
Improvements to dataloader
2024-04-27 09:28:28 -06:00
Jaret Burkett
5da3613e0b
Bug fixes and minor features
2024-04-25 06:14:31 -06:00
Jaret Burkett
5a70b7f38d
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
2024-04-20 10:46:56 -06:00
Jaret Burkett
7284aab7c0
Added specialized scaler training to ip adapters
2024-04-05 08:17:09 -06:00
Jaret Burkett
427847ac4c
Small tweaks and fixes for specialized ip adapter training
2024-03-26 11:35:26 -06:00
Jaret Burkett
9c1cc9641e
Added keep tokens to keep so many tokens in a prompt when dropping
2024-03-18 13:18:25 -06:00
Jaret Burkett
016687bda1
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
2024-03-17 10:21:47 -06:00
Jaret Burkett
72de68d8aa
WIP on clip vision encoder
2024-03-13 07:24:08 -06:00
Jaret Burkett
b01e8d889a
Added stochastic rounding to adafactor. ILora adjustments
2024-03-05 07:07:09 -07:00
Jaret Burkett
337945de9a
Added this not that guidance. Added ability to replace prompts.
2024-02-28 20:10:14 -07:00
Jaret Burkett
49c41e6a5f
Bug fixes. allow for random negative prompts
2024-02-21 04:51:52 -07:00
Jaret Burkett
93b52932c1
Added training for pixart-a
2024-02-13 16:00:04 -07:00
Jaret Burkett
4ec4025cbb
Added adapter modules for text encoders and direct vision
2024-02-12 08:46:18 -07:00
Jaret Burkett
e18e0cb5f8
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
2024-02-05 07:40:03 -07:00
Jaret Burkett
177c7130ec
improved correction of pred norm by targeting the prior
2024-02-01 06:31:04 -07:00
Jaret Burkett
1ae1017748
Bug fixes. added ability to use l1 loss. varous other tests and improvements
2024-01-31 06:30:54 -07:00
Jaret Burkett
92b9c71d44
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
2024-01-28 08:20:03 -07:00
apolinárioandmultimodalart
Jaret Burkett