 Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
|
Jaret Burkett
|
561914d8e6
|
Removed old code for fixing multistep sampler that is no longer needed
|
2024-02-25 11:53:35 -07:00 |
|
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
|
Jaret Burkett
|
bd2bce9b92
|
Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)
|
2023-11-29 14:32:48 -07:00 |
|
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
|
Jaret Burkett
|
bef10a639c
|
Merge remote-tracking branch 'origin/development'
# Conflicts:
# toolkit/stable_diffusion_model.py
|
2023-11-28 10:40:05 -07:00 |
|
|
Jaret Burkett
|
c2a4b8e058
|
More timestep fixes
|
2023-11-28 10:34:08 -07:00 |
|
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
|
Jaret Burkett
|
fbec68681d
|
Added timestep modifications to lcm scheduler for more evenly spaced timesteps
|
2023-11-17 23:26:52 -07:00 |
|
|
Jaret Burkett
|
ad50921c41
|
Sampling tests and added fixes for cleanups
|
2023-11-16 08:33:23 -07:00 |
|
|
Jaret Burkett
|
e47006ed70
|
Added some features for an LCM condenser plugin
|
2023-11-15 08:56:45 -07:00 |
|
|
Jaret Burkett
|
4f9cdd916a
|
added prompt dropout to happen indempendently on each TE
|
2023-11-14 05:26:51 -07:00 |
|
|
Jaret Burkett
|
1ee62562a4
|
diffirential guidance is WORKING (from what I can tell)
|
2023-11-07 19:24:12 -07:00 |
|
|
Jaret Burkett
|
dc8448d958
|
Added a way pass refiner ratio to sample config
|
2023-11-06 09:22:58 -07:00 |
|
|
Jaret Burkett
|
93ea955d7c
|
Added refiner fine tuning. Works, but needs some polish.
|
2023-11-05 17:15:03 -07:00 |
|
|
Jaret Burkett
|
d35733ac06
|
Added support for training ssd-1B. Added support for saving models into diffusers format. We can currently save in safetensors format for ssd-1b, but diffusers cannot load it yet.
|
2023-11-03 05:01:16 -06:00 |
|
|
Jaret Burkett
|
ceaf1d9454
|
Various bug fixes, wip stuff, and tweaks
|
2023-11-02 18:19:20 -06:00 |
|
|
Jaret Burkett
|
7d707b2fe6
|
Added masking to slider training. Something is still weird though
|
2023-11-01 14:51:29 -06:00 |
|
|
Jaret Burkett
|
6f3e0d5af2
|
Improved lorm extraction and training
|
2023-10-28 08:21:59 -06:00 |
|
|
Jaret Burkett
|
0a79ac9604
|
Added lorm. WIP
|
2023-10-26 18:23:51 -06:00 |
|
|
Jaret Burkett
|
9636194c09
|
Added fuyu captioning
|
2023-10-25 14:14:53 -06:00 |
|
|
Jaret Burkett
|
002279cec3
|
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
|
2023-10-24 16:02:07 -06:00 |
|
|
Jaret Burkett
|
9905a1e205
|
Fixes and longer prompts
|
2023-10-22 08:57:37 -06:00 |
|
|
Jaret Burkett
|
b1cfafa0c6
|
always prompt both even when training only one encoder
|
2023-10-07 11:23:09 -06:00 |
|
|
Jaret Burkett
|
cac8754399
|
Allow for training loras on onle one text encoder for sdxl
|
2023-10-06 08:11:56 -06:00 |
|
|
Jaret Burkett
|
f73402473b
|
Bug fixes. Added some functionality to help with private extensions
|
2023-10-05 07:09:34 -06:00 |
|
|
Jaret Burkett
|
76c764af49
|
Fixed issues with adapter and disabled telementry for now
|
2023-09-24 12:51:29 -06:00 |
|
|
Jaret Burkett
|
abf7cd221d
|
allow setting adapter weight in prompts
|
2023-09-24 06:51:54 -06:00 |
|
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|
|
Jaret Burkett
|
61badf85a7
|
t2i training working from what I can tell at least
|
2023-09-17 15:56:43 -06:00 |
|
|
Jaret Burkett
|
c698837241
|
Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it
|
2023-09-16 17:41:07 -06:00 |
|