 Jaret Burkett
|
ca3ce0f34c
|
Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range.
|
2025-04-13 13:49:13 -06:00 |
|
|
Jaret Burkett
|
6fb44db6a0
|
Finished up first frame for i2v adapter
|
2025-04-12 17:13:04 -06:00 |
|
|
Jaret Burkett
|
4a43589666
|
Use a shuffled embedding as unconditional for i2v adapter
|
2025-04-11 10:44:43 -06:00 |
|
|
Jaret Burkett
|
059155174a
|
Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter
|
2025-04-10 11:50:01 -06:00 |
|
|
Jaret Burkett
|
615b0d0e94
|
Added initial support for training i2v adapter WIP
|
2025-04-09 08:06:29 -06:00 |
|
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
|
Jaret Burkett
|
6c8b5ab606
|
Added some more useful error handeling and logging
|
2025-04-07 08:01:37 -06:00 |
|
|
Jaret Burkett
|
5ea19b6292
|
small bug fixes
|
2025-03-30 20:09:40 -06:00 |
|
|
Jaret Burkett
|
c083a0e5ea
|
Allow DFE to not have a VAE
|
2025-03-30 09:23:01 -06:00 |
|
|
Jaret Burkett
|
860d892214
|
Pixel shuffle adapter. Some bug fixes thrown in
|
2025-03-29 21:15:01 -06:00 |
|
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
|
Jaret Burkett
|
1ad58c5816
|
Changed control lora to only have new weights and leave other input weights alone for more flexability of using multiple ones together.
|
2025-03-22 10:24:52 -06:00 |
|
|
Jaret Burkett
|
f5aa4232fa
|
Added ability to quantize with torchao
|
2025-03-20 16:28:54 -06:00 |
|
|
Jaret Burkett
|
b829983b16
|
Added ability to load video datasets and train with them
|
2025-03-19 09:54:26 -06:00 |
|
|
Jaret Burkett
|
604e76d34d
|
Fix issue with full finetuning wan
|
2025-03-17 09:17:40 -06:00 |
|
|
Jaret Burkett
|
3812957bc9
|
Added ability to train control loras. Other important bug fixes thrown in
|
2025-03-14 18:03:00 -06:00 |
|
|
Jaret Burkett
|
391329dbdc
|
Fix issue with device placement on te
|
2025-03-13 20:48:12 -06:00 |
|
|
Jaret Burkett
|
31e057d9a3
|
Fixed issue with device placement in some scenereos when doing low vram on wan
|
2025-03-13 10:30:27 -06:00 |
|
|
Jaret Burkett
|
e6739f7eb2
|
Convert wan lora weights on save to be something comfy can handle
|
2025-03-08 12:55:11 -07:00 |
|
|
Jaret Burkett
|
7e37918fbc
|
Double tap module casting as it doesent seem to happen every time.
|
2025-03-07 22:15:24 -07:00 |
|
|
Jaret Burkett
|
4d88f8f218
|
Fixed cuda error when not all tensors have been moved to the correct device.
|
2025-03-07 22:04:35 -07:00 |
|
|
Jaret Burkett
|
25341c4613
|
Got wan 14b training to work on 24GB card.
|
2025-03-07 17:04:10 -07:00 |
|
|
Jaret Burkett
|
391cf80fea
|
Added training for Wan2.1. Not finalized, wait.
|
2025-03-07 13:53:44 -07:00 |
|
|
Jaret Burkett
|
763128ea42
|
Note about cogview
|
2025-03-05 14:46:11 -07:00 |
|
|
Jaret Burkett
|
4fe33f51c1
|
Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4
|
2025-03-05 13:44:40 -07:00 |
|
|
Jaret Burkett
|
aa44828c0c
|
WIP more work on cogview4
|
2025-03-05 09:43:00 -07:00 |
|
|
Jaret Burkett
|
6f6fb90812
|
Added cogview4. Loss still needs work.
|
2025-03-04 18:43:52 -07:00 |
|
|
Jaret Burkett
|
c57434ad7b
|
Removed wan submodule stuff for now
|
2025-03-04 00:32:24 -07:00 |
|
|
Jaret Burkett
|
8bb47d1bfe
|
Merge branch 'main' into wan21
|
2025-03-04 00:31:57 -07:00 |
|
|
Jaret Burkett
|
1f3f45a48d
|
Bugfixes
|
2025-03-03 08:22:15 -07:00 |
|
|
Jaret Burkett
|
b16819f8e7
|
Added LoKr support
|
2025-03-02 06:57:50 -07:00 |
|
|
Jaret Burkett
|
f5e40dfa62
|
WIP on wan
|
2025-03-01 16:12:52 -07:00 |
|
|
Jaret Burkett
|
acc79956aa
|
WIP create new class to add new models more easily
|
2025-03-01 13:49:02 -07:00 |
|
|
Jaret Burkett
|
dd700f70b3
|
Avoid loading state dict for automagic for now until I can sort out some issues
|
2025-02-26 17:03:14 -07:00 |
|
|
Jaret Burkett
|
33fdfd6091
|
Added beginning or lokr
|
2025-02-20 12:47:42 -07:00 |
|
|
Jaret Burkett
|
4af6c5cf30
|
Work on supporting flex.2 potential arch
|
2025-02-17 14:10:25 -07:00 |
|
|
Jaret Burkett
|
1f7784510d
|
WIP Flex 2 pipeline
|
2025-02-16 14:54:29 -07:00 |
|
|
Jaret Burkett
|
87e557cf1e
|
Bug fixes and improvements to llmadapter
|
2025-02-15 07:18:07 -07:00 |
|
|
Jaret Burkett
|
bd8d7dc081
|
fixed various issues with llm attention masking. Added block training on the llm adapter.
|
2025-02-14 11:24:01 -07:00 |
|
|
Jaret Burkett
|
2be6926398
|
Added back syustem prompt for llm and remove those tokens from the embeddings
|
2025-02-14 07:23:37 -07:00 |
|
|
Jaret Burkett
|
87ac031859
|
Remove system prompt, shouldnt be necessary fo rhow it works.
|
2025-02-13 08:42:48 -07:00 |
|
|
Jaret Burkett
|
7679105d52
|
Added llm text encoder adapter
|
2025-02-13 08:28:32 -07:00 |
|
|
Jaret Burkett
|
2622de1e01
|
DFE tweaks. Adding support for more llms as text encoders
|
2025-02-13 04:31:49 -07:00 |
|
|
Jaret Burkett
|
0b8a32def7
|
merged in lumina2 branch
|
2025-02-12 09:33:03 -07:00 |
|
|
Jaret Burkett
|
787bb37e76
|
Small fixed for DFE, polar guidance, and other things
|
2025-02-12 09:27:44 -07:00 |
|
|
Jaret Burkett
|
9a7266275d
|
Wokr on lumina2
|
2025-02-08 14:52:39 -07:00 |
|
|
Jaret Burkett
|
d138f07365
|
Imitial lumina3 support
|
2025-02-08 10:59:53 -07:00 |
|
|
Jaret Burkett
|
216ab164ce
|
Experimental features and bug fixes
|
2025-02-04 13:36:34 -07:00 |
|