4 Commits

Include renames

Author	SHA1	Message	Date
Jaret Burkett	894374b2e9	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
Jaret Burkett	298001439a	Added gradient accumulation finally	2023-10-28 13:14:29 -06:00
Jaret Burkett	6f3e0d5af2	Improved lorm extraction and training	2023-10-28 08:21:59 -06:00
Jaret Burkett	0a79ac9604	Added lorm. WIP	2023-10-26 18:23:51 -06:00