4 Commits

Include renames

Author	SHA1	Message	Date
Jaret Burkett	894374b2e9	Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)	2024-11-20 09:16:55 -07:00
Jaret Burkett	9f94c7b61e	Added experimental param multiplier to the ema module	2024-10-22 09:25:52 -06:00
Jaret Burkett	acafe9984f	Adjustments to loading of flux. Added a feedback to ema	2024-08-07 13:17:26 -06:00
Jaret Burkett	603ceca3ca	added ema	2024-06-28 10:03:26 -06:00