 Jaret Burkett
|
577004a9cd
|
Publish libdevice as a module global so older triton builds without closure capture can compile the convrot kernels
|
2026-10-17 14:54:32 -06:00 |
|
|
Jaret Burkett
|
732c761231
|
Add lora on generate
|
2026-09-10 18:23:23 -06:00 |
|
|
Jaret Burkett
|
7195abc32b
|
Performance fixes and bug fixes
|
2026-08-28 22:21:09 -06:00 |
|
|
Jaret Burkett
|
92df289931
|
Fix quantization issues
|
2026-08-28 10:48:34 -06:00 |
|
|
Jaret Burkett
|
d870e9b68a
|
Fix backwards compatability for older versions of triton
|
2026-08-04 21:07:57 -06:00 |
|
|
Jaret Burkett
|
8a0bcf1ffe
|
Fix issue loading H3 test encoder on older GPUS
|
2026-08-04 15:30:29 -06:00 |
|
|
Jaret Burkett
|
c3afd95cc4
|
Improvements for mps convrot quants
|
2026-07-28 12:11:19 -06:00 |
|
|
Jaret Burkett
|
e28727d5cb
|
Made a fused GEMV kernel for convrot unpacking to increase speed further. Fix bug in test script that made train time add additional grads to bf16.
|
2026-07-15 10:24:52 -06:00 |
|
|
Jaret Burkett
|
cf0db39ede
|
Fix some errors for specific quants. Enable saving quantizations.
|
2026-07-14 07:25:09 -06:00 |
|
|
Jaret Burkett
|
28b05ee4ed
|
Added convrotbitnet 1.58 bit quantization
|
2026-07-13 07:52:48 -06:00 |
|
|
Jaret Burkett
|
b6ff367633
|
Convrot improvements. Add argitrary bit packed byte quantizations.
|
2026-07-13 06:33:54 -06:00 |
|
|
Jaret Burkett
|
095d6e7418
|
Add convrot4 and convrot8 quantizations to the ui. A lot of improvements to the convrot quantization methods.
|
2026-07-11 13:49:41 -06:00 |
|
|
Jaret Burkett
|
933ca1c517
|
Apply w8a8 on the forward when training with convrot for more speed. Fix issue where quantizing a model had a pin memory leak.
|
2026-07-11 10:53:50 -06:00 |
|
|
Jaret Burkett
|
065ac27353
|
Fix issue with compiling convrot on some models
|
2026-07-11 09:26:12 -06:00 |
|
|
Jaret Burkett
|
96a3a06111
|
Added initial experimental support for convrot4 and convrot8 quantization.
|
2026-07-10 11:01:14 -06:00 |
|