Commit Graph
1343 Commits
Author SHA1 Message Date
Jaret Burkett c8cd78b1a4 Allow nested transformer block names for quantization, lora targeting, quantizing 2026-06-13 14:33:16 -06:00
Jaret Burkett 17c9279828 Version bump 2026-06-13 09:48:26 -06:00
Jaret Burkett 6c3b82696e Add support for PRX Pixel T2I 2026-06-13 09:47:53 -06:00
Jaret Burkett a01c83073a Added an example model with docs so people and agents can add models easier. 2026-06-13 08:17:06 -06:00
Jaret Burkett 2f91db8363 Defauly to compiling full graph to false 2026-06-13 07:28:51 -06:00
PlagueKind e908d85f5e Allow quantized unet offload compile and force fullgraph false (#881) 2026-06-13 07:27:28 -06:00
Jaret Burkett 0165fb2ac6 Update npm packages 2026-06-12 17:50:47 -06:00
Jaret Burkett c90c400716 Add Ustris Cloud info to the README 2026-06-12 12:53:47 -06:00
Jaret Burkett 43b22b91ee Add a triton check on compile 2026-06-12 12:26:16 -06:00
Jaret Burkett 10e50d5797 Fix issue with casting unet after compilation 2026-06-12 12:16:51 -06:00
Jaret Burkett d83f7dd4d9 Fix a few issues with compile. Changed defaults. Future proofed block layer compile. 2026-06-12 11:43:43 -06:00
Jaret Burkett a5558ae7d9 Add compile to the actual right config section. 2026-06-12 11:12:41 -06:00
Jaret Burkett c09b228a35 Add model compiling to the ui 2026-06-12 11:02:10 -06:00
PlagueKind 6b1f89f30b Enhanced torch.compile System with Block-Level Compilation and Unified Whole-Model Fallback (#866)
* Add block-level compile and qcompile torch.compile whole model  modes

* Update torch compile system
2026-06-12 10:35:12 -06:00
Rainer 324faf17b3 accept .json uploads (#880) 2026-06-12 10:31:19 -06:00
Jaret Burkett 0f580f0663 Add compiling option for captioning. Added progress bar for captioning on active job widget. Track steps on caption. Added reverse proxy iframe that plugins can use to add ui functionality. 2026-06-12 10:26:52 -06:00
Jaret Burkett 3fd14f3805 Change suporters view to an auto updating SVG file so the README doesnt need to be updated constantly. 2026-06-12 09:48:50 -06:00
Jaret Burkett 9cf34f945c Allow multi selecting jobs and deleting them in one go 2026-06-12 08:01:56 -06:00
Jaret Burkett 55ce6570f2 Automagic 3 rework. Stable in my testing. 2026-06-12 07:52:44 -06:00
fatalis 53ebb93edb fix learning rate metric truncating to zero on graph (#877) 2026-06-12 07:30:21 -06:00
Jaret Burkett 88127557f5 Comment out logging supression that was keeping weight loadings from being shown with transformers library 2026-06-11 07:53:41 -06:00
Jaret Burkett 01b6a9806b Another complete rework of automagic3. Added a decay to the LR spread to the mean to prevent LRs fighting with eachother 2026-06-09 12:08:45 -06:00
Jaret Burkett 9e99d3ce5d Save loss graph view settings per page to local storage. 2026-06-09 07:29:51 -06:00
Jaret Burkett acb1548722 Updated the comments and doc for Automagic v3 2026-06-09 07:05:48 -06:00
Jaret Burkett a1ac6e8b01 Reworked automagic v3 again. Seems more stable. Still testing. 2026-06-08 22:03:54 -06:00
Jaret Burkett 5d6887fd98 Major updates to automagic3 optimizer. Seems to be functioning more ideally and naturally decays, as it should. 2026-06-08 14:09:02 -06:00
Jaret Burkett 0d018db689 Rework the toggles so we can hide the trend line from the loss graph. No need for a raw toggle either. 2026-06-08 13:56:37 -06:00
Jaret Burkett cac3815b2c Make DOP run in a single backward pass, should be faster and more stable. Show dop loss on ui 2026-06-08 13:55:47 -06:00
Jaret Burkett 687def6f7a Add better smoothing with ema rounding of the ends of the loss graph for first and last instance do not dominate the smoothing factors. 2026-06-08 10:43:46 -06:00
Jaret Burkett d7f8887bbf Show all logged metrics on the loss graph 2026-06-08 09:43:03 -06:00
Jaret Burkett e281df70dd Allow automagic3 to run unfused. Add some clipping. 2026-06-08 08:59:06 -06:00
Jaret Burkett c9cdbb5bb7 Version bump 2026-06-07 16:08:11 -06:00
Jaret Burkett c78b1404e3 Deepen offload prefetch pipeline with per-slot events
Replace the 2-slot ping-pong + single global "compute-started" event
with a depth-N ring buffer where each transfer waits only on the slot
it's reusing (D layers back) instead of the most-recent compute. Applies
to forward and backward, Linear and Conv. Depth is tunable via
AI_TOOLKIT_OFFLOAD_DEPTH (default 4).

Bit-exact vs non-offload (output, grad_input, weight grads). No speedup
on a bandwidth-bound PCIe link (already saturated at depth 2), but the
cleaner per-slot design removes the fragile shared-event serialization
and lets deeper prefetch help on faster buses.
2026-06-07 16:07:13 -06:00
Jaret Burkett cdff6e36aa Pin inner stores of torachao to speed up layer offloading for quantized models around 25% 2026-06-07 15:52:01 -06:00
Jaret Burkett 75781fb5a5 Fix float8 weights not offloading to CPU in layer offloading 2026-06-07 15:36:17 -06:00
PlagueKind 7c1a76f336 Fix text encoder offload bug when caching embeddings (#868) 2026-06-07 14:09:32 -06:00
Jaret Burkett 35588726de Fixed issue where a buffer was stuck on cpu when offloading ideogram4 2026-06-07 13:31:03 -06:00
Jaret Burkett 1dc9a797cf Added Automagic v3 2026-06-07 12:06:42 -06:00
Jaret Burkett 82190b41e6 Fix bug where EMA was not being initialized even when setup in the config. EMA will now properly be setup and used. 2026-06-07 11:11:49 -06:00
Jaret Burkett 8968e41234 Set ideogram to use new loke saving format 2026-06-07 09:49:57 -06:00
Jaret Burkett fa0dca288d Version bump 2026-06-06 10:24:31 -06:00
Jaret Burkett 41157b460c Added ability to set the caption extention in dataset viewer, captioner, and trainer so one dataset can have multiple caption styles in different files with different extensions. Added dataset caption template for a blank ideogram 4 formatted template. 2026-06-06 08:32:24 -06:00
Jaret Burkett 10cdeb394e Version bump 2026-06-05 14:09:46 -06:00
Jaret Burkett 21a6beb194 Allow editing the boxes visually on the sample section for ideogram 2026-06-05 14:09:18 -06:00
Jaret Burkett 4441080c05 Rework the ui of ideogram dataset image caption editor 2026-06-05 13:20:58 -06:00
Jaret Burkett b70083a74f Fix issue with default sampels. 2026-06-05 12:33:42 -06:00
Jaret Burkett c994398850 Rework prompts and captioning systems for ideogram to more strictly match the format provided by ideogram. 2026-06-05 11:14:36 -06:00
Jaret Burkett 6fd2253932 Imporved editing boxed on the dataset viewer 2026-06-05 10:30:06 -06:00
Jaret Burkett ef12260b80 Add a prompt upsample ui for upsampling prompts to ideogram format prompts. 2026-06-05 09:56:02 -06:00
Jaret Burkett 90a2084f70 Allow adjusting, adding, and deleting bounding boxes. 2026-06-04 20:29:31 -06:00