Jaret Burkett
|
a9e7752178
|
Add MOSS music audio captioner
|
2026-09-17 10:45:37 -06:00 |
|
Jaret Burkett
|
080873bec9
|
Harden ace step transcription engine to detect and break out of loops. Add melbanroformer to seperate out the vocals and music for better transcriptions. Much better results.
|
2026-09-17 09:49:19 -06:00 |
|
Jaret Burkett
|
1db6083645
|
Show more information about LoRAs when loading loras in generate page
|
2026-09-17 09:35:43 -06:00 |
|
Jaret Burkett
|
ef8110cef7
|
Add LoRA uploader to the lora picker on the generator
|
2026-09-17 05:17:34 -06:00 |
|
Jaret Burkett
|
e65c4d0fb6
|
Fix issue with Krea2 patch size when training with shift
|
2026-09-16 13:46:39 -06:00 |
|
Jaret Burkett
|
410206e41c
|
Improve speed of sage sheet decoder with yue2. Recover from tracks that fail
|
2026-09-16 12:24:39 -06:00 |
|
Jaret Burkett
|
ce64e65c39
|
Add support for Qwen 2.5 Omni and add lora loading for captioning models
|
2026-09-16 10:36:19 -06:00 |
|
Jaret Burkett
|
2977672e4b
|
Point omni vllm to real repo
|
2026-09-16 09:37:21 -06:00 |
|
Jaret Burkett
|
db8dbd68c2
|
Add support for training VLLMs, omni models, and LLMs
|
2026-09-15 17:47:02 -06:00 |
|
Jaret Burkett
|
426ccb4ec4
|
fix file identifier parsing of some extensions that were not being recofnized in the ui
|
2026-09-15 12:59:54 -06:00 |
|
Jaret Burkett
|
6b2526a4d7
|
Allow Ace Step captioner to work with different output formats like yue2
|
2026-09-15 12:48:15 -06:00 |
|
Jaret Burkett
|
8bf12e476e
|
Fixed issue that could allow deleting and uploading items outside the restricted directories.
|
2026-09-15 10:13:53 -06:00 |
|
Jaret Burkett
|
07de70940a
|
Fix and optimize Ace Step captioner
|
2026-09-15 06:49:06 -06:00 |
|
Jaret Burkett
|
59c7de0539
|
Increase the repition penalty
|
2026-09-15 06:12:20 -06:00 |
|
Jaret Burkett
|
f2a2a6bea0
|
Make audio files in dataset be thumbnails until clicked and opened inn the viewer
|
2026-09-15 05:32:13 -06:00 |
|
Jaret Burkett (Ostris)
|
d673cc5205
|
Merge pull request #1042 from ostris/yue2
YuE2
|
2026-09-14 17:55:47 -06:00 |
|
Jaret Burkett
|
48d6f441cc
|
Version bump
|
2026-09-14 17:50:36 -06:00 |
|
Jaret Burkett
|
213d32cad3
|
Train 50% of the time with and without sheet music.
|
2026-09-14 17:50:15 -06:00 |
|
Jaret Burkett
|
f9b23b40bb
|
Load sage sheet and use it on training with 50% dropout so it generates sheet music and handles without it.
|
2026-09-14 17:01:36 -06:00 |
|
Jaret Burkett
|
9ea4348d1e
|
Normalize captions
|
2026-09-14 14:51:14 -06:00 |
|
Jaret Burkett
|
5ae240dd81
|
Update readme
|
2026-09-14 14:18:45 -06:00 |
|
Jaret Burkett
|
b53436331c
|
Add regularization and moden info
|
2026-09-14 14:14:36 -06:00 |
|
Jaret Burkett
|
900c0e8a67
|
Det the dataset dropout for yue2
|
2026-09-14 12:19:51 -06:00 |
|
Jaret Burkett
|
7bc91e91a5
|
Add yue2 caption options
|
2026-09-14 12:16:39 -06:00 |
|
Jaret Burkett
|
29635253cf
|
Merge branch 'main' into yue2
|
2026-09-14 09:32:31 -06:00 |
|
Jaret Burkett
|
87f8090bb9
|
Force advanced editor to 2 spaces indentation
|
2026-09-14 09:04:30 -06:00 |
|
Jaret Burkett
|
1e8e9d5efe
|
Allow to shift click samples and mass delete rows of samples
|
2026-09-14 08:55:07 -06:00 |
|
Jaret Burkett
|
d44dffd7b8
|
Move the duration selector
|
2026-09-14 07:07:26 -06:00 |
|
Jaret Burkett
|
f940e61dcd
|
Merge branch 'main' into yue2
|
2026-09-14 05:21:25 -06:00 |
|
Jaret Burkett
|
dd48f5572d
|
Version bump
|
2026-09-14 05:08:00 -06:00 |
|
Jaret Burkett
|
e43f138ae4
|
Initial experimental support for yue2
|
2026-09-14 05:07:11 -06:00 |
|
Jaret Burkett
|
82137c8ca0
|
Fix album art issue with music files
|
2026-09-13 18:08:37 -06:00 |
|
Jaret Burkett
|
881143cbe8
|
Fixed issue with EMA climbing decay instead of reducing it.
|
2026-09-12 21:00:31 -06:00 |
|
Jaret Burkett
|
547593449b
|
Version bump
|
2026-09-12 14:55:06 -06:00 |
|
Jaret Burkett
|
238c5dc975
|
Added a toggle on LoRAs on the inference engine to toggle them active or not
|
2026-09-12 14:28:03 -06:00 |
|
Jaret Burkett
|
737ee20733
|
Add lokr support to inference engine
|
2026-09-12 14:17:44 -06:00 |
|
Jaret Burkett
|
ca097e63da
|
Version bump
|
2026-09-12 13:14:47 -06:00 |
|
Jaret Burkett
|
68504f69fa
|
Move engine stream to a non git ignored folder.
|
2026-09-12 13:14:09 -06:00 |
|
Jaret Burkett (Ostris)
|
24916ec09e
|
Merge pull request #1039 from ostris/inference_engine
Add an inference engine and generation via the UI
|
2026-09-12 10:39:00 -06:00 |
|
Jaret Burkett
|
63261a9188
|
Resolve conflict
|
2026-09-12 06:43:41 -06:00 |
|
Jaret Burkett
|
561a0236b3
|
Ignore test outputs
|
2026-09-11 16:37:57 -06:00 |
|
Jaret Burkett
|
732c761231
|
Add lora on generate
|
2026-09-10 18:23:23 -06:00 |
|
Jaret Burkett
|
6e1b39c7a8
|
Improve ui and functionality
|
2026-09-10 15:44:00 -06:00 |
|
Jaret Burkett
|
449488f6b7
|
Initial inference engine build out
|
2026-09-10 14:22:49 -06:00 |
|
Jaret Burkett
|
f56b5a1d40
|
Change hidream to be proper x0 prediction and use a custom weighing scheme for x0 models.
|
2026-09-10 11:49:54 -06:00 |
|
Jaret Burkett
|
b1bf3e4381
|
Add a config to force pure noise step at a set rate
|
2026-09-09 11:26:28 -06:00 |
|
Jaret Burkett
|
4a41f146a3
|
Fix feedback when doing an ema with feedback so it uses its own scale
|
2026-09-09 06:43:14 -06:00 |
|
Jaret Burkett
|
b764c4a94e
|
DFE cleanup
|
2026-09-09 06:42:24 -06:00 |
|
Jaret Burkett
|
fb7c14b288
|
Version update
|
2026-09-08 12:25:18 -06:00 |
|
Jaret Burkett
|
af82197907
|
Fix gradient checkpointing for sapiens DFE
|
2026-09-08 12:24:56 -06:00 |
|
Jaret Burkett
|
3ab6eaa3c4
|
Show fft loss in loss log
|
2026-09-08 05:16:07 -06:00 |
|
Jaret Burkett
|
af89a27e0f
|
Fixed issue with partial offloading torchao quants
|
2026-09-08 05:15:26 -06:00 |
|
Jaret Burkett
|
3e1cb5f67f
|
Rework DFEs to work better with x0 models. Show their loss in the graph
|
2026-09-07 13:26:01 -06:00 |
|
Jaret Burkett
|
7690ea62c8
|
Add variable precision adam convrot optimizer with stochastic rounding and accumulation.
|
2026-09-06 10:51:35 -06:00 |
|
Jaret Burkett
|
bbb1fda457
|
Fix gradient accumulation scaling so grads scale to the same size as if it was one big batch.
|
2026-09-06 10:48:10 -06:00 |
|
Jaret Burkett (Ostris)
|
fea99cf5d0
|
Merge pull request #813 from Booyaka101/fix/dataloader-pin-memory
perf: enable pin_memory on CUDA DataLoaders for faster CPU->GPU transfer
|
2026-09-05 08:09:26 -06:00 |
|
Jaret Burkett (Ostris)
|
2a2ca26ee8
|
Merge branch 'main' into fix/dataloader-pin-memory
|
2026-09-05 08:08:39 -06:00 |
|
Jaret Burkett
|
b36bb3998a
|
Version bump
|
2026-09-03 08:44:44 -06:00 |
|
Jaret Burkett
|
90515c5396
|
Fix issue where we gave the wrong dtype hidden states
|
2026-09-03 08:43:15 -06:00 |
|
Jaret Burkett
|
ead3738773
|
Fixed connection cap for SSE in the ui
|
2026-09-02 17:08:12 -06:00 |
|
Jaret Burkett
|
ecb2bfbe5e
|
Fixed issue where some unmanaged modules could be lefs on cpu
|
2026-09-02 09:22:39 -06:00 |
|
Jaret Burkett
|
9d6a9a0803
|
Fixed embedding scale for offloading for ltx 2.3. Was a new bug added today.
|
2026-08-31 15:53:58 -06:00 |
|
Jaret Burkett
|
6940ebf533
|
Skip files where caching fails in a dataset instead of crashing.
|
2026-08-30 16:49:12 -06:00 |
|
Jaret Burkett
|
e98109f213
|
Version bump
|
2026-08-30 11:02:22 -06:00 |
|
Jaret Burkett
|
74ed5fddb0
|
Fix issue with ltx caching
|
2026-08-30 11:01:52 -06:00 |
|
Jaret Burkett
|
764b5064fb
|
Migrate to a new DTO for latents to carry more information that a normal tensor such as audio.
|
2026-08-30 10:30:21 -06:00 |
|
Jaret Burkett
|
2a69c1e7de
|
Add initial support for Minimax H3 VSA sparse attention
|
2026-08-30 08:24:43 -06:00 |
|
Jaret Burkett
|
be995185f5
|
Fixed issue with offloading with new model loader on nvfp4 weights.
|
2026-08-29 12:01:40 -06:00 |
|
Jaret Burkett
|
7380476b9c
|
Version bump
|
2026-08-29 11:24:16 -06:00 |
|
Jaret Burkett
|
683fe8afc0
|
Stability improvements to model offloading. Added D-OPSD bleed loss as well.
|
2026-08-29 11:23:47 -06:00 |
|
Jaret Burkett (Ostris)
|
64a20f51a6
|
Merge pull request #1025 from ostris/models/v2
Reworked the entire model loading to make everything testable, hot swappable, and uniform.
|
2026-08-29 09:06:19 -06:00 |
|
Jaret Burkett
|
bb55d38958
|
Version bump
|
2026-08-29 08:58:15 -06:00 |
|
Jaret Burkett
|
7195abc32b
|
Performance fixes and bug fixes
|
2026-08-28 22:21:09 -06:00 |
|
Jaret Burkett
|
5ddc5f8ca7
|
Optimize quantization path
|
2026-08-28 11:47:29 -06:00 |
|
Jaret Burkett
|
ce3df32101
|
Fix speed on wan conv patch
|
2026-08-28 10:54:26 -06:00 |
|
Jaret Burkett
|
92df289931
|
Fix quantization issues
|
2026-08-28 10:48:34 -06:00 |
|
Jaret Burkett
|
85a6880643
|
Move the offload and quantization to the base model
|
2026-08-28 08:37:56 -06:00 |
|
Jaret Burkett
|
702254688d
|
Added legacy paths
|
2026-08-28 07:55:19 -06:00 |
|
Jaret Burkett
|
c3bc8b0b4e
|
Full test of ui arch compatability
|
2026-08-28 06:56:05 -06:00 |
|
Jaret Burkett
|
520d96aac3
|
Phase 2
|
2026-08-27 18:18:31 -06:00 |
|
Jaret Burkett
|
45886f01b2
|
Phase 2
|
2026-08-27 16:16:35 -06:00 |
|
Jaret Burkett
|
9113420b61
|
Phase 2
|
2026-08-27 15:37:13 -06:00 |
|
Jaret Burkett
|
9ed2e0b8e7
|
Test model loading
|
2026-08-27 14:31:53 -06:00 |
|
Jaret Burkett
|
8db198ec0a
|
Phase 1
|
2026-08-27 11:53:08 -06:00 |
|
Jaret Burkett
|
e8d9cf6d35
|
Models v2 - phase 0
|
2026-08-27 10:51:43 -06:00 |
|
Jaret Burkett
|
5497a001cb
|
Fix issue where errors on qwen image omni were not being fully surfaced.
|
2026-08-26 20:54:24 -06:00 |
|
Jaret Burkett
|
da79ebce99
|
Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va
|
2026-08-26 11:06:33 -06:00 |
|
Jaret Burkett
|
8a912564ce
|
Fix video DOP methods
|
2026-08-26 10:05:14 -06:00 |
|
Jaret Burkett
|
8436c407f6
|
Add ability to delete the loss logs from a selected range on the loss graph
|
2026-08-23 09:57:47 -06:00 |
|
Jaret Burkett
|
27a03a91f2
|
Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time
|
2026-08-21 13:31:02 -06:00 |
|
Jaret Burkett
|
b96476a841
|
Allow overriding the batch size on a per dataset level
|
2026-08-21 12:56:04 -06:00 |
|
Jaret Burkett
|
89102f76dc
|
Allow user to pick if reference images are sent in the image or video reference stream for Hidream H3 ref2va
|
2026-08-19 13:32:06 -06:00 |
|
Jaret Burkett
|
afd1d92722
|
Fix issue with double sampling qwen vl video frames for hidream h3 for reference videos
|
2026-08-17 15:39:07 -06:00 |
|
Jaret Burkett
|
42dfe9c661
|
Improve video frame reader
|
2026-08-16 10:21:11 -06:00 |
|
Jaret Burkett
|
b982a03ae4
|
Add training adapter for MiniMax H3 ref2va and default to contrastive loss with adapter
|
2026-08-16 09:11:07 -06:00 |
|
Jaret Burkett
|
2042481914
|
On MiniMax H3 set the default to use both contrastive guidance and the training adapter as it is yielding better results than one or the other.
|
2026-08-16 08:43:31 -06:00 |
|
Jaret Burkett
|
61310c6397
|
Inprove cpu data acuisition on backend
|
2026-08-16 08:42:36 -06:00 |
|
Jaret Burkett
|
2cbc2bb097
|
On minimax h3, trim cached text embeddings to max tokens if they are longer than specified
|
2026-08-16 08:42:01 -06:00 |
|
Jaret Burkett
|
0f788923ae
|
Animate action bar so starting a job has a 'working' indicator.
|
2026-08-15 10:33:40 -06:00 |
|
Jaret Burkett
|
e6cffbc002
|
Adjust encoded paths so filenames resolve as a basename properly when downloading with things like wget.
|
2026-08-15 08:56:55 -06:00 |
|