hitoshic1982 5fc8fd76de Fix cache_text_encoder device preset missing in BaseModel ...

BaseModel.set_device_state_preset() has no branch for the
'cache_text_encoder' preset, so when TextEmbeddingCachingMixin calls
set_device_state_preset('cache_text_encoder') the active_modules list
stays empty and the text encoder is placed on CPU. With
cache_text_embeddings enabled on a BaseModel arch (e.g. chroma), every
caption is then encoded on CPU — with a quantized T5-XXL this took
~6.5 minutes per caption (~21 hours for a 205-image dataset) while the
GPU sat idle. StableDiffusion.set_device_state_preset() already has
this branch; this adds the same two lines to BaseModel.

2026-08-29 01:37:39 +08:00

..

audio

Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785)

2026-04-09 15:02:03 -06:00

data_transfer_object

Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va

2026-08-26 11:06:33 -06:00

keymaps

Fixed issue with grad scaling

2024-07-20 08:21:57 -06:00

memory_management

Fixed issue with offloading text encoder on ltx 2.5

2026-08-12 10:46:58 -06:00

models

Fix cache_text_encoder device preset missing in BaseModel

2026-08-29 01:37:39 +08:00

optimizers

Add code for automagic experiment

2026-08-01 10:04:46 -06:00

orig_configs

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

samplers

fix custom_flowmatch_sampler (#783)

2026-04-13 09:42:05 -06:00

timestep_weighing

Added new timestep weighing strategy

2025-06-04 01:16:02 -06:00

util

Fix backwards compatability for older versions of triton

2026-08-04 21:07:57 -06:00

__init__.py

Force HF downloads to show progress bars when output is not a TTY (#909)

2026-06-24 07:55:38 -06:00

accelerator.py

Fallback unwrapping logic if fails

2025-05-21 03:10:33 -06:00

advanced_prompt_embeds.py

When dropping out, caching, and doing DOP, make sure we select a cahced trigger word when dropped out so DOP matches the drop out embeddings.

2026-08-11 06:59:20 -06:00

assistant_lora.py

fixed huge flux training bug. Added ability to use an assistatn lora

2024-08-14 10:14:13 -06:00

basic.py

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

buckets.py

Fixed issue with new bucket scaler

2026-05-28 11:34:16 -06:00

civitai.py

Added ability to use civit ai url ar model name and built a model downloader and cache manager for it

2023-08-13 13:09:51 -06:00

clip_vision_adapter.py

Varous bug fixes

2024-07-10 15:20:04 -06:00

config_modules.py

Allow overriding the batch size on a per dataset level

2026-08-21 12:56:04 -06:00

config.py

Added specialized scaler training to ip adapters

2024-04-05 08:17:09 -06:00

control_generator.py

Add a control generation script.

2026-06-25 10:14:24 -06:00

cuda_malloc.py

Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation

2023-09-12 04:30:23 -06:00

custom_adapter.py

Prep for future breaking changes in newer versions of transformers library

2026-04-10 12:04:32 -06:00

data_loader.py

Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va

2026-08-26 11:06:33 -06:00

dataloader_mixins.py

Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va

2026-08-26 11:06:33 -06:00

dequantize.py

Improvements for full tuning flux. Added debugging launch config for vscode

2024-10-29 04:54:08 -06:00

ema.py

Increase ema feedback amount. Normalize the dfe 4 image embeds

2025-06-10 08:01:13 -06:00

embedding.py

Work on ipadapters and custom adapters

2024-05-13 06:37:54 -06:00

esrgan_utils.py

Added training for a custom version of ERSGAN arcitecture. Testing training now

2023-08-07 18:04:23 -06:00

extension.py

Added support for finetuning OmniGen2.

2025-06-25 13:58:16 -06:00

guidance.py

Add model hooks to polarity loss

2025-04-17 09:00:10 -06:00

ideogram_caption.py

Add a fallback bbox adjustment when json parsing fails on ideogram4 captioner

2026-06-19 07:25:54 -06:00

image_utils.py

Adjust dataloader tester to handle videos to test them

2025-10-21 14:47:23 -06:00

inversion_utils.py

Various bug fixes, wip stuff, and tweaks

2023-11-02 18:19:20 -06:00

ip_adapter.py

Prep for future breaking changes in newer versions of transformers library

2026-04-10 12:04:32 -06:00

job.py

Moved the run job command

2023-08-13 10:25:56 -06:00

kohya_lora.py

Restore device runtime scales for compiled adapters (#963)

2026-07-18 08:19:57 -06:00

kohya_model_util.py

Hotfix to handle latest transformers clip model missing key suddenly

2023-08-02 12:26:18 -06:00

layers.py

Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take

2023-08-05 18:46:08 -06:00

llvae.py

Bug fixes. Added some functionality to help with private extensions

2023-10-05 07:09:34 -06:00

logging_aitk.py

Remove future steps from loss log if resuming from an earlier step

2026-05-18 09:23:55 -06:00

lora_special.py

Reworked merge in out of loras with convrot weights for better roundtrip accuracy.

2026-08-02 08:29:17 -06:00

lorm.py

Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)

2024-11-20 09:16:55 -07:00

losses.py

Small updates and bug fixes for various things

2025-06-03 20:08:35 -06:00

lycoris_special.py

Restore device runtime scales for compiled adapters (#963)

2026-07-18 08:19:57 -06:00

lycoris_utils.py

Updated module names to be compatable with ney koyha unet

2023-07-31 13:16:29 -06:00

metadata.py

Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs

2024-01-28 08:20:03 -07:00

network_mixins.py

Apply sigma to contrastive guidance to balance loss better. Prevent noise grads on images/non audio datasets. Prep for training adapters on MiniMax H3

2026-08-05 13:27:12 -06:00

optimizer.py

Fixed experiment opt name match

2026-08-01 17:43:36 -06:00

paths.py

Add support for MiniMax H3 T2V and I2V training

2026-08-03 10:17:39 -06:00

photomaker_pipeline.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

photomaker.py

Added an experimental clip fusion model that is showing promise for embedding concepts

2024-01-17 13:13:04 -07:00

pipelines.py

Remove k-sampler requirement and remove it form the cold. not used anymore anyway

2026-07-27 14:58:31 -06:00

pixel_shuffle_encoder.py

Pixel shuffle adapter. Some bug fixes thrown in

2025-03-29 21:15:01 -06:00

print.py

Remove print buffer. Add new line after sampling.

2026-07-16 11:37:23 -06:00

progress_bar.py

Rework progress bar and ui speed string so it gets the same value at a more accurate and snappier wall clock time

2026-08-21 13:31:02 -06:00

prompt_utils.py

feat: Add Anima support (#860)

2026-07-15 11:59:01 -06:00

reference_adapter.py

Prep for future breaking changes in newer versions of transformers library

2026-04-10 12:04:32 -06:00

resampler.py

Added a clip vision adapter trainer. Only works for sd15 for now

2023-12-24 13:26:04 -07:00

sampler.py

Remove k-sampler requirement and remove it form the cold. not used anymore anyway

2026-07-27 14:58:31 -06:00

saving.py

Added training for pixart-a

2024-02-13 16:00:04 -07:00

scheduler.py

Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115)

2024-08-22 21:25:44 -06:00

sd_device_states_presets.py

Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications

2024-12-15 08:59:27 -07:00

stable_diffusion_model.py

Add D-OPSD as a distillation handeling option for MiniMax H3 ref2va

2026-08-26 11:06:33 -06:00

style.py

Bug fixes and little improvements here and there.

2024-06-08 06:24:20 -06:00

timer.py

Show the console log on the job overview in the ui.

2025-03-21 11:45:36 -06:00

train_pipelines.py

Information trainer

2023-07-28 08:16:29 -06:00

train_tools.py

Added initial support for f-lite model

2025-05-01 11:15:18 -06:00

unloader.py

Reworked freeing memory manager for removing text encoder completly when not needed.

2026-08-09 07:08:24 -06:00

win_console.py

Rework windows start and stop methods so that command windows dont appear. Stop with signal since we cannot signint.

2026-07-27 17:43:01 -06:00