6 VAE Variational Auto Encoder

JeLuF edited this page 2022-11-16 07:58:10 +01:00

Table of Contents

• What does a VAE do?
• How to use a custom VAE?

What does a VAE do?

In short, it improves the generated images. A VAE is trained for certain aspects of the image, and the default VAE bundled in our UI (vae-ft-mse-840000-ema-pruned) improves the eyes in generated images.

Stable Diffusion UI installs and starts using the vae-ft-mse-840000-ema-pruned VAE file that works with all Stable diffusion models. This uses the official one: https://huggingface.co/stabilityai/sd-vae-ft-mse-original

How to use a custom VAE?

Put your VAE file ending with .ckpt or .vae.pt inside the models/vae folder, like this:

Then refresh your browser UI. After that, you can select the desired VAE file in Image Settings:

Basics

• Installation
• How to Use
• Writing Prompts
• Image Modifiers
• Inpainting
• Samplers
• Summary of every UI option
• Common error messages (and solutions)

Intermediate

• Custom Models
• Prompt Syntax
• UI Plugins
• Embeddings
• LoRA
• SDXL
• ControlNet
• Seamless Tiling
• xFormers
• The beta channel

Advanced topics

• Run on Multiple GPUs
• Model Merging
• Custom Modifiers
• Config settings