Stable Diffusion 3
Stability AI's multimodal diffusion transformer
Stable Diffusion 3 is a family of open-weight text-to-image generation models from Stability AI built on a Multimodal Diffusion Transformer (MMDiT) architecture, offering improved text rendering, prompt adherence, and image quality…
Definition
Stable Diffusion 3 is a family of open-weight text-to-image generation models from Stability AI built on a Multimodal Diffusion Transformer (MMDiT) architecture, offering improved text rendering, prompt adherence, and image quality compared to earlier Stable Diffusion versions.
Overview
Stable Diffusion 3 replaced the U-Net-based architecture used in earlier Stable Diffusion versions with a Multimodal Diffusion Transformer, which processes image and text token representations using separate weight sets that interact through joint attention layers, rather than the cross-attention conditioning approach used in older Stable Diffusion models. This architectural shift, combined with a rectified-flow-based training objective, was aimed at improving sample quality, training stability, and scalability to larger model sizes. Stability AI released Stable Diffusion 3 in multiple parameter sizes, from smaller variants suitable for consumer GPUs up to an 8-billion-parameter flagship, letting users trade off generation quality against compute requirements. A widely noted improvement over prior Stable Diffusion versions was substantially better rendering of legible text within generated images, a longstanding weakness of diffusion image models, along with improved adherence to complex, multi-subject prompts involving specific spatial relationships and attributes. As with earlier Stable Diffusion releases, Stable Diffusion 3 models are released with open (though not fully unrestricted) weights, allowing self-hosting, fine-tuning, and integration into third-party tools, subject to Stability AI's community license terms which include usage restrictions for larger commercial deployments. The open nature of the Stable Diffusion family has made it the foundation for a large ecosystem of fine-tuned checkpoints, LoRA adapters, and downstream tools such as ControlNet-style conditioning, distinguishing it from closed image-generation services accessible only via API.
Key Features
- Multimodal Diffusion Transformer (MMDiT) architecture replacing the prior U-Net design
- Rectified-flow training objective for improved sample quality and stability
- Released in multiple parameter sizes up to 8 billion parameters
- Substantially improved legible text rendering within images
- Better adherence to complex, multi-subject prompts
- Open-weight release under Stability AI's community license
- Foundation for a large ecosystem of fine-tunes and LoRA adapters
- Supports third-party conditioning tools like ControlNet-style pipelines