Diffusion & generation

DiT block (diffusion transformer)

A transformer block operating on image-latent tokens, modulated by the diffusion timestep.

First page of Scalable Diffusion Models with TransformersIntroduced inDec 2022Scalable Diffusion Models with TransformersPeebles & Xie · arXiv 2212.09748 ↗
DiT block: a transformer steered by timelatent tokens pass through attention and MLP while the timestep steers each normattentionMLPt + promptscale + shift

Diffusion transformers replace the classic U-Net with a stack of transformer blocks over patchified latent tokens. Each block is conditioned on the timestep (and prompt) through adaptive layer-norm modulation. The timestep embedding shifts and scales activations inside every block. DiTs scale more predictably than U-Nets and power most recent image and video generators.

Adoption over time

Share of new models that have included DiT blocks over time.

7%202220232024202520267%20222023202420252026

See it in real models

Open any of these on hfviewer to find this block in the interactive architecture graph.

Comfy-Org/MiniMax-H3 architecture graphComfy-Org/MiniMax-H3↓ 17.3M · ♡ 2kOpen in visualizer coqui/XTTS-v2 architecture graphcoqui/XTTS-v2text-to-speech · ↓ 8.4M · ♡ 4kOpen in visualizer MiniMaxAI/MiniMax-H3 architecture graphMiniMaxAI/MiniMax-H3image-text-to-video · ↓ 4.0M · ♡ 4kOpen in visualizer Comfy-Org/Krea-2 architecture graphComfy-Org/Krea-2↓ 2.2M · ♡ 465Open in visualizer ResembleAI/chatterbox architecture graphResembleAI/chatterboxtext-to-speech · ↓ 2.0M · ♡ 2kOpen in visualizer stabilityai/stable-diffusion-xl-base-1.0 architecture graphstabilityai/stable-diffusion-xl-base-1.0text-to-image · ↓ 1.6M · ♡ 8kOpen in visualizer Lightricks/LTX-2.3 architecture graphLightricks/LTX-2.3image-to-video · ↓ 1.6M · ♡ 2kOpen in visualizer stable-diffusion-v1-5/stable-diffusion-v1-5 architecture graphstable-diffusion-v1-5/stable-diffusion-v1-5text-to-image · ↓ 1.4M · ♡ 1kOpen in visualizer stabilityai/sdxl-turbo architecture graphstabilityai/sdxl-turbotext-to-image · ↓ 1.1M · ♡ 3kOpen in visualizer Qwen/Qwen2.5-Omni-3B architecture graphQwen/Qwen2.5-Omni-3Bany-to-any · ↓ 1.0M · ♡ 346Open in visualizer Tongyi-MAI/Z-Image-Turbo architecture graphTongyi-MAI/Z-Image-Turbotext-to-image · ↓ 794k · ♡ 5kOpen in visualizer Lightricks/LTX-2.5 architecture graphLightricks/LTX-2.5image-to-video · ↓ 790k · ♡ 2kOpen in visualizer

Browse all 278 models with this in the catalog →

Related concepts

hfviewer renders the full architecture of 4,000+ Hugging Face models as interactive graphs. Hover any block to see what it does, with this model’s real numbers.

Browse all model graphs →