News: A nightly version of ControlNet 1.1 is released! ControlNet 1.1 is released. Those new models will be merged to this repo after we make sure that everything is good. Below is ControlNet 1.0 ...
Abstract: We explore a new class of diffusion models based on the transformer architecture. We train latent diffusion models of images, replacing the commonly-used U-Net backbone with a transformer ...