ControlNet training example

Installing the dependencies

Circle filling dataset

Training

Training with multiple GPUs

Example results

After 300 steps with batch size 8

After 6000 steps with batch size 8:

Training on a 16 GB GPU

Training on a 12 GB GPU

Training on an 8 GB GPU

Performing inference with the trained ControlNet

Training with Flax/JAX

Running on Google Cloud TPU

Support for Stable Diffusion XL