README.md

---
license: openrail++
base_model: stabilityai/stable-diffusion-xl-base-1.0
tags:
- stable-diffusion-xl
- stable-diffusion-xl-diffusers
- text-to-image
- diffusers
- controlnet
inference: false
---
    
# SDXL-controlnet: OpenPose (v2)

These are controlnet weights trained on stabilityai/stable-diffusion-xl-base-1.0 with OpenPose (v2) conditioning. You can find some example images in the following. 

prompt: a ballerina, romantic sunset, 4k photo
![images_0)](./screenshot_ballerina.png)


### Comfy Workflow
![images_0)](./out_ballerina.png)


(Image is from ComfyUI, you can drag and drop in Comfy to use it as workflow)

### Training

Use of the training script by HF🤗 [here](https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md). 

#### Training data
This checkpoint was first trained for 15,000 steps on laion 6a resized to a max minimum dimension of 768. 

#### Compute
one 1xA100 machine (Thanks a lot HF🤗 to provide the compute!)

#### Batch size
Data parallel with a single gpu batch size of 2 with gradient accumulation 8.

#### Hyper Parameters
Constant learning rate of 8e-5

#### Mixed precision
fp16