gvecchio/MatSynth
Updated • 4.51k • 59
How to use sidnarsipur/controlnet_height with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline
controlnet = ControlNetModel.from_pretrained("sidnarsipur/controlnet_height")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
"stabilityai/stable-diffusion-2-1-base", controlnet=controlnet
)from diffusers import ControlNetModel, StableDiffusionControlNetPipeline
controlnet = ControlNetModel.from_pretrained("sidnarsipur/controlnet_height")
pipe = StableDiffusionControlNetPipeline.from_pretrained(
"stabilityai/stable-diffusion-2-1-base", controlnet=controlnet
)These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning. You can find some example images below.
prompt: Height Map
prompt: Height Map
prompt: Height Map
prompt: Height Map

# TODO: add an example code snippet for running this diffusion pipeline
[TODO: provide examples of latent issues and potential remediations]
[TODO: describe the data used to train the model]
Base model
stabilityai/stable-diffusion-2-1-base