fermatresearch/sdxl-controlnet-lora

'''Last update: Now supports img2img.''' SDXL Canny controlnet with LoRA support.

Capabilities

Reference Images Negative Prompt Seed

Cost

Community model (estimated from hardware time)

Input Parameters

Name	Type	Description	Default	Constraints
`apply_watermark`	boolean	Applies a watermark to enable determining if an image is generated in downstream applications. If you have other provisions for generating or deploying images safely, you can use this to disable watermarking.	`true`	—
`condition_scale`	number	The bigger this number is, the more ControlNet interferes	`1.1`	min: 0, max: 2
`guidance_scale`	number	Scale for classifier-free guidance	`7.5`	min: 1, max: 50
`image`	string (uri)	Input image for img2img or inpaint mode	`—`	—
`img2img`	boolean	Use img2img pipeline, it will use the image input both as the control image and the base image.	`—`	—
`lora_scale`	number	LoRA additive scale. Only applicable on trained models.	`0.95`	min: 0, max: 1
`lora_weights`	string	Replicate LoRA weights to use. Leave blank to use the default weights.	`—`	—
`negative_prompt`	string	Input Negative Prompt	`""`	—
`num_inference_steps`	integer	Number of denoising steps	`30`	min: 1, max: 500
`num_outputs`	integer	Number of images to output	`1`	min: 1, max: 4
`prompt`	string	Input prompt	`"An astronaut riding a rainbow unicorn"`	—
`refine`	string	Whether to use refinement steps or not	`"base_image_refiner"`	no_refiner base_image_refiner
`refine_steps`	integer	For base_image_refiner, the number of steps to refine	`10`	—
`scheduler`	string	scheduler	`"K_EULER"`	DDIM DPMSolverMultistep HeunDiscrete KarrasDPM K_EULER_ANCESTRAL K_EULER PNDM
`seed`	integer	Random seed. Leave blank to randomize the seed	`—`	—
`strength`	number	When img2img is active, the denoising strength. 1 means total destruction of the input image.	`0.8`	min: 0, max: 1

apply_watermark boolean

Applies a watermark to enable determining if an image is generated in downstream applications. If you have other provisions for generating or deploying images safely, you can use this to disable watermarking.

Default: true

condition_scale number

The bigger this number is, the more ControlNet interferes

Default: 1.1 min: 0, max: 2

guidance_scale number

Scale for classifier-free guidance

Default: 7.5 min: 1, max: 50

image string

Input image for img2img or inpaint mode

img2img boolean

Use img2img pipeline, it will use the image input both as the control image and the base image.

lora_scale number

LoRA additive scale. Only applicable on trained models.

Default: 0.95 min: 0, max: 1

lora_weights string

Replicate LoRA weights to use. Leave blank to use the default weights.

negative_prompt string

Input Negative Prompt

Default: ""

num_inference_steps integer

Number of denoising steps

Default: 30 min: 1, max: 500

num_outputs integer

Number of images to output

Default: 1 min: 1, max: 4

prompt string

Input prompt

Default: "An astronaut riding a rainbow unicorn"

refine string

Whether to use refinement steps or not

Default: "base_image_refiner"

no_refiner base_image_refiner

refine_steps integer

For base_image_refiner, the number of steps to refine

Default: 10

scheduler string

scheduler

Default: "K_EULER"

DDIM DPMSolverMultistep HeunDiscrete KarrasDPM K_EULER_ANCESTRAL K_EULER PNDM

seed integer

Random seed. Leave blank to randomize the seed

strength number

When img2img is active, the denoising strength. 1 means total destruction of the input image.

Default: 0.8 min: 0, max: 1

Version: 3bb13fe1c33c Updated: 2/26/2026 997.7K runs