zsxkib/animate-diff

OfficialView on Replicate →

🎨 AnimateDiff (w/ MotionLoRAs for Panning, Zooming, etc): Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning

Capabilities

1:14:33:416:99:162:33:2Negative PromptSeed

Cost

Community model (estimated from hardware time)

Input Parameters

Name	Type	Description	Default	Constraints
`base_model`	string	Select a base model (DreamBooth checkpoint)	`"realisticVisionV20_v20"`	realisticVisionV20_v20lyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3
`frames`	integer	Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)	`16`	min: 1, max: 32
`guidance_scale`	number	Guidance Scale. How closely do we want to adhere to the prompt and its contents	`7.5`	min: 0, max: 20
`height`	integer	Height in pixels	`512`	—
`negative_prompt`	string	—	`"blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation"`	—
`output_format`	string	Output format of the video. Can be 'mp4' or 'gif'	`"mp4"`	mp4gif
`pan_down_motion_strength`	number	Strength of Pan Down Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`pan_left_motion_strength`	number	Strength of Pan Left Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`pan_right_motion_strength`	number	Strength of Pan Right Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`pan_up_motion_strength`	number	Strength of Pan Up Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`prompt`	string	—	`"photo of vocano, rocks, storm weather, wind, lava waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3"`	—
`rolling_anticlockwise_motion_strength`	number	Strength of Rolling Anticlockwise Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`rolling_clockwise_motion_strength`	number	Strength of Rolling Clockwise Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`seed`	integer	Seed for different images and reproducibility. Use -1 to randomise seed	`-1`	—
`steps`	integer	Number of inference steps	`25`	min: 1, max: 100
`width`	integer	Width in pixels	`512`	—
`zoom_in_motion_strength`	number	Strength of Zoom In Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1
`zoom_out_motion_strength`	number	Strength of Zoom Out Motion LoRA. 0 disables the LoRA	`0`	min: 0, max: 1

base_modelstring

Select a base model (DreamBooth checkpoint)

Default: "realisticVisionV20_v20"

realisticVisionV20_v20lyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3

framesinteger

Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)

Default: 16min: 1, max: 32

guidance_scalenumber

Guidance Scale. How closely do we want to adhere to the prompt and its contents

Default: 7.5min: 0, max: 20

heightinteger

Height in pixels

Default: 512

negative_promptstring

Default:

"blur, haze, deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime, mutated hands and fingers, deformed, distorted, disfigured, poorly drawn, bad anatomy, wrong anatomy, extra limb, missing limb, floating limbs, disconnected limbs, mutation, mutated, ugly, disgusting, amputation"

output_formatstring

Output format of the video. Can be 'mp4' or 'gif'

Default: "mp4"

mp4gif

pan_down_motion_strengthnumber

Strength of Pan Down Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

pan_left_motion_strengthnumber

Strength of Pan Left Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

pan_right_motion_strengthnumber

Strength of Pan Right Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

pan_up_motion_strengthnumber

Strength of Pan Up Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

promptstring

Default:

"photo of vocano, rocks, storm weather, wind, lava waves, lightning, 8k uhd, dslr, soft lighting, high quality, film grain, Fujifilm XT3"

rolling_anticlockwise_motion_strengthnumber

Strength of Rolling Anticlockwise Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

rolling_clockwise_motion_strengthnumber

Strength of Rolling Clockwise Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

seedinteger

Seed for different images and reproducibility. Use -1 to randomise seed

Default: -1

stepsinteger

Number of inference steps

Default: 25min: 1, max: 100

widthinteger

Width in pixels

Default: 512

zoom_in_motion_strengthnumber

Strength of Zoom In Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

zoom_out_motion_strengthnumber

Strength of Zoom Out Motion LoRA. 0 disables the LoRA

Default: 0min: 0, max: 1

Version: 269a616c8b0cUpdated: 7/25/202659.3K runs