zsxkib/animatediff-illusions

Monster Labs' Controlnet QR Code Monster v2 For SD-1.5 on top of AnimateDiff Prompt Travel (Motion Module SD 1.5 v2)

Capabilities

1:14:33:416:99:162:33:2Negative PromptSeed

Cost

Community model (estimated from hardware time)

Input Parameters

Name	Type	Description	Default	Constraints
`base_model`	string	Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter	`"majicmixRealistic_v5Preview"`	realisticVisionV40_v20Novaelyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3CUSTOM
`clip_skip`	integer	Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)	`2`	min: 1, max: 6
`context`	integer	Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24	`16`	min: 1, max: 32
`controlnet_conditioning_scale`	number	Strength of ControlNet. The outputs of the ControlNet are multiplied by `controlnet_conditioning_scale` before they are added to the residual in the original UNet	`0.18`	—
`controlnet_video`	string(uri)	A short video/gif that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes	`—`	—
`custom_base_model_url`	string	Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed	`""`	—
`enable_qr_code_monster_v2`	boolean	Flag to enable QR Code Monster V2 ControlNet	`true`	—
`film_interpolation`	boolean	Whether to use FILM for between-frame interpolation (film-net.github.io)	`true`	—
`frames`	integer	Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)	`128`	min: 1, max: 1024
`guidance_scale`	number	Guidance Scale. How closely do we want to adhere to the prompt and its contents	`7.5`	min: 0, max: 20
`head_prompt`	string	Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map	`"masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky"`	—
`height`	integer	Height of generated video in pixels, must be divisable by 8	`384`	min: 64, max: 2160
`loop`	boolean	Flag to loop the video. Use when you have an 'infinitely' repeating video/gif ControlNet video	`true`	—
`negative_prompt`	string	—	`""`	—
`num_interpolation_steps`	integer	Number of steps to interpolate between animation frames	`3`	min: 1, max: 50
`output_format`	string	Output format of the video. Can be 'mp4' or 'gif'	`"mp4"`	mp4gif
`playback_frames_per_second`	integer	—	`8`	min: 1, max: 60
`prompt_fixed_ratio`	number	Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).	`0.5`	min: 0, max: 1
`prompt_map`	string	Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '\|'. Make sure the frame number does not exceed the length of video (frames)	`""`	—
`qr_code_monster_v2_guess_mode`	boolean	Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet	`false`	—
`qr_code_monster_v2_preprocessor`	boolean	Flag to pre-process keyframes for QR Code Monster V2 ControlNet	`true`	—
`scheduler`	string	Diffusion scheduler	`"k_dpmpp_sde"`	ddimpndmheununipceulereuler_almsk_lmsdpm_2k_dpm_2dpm_2_ak_dpm_2_adpmpp_2mk_dpmpp_2mdpmpp_sdek_dpmpp_sdedpmpp_2m_sdek_dpmpp_2m_sde
`seed`	integer	Seed for different images and reproducibility. Leave blank to randomise seed	`—`	—
`steps`	integer	Number of inference steps	`25`	min: 1, max: 100
`tail_prompt`	string	Additional prompt that will be appended at the end of the main prompt or individual prompts in the map	`""`	—
`width`	integer	Width of generated video in pixels, must be divisable by 8	`256`	min: 64, max: 2160

base_modelstring

Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter

Default: "majicmixRealistic_v5Preview"

realisticVisionV40_v20Novaelyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3CUSTOM

clip_skipinteger

Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)

Default: 2min: 1, max: 6

contextinteger

Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24

Default: 16min: 1, max: 32

controlnet_conditioning_scalenumber

Strength of ControlNet. The outputs of the ControlNet are multiplied by `controlnet_conditioning_scale` before they are added to the residual in the original UNet

Default: 0.18

controlnet_videostring

A short video/gif that will be used as the keyframes for QR Code Monster to use, Please note, all of the frames will be used as keyframes

custom_base_model_urlstring

Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed

Default: ""

enable_qr_code_monster_v2boolean

Flag to enable QR Code Monster V2 ControlNet

Default: true

film_interpolationboolean

Whether to use FILM for between-frame interpolation (film-net.github.io)

Default: true

framesinteger

Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)

Default: 128min: 1, max: 1024

guidance_scalenumber

Guidance Scale. How closely do we want to adhere to the prompt and its contents

Default: 7.5min: 0, max: 20

head_promptstring

Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map

Default:

"masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky"

heightinteger

Height of generated video in pixels, must be divisable by 8

Default: 384min: 64, max: 2160

loopboolean

Flag to loop the video. Use when you have an 'infinitely' repeating video/gif ControlNet video

Default: true

negative_promptstring

Default: ""

num_interpolation_stepsinteger

Number of steps to interpolate between animation frames

Default: 3min: 1, max: 50

output_formatstring

Output format of the video. Can be 'mp4' or 'gif'

Default: "mp4"

mp4gif

playback_frames_per_secondinteger

Default: 8min: 1, max: 60

prompt_fixed_rationumber

Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).

Default: 0.5min: 0, max: 1

prompt_mapstring

Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)

Default: ""

qr_code_monster_v2_guess_modeboolean

Flag to enable guess mode (un-guided) for QR Code Monster V2 ControlNet

Default: false

qr_code_monster_v2_preprocessorboolean

Flag to pre-process keyframes for QR Code Monster V2 ControlNet

Default: true

schedulerstring

Diffusion scheduler

Default: "k_dpmpp_sde"

ddimpndmheununipceulereuler_almsk_lmsdpm_2k_dpm_2dpm_2_ak_dpm_2_adpmpp_2mk_dpmpp_2mdpmpp_sdek_dpmpp_sdedpmpp_2m_sdek_dpmpp_2m_sde

seedinteger

Seed for different images and reproducibility. Leave blank to randomise seed

stepsinteger

Number of inference steps

Default: 25min: 1, max: 100

tail_promptstring

Additional prompt that will be appended at the end of the main prompt or individual prompts in the map

Default: ""

widthinteger

Width of generated video in pixels, must be divisable by 8

Default: 256min: 64, max: 2160

Version: b3ccb0101402Updated: 7/25/202610.5K runs