zsxkib/animatediff-prompt-travel

🎨AnimateDiff Prompt Travel🧭 Seamlessly Navigate and Animate Between Text-to-Image Prompts for Dynamic Visual Narratives

Capabilities

1:14:33:416:99:162:33:2Negative PromptSeed

Cost

Community model (estimated from hardware time)

Input Parameters

Name	Type	Description	Default	Constraints
`base_model`	string	Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter	`"majicmixRealistic_v5Preview"`	realisticVisionV20_v20lyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3CUSTOM
`clip_skip`	integer	Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)	`2`	min: 1, max: 6
`context`	integer	Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24	`16`	min: 1, max: 32
`custom_base_model_url`	string	Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed	`""`	—
`frames`	integer	Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)	`128`	min: 1, max: 1024
`guidance_scale`	number	Guidance Scale. How closely do we want to adhere to the prompt and its contents	`7.5`	min: 0, max: 20
`head_prompt`	string	Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map	`"masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky"`	—
`height`	integer	Height of generated video in pixels, must be divisable by 8	`384`	min: 64, max: 2160
`negative_prompt`	string	—	`"(worst quality, low quality:1.4), black and white, b&w, sunny, clear skies, calm seas, beach, daytime, ((bright colors)), cartoonish, modern ships, sketchy, unfinished, modern buildings, trees, island"`	—
`output_format`	string	Output format of the video. Can be 'mp4' or 'gif'	`"mp4"`	mp4gif
`playback_frames_per_second`	integer	—	`8`	min: 1, max: 60
`prompt_fixed_ratio`	number	Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).	`0.5`	min: 0, max: 1
`prompt_map`	string	Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '\|'. Make sure the frame number does not exceed the length of video (frames)	`"0: ship steadily moving,((waves crashing against the ship:1.0)) \| 32: (((lightning strikes))), distant thunder, ship rocked by waves \| 64: ship silhouette,(((heavy rain))),wind howling, waves rising higher \| 96: ship navigating through the storm, rain easing off"`	—
`scheduler`	string	Diffusion scheduler	`"k_dpmpp_sde"`	ddimpndmheununipceulereuler_almsk_lmsdpm_2k_dpm_2dpm_2_ak_dpm_2_adpmpp_2mk_dpmpp_2mdpmpp_sdek_dpmpp_sdedpmpp_2m_sdek_dpmpp_2m_sde
`seed`	integer	Seed for different images and reproducibility. Use -1 to randomise seed	`-1`	—
`steps`	integer	Number of inference steps	`25`	min: 1, max: 100
`tail_prompt`	string	Additional prompt that will be appended at the end of the main prompt or individual prompts in the map	`"dark horizon, flashes of lightning illuminating the ship, sailors working hard, ship's lanterns flickering, eerie, mysterious, sails flapping loudly, stormy atmosphere"`	—
`width`	integer	Width of generated video in pixels, must be divisable by 8	`256`	min: 64, max: 2160

base_modelstring

Choose the base model for animation generation. If 'CUSTOM' is selected, provide a custom model URL in the next parameter

Default: "majicmixRealistic_v5Preview"

realisticVisionV20_v20lyriel_v16majicmixRealistic_v5PreviewrcnzCartoon3d_v10toonyou_beta3CUSTOM

clip_skipinteger

Skip the last N-1 layers of the CLIP text encoder (lower values follow prompt more closely)

Default: 2min: 1, max: 6

contextinteger

Number of frames to condition on (default: max of <length> or 32). max for motion module v1 is 24

Default: 16min: 1, max: 32

custom_base_model_urlstring

Only used when base model is set to 'CUSTOM'. URL of the custom model to download if 'CUSTOM' is selected in the base model. Only downloads from 'https://civitai.com/api/download/models/' are allowed

Default: ""

framesinteger

Length of the video in frames (playback is at 8 fps e.g. 16 frames @ 8 fps is 2 seconds)

Default: 128min: 1, max: 1024

guidance_scalenumber

Guidance Scale. How closely do we want to adhere to the prompt and its contents

Default: 7.5min: 0, max: 20

head_promptstring

Primary animation prompt. If a prompt map is provided, this will be prefixed at the start of every individual prompt in the map

Default:

"masterpiece, best quality, a haunting and detailed depiction of a ship at sea, battered by waves, ominous,((dark clouds:1.3)),distant lightning, rough seas, rain, silhouette of the ship against the stormy sky"

heightinteger

Height of generated video in pixels, must be divisable by 8

Default: 384min: 64, max: 2160

negative_promptstring

Default:

"(worst quality, low quality:1.4), black and white, b&w, sunny, clear skies, calm seas, beach, daytime, ((bright colors)), cartoonish, modern ships, sketchy, unfinished, modern buildings, trees, island"

output_formatstring

Output format of the video. Can be 'mp4' or 'gif'

Default: "mp4"

mp4gif

playback_frames_per_secondinteger

Default: 8min: 1, max: 60

prompt_fixed_rationumber

Defines the ratio of adherence to the fixed part of the prompt versus the dynamic part (from prompt map). Value should be between 0 (only dynamic) to 1 (only fixed).

Default: 0.5min: 0, max: 1

prompt_mapstring

Prompt for changes in animation. Provide 'frame number : prompt at this frame', separate different prompts with '|'. Make sure the frame number does not exceed the length of video (frames)

Default:

"0: ship steadily moving,((waves crashing against the ship:1.0)) | 32: (((lightning strikes))), distant thunder, ship rocked by waves | 64: ship silhouette,(((heavy rain))),wind howling, waves rising higher | 96: ship navigating through the storm, rain easing off"

schedulerstring

Diffusion scheduler

Default: "k_dpmpp_sde"

ddimpndmheununipceulereuler_almsk_lmsdpm_2k_dpm_2dpm_2_ak_dpm_2_adpmpp_2mk_dpmpp_2mdpmpp_sdek_dpmpp_sdedpmpp_2m_sdek_dpmpp_2m_sde

seedinteger

Seed for different images and reproducibility. Use -1 to randomise seed

Default: -1

stepsinteger

Number of inference steps

Default: 25min: 1, max: 100

tail_promptstring

Additional prompt that will be appended at the end of the main prompt or individual prompts in the map

Default:

"dark horizon, flashes of lightning illuminating the ship, sailors working hard, ship's lanterns flickering, eerie, mysterious, sails flapping loudly, stormy atmosphere"

widthinteger

Width of generated video in pixels, must be divisable by 8

Default: 256min: 64, max: 2160

Version: 1b8a8f2725c0Updated: 7/25/20265.7K runs