← Back to all generators

ibm-granite/granite-20b-code-instruct-8k

Join the Granite community where you can find numerous recipe workbooks to help you get started with a wide variety of use cases using this model. https://github.com/ibm-granite-community

Capabilities

SeedSystem PromptMax TokensTop-P

Cost

Community model (estimated from hardware time)

Input Parameters

frequency_penaltynumber

Frequency penalty

Default: 0
max_tokensinteger

The maximum number of tokens the model should generate as output.

Default: 512
min_tokensinteger

The minimum number of tokens the model should generate as output.

Default: 0
presence_penaltynumber

Presence penalty

Default: 0
promptstring

Prompt

Default: ""
prompt_templatestring

A template to format the prompt with. If not provided, the default prompt template will be used.

seedinteger

Random seed. Leave blank to randomize the seed.

stop_sequencesstring

A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.

system_promptstring

System prompt to send to the model. This is prepended to the prompt and helps guide system behavior. Ignored for non-chat models.

Default: "You are a helpful assistant."
temperaturenumber

The value used to modulate the next token probabilities.

Default: 0.6
top_kinteger

The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).

Default: 50
top_pnumber

A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).

Default: 0.9
Version: 409a0c68b74dUpdated: 7/25/2026110.0K runs