Usage guide
Setup, environment variables, and Python/JavaScript/Go usage examples.
AWSBedrockLLM
Language model access through Amazon Bedrock, using your own AWS credentials. Choose it to run Amazon Nova, Anthropic Claude, Llama and other Bedrock models inside your AWS account. Authenticates with AWS_ACCESS_KEY_ID from your environment, or an explicitapi_key.
Fields
str
default:"UNSET"
Bedrock model ID or inference profile ARN, e.g. “amazon.nova-lite-v1:0”. Defaults to ‘amazon.nova-lite-v1:0’.
str
default:"UNSET"
AWS region to call Bedrock in, e.g. “us-east-1”. The model must be enabled in that region. Defaults to ‘us-east-1’.
float
default:"UNSET"
Sampling randomness, typically 0 to 1. Lower is more focused and predictable, higher is more varied. Defaults to 0.7.
Literal['auto', 'required', 'none']
default:"UNSET"
Whether the model may call tools: “auto” lets it decide, “required” forces a tool call, “none” disables tools. Defaults to ‘auto’.
int | None
default:"UNSET"
Maximum number of tokens in each response. Defaults to None (not set).
float | None
default:"UNSET"
Nucleus sampling, 0 to 1: only tokens within this cumulative probability are considered. Defaults to None (not set).
int | None
default:"UNSET"
Limits sampling to the K most likely tokens. Not every model supports it. Defaults to None (not set).
list[str] | None
default:"UNSET"
Strings that end the response as soon as the model produces one. Defaults to None (not set).
dict[str, Any] | None
default:"UNSET"
Extra model-specific request parameters as a dict, passed as Bedrock additionalModelRequestFields. Defaults to None (not set).
bool
default:"UNSET"
Cache the system prompt between turns to cut input token cost and latency, on models that support prompt caching. Defaults to False.
bool
default:"UNSET"
Cache the tool definitions between turns to cut input token cost and latency, on models that support prompt caching. Defaults to False.
bool
default:"UNSET"
Remove <thinking>…</thinking> reasoning from responses so it is not spoken aloud. Amazon Nova models emit these tags. Defaults to True.
bool | None
default:"UNSET"
Turn tool calls the model writes as plain text into real tool calls, for models without native tool use such as Gemma. Unset enables it automatically for such models. Defaults to None (not set).