Retrieves detailed information about an evaluator, including its configuration, status, and metadata¶
Description¶
Retrieves detailed information about an evaluator, including its configuration, status, and metadata. Works with both built-in and custom evaluators.
Usage¶
Arguments¶
-
evaluatorId[required] The unique identifier of the evaluator to retrieve. Can be a built-in evaluator ID (e.g., Builtin.Helpfulness) or a custom evaluator ID.
-
includedDataControls which data is returned in the response.
ALL_DATA(default) returns the full evaluator including decrypted instructions and rating scale. For evaluators encrypted with a customer managed KMS key, this requireskms:Decryptpermission on the key.METADATA_ONLYreturns evaluator metadata and model configuration without instructions or rating scale, and does not require any KMS permissions.
Value¶
A list with the following syntax:
list(
evaluatorArn = "string",
evaluatorId = "string",
evaluatorName = "string",
description = "string",
evaluatorConfig = list(
llmAsAJudge = list(
instructions = "string",
ratingScale = list(
numerical = list(
list(
definition = "string",
value = 123.0,
label = "string"
)
),
categorical = list(
list(
definition = "string",
label = "string"
)
)
),
modelConfig = list(
bedrockEvaluatorModelConfig = list(
modelId = "string",
inferenceConfig = list(
maxTokens = 123,
temperature = 123.0,
topP = 123.0,
stopSequences = list(
"string"
)
),
additionalModelRequestFields = list()
),
responsesEvaluatorModelConfig = list(
modelId = "string",
maxOutputTokens = 123,
temperature = 123.0,
topP = 123.0,
reasoning = list(
effort = "string"
)
)
)
),
codeBased = list(
lambdaConfig = list(
lambdaArn = "string",
lambdaTimeoutInSeconds = 123
)
),
derived = list(
baseEvaluatorId = "string",
modelConfig = list(
bedrockEvaluatorModelConfig = list(
modelId = "string",
inferenceConfig = list(
maxTokens = 123,
temperature = 123.0,
topP = 123.0,
stopSequences = list(
"string"
)
),
additionalModelRequestFields = list()
),
responsesEvaluatorModelConfig = list(
modelId = "string",
maxOutputTokens = 123,
temperature = 123.0,
topP = 123.0,
reasoning = list(
effort = "string"
)
)
)
)
),
evaluatorType = "Builtin"|"ThirdParty"|"Custom"|"CustomCode"|"CustomDerived",
provider = "AWS"|"DeepEval"|"AutoEval"|"Custom",
level = "TOOL_CALL"|"TRACE"|"SESSION",
status = "ACTIVE"|"CREATING"|"CREATE_FAILED"|"UPDATING"|"UPDATE_FAILED"|"DELETING",
createdAt = as.POSIXct(
"2015-01-01"
),
updatedAt = as.POSIXct(
"2015-01-01"
),
lockedForModification = TRUE|FALSE,
kmsKeyArn = "string"
)