Create Inference Profile

bedrock_create_inference_profile

R Documentation

Creates an application inference profile to track metrics and costs when invoking a model¶

Description¶

Creates an application inference profile to track metrics and costs when invoking a model. To create an application inference profile for a foundation model in one region, specify the ARN of the model in that region. To create an application inference profile for a foundation model across multiple regions, specify the ARN of the system-defined inference profile that contains the regions that you want to route requests to. For more information, see Increase throughput and resilience with cross-region inference in Amazon Bedrock. in the Amazon Bedrock User Guide.

Usage¶

bedrock_create_inference_profile(inferenceProfileName, description,
  clientRequestToken, modelSource, tags)

Arguments¶

inferenceProfileName: [required] A name for the inference profile.
description: A description for the inference profile.
clientRequestToken: A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.
modelSource: [required] The foundation model or system-defined inference profile that the inference profile will track metrics and costs for.
tags: An array of objects, each of which contains a tag and its value. For more information, see Tagging resources in the Amazon Bedrock User Guide.

Value¶

A list with the following syntax:

list(
  inferenceProfileArn = "string",
  status = "ACTIVE"
)

Request syntax¶

svc$create_inference_profile(
  inferenceProfileName = "string",
  description = "string",
  clientRequestToken = "string",
  modelSource = list(
    copyFrom = "string"
  ),
  tags = list(
    list(
      key = "string",
      value = "string"
    )
  )
)