bedrock

README

---

title: 'Amazon Bedrock' description: 'Integration with Amazon Bedrock for accessing Claude and other AI models'

The Amazon Bedrock provider enables integration with Claude 3.7 Sonnet and other Anthropic models hosted on AWS Bedrock. This guide covers setup, configuration, authentication, and usage options.

Overview

Amazon Bedrock is a fully managed service that offers a selection of high-performing foundation models (FMs), including Anthropic's Claude models. The provider leverages AWS services to securely access these models with robust authentication and flexible configuration options.

AWS Authorization and Authentication

The provider uses standard AWS authentication mechanisms to manage access to Bedrock services. To ensure secure and seamless integration, make sure you have the necessary IAM permissions. AWS supports multiple methods for credential management, including:

• Environment Variables: Set AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY to provide your credentials.
• AWS Credentials File: Configure your credentials in the ~/.aws/credentials file.
• EC2 Instance Profiles: For applications running on EC2, IAM roles can provide temporary credentials.

For more details on configuring AWS credentials and best practices, refer to the following resources:

• AWS IAM Best Practices
• AWS CLI Configuration Guide

CLI Installation

The AWS CLI is a crucial tool for managing your AWS credentials and interacting with AWS services. If you haven't installed it yet, follow the instructions in the official guide:

• AWS CLI Installation Guide

After installation, configure your credentials using:

aws configure

Example Usage

Below is a basic example of how to use the provider with a connection configuration file:

./gateway discover \
  --ai-provider bedrock \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

Region Configuration

The provider determines which AWS region to use in the following order:

1. Explicitly configured region via the --bedrock-region flag
2. Environment variable BEDROCK_REGION
3. Environment variable AWS_REGION
4. Default fallback to us-east-1

Example with an explicit region:

./gateway discover \
  --ai-provider bedrock \
  --bedrock-region us-west-2 \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

Model Selection

By default, the Bedrock provider uses us.anthropic.claude-3-7-sonnet-20250219-v1:0. You can specify a different model using one of the following methods:

1. Command-line Flag: Use the --ai-model flag.
2. Environment Variable: Set the BEDROCK_MODEL_ID.

Examples:

# Specify model via command line
./gateway discover \
  --ai-provider bedrock \
  --ai-model us.anthropic.claude-3-7-sonnet-20250219-v1:0 \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

# Or via environment variable
export BEDROCK_MODEL_ID=us.anthropic.claude-3-7-sonnet-20250219-v1:0
./gateway discover \
  --ai-provider bedrock \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

Advanced Configuration

Reasoning Mode

Enable Claude's "thinking" mode for complex reasoning tasks:

./gateway discover \
  --ai-provider bedrock \
  --ai-reasoning=true \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

When reasoning mode is enabled, the provider:

• Activates Claude's thinking capability
• Allocates a thinking token budget of 4096 tokens
• Sets the temperature to 1.0

Response Length Control

Control the maximum token count in responses:

./gateway discover \
  --ai-provider bedrock \
  --ai-max-tokens 8192 \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

If not specified, the default maximum token count is 64000 tokens.

Temperature Adjustment

Adjust the randomness of responses with the temperature parameter:

./gateway discover \
  --ai-provider bedrock \
  --ai-temperature 0.5 \
  --connection-string "postgresql://my_user:my_pass@localhost:5432/mydb"

Lower values produce more deterministic outputs, while higher values increase creativity and randomness.

Usage Costs

The Bedrock provider includes cost estimation for Claude Sonnet models:

• Input tokens: $3.75 per 1 million tokens
• Output tokens: $15.00 per 1 million tokens

Costs are calculated based on the actual token usage for each request.

Recommended Best Practices

• Start with Claude 3.7 Sonnet: Offers a balance of performance and cost.
• Manage Token Count: Set a reasonable maximum token count to control costs.
• Enable Reasoning Mode: Use for complex analytical tasks.
• Secure Configuration: Use environment variables or AWS credentials files for sensitive settings.
• Regularly Update IAM Policies: Follow the principle of least privilege to minimize risks.

Additional Resources

• AWS Identity and Access Management (IAM) Documentation
• AWS Security Credentials
• AWS CLI Official Documentation

Documentation

Index

• Variables
• func NewBedrockProvider(providerConfig providers.ModelProviderConfig) (providers.ModelProvider, error)
• type BedrockProvider
  • func (bp *BedrockProvider) Chat(ctx context.Context, req *providers.ConversationRequest) (*providers.ConversationResponse, error)
  • func (bp *BedrockProvider) ChatStream(ctx context.Context, req *providers.ConversationRequest) (providers.ChatStreamOutput, error)
  • func (ap *BedrockProvider) CostEstimate(modelId string, usage providers.ModelUsage) float64
  • func (bp *BedrockProvider) GetName() string
• type BedrockStream
  • func (s *BedrockStream) Events() <-chan providers.StreamChunk
• type BedrockStreamOutput
  • func (o *BedrockStreamOutput) GetStream() providers.ChatStream

Variables

var (
	ErrBedrockClientNotInit = errors.New("bedrock client is not initialized")
	ErrUnexpectedResponse   = errors.New("unexpected response format from Bedrock")
)

Functions

func NewBedrockProvider

func NewBedrockProvider(providerConfig providers.ModelProviderConfig) (providers.ModelProvider, error)

Types

type BedrockProvider

type BedrockProvider struct {
	Client     *bedrockruntime.Client
	RegionName string
}

func (*BedrockProvider) Chat

func (bp *BedrockProvider) Chat(ctx context.Context, req *providers.ConversationRequest) (*providers.ConversationResponse, error)

func (*BedrockProvider) ChatStream

func (bp *BedrockProvider) ChatStream(ctx context.Context, req *providers.ConversationRequest) (providers.ChatStreamOutput, error)

func (*BedrockProvider) CostEstimate

func (ap *BedrockProvider) CostEstimate(modelId string, usage providers.ModelUsage) float64

func (*BedrockProvider) GetName

func (bp *BedrockProvider) GetName() string

type BedrockStream

type BedrockStream struct {
	// contains filtered or unexported fields
}

func (*BedrockStream) Events

func (s *BedrockStream) Events() <-chan providers.StreamChunk

type BedrockStreamOutput

type BedrockStreamOutput struct {
	// contains filtered or unexported fields
}

func (*BedrockStreamOutput) GetStream

func (o *BedrockStreamOutput) GetStream() providers.ChatStream