bedrock

Documentation

Index

• Constants
• type Client
  • func New(opts ...Option) (*Client, error)
  • func (c *Client) ConsumedTokens() int
  • func (c *Client) Send(ctx context.Context, prompt *chatter.Prompt) (*chatter.Prompt, error)
• type Llama2
  • func (v Llama2) String() string
• type Model
• type Option
  • func WithConfig(cfg aws.Config) Option
  • func WithModel(model Model) Option
  • func WithQuotaTokensInReply(quota int) Option
• type TitanText
  • func (v TitanText) String() string

Constants

const (
	LLAMA2_13B_CHAT_V1 = Llama2("meta.llama2-13b-chat-v1")
	LLAMA2_70B_CHAT_V1 = Llama2("meta.llama2-70b-chat-v1")
)

See https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html

const (
	TITAN_TEXT_LITE_V1    = TitanText("amazon.titan-text-lite-v1")
	TITAN_TEXT_EXPRESS_V1 = TitanText("amazon.titan-text-express-v1")
)

See https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids.html

Types

type Client

type Client struct {
	// contains filtered or unexported fields
}

Bedrock client

func New

func New(opts ...Option) (*Client, error)

Creates AWS BedRock embeddings client.

By default `us-east-1` region is used, supply custom `aws.Config` to alter behavior.

The client is configurable using

WithConfig(cfg aws.Config)
WithModel(model Model)
WithQuotaTokensInReply(quota int)

func (*Client) ConsumedTokens

func (c *Client) ConsumedTokens() int

Number of tokens consumed within the session

func (*Client) Send

func (c *Client) Send(ctx context.Context, prompt *chatter.Prompt) (*chatter.Prompt, error)

Calculates embedding vector

type Llama2

type Llama2 string

Meta Llama 2 Chat model

See * https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-meta.html * https://replicate.com/blog/how-to-prompt-llama

func (Llama2) String

func (v Llama2) String() string

type Model

type Model interface {
	String() string
	// contains filtered or unexported methods
}

type Option

type Option func(*Client)

Config option for the client

func WithConfig

func WithConfig(cfg aws.Config) Option

Config AWS endpoints

func WithModel

func WithModel(model Model) Option

Config bedrock model

func WithQuotaTokensInReply

func WithQuotaTokensInReply(quota int) Option

Config tokens quota in reply

type TitanText

type TitanText string

Amazon Titan Text model See https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-titan-text.html See https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-templates-and-examples.html

func (TitanText) String

func (v TitanText) String() string