teiapi

Documentation

Index

• type Client
  • func NewClient(baseURL string, timeout time.Duration) *Client
  • func (c *Client) Close() error
  • func (c *Client) Decode(ctx context.Context, req *proto.DecodeRequest) (*proto.DecodeResponse, error)
  • func (c *Client) Embed(ctx context.Context, req *proto.EmbedRequest) (*proto.EmbedResponse, error)
  • func (c *Client) EmbedAll(ctx context.Context, req *proto.EmbedAllRequest) (*proto.EmbedAllResponse, error)
  • func (c *Client) EmbedSparse(ctx context.Context, req *proto.EmbedSparseRequest) (*proto.EmbedSparseResponse, error)
  • func (c *Client) Health(ctx context.Context) error
  • func (c *Client) Info(ctx context.Context, req *proto.InfoRequest) (*proto.InfoResponse, error)
  • func (c *Client) Metrics(ctx context.Context) (string, error)
  • func (c *Client) OpenAIEmbed(ctx context.Context, req *proto.EmbedRequest) (*proto.EmbedResponse, error)
  • func (c *Client) Predict(ctx context.Context, req *proto.PredictRequest) (*proto.PredictResponse, error)
  • func (c *Client) Rerank(ctx context.Context, req *proto.RerankRequest) (*proto.RerankResponse, error)
  • func (c *Client) Tokenize(ctx context.Context, req *proto.EncodeRequest) (*proto.EncodeResponse, error)

Types

type Client

type Client struct {
	// contains filtered or unexported fields
}

Client is a HTTP client for the TEI REST API using protobuf message types.

func NewClient

func NewClient(baseURL string, timeout time.Duration) *Client

NewClient creates a new HTTP client with the given baseURL and timeout.

func (*Client) Close

func (c *Client) Close() error

Close is a no-op for HTTP client.

func (*Client) Decode

func (c *Client) Decode(ctx context.Context, req *proto.DecodeRequest) (*proto.DecodeResponse, error)

Decode decodes input IDs to text.

func (*Client) Embed

func (c *Client) Embed(ctx context.Context, req *proto.EmbedRequest) (*proto.EmbedResponse, error)

Embed returns pooled embeddings.

func (*Client) EmbedAll

func (c *Client) EmbedAll(ctx context.Context, req *proto.EmbedAllRequest) (*proto.EmbedAllResponse, error)

EmbedAll returns token-level embeddings.

func (*Client) EmbedSparse

func (c *Client) EmbedSparse(ctx context.Context, req *proto.EmbedSparseRequest) (*proto.EmbedSparseResponse, error)

EmbedSparse returns sparse embeddings.

func (*Client) Health

func (c *Client) Health(ctx context.Context) error

Health checks service health.

func (*Client) Info

func (c *Client) Info(ctx context.Context, req *proto.InfoRequest) (*proto.InfoResponse, error)

Info retrieves model information.

func (*Client) Metrics

func (c *Client) Metrics(ctx context.Context) (string, error)

Metrics returns Prometheus metrics text.

func (*Client) OpenAIEmbed

func (c *Client) OpenAIEmbed(ctx context.Context, req *proto.EmbedRequest) (*proto.EmbedResponse, error)

OpenAIEmbed returns embeddings in OpenAI-compatible format.

func (*Client) Predict

func (c *Client) Predict(ctx context.Context, req *proto.PredictRequest) (*proto.PredictResponse, error)

Predict returns classification predictions.

func (*Client) Rerank

func (c *Client) Rerank(ctx context.Context, req *proto.RerankRequest) (*proto.RerankResponse, error)

Rerank returns ranked texts for a query.

func (*Client) Tokenize

func (c *Client) Tokenize(ctx context.Context, req *proto.EncodeRequest) (*proto.EncodeResponse, error)

Tokenize converts text to tokens.