server

Documentation

Index

• type S
  • func New(om *ollama.Manager) *S
  • func (s *S) RegisterModel(ctx context.Context, req *v1.RegisterModelRequest) (*v1.RegisterModelResponse, error)
  • func (s *S) Run(port int) error
  • func (s *S) Stop()

Types

type S

type S struct {
	v1.UnimplementedInferenceEngineInternalServiceServer
	// contains filtered or unexported fields
}

S is a server.

func New

func New(om *ollama.Manager) *S

New creates a server.

func (*S) RegisterModel

func (s *S) RegisterModel(
	ctx context.Context,
	req *v1.RegisterModelRequest,
) (*v1.RegisterModelResponse, error)

func (*S) Run

func (s *S) Run(port int) error

Run starts the gRPC server.

func (*S) Stop

func (s *S) Stop()

Stop stops the gRPC server.