inference/

directory
v8.18.1 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Jun 17, 2025 License: Apache-2.0

Directories

Path Synopsis
Perform chat completion inference
Perform chat completion inference
Perform completion inference on the service
Perform completion inference on the service
Delete an inference endpoint
Delete an inference endpoint
Get an inference endpoint
Get an inference endpoint
Perform inference on the service.
Perform inference on the service.
Create an inference endpoint.
Create an inference endpoint.
Create an AlibabaCloud AI Search inference endpoint.
Create an AlibabaCloud AI Search inference endpoint.
Create an Amazon Bedrock inference endpoint.
Create an Amazon Bedrock inference endpoint.
Create an Anthropic inference endpoint.
Create an Anthropic inference endpoint.
Create an Azure AI studio inference endpoint.
Create an Azure AI studio inference endpoint.
Create an Azure OpenAI inference endpoint.
Create an Azure OpenAI inference endpoint.
Create a Cohere inference endpoint.
Create a Cohere inference endpoint.
Create an Elasticsearch inference endpoint.
Create an Elasticsearch inference endpoint.
Create an ELSER inference endpoint.
Create an ELSER inference endpoint.
Create an Google AI Studio inference endpoint.
Create an Google AI Studio inference endpoint.
Create a Google Vertex AI inference endpoint.
Create a Google Vertex AI inference endpoint.
Create a Hugging Face inference endpoint.
Create a Hugging Face inference endpoint.
Create an JinaAI inference endpoint.
Create an JinaAI inference endpoint.
Create a Mistral inference endpoint.
Create a Mistral inference endpoint.
Create an OpenAI inference endpoint.
Create an OpenAI inference endpoint.
Create a VoyageAI inference endpoint.
Create a VoyageAI inference endpoint.
Create a Watsonx inference endpoint.
Create a Watsonx inference endpoint.
Perform rereanking inference on the service
Perform rereanking inference on the service
Perform sparse embedding inference on the service
Perform sparse embedding inference on the service
Perform streaming inference.
Perform streaming inference.
Perform text embedding inference on the service
Perform text embedding inference on the service
Update an inference endpoint.
Update an inference endpoint.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL