From fd15bbfc4625b7ca74c3e6882fcbf3a0ae460384 Mon Sep 17 00:00:00 2001 From: "github-actions[bot]" <41898282+github-actions[bot]@users.noreply.github.com> Date: Fri, 6 Dec 2024 20:30:33 -0500 Subject: [PATCH] Update docs for operator (#338) Co-authored-by: michaeljguarino --- pages/deployments/operator/api.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/pages/deployments/operator/api.md b/pages/deployments/operator/api.md index 7f41b6a2..7d2237b6 100644 --- a/pages/deployments/operator/api.md +++ b/pages/deployments/operator/api.md @@ -53,6 +53,7 @@ _Appears in:_ | Field | Description | Default | Validation | | --- | --- | --- | --- | | `model` _string_ | Model is the LLM model name to use. | | Optional: {}
| +| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {}
| | `baseUrl` _string_ | A custom base url to use, for reimplementations of the same API scheme (for instance Together.ai uses the OpenAI API spec) | | Optional: {}
| | `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the token to access
the configured AI provider. | | Required: {}
| @@ -98,6 +99,7 @@ _Appears in:_ | `endpoint` _string_ | Your Azure OpenAI endpoint, should be formatted like: https://{endpoint}/openai/deployments/{deployment-id}" | | Required: {}
| | `apiVersion` _string_ | The azure openai Data plane - inference api version to use, defaults to 2024-10-01-preview or the latest available | | Optional: {}
| | `model` _string_ | The OpenAi Model you wish to use. If not specified, Plural will provide a default | | Optional: {}
| +| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {}
| | `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the token to access
the configured AI provider. | | Required: {}
| @@ -115,6 +117,7 @@ _Appears in:_ | Field | Description | Default | Validation | | --- | --- | --- | --- | | `modelId` _string_ | The AWS Bedrock Model ID to use | | Required: {}
| +| `toolModelId` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {}
| | `accessKeyId` _string_ | An AWS Access Key ID to use, can also use IRSA to acquire credentials | | Optional: {}
| | `secretAccessKeyRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | An AWS Secret Access Key to use, can also use IRSA to acquire credentials | | Optional: {}
| @@ -1602,6 +1605,7 @@ _Appears in:_ | --- | --- | --- | --- | | `url` _string_ | URL is the url this model is queryable on | | Required: {}
| | `model` _string_ | Model is the Ollama model to use when querying the /chat api | | Required: {}
| +| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {}
| | `tokenSecretRef` _[SecretKeySelector](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.29/#secretkeyselector-v1-core)_ | TokenSecretRef is a reference to the local secret holding the contents of a HTTP Authorization header
to send to your ollama api in case authorization is required (eg for an instance hosted on a public network) | | Optional: {}
| @@ -2731,6 +2735,7 @@ _Appears in:_ | Field | Description | Default | Validation | | --- | --- | --- | --- | | `model` _string_ | The Vertex AI model to use | | Optional: {}
| +| `toolModel` _string_ | Model to use for tool calling, which is less frequent and often requires more advanced reasoning | | Optional: {}
| | `project` _string_ | The GCP project you'll be using | | Required: {}
| | `location` _string_ | The GCP region Vertex is queried from | | Required: {}
| | `endpoint` _string_ | A custom endpoint for self-deployed models | | Optional: {}
|