Configure Command Center AI

For models hosted by OpenAI use the following configuration:

LLM Provider

Select “OpenAI” as the provider

LLM Model

Select your OpenAI LLM model from the dropdown.

API Key

Add your OpenAI API Key

Base URL

Open “Advanced Options” and in the Base URL option and enter the following URL:

https://api.openai.com/v1/chat/completions

Command Center supports OpenAI models hosted in Azure.

LLM Provider

Select “OpenAI” as the provider

LLM Model

Select your OpenAI LLM model from the dropdown.

API Key

Add your Azure LLM API Key

Base URL

Open “Advanced Options” and in the Base URL option enter your Azure OpenAI URL including the deployment name and chat completions path.  Deployment URLs have the following format:

https://{{tenantName}}.openai.azure.com/openai/deployments/{{deploymentName}}/chat/completions?api-version={{apiVersion}}

You will need to replace {{tenantName}}, {{deploymentName}}, and {{apiVersion}} with the appropriate values for your environment and model.  As an example, a complete URL will look like this:

https://mycompany-openai-instance.openai.azure.com/openai/deployments/gpt-4-32k/chat/completions?api-version=2023-12-01-preview

Model Name vs API Version vs Deployment Name

The API Version which has a YYYY-MM-DD format with an optional -preview is not the same as the model name.  The API version is only included as part of the api-version query parameter in the Base URL option.

The deployment name will often be named after a model but is unique from the list of models supported by the deployment.  Typically, a deployment will support one or more models which you can select from the OpenAI Models dropdown list.

Command Center can connect to API’s hosted via Open WebUI (https://openwebui.com/).

Configure Open WebUI to use OpenAI Syntax API and then set the following in Command Center:

LLM Provider

Select “OpenAI” as the provider

LLM Model

Select your OpenAI LLM model from the dropdown.  

Note:  If your model is not listed you can rename the model in OpenWeb UI to match one of the models in the dropdown list.

API Key

Add your Open WebUI API Key

Base URL

Open “Advanced Options” and in the Base URL option and enter the following URL:

https://{{open-web-ui-fqdn}}/api/v1/chat/completions 

Note:  The Open WebUI URL varies slightly from the OpenAI URL in that it starts with api in the URL path.