Skip to main content

​
What is the LLM Tab?

The LLM Tab is where you select and configure the intelligence behind your voice AI agent. Choose your language model provider, adjust response parameters, and connect knowledge bases for enhanced conversations.
LLM Tab showing model selection, parameters, and knowledge base options

​
Configuration Options

​
Choose LLM Model

Select your AI provider and model for conversation intelligence.
Choose LLM model with Azure provider and gpt-4.1-mini cluster selected

Provider Selection

Choose from Azure, OpenAI, Anthropic, Groq, and more

Model Selection

Pick the specific model (e.g., gpt-4.1-mini cluster)
Connect your own provider keys in Providers to reduce costs and access more models.

​
Model Parameters

Fine-tune how your agent generates responses.
Model Parameters section showing Tokens and Temperature sliders with Knowledge Base dropdown
ParameterDescriptionRecommended
Tokens GeneratedMax tokens per LLM output300-500 for concise responses
TemperatureControls creativity/randomness0.3-0.5 for balanced responses
Keep temperature low (0.3-0.5) if you want consistent, controlled responses. Higher temperature increases creativity but may cause deviation from your prompt instructions.

​
Add Knowledge Base

Connect your knowledge bases to give your agent accurate, contextual information.
Knowledge base dropdown showing connected URLs and PDFs with Add new knowledgebase option
1

Click the Dropdown

Open the “Select knowledge bases” multi-select dropdown.
2

Select Knowledge Bases

Check one or more knowledge bases (PDFs, URLs) to connect.
3

Create New (Optional)

Click “Add new knowledgebase” to create and upload new content.
Knowledge bases enable your agent to answer questions with accurate, up-to-date information from your documents and URLs. Connect multiple knowledge bases for comprehensive coverage.
Create knowledge bases in the Knowledge Base section by uploading PDFs or adding URLs.

​
Next Steps

Knowledge Base

Create and manage knowledge bases

Agent Tab

Configure prompts and welcome message

Audio Tab

Set up voice, transcription, and languages

LLM Providers

Connect your own LLM provider