Advanced Model Settings
Fine-tune how language models reason and generate responses across Syntphony CAI.
Overview
Advanced Model Settings let you customize specific aspects of model behavior, such as reasoning, response detail, randomness, vocabulary variation, repetition, and response limits.
The available settings depend on the selected model and the Syntphony CAI feature being configured. GPT-4 and GPT-5 family models expose different controls because they provide different ways to influence response generation.
Settings by model family
GPT-5 family
GPT-5 family models introduce separate controls for reasoning and response detail:
Reasoning Effort: controls how much reasoning the model performs before generating a response.
Verbosity: controls the level of detail in the generated response.
These settings work independently. For example, you can configure higher reasoning with a concise response, or lower reasoning with a more detailed response.
Reasoning Effort
Reasoning Effort controls how much reasoning the model performs before generating its response.
Depending on the GPT-5 model, available levels may include None, Minimal, Low, Medium, High, Xhigh, or Max.
Higher levels can be useful for tasks involving multi-step reasoning, calculations, or ambiguity resolution, but may also increase response time and token usage. Lower levels are more appropriate for simpler interactions where fast responses are preferred.
Verbosity
Verbosity controls how much detail appears in the generated response:
Low: Concise responses with minimal detail.
Medium: Balanced responses with moderate detail.
High: More comprehensive and detailed responses.
Low Verbosity can be useful for short conversational interactions, including chat and voice experiences. Higher levels can be appropriate when users need more detailed explanations.
GPT-4 family
GPT-4 family models provide controls focused on generation variation and repetition:
Temperature: controls randomness. Lower values produce more predictable responses, while higher values increase variation.
Top P: controls vocabulary variation by influencing the range of possible tokens.
Frequency Penalty: influences repetition according to how frequently tokens have already appeared.
Presence Penalty: influences whether previously used tokens are likely to appear again.
Temperature
Temperature controls the randomness of generated content.
Lower values produce more predictable and consistent responses.
Higher values increase variation and creativity.
Use lower values when consistency is important and higher values when the interaction benefits from more varied responses.
Top P
Top P controls vocabulary variation by influencing the range of words the model considers when generating a response.
Lower values favor more common and predictable words or phrases.
Higher values allow a broader range of possible words.
Use it to adjust how varied the model's vocabulary can be.
Frequency Penalty
Frequency Penalty controls repetition based on how frequently tokens have already appeared in the generated content.
Higher values increase the influence of token frequency, helping reduce repeated words or expressions.
Presence Penalty
Presence Penalty considers whether a token has already appeared in the generated content, regardless of how frequently it was used.
Higher values make the model more likely to introduce tokens that have not yet appeared, encouraging greater variation in the response.
Understanding the settings
Model-specific settings
These settings control how the selected language model generates responses. Their availability and supported values depend on the model family and selected model.
Reasoning effort
Adjust how much reasoning occurs before a response.
Model-dependent levels
Verbosity
Adjust the level of detail in a response.
Low, Medium, High
Temperature
Adjust randomness in generated content.
Numeric control or slider
Top P
Adjust vocabulary variation.
Numeric control or slider
Frequency Penalty
Influence repetition according to token frequency.
Numeric control or slider
Presence Penalty
Influence whether previously used tokens appear again.
Numeric control or slider
General settings
These settings control how Syntphony CAI handles the model request or output rather than the model's generation behavior itself.
Response wait time
Define how long Syntphony CAI waits for a model response.
Slider, in seconds
Maximum Tokens
Limit the maximum amount of content generated in the output.
Slider, in tokens
Restrict vocabulary
Prevent specified words from appearing in an answer variation.
Optional text field
Conversation history
Control how much previous conversation context is considered when generating an answer variation.
Numeric control or slider
Settings by feature
The controls available also depend on where the model is being used:
AI Agents and Supervisor
Response wait time, Temperature, Top P, Presence penalty, Frequency penalty
Response wait time, Reasoning effort, Verbosity
Prompt Cell
Maximum Tokens, Temperature, Top P, Presence penalty, Frequency penalty
Maximum Tokens, Reasoning effort, Verbosity
Rephrase Answer
Temperature, Conversation history, Restrict vocabulary
Still not available on the platform
Configure advanced settings
Configure the settings directly from the feature where the model is being used.
For AI Agents and Supervisor, go to Preferences and expand Advanced Settings. The available controls automatically reflect the configured model.
For Prompt Cells, expand Advanced Parameters and configure the settings available for the selected model. Use Generate Preview to validate the combination of your Prompt and current parameters before saving.
For Rephrase Answer, enable the feature and configure the available generation control together with Conversation History and, when required, Restrict Vocabulary.
When changing models
When switching between models or model families, review the available settings before publishing.
Settings from one model family do not necessarily have direct equivalents in another. Instead of trying to reproduce the same parameter values, test the resulting behavior and adjust the new model according to the expected outcome.
A simple workflow is:
Select model → Review available settings → Configure → Test → Adjust → Save or publish
Troubleshooting
A Reasoning effort level is not available
Supported levels vary between GPT-5 models.
Select one of the levels available for the selected model.
A previously available Reasoning effort level is unavailable after changing family 5 models
Supported levels vary within family 5.
Select a level available for the active model.
A setting is not displayed
The selected model or feature does not support it.
Use the controls available for the active configuration.
Last updated
Was this helpful?