Not all options are available for every model. Check your dashboard for model-specific capabilities.
Temperature
Temperature controls the randomness and creativity of your agent’s responses — a value between 0 and 1 that affects how the model selects its next words.
Recommendations by use case:
Structured Output
Structured Output ensures LLM responses strictly follow predefined schemas — particularly important for reliable function calling. When enabled, the model is constrained to output only valid function calls with all required parameters. Benefits:- Eliminates missing or malformed function arguments
- Prevents invalid function calls from being attempted
- Ensures all outputs match expected schemas
- Schema caching may delay agent configuration saves
- Model cannot deviate from defined structures
- First load after changes may be slower
Enable when
- Production agents with critical function calls
- Agents handling financial or medical data
- Integration with strict API requirements
Consider disabling when
- Development and testing phases
- Agents with simple or flexible function needs
- Rapid iteration is more important than reliability
Fast Tier
Fast Tier routes LLM calls through dedicated, high-priority infrastructure for superior performance and consistency. It eliminates latency variability you might experience with standard routing. Key benefits:- Consistent, predictable response times on every call
- Priority access to compute resources
- Minimal fluctuation in processing speeds
- Smoother, more natural conversations
Ideal for
- High-value customer interactions
- Time-sensitive operations (emergency services, urgent support)
- Premium service tiers
- Demos and sales calls
May not be necessary for
- Internal testing
- Low-volume or non-critical calls
- Cost-sensitive applications