Choosing an AI model

Kanbu lets you choose the AI model the agent uses to generate answers. Different models vary in accuracy, speed, and cost. The setting is available in the Advanced settings section in Configuration.

Changing the model is an advanced setting. The default model is set to work well for most cases — change it only if you have a specific reason.

1. How to do it

  1. In the left menu under the selected agent, click Configuration.

image.png

  1. Expand the Advanced settings section.

image.png

  1. In the Model selector, choose the desired model.
  2. Optionally also set Small model — it is used for simpler queries and helps reduce costs.
  3. Click Save.

image.png

  1. Verify in Playground — try real queries.

image.png

2. How to choose a model

A current overview of available models including their properties and prices is in the app — click the Overview of open model prices and benchmarks link in the Advanced settings section.

General recommendations:

  • You need higher accuracy or more complex answers — choose a more powerful model (typically GPT-4 or equivalent).
  • You need faster answers or lower costs — choose a lighter model (typically Gemini Flash or equivalent) as the main or small model.
  • E-commerce agent with a large product catalog — a more powerful model handles product comparison and filtering better.

Frequently asked questions

  • What is the small model?

    The small model is used for simpler queries where the full power of the main model is not needed. It reduces costs without a significant impact on answer quality for routine questions.

  • Will changing the model affect historical conversations retroactively?

    No, changing the model affects only new conversations.