Skip to main content

​
Overview

Bag of words allows you to effortlessly bring your own LLM (via provider and API Key), providing seamless integration with any of the main LLM providers, with additional support to any OpenAI-compatible API providers.
  • Google
  • Azure
  • OpenAI
  • Anthropic
This flexibility ensures you can utilize your preferred LLM while benefiting from Bag of words’ features.
If you’re using a custom LLM provider, make sure it supports streaming

​
Natively Supported Models

GPT-5.1Recommended
GPT-5Recommended
GPT-4.1Recommended
GPT-4.1 Mini
Claude 4.5 SonnetRecommended
Claude 4 Sonnet
Claude 4 Opus
Claude 3.7 Sonnet
Gemini 2.5 ProRecommended
Gemini 2.5 Flash

​
Add an LLM Provider

To add a new LLM provider, follow these steps:
  1. Select from existing models: Choose from a list of pre-configured models that Bag of words natively supports.
  2. Add custom model: If your desired LLM is not listed, you can integrate it by providing the necessary API details. Bring your own LLM

​
Set LLM as default

To set a specific LLM as your default:
  1. Navigate to the LLM settings.
  2. Go to the desired LLM row, and click the elipsis icon on the right
  3. Click “Make Default”

​
Small Default LLM

You can also set small default LLM for back-office tasks like LLM judge, tests, evals, etc. The agent will use the small model to save costs.

​
Select LLM in the prompt box

While default LLM can be configured only by users with the right permissions (admin), each individual can choose their own LLM when creating reports. When using the prompt box:
  1. Click on the LLM selection dropdown.
  2. Choose the LLM you wish to use for that specific prompt.
Customize prompt LLM