> ## Documentation Index
> Fetch the complete documentation index at: https://docs.bagofwords.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LLMs

> Generate, save and publish reports with Bag of words

## Overview

Bag of words allows you to effortlessly bring your own LLM (via provider and API Key), providing seamless integration with any of the main LLM providers, with additional support to any OpenAI-compatible API providers.

* <img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/google.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=054b34ac78c8439644685c952acf3f2b" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 8, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/google.png" /> **Google**
* <img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/azure.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e8499bcf04cf3ac3ea52e7252e8e5edf" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 8, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/azure.png" /> **Azure**
* <img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/openai.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e58e1f38a7656a8997a4e7a157c8a424" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 8, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/openai.png" /> **OpenAI**
* <img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 8, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /> **Anthropic**
* Custom LLM endpoints like Ollama or other proxy services

This flexibility ensures you can utilize your preferred LLM while benefiting from Bag of words' features.

## Natively Supported Models

|                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |                                                          |                                                    |
| :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | :------------------------------------------------------- | :------------------------------------------------- |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/openai.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e58e1f38a7656a8997a4e7a157c8a424" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/openai.png" /> </span>                       | <span style={{marginRight: 80}}>GPT-5.1</span>           | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/openai.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e58e1f38a7656a8997a4e7a157c8a424" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/openai.png" /> </span>                       | <span style={{marginRight: 80}}>GPT-5</span>             | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/openai.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e58e1f38a7656a8997a4e7a157c8a424" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/openai.png" /> </span>                       | <span style={{marginRight: 80}}>GPT-4.1</span>           | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/openai.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=e58e1f38a7656a8997a4e7a157c8a424" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/openai.png" /> </span>                       | <span style={{marginRight: 80}}>GPT-4.1 Mini</span>      | <span style={{marginRight: 80}} />                 |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /> </span> | <span style={{marginRight: 80}}>Claude 4.5 Opus</span>   | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /> </span> | <span style={{marginRight: 80}}>Claude 4.5 Sonnet</span> | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /> </span> | <span style={{marginRight: 80}}>Claude 4 Sonnet</span>   | <span style={{marginRight: 80}} />                 |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0,  marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /></span> | <span style={{marginRight: 80}}>Claude 4 Opus</span>     | <span style={{marginRight: 80}} />                 |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/anthropic.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=a5c3291151f2b8b40edd7969724d9eeb" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/anthropic.png" /> </span> | <span style={{marginRight: 80}}>Claude 3.7 Sonnet</span> | <span style={{marginRight: 80}} />                 |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/google.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=054b34ac78c8439644685c952acf3f2b" width="16" height="16" style={{margin: 0, padding: 0, marginRight: 10 , verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/google.png" /> </span>                        | <span style={{marginRight: 80}}>Gemini 2.5 Pro</span>    | <span style={{marginRight: 80}}>Recommended</span> |
| <span><img src="https://mintcdn.com/bagofwords/sEUbNS5t9nxwZKlT/assets/llm-icons/google.png?fit=max&auto=format&n=sEUbNS5t9nxwZKlT&q=85&s=054b34ac78c8439644685c952acf3f2b" width="16" height="16" style={{margin: 0, padding: 0,  marginRight: 10, verticalAlign: 'middle', display: 'inline-block'}} data-path="assets/llm-icons/google.png" /> </span>                        | <span style={{marginRight: 80}}>Gemini 2.5 Flash</span>  | <span style={{marginRight: 80}} />                 |

<Note>
  You can integrate any custom LLM as long as it supports OpenAI requests and streaming

  To use a custom LLM (Ollama, proxy services, etc) - choose the Custom provider and set the base URL (e.g `http://localhost:11434/v1` and an API key (put any character if no API is required))
</Note>

## Add an LLM Provider

To add a new LLM provider, follow these steps:

1. **Select from existing models**: Choose from a list of pre-configured models that Bag of words natively supports.
2. **Add custom model**: If your desired LLM is not listed, you can integrate it by providing the necessary API details.
   <img src="https://mintcdn.com/bagofwords/LAdg09T4Ov37V_62/assets/media/llm/llm.png?fit=max&auto=format&n=LAdg09T4Ov37V_62&q=85&s=2115aef962af256850a24ef520ac52a7" alt="Bring your own LLM" width="1520" height="990" data-path="assets/media/llm/llm.png" />

## Set LLM as default

To set a specific LLM as your default:

1. Navigate to the LLM settings.
2. Go to the desired LLM row, and click the elipsis icon on the right
3. Click "Make Default"

<Note>
  #### Small Default LLM

  You can also set small default LLM for back-office tasks like LLM judge, tests, evals, etc. The agent will use the small model to save costs.
</Note>

## Select LLM in the prompt box

While default LLM can be configured only by users with the right permissions (admin), each individual can
choose their own LLM when creating reports.

When using the prompt box:

1. Click on the LLM selection dropdown.
2. Choose the LLM you wish to use for that specific prompt.

<img src="https://mintcdn.com/bagofwords/LAdg09T4Ov37V_62/assets/media/llm/prompt-box.png?fit=max&auto=format&n=LAdg09T4Ov37V_62&q=85&s=7cf9fc33708587ca7e84cdaba84caf37" alt="Customize prompt LLM" width="1614" height="922" data-path="assets/media/llm/prompt-box.png" />
