> ## Documentation Index
> Fetch the complete documentation index at: https://stagehand.readme-i18n.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LLM Customization

> Stagehand supports a wide variety of LLMs. You can use any LLM that supports structured outputs with our existing clients, or by writing a custom LLM provider.

<Tip>
  Small models on **Ollama** are really difficult to get consistent structured outputs from. Though these models are "supported" via an OpenAI-compatible API, we do not recommend them yet for Stagehand.
</Tip>

## Supported LLMs

Stagehand supports most of the hosted LLM providers. The full list of supported models is below:

### Providers

<Expandable title="Supported Providers">
  * **OpenAI**
  * **Anthropic**
  * **Google**
  * **xAI**
  * **Azure**
  * **Groq**
  * **Cerebras**
  * **TogetherAI**
  * **Mistral**
  * **DeepSeek**
  * **Perplexity**
  * **Ollama**
</Expandable>

### Model Name Format

Stagehand takes the model name in the format of `provider/model`.

For example, to use Gemini 2.0 Flash, you would pass in `google/gemini-2.0-flash`.

### Using a Provider

You can pass in one of these LLMs to the `llm` property in the `Stagehand` constructor.

<CodeGroup>
  ```typescript TypeScript theme={null}
  const stagehand = new Stagehand({
    modelName: "google/gemini-2.0-flash",
    modelClientOptions: {
      apiKey: process.env.GOOGLE_API_KEY,
    },
  });
  ```

  ```python Python theme={null}
  stagehand = Stagehand(
    model="google/gemini-2.0-flash",
    model_client_options={"apiKey": os.getenv("GOOGLE_API_KEY")},
  )
  ```
</CodeGroup>

## Custom LLMs

<Note>
  Custom LLMs are currently only supported in TypeScript.
</Note>

If you'd like to use a custom LLM, you can do so by providing a custom `llmProvider` function to the `Stagehand` constructor.

The only requirement for an LLM to be used with Stagehand is that it supports structured outputs.

### OpenAI-compatible APIs

Most LLMs are OpenAI-compatible, and thus can be used with Stagehand as long as they support structured outputs. This includes models like Google Gemini, Ollama, and most Llama models including Groq, Cerebras, and more.

To get started, you can use the [OpenAI external client](https://github.com/browserbase/stagehand/blob/main/examples/external_clients/customOpenAI.ts) as a template to create a client for your model.

```ts {7-13} theme={null}
import { Stagehand } from "@browserbasehq/stagehand";
import { CustomOpenAIClient } from "./external_clients/customOpenAI";
import OpenAI from "openai";

const stagehand = new Stagehand({
	...StagehandConfig,
	llmClient: new CustomOpenAIClient({
		modelName: "llama3.3",
		client: new OpenAI({
			apiKey: "ollama",
			baseURL: "http://localhost:11434/v1",
		}),
	}),
});

await stagehand.init();
```

### Vercel AI SDK

The [Vercel AI SDK](https://sdk.vercel.ai/providers/ai-sdk-providers) is a popular library for interacting with LLMs. You can use any of the providers supported by the Vercel AI SDK to create a client for your model, **as long as they support structured outputs**.

Vercel AI SDK supports providers for OpenAI, Anthropic, and Google, along with support for **Amazon Bedrock** and **Azure OpenAI**.

To get started, you'll need to install the `ai` package and the provider you want to use. For example, to use Amazon Bedrock, you'll need to install the `@ai-sdk/amazon-bedrock` package.

You'll also need to use the [Vercel AI SDK external client](https://github.com/browserbase/stagehand/blob/main/examples/external_clients/aisdk.ts) as a template to create a client for your model.

<Tabs>
  <Tab title="npm">
    ```bash theme={null}
    npm install ai @ai-sdk/amazon-bedrock
    ```
  </Tab>

  <Tab title="pnpm">
    ```bash theme={null}
    pnpm install ai @ai-sdk/amazon-bedrock
    ```
  </Tab>

  <Tab title="yarn">
    ```bash theme={null}
    yarn add ai @ai-sdk/amazon-bedrock
    ```
  </Tab>
</Tabs>

To get started, you can use the [Vercel AI SDK external client](https://github.com/browserbase/stagehand/blob/84f810b4631291307a32a47addad7e26e9c1deb3/examples/external_clients/aisdk.ts) as a template to create a client for your model.

```ts theme={null}
// Install/import the provider you want to use.
// For example, to use OpenAI, import `openai` from @ai-sdk/openai
import { bedrock } from "@ai-sdk/amazon-bedrock";
import { AISdkClient } from "./aisdkClient.ts";

const stagehand = new Stagehand({
  llmClient: new AISdkClient({
	model: bedrock("anthropic.claude-3-7-sonnet-20250219-v1:0"),
  }),
});
```

### LangChain

LangChain is a popular library for building LLM applications. You can use any of the providers supported by LangChain to create a client for your model, **as long as they support structured outputs**.

To get started, you'll need to install the `langchain` package and the provider you want to use. For example, to use OpenAI, you'll need to install the `@langchain/openai` package. You'll also need to install the `zod-to-json-schema` package to convert your Zod schema to a JSON schema.

You'll also want to add the [LangChain external client](https://github.com/browserbase/stagehand/blob/84f810b4631291307a32a47addad7e26e9c1deb3/examples/external_clients/langchain.ts) to your Stagehand project.

<Tabs>
  <Tab title="npm">
    ```bash theme={null}
    npm install langchain @langchain/openai zod-to-json-schema
    ```
  </Tab>

  <Tab title="pnpm">
    ```bash theme={null}
    pnpm install langchain @langchain/openai zod-to-json-schema
    ```
  </Tab>

  <Tab title="yarn">
    ```bash theme={null}
    yarn add langchain @langchain/openai zod-to-json-schema
    ```
  </Tab>
</Tabs>

Next, you can use the [LangChain external client](https://github.com/browserbase/stagehand/blob/84f810b4631291307a32a47addad7e26e9c1deb3/examples/external_clients/langchain.ts) as a template to create a Stagehand LLM client for your model.

```ts theme={null}
import { ChatOpenAI } from "@langchain/openai";
import { LangchainClient } from "./external_clients/langchain";

const stagehand = new Stagehand({
  llmClient: new LangchainClient(
	new ChatOpenAI({ model: "gpt-4o" }),
  ),
});
```