Skip to main content

Overview

Pydantic AI can use TokenLab with OpenAIChatModel and OpenAIProvider(base_url=...).
Type: Agent FrameworkPrimary Path: OpenAI-compatible chat completionsSupport Confidence: Supported OpenAI-compatible provider path

Environment

export TOKENLAB_API_KEY="sk-your-tokenlab-key"

Basic Agent

import os

from pydantic_ai import Agent
from pydantic_ai.models.openai import OpenAIChatModel
from pydantic_ai.providers.openai import OpenAIProvider

model = OpenAIChatModel(
    "claude-sonnet-5",
    provider=OpenAIProvider(
        base_url="https://api.tokenlab.sh/v1",
        api_key=os.environ["TOKENLAB_API_KEY"],
    ),
)

agent = Agent(model)
result = agent.run_sync("Explain one benefit of OpenAI-compatible gateways.")
print(result.output)

Tools

from pydantic_ai import Agent, RunContext

agent = Agent(model)

@agent.tool
def lookup_status(ctx: RunContext[None], service: str) -> str:
    return f"{service} is online"

result = agent.run_sync("Check the TokenLab status.")
print(result.output)

Endpoint Notes

This path targets Pydantic AI’s OpenAI Chat Completions model class. For Responses-native or provider-native protocol behavior, choose a client path that exposes that protocol directly.