Cerebras

Integrate Cerebras models with Portkey’s AI Gateway

Portkey provides a robust and secure gateway to integrate various Large Language Models (LLMs) into applications, including Cerebras Inference API.

With Portkey, take advantage of features like fast AI gateway access, observability, prompt management, and more, while securely managing API keys through Model Catalog.

Quick Start

Get Cerebras working in 3 steps:

Python

from portkey_ai import Portkey

# 1. Install: pip install portkey-ai
# 2. Add @cerebras provider in model catalog
# 3. Use it:

portkey = Portkey(api_key="PORTKEY_API_KEY")

response = portkey.chat.completions.create(
    model="@cerebras/llama3.1-8b",
    messages=[{"role": "user", "content": "Say this is a test"}]
)

print(response.choices[0].message.content)

Tip: You can also set provider="@cerebras" in Portkey() and use just model="llama3.1-8b" in the request.

Add Provider in Model Catalog

1. Go to Model Catalog → Add Provider
2. Select Cerebras
3. Choose existing credentials or create new by entering your Cerebras API key
4. Name your provider (e.g., cerebras-prod)

Complete Setup Guide →

See all setup options, code examples, and detailed instructions

---

Supported Models

Cerebras Models

View all available models and documentation

Next Steps

Add Metadata

Add metadata to your Cerebras requests

Gateway Configs

Add gateway configs to your Cerebras requests

Tracing

Trace your Cerebras requests

Fallbacks

Setup fallback from OpenAI to Cerebras

For complete SDK documentation:

SDK Reference

Complete Portkey SDK documentation