Step-by-step guides to sign up, generate keys, and integrate with Bifrost
for cost tracking, governance, and multi-provider routing.
[ AVAILABLE GUIDES ]
Anthropic
Sign up at console.anthropic.com, add billing, generate your Claude API key (sk-ant- format), and integrate with Bifrost for cost tracking and virtual key support. 5-minute setup.
AWS Bedrock
Set up AWS Bedrock access through IAM, configure credentials, and integrate with Bifrost for cost tracking and multi-model governance.
Azure OpenAI
Create an Azure OpenAI resource in the Azure portal, get your API key and endpoint, deploy a model, and integrate with Bifrost for governance and cost tracking.
Cerebras
Generate a Cerebras API key for fast LLM inference and integrate with Bifrost for cost governance and routing.
Cohere
Create a Cohere account, copy your trial API key from the dashboard, store it securely, and integrate with Bifrost for cost tracking, governance, and multi-provider routing.
Databricks
Generate Databricks API credentials for foundation models and integrate with Bifrost for unified LLM governance.
ElevenLabs
Generate an ElevenLabs API key for text-to-speech and voice synthesis and integrate with Bifrost for cost tracking.
Fireworks
Generate a Fireworks API key for fast inference on open-source models and integrate with Bifrost for cost governance.
Google Gemini
Create a Google account, generate your Gemini API key at Google AI Studio, set up billing for production, and integrate with Bifrost for multi-model routing and cost governance.
Groq
Create a Groq account, generate your API key from console.groq.com, set up billing, and integrate with Bifrost for cost tracking and high-speed inference routing.
Hugging Face
Generate a Hugging Face access token for the Inference API and integrate with Bifrost for cost tracking and governance.
Mistral
Create a Mistral account, generate your API key from console.mistral.ai, store it securely, and integrate with Bifrost for cost tracking and multi-provider routing.
Nebius
Configure Nebius API access for open-source LLM inference and integrate with Bifrost for cost tracking.
OpenAI
Create an OpenAI API key in the dashboard, export OPENAI_API_KEY, add billing or credits for production use, and route requests through Bifrost for virtual keys, budgets, and observability.
OpenRouter
Generate an OpenRouter API key to route across multiple LLM providers and integrate with Bifrost for unified cost governance.
Replicate
Create a Replicate account, copy your API token, store it securely, and integrate with Bifrost for cost tracking and governance.
Runway
Create a Runway developer account, generate your API key from the developer portal, and integrate with Bifrost for cost tracking and governance.
Vertex AI
Create a Google Cloud Project, enable Vertex AI API, generate a service account key, and integrate with Bifrost for cost tracking and multi-provider governance.
Ollama
Run open-source LLMs locally with Ollama and integrate with Bifrost for local inference routing and governance.
Ollama Setup
Install Ollama, pull models, and connect your local inference server to Bifrost for unified routing and observability.
vLLM
Deploy vLLM for high-throughput open-model serving and integrate with Bifrost for production routing and cost controls.
SGLang
Run SGLang for structured generation and fast serving, then connect to Bifrost for governance and multi-provider routing.
[ BIFROST FEATURES ]
Everything you need to run AI in production, from free open source to enterprise-grade features.
01 Governance
SAML support for SSO and Role-based access control and policy enforcement for team collaboration.
02 Adaptive Load Balancing
Automatically optimizes traffic distribution across provider keys and models based on real-time performance metrics.
03 Cluster Mode
High availability deployment with automatic failover and load balancing. Peer-to-peer clustering where every instance is equal.
04 Alerts
Real-time notifications for budget limits, failures, and performance issues on Email, Slack, PagerDuty, Teams, Webhook and more.
05 Log Exports
Export and analyze request logs, traces, and telemetry data from Bifrost with enterprise-grade data export capabilities for compliance, monitoring, and analytics.
06 Audit Logs
Comprehensive logging and audit trails for compliance and debugging.
07 Vault Support
Secure API key management with HashiCorp Vault, AWS Secrets Manager, Google Secret Manager, and Azure Key Vault integration.
08 VPC Deployment
Deploy Bifrost within your private cloud infrastructure with VPC isolation, custom networking, and enhanced security controls.
09 Guardrails
Automatically detect and block unsafe model outputs with real-time policy enforcement and content moderation across all agents.
[ SHIP RELIABLE AI ]
Change just one line of code. Works with OpenAI, Anthropic, Vercel AI SDK, LangChain, and more.