Claude Marketplace
Submit skill

bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

3,710 stars420 forksGoBy maximhq
View on GitHub

Free · Open source


CategoryMonitoring
Stars3,710
Forks420
LanguageGo
Sourcegithub

About

maximhq/bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Ready to connect?

Open the GitHub repo to get started.

View on GitHub

Questions

Repository stats

3,710stars

420 forks

Report an issue

bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.