Skip to main content

网关提供商

🌐 Gateway Providers

网关提供商整合了多个模型提供商,并添加了缓存、速率限制、分析和自动故障转移等功能。当你需要可观察性、成本管理或简化的多提供商访问时,可以使用网关。

🌐 Gateway providers aggregate multiple model providers and add features like caching, rate limiting, analytics, and automatic failover. Use gateways when you need observability, cost management, or simplified multi-provider access.

自定义网关
Direct link to 自定义网关

🌐 Custom Gateways

为私有 LLM 部署或专用提供商集成创建自定义网关。有关实现细节,请参阅 自定义网关

🌐 Create custom gateways for private LLM deployments or specialized provider integrations. See Custom Gateways for implementation details.

内置网关
Direct link to 内置网关

🌐 Built-in Gateways