WSO2 is now Choreo LabsLearn more

Trusted AI Governance
Build

Create agents and AI apps with the tools and languages your teams already use.

Connect

Link agents securely to your APIs, data, models and business systems.

Run

Deploy, observe and operate agents and AI apps reliably at any scale.

Govern

Control identity, access, cost and policy for every agent in production.

Agent Management

Developer Platform

  • API Management Cloud

    Design, secure and publish APIs with governance and analytics built in.

    Sign Up Now
  • Integration Cloud

    Connect apps, data and AI agents with low-code and pro-code integration.

    Sign Up Now
  • Identity & Access Management Cloud

    Secure sign-in and access for customers, partners, workforce and agents.

    Sign Up Now
  • Agent Management Cloud

    Build, run and govern AI agents with full visibility and control.

    Sign Up Now
  • Developer Platform Cloud

    Ship cloud-native apps faster on an internal developer platform.

    Sign Up Now

Self-Hosted

Full control over your stack. Deploy directly to your own servers, bare metal, cloud, or Kubernetes environment. Your data never leaves your perimeter.

Product Downloads
Choreo Labs
AI Governance
Platform
Solutions
Resources
Blog

Introducing the Choreo AI gateway

In recent years, AI technologies have evolved rapidly, and these capabilities are now accessible through APIs, making it easier for developers and enterprises to integrate AI into their applications. Whether it's natural language processing, image generation, or text summarization, AI APIs have become essential for modern applications.

However, this comes with its own set of challenges. As AI adoption increases across teams and services, organizations face issues around security, compliance, usage governance, and cost control. Unmonitored or uncontrolled API usage can lead to sudden cost spikes, service throttling, or even disruptions due to quota exhaustion. There’s also the growing complexity of managing multiple API credentials, handling provider-specific security, and tracking usage across teams.

To solve these challenges, we're excited to introduce the Managed GenAI Service Registration capability in Choreo. The Choreo AI Gateway acts as the secure, governed control point for all GenAI traffic.

With just a few clicks, platform engineers and administrators can enable secure, governed access to supported AI providers.

Key capabilities of the Choreo AI Gateway

  •  Rate Limiting and Cost Control: Apply token-based rate limits at the egress gateway level to prevent unexpected costs. Limit usage by prompt, completion, or total tokens to ensure controlled access to AI APIs.
  • Observability and Monitoring (Coming Soon): Track AI API consumption with detailed logs. Monitor key metrics like error rates and latency to detect performance issues and understand usage trends early.
  • Dynamic Credential Management: Securely manage and apply provider-specific credentials for each environment. Ideal for teams using multiple subscriptions or API keys across environments.
  • Unified Access for Developers: Once a service is registered, it becomes instantly available through the Choreo internal marketplace. Developers can consume services without needing access to the provider’s URL, credentials, or quota settings.

The upcoming Choreo AI Gateway brings secure, cost-controlled, and developer-friendly access to AI APIs. With built-in governance, observability, and seamless service publishing, it simplifies AI adoption at scale.

Watch the demo video to see how easy it is to:

  • Keep your AI credentials safe and easy to manage - without exposing them to users
  • Enforce usage governance through token-based rate limits
  • Publish AI services to the internal marketplace for developers to easily consume

 

 

Get started

Ready to see how Choreo helps to elevate your API integration experience through AI Gateway? Head over to our documentation to get started.