Skip to main content
MOSAIC AI GATEWAY

Democratize LLM access securely and responsibly

Manage and govern all AI models and agents across the enterprise.
hero mosaic ai gateway
BENEFITS

Governance and observability across any AI model and agent

Mosaic AI Gateway centralizes control of your AI systems — standardizing access, safeguarding usage and delivering full observability across all models and agents in your organization.

Unified access

Access the latest models from any provider — foundation, open source or custom — through a single, standardized query interface. AI Gateway eliminates integration friction, so teams can build faster with the best models for their use case, without managing multiple endpoints or rewriting code.

Full observability

Track usage, quality and cost in real time with detailed request and response logs stored in the lakehouse. Built-in support for dashboards, alerts and SQL queries lets you monitor performance, troubleshoot issues and manage spend across all your models and agents.

Built-in safeguards

Enforce safety, privacy and compliance at scale with flexible guardrails. Filter PII, block unsafe content and apply policy-driven controls on every request. Role-based permissions, usage tracking and traffic controls ensure secure access across all users and teams — no custom code required.

FEATURES

Production-grade security and governance

AI Gateway streamlines and secures AI usage with governance, observability and production-ready features to optimize AI traffic.

Control who can access your AI models and how much access they have with customizable permissions and rate limits, ensuring secure and compliant AI usage across your organization.

01 feature rate limiting

Monitor and audit AI requests to enhance model performance and security.

02 feature inference tables

Track costs across all LLM consumption enterprise-wide in one place.

03 feature usage tracking

Enforce the compliant usage of LLMs with default safety and PII guardrails.

04 feature ai guardrails

Improve the reliability of LLMs across use cases with fallbacks, load balancing and more.

05 feature traffic routing

More features

Unified Model Access

Easily integrate and switch between all AI models with a single interface to streamline development and reduce integration costs.

Learn more

Fallbacks

Minimize production outages during and after deployment.

Learn more

PII Filters

Detect and block requests containing sensitive content such as personally identifiable information (PII) in user inputs.

More about PII filters

Safety Filtering

Filter harmful content such as hate speech, insults, sexual content, violence and misconduct.

More about safety filters

Audit Logging

Capture a complete audit log in Unity Catalog to monitor data access, ensure compliance and simplify governance across all AI workloads.

Learn more

Model Serving Integration

Seamlessly integrates with FMAPIs like Anthropic and Gemini via Model Serving endpoints, enabling advanced governance and observability with minimal setup.

Learn more
USE CASES

A secure solution for managing LLM traffic

PRICING

Usage-based pricing keeps spending in check

Only pay for the products you use at per-second granularity.
RELATED PRODUCTS

Explore our integrated AI solutions

Explore how our suite of products integrates seamlessly to enhance your AI capabilities.

Model Serving

Effortlessly deploy and manage all types of models with a unified interface. Integrate with AI Gateway for advanced governance and scalability.

Agent Bricks

Build production AI agents optimized on your data.

Model Training

Fine-tune an open source model like Llama 3.1 efficiently with our robust infrastructure.

Vector Search

Vector Search is a serverless vector database seamlessly integrated into the Data Intelligence Platform.

Agent Framework

Build, test and deploy intelligent agents with ease. Leverage AI Gateway for secure integration and management across multiple endpoints.

Managed MLflow

Managed MLflow enhances MLflow, an open source platform developed by Databricks for building better models and GenAI apps, focusing on enterprise reliability, security and scalability.

Unity Catalog

AI Gateway logs endpoint usage and payload data into Unity Catalog. This includes detailed records of requests and inference results, providing robust data management and analysis capabilities.

Discover your next steps

AI Gateway FAQ

Ready to become a
data + AI company?

Take the first steps in your transformation