Enterprise Observability with ZeroBus and OTEL at Scale with Databricks

OpenTelemetry has become the industry standard for collecting traces, metrics, and logs from modern distributed systems. However, operating observability platforms at enterprise scale often requires proprietary tools and fragmented data pipelines.In this session, we present an end-to-end architecture for enterprise observability using OpenTelemetry and ZeroBus with Databricks as the analytics and visualization backbone. We will show how OpenTelemetry telemetry streams can be ingested through ZeroBus and stored in Delta Lake, enabling scalable processing and long-term retention of traces, metrics, and logs.We will demonstrate how to build a custom Databricks App to visualize flame graphs, explore distributed traces, and correlate metrics and logs in a unified interface - delivering capabilities similar to proprietary platforms but powered by the Lakehouse.