OpenTelemetry (OTel) is a vendor-neutral, open-source observability framework that provides standardized APIs, SDKs, and tools for collecting traces, metrics, and logs from applications. It is the unified standard for instrumenting software, replacing the fragmented landscape of proprietary observability tools.

The Three Signals

• Traces: Distributed request flows across services (spans with timing, status, and relationships).
• Metrics: Numerical measurements (counters, gauges, histograms) for system and application health.
• Logs: Structured event records correlated with traces and metrics.

Core Components

• API: Vendor-neutral interfaces for instrumenting code. Available for Python, Java, Go, JavaScript, .NET, and more.
• SDK: Implementations that process and export telemetry data.
• Collector: A standalone binary that receives, processes, and exports telemetry data. Acts as a centralizing pipeline between applications and backends.
• Exporters: Send data to any compatible backend — Jaeger, Prometheus, Datadog, Grafana, New Relic, Elastic, and dozens more.

Why OpenTelemetry Matters

• Vendor Neutrality: Instrument once, export to any backend. Switch observability vendors without re-instrumenting code.
• Standardization: One API for traces, metrics, and logs instead of separate libraries for each.
• Auto-Instrumentation: Automatically capture telemetry from popular frameworks (Flask, FastAPI, Django, Express, gRPC) without code changes.
• Correlation: Link traces, metrics, and logs together using shared context (trace IDs, span IDs).

OpenTelemetry for AI/ML

• LLM Instrumentation: Libraries like opentelemetry-instrumentation-openai automatically trace LLM API calls with token counts, latency, and model version.
• Pipeline Tracing: Trace RAG pipelines, agent chains, and multi-model workflows end-to-end.
• Custom Metrics: Export model-specific metrics (quality scores, drift indicators) through the OTel metrics API.

Adoption

• CNCF Graduated Project: One of the most active projects in the Cloud Native Computing Foundation.
• Industry Standard: Supported by all major cloud providers and observability vendors.

OpenTelemetry is rapidly becoming the single standard for application observability — any new AI application should use OTel for instrumentation rather than vendor-specific libraries.