LLM Observability with Sentry and OpenLLMetry

Install Sentry SDK with OpenTelemetry support:

Python

pip install --upgrade 'sentry-sdk[opentelemetry]'

npm install @sentry/node @sentry/opentelemetry-node

Initialize Sentry and enable OpenTelemetry instrumentation:

Python

import sentry_sdk

sentry_sdk.init(
dsn=<Your DSN>,
enable_tracing=True,

    # set the instrumenter to use OpenTelemetry instead of Sentry
    instrumenter="otel",

)

Sentry.init({
  dsn: <Your DSN>,
  tracesSampleRate: 1.0,
  skipOpenTelemetrySetup: true,
});

Then, when initializing the Traceloop SDK, make sure to override the processor and propagator:

Python

from traceloop.sdk import Traceloop
from sentry_sdk.integrations.opentelemetry import SentrySpanProcessor, SentryPropagator

Traceloop.init(processor=SentrySpanProcessor(), propagator=SentryPropagator())

import * as traceloop from "@traceloop/node-server-sdk";
import { SentrySpanProcessor, SentryPropagator, SentrySampler } from "@sentry/opentelemetry";

traceloop.initialize({
  contextManager: new Sentry.SentryContextManager(),
  processor: new SentrySpanProcessor(),
  propagator: new SentryPropagator()
})