OpenLLMTelemetry
OpenLLMTelemetry is a package built on top of OpenTelemetry instrumentation and provides both observability and guard rails for LLMs.
Using OpenLLMTelemetry, you can instrument your LLM applications in two primary ways:
- Code-based solutions via APIs and SDKs
- Zero-code solutions
The integration is minimal, built on top of OpenTelemetry tracing. You can choose to export the traces to WhyLabs, or to your existing tracing stack.
Once you have our Guardrails APIs deployment up and running, you can seamlessly integrate with our policy via OpenLLMTelemetry.
