Customer Experience Ruleset

Customer Experience is designed to prevent various issues that impact the application experience by detecting sentiment, toxicity, refusals, and any PII that a user attempts to share.

The following yaml code can be added to your policy to enable the Truthfulness ruleset.

  - ruleset: score.customer_experience
    options:
      behavior: observe
      sensitivity: medium

This ruleset adds the equivalent of the following metric section to your yaml policy and uses those metrics to compute an overall score.

metrics:
  - metric: prompt.sentiment.sentiment_score
  - metric: prompt.pii
  - metric: response.sentiment.sentiment_score
  - metric: response.toxicity.toxicity_score
  - metric: response.regex.refusal