When a user sets up a monitor, they have the option to select specific actions to be taken upon anomaly detection. These actions may include notifications which can be via Slack, Pager, or email. Users can also submit a support request for additional notification channels or custom actions such as custom webhooks or pipeline triggers.
In the case of notifications, users can enable one or more of these at the monitor level. Users can also include a custom message and assign a severity level to the notification to help with prioritization.
Before these notification channels are available for selection in the monitor manager, users must first configure the notifications in the Notifications and Digest Settings page in the settings section.
To set up email notifications, we recommend creating a mailing list dedicated to WhyLabs Notifications, so that multiple team members can subscribe to it. Please work with your email administrator to configure permissions for the mailing list to receive external messages.
Email notifications will include models with alerts along with alert types and additional info configured within the monitor.
To set up Slack notifications, we recommend creating a dedicated Slack channel for WhyLabs Notifications. Make sure all relevant team members are subscribed to the channel.
To obtain the Slack webhook, please follow Slack documentation: https://api.slack.com/messaging/webhooks.
Slack based notifications will look like the following.
To set up PagerDuty Notifications, please follow the steps below:
- In PagerDuty, create a Service to receive WhyLabs Alerts
- Once created, go to Integrations tab for this Service
- Click Add New Integration
- Search for "WhyLabs" and select the WhyLabs AI Observability integration.
- Copy the integration key, you’ll need it for the next step
- Go to notification settings in WhyLabs
- Enable PagerDuty Notifications
- Paste your integration key and set a schedule for your Notifications
Notifications will include a breakdown of Alerts detected since the last Notification was sent. For example, the PagerDuty Notification may look like this:
If the base Notification template does not work for your use case, and your team would like to receive customized Notifications instead, please reach out to us.
In some cases, users may wish to set up multiple delivery methods. For example, users may want specific projects to deliver notifications to different locations than other projects. This level of customization is possible through the API by following steps outlined in this page.