Exploratory: Grafana Alerts

[arlake228]

This is an exploratory task to determine if we should be doing more with Grafana Alerts. For example:

• Are there standard alerts we should add to certain bundles?
• Should psconfig have the ability to create certain alerts for people?
• Is this a documentation issue and we give people guidance on how to build their own alerts? possibly something to be added to workshops?

Since this is exploratory, it is entirely possible that this will lead to tasks that are beyond 5.3.0.

[szymontrocha]

I think this is a great idea! There can be alerts on metrics but also operational alerts. I alredy investigated and develop some alerts mainly on "No data" as this was important metric to me to see which hosts are not providing data (but should have been doing this). See also perfsonar/grafana#26

[szymontrocha]

We discussed it a bit at the f2f. As a starting step we'll create a documentation entry about creating alerts in Grafana. I created a separate docs issue perfsonar/docs#269