How to use plugins with Harvest for metrics filtering

[gaur-piyush]

We're using Harvest to scrape ONTAP metrics. However, the number of labels are high(30+). This is causing the googlecloud exporter to drop the metrics.

I saw the plugins doc for it. However, wandering how to use it within configuration. Do I need to add it in the poller configuration or somewhere else?

https://netapp.github.io/harvest/24.11.1/plugins/

[rahulguptajss]

@gaur-piyush Plugins in Harvest are designed to manipulate data collected by collectors as needed. However, built-in plugins do not support the functionality to drop labels. To achieve this, custom Go code is required.

One approach to dropping labels is to exclude them from the collection template. For instance, in the Volume template, you can reduce the number of labels in volume_labels by commenting out the unnecessary ones in the instance_labels section.

[rahulguptajss]

You can also utilize tool like VictoriaMetrics vmagent with relabeling rules. vmagent can scrape metrics from Harvest, apply relabeling rules to reduce the number of labels, and then forward the processed metrics to the Google Cloud exporter. doesn't require any changes to Harvest.

For more details on how to configure vmagent, you can refer to the VictoriaMetrics vmagent documentation.

[gaur-piyush]

You can also utilize tool like VictoriaMetrics vmagent with relabeling rules. vmagent can scrape metrics from Harvest, apply relabeling rules to reduce the number of labels, and then forward the processed metrics to the Google Cloud exporter. doesn't require any changes to Harvest.

For more details on how to configure vmagent, you can refer to the VictoriaMetrics vmagent documentation.

We're already using Otel to scrape the metrics. Let me check if we can do it using relabel configs.