You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently, the SentimentBias and CounterfactualMetrics classes offer computation of counterfactual sentiment bias using only a single sentiment classifier, vaderSentiment.
For more robustness, it may be worthwhile to include additional sentiment classifiers for the user to choose among. Ideally, we could do so in a way that does not introduce new dependencies.
Describe the solution you'd like
There are multiple options for how this could be structured:
Similar to ToxicityMetrics class that offers multiple toxicity classifiers. If users specify multiple, an ensemble is used.
Only a single sentiment classifier may be specified
If multiple classifiers are specified, return a value of counterfactual sentiment bias for each classifier
Describe alternatives you've considered
Status quo
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Currently, the
SentimentBias
andCounterfactualMetrics
classes offer computation of counterfactual sentiment bias using only a single sentiment classifier,vaderSentiment
.For more robustness, it may be worthwhile to include additional sentiment classifiers for the user to choose among. Ideally, we could do so in a way that does not introduce new dependencies.
Describe the solution you'd like
There are multiple options for how this could be structured:
ToxicityMetrics
class that offers multiple toxicity classifiers. If users specify multiple, an ensemble is used.Describe alternatives you've considered
Status quo
The text was updated successfully, but these errors were encountered: