Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional sentiment classifiers #108

Open
dylanbouchard opened this issue Jan 24, 2025 · 1 comment
Open

Additional sentiment classifiers #108

dylanbouchard opened this issue Jan 24, 2025 · 1 comment
Assignees
Labels
good first issue Good for newcomers

Comments

@dylanbouchard
Copy link
Collaborator

dylanbouchard commented Jan 24, 2025

Is your feature request related to a problem? Please describe.
Currently, the SentimentBias and CounterfactualMetrics classes offer computation of counterfactual sentiment bias using only a single sentiment classifier, vaderSentiment.

For more robustness, it may be worthwhile to include additional sentiment classifiers for the user to choose among. Ideally, we could do so in a way that does not introduce new dependencies.

Describe the solution you'd like
There are multiple options for how this could be structured:

  • Similar to ToxicityMetrics class that offers multiple toxicity classifiers. If users specify multiple, an ensemble is used.
  • Only a single sentiment classifier may be specified
  • If multiple classifiers are specified, return a value of counterfactual sentiment bias for each classifier

Describe alternatives you've considered
Status quo

@dylanbouchard dylanbouchard added good first issue Good for newcomers help wanted Extra attention is needed labels Jan 24, 2025
@ManaliJoshi92
Copy link

I have just started working on this issue and have opened a draft PR #129
This is still a work in progress, and I will update it as I make progress.

@dylanbouchard dylanbouchard removed the help wanted Extra attention is needed label Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants