New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

reverse KL and JSD #252

Open

yundai424 opened this issue Sep 17, 2024 · 1 comment

Assignees

Labels

feature

Collaborator

yundai424 commented Sep 17, 2024

🚀 The feature, motivation and pitch

which are also commonly used divergence loss in distillation

Alternatives

No response

Additional context

No response

yundai424 self-assigned this

yundai424 added the feature label

Contributor

Tcc0403 commented Sep 19, 2024 •

edited

Loading

I would like to take the JSD part. @yundai424
Do we expect input and target in log-space like KLDiv? or make it a parameter option?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment