Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Z Loss in CE #239

Merged
merged 37 commits into from
Nov 7, 2024
Merged

Support Z Loss in CE #239

merged 37 commits into from
Nov 7, 2024

Commits on Sep 9, 2024

  1. Implement z loss in LigerCrossEntropyFunction

    @Tcc0403
    Tcc0403 committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    0454a12 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into z-loss

    @lancerts
    lancerts authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    9349e89 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into z-loss

    @lancerts
    lancerts authored Sep 9, 2024
    Configuration menu
    Copy the full SHA
    27783be View commit details
    Browse the repository at this point in the history

  4. Rename z_loss_scale to lse_square_scale

    @Tcc0403
    Tcc0403 committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    02e90db View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge branch 'z-loss' of github.com:Tcc0403/Liger-Kernel into z-loss

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    aa43dca View commit details
    Browse the repository at this point in the history

  2. Fix a mistake of the gradient calculation and update comments

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    aa4a4b2 View commit details
    Browse the repository at this point in the history

  3. Remove the parameter lse_square_scale in FusedLinearCrossEntropyLos… 

    …s and update comments
    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    f53f61c View commit details
    Browse the repository at this point in the history

  4. Implement z loss in LigerCrossEntropyFunction

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    b43c457 View commit details
    Browse the repository at this point in the history

  5. Rename z_loss_scale to lse_square_scale

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    59bc0a3 View commit details
    Browse the repository at this point in the history

  6. Fix a mistake of the gradient calculation and update comments

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    0921c81 View commit details
    Browse the repository at this point in the history

  7. Remove the parameter lse_square_scale in FusedLinearCrossEntropyLos… 

    …s and update comments
    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    c19f69c View commit details
    Browse the repository at this point in the history

  8. Merge branch 'z-loss' of github.com:Tcc0403/Liger-Kernel into z-loss

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    83c99ad View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    1ee07de View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Support z loss in flce

    @Tcc0403
    Tcc0403 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    83f23d0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    fcd5ff4 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    295aab7 View commit details
    Browse the repository at this point in the history

  2. Fix parameter orders of ce and flce

    @Tcc0403
    Tcc0403 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f72e9bb View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Fix functional tests

    @Tcc0403
    Tcc0403 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    10fa578 View commit details
    Browse the repository at this point in the history

  2. Fix bfloat16 precision issue on custom model

    @Tcc0403
    Tcc0403 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    03beb05 View commit details
    Browse the repository at this point in the history

  3. Add missing arguments in test and cleanup stdout

    @Tcc0403
    Tcc0403 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    3a6cad4 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge branch 'main' into ce-z-loss

    @lancerts
    lancerts authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7e4cc4b View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. Merge branch 'main' into ce-z-loss

    @lancerts
    lancerts authored Sep 21, 2024
    Configuration menu
    Copy the full SHA
    c0f2581 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 authored Sep 28, 2024
    Configuration menu
    Copy the full SHA
    9abd163 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    5c24241 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ce-z-loss

    @lancerts
    lancerts authored Oct 1, 2024
    Configuration menu
    Copy the full SHA
    97db6b4 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Merge branch 'main' into ce-z-loss

    @lancerts
    lancerts authored Oct 3, 2024
    Configuration menu
    Copy the full SHA
    cf632d8 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    91b62fd View commit details
    Browse the repository at this point in the history

  2. Fix merge conflicts

    @Tcc0403
    Tcc0403 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    d2d6e44 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'ce-z-loss' of github.com:Tcc0403/Liger-Kernel into ce-z… 

    …-loss
    @Tcc0403
    Tcc0403 committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    f7083f2 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 authored Oct 27, 2024
    Configuration menu
    Copy the full SHA
    b89f335 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 authored Nov 2, 2024
    Configuration menu
    Copy the full SHA
    9a6079a View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Merge branch 'main' into ce-z-loss

    @Tcc0403
    Tcc0403 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c8d0fac View commit details
    Browse the repository at this point in the history

  2. chekcstyle

    @Tcc0403
    Tcc0403 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    c957357 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Merge branch 'main' into ce-z-loss

    @ByronHsu
    ByronHsu authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    4e34bf2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ce-z-loss

    @ByronHsu
    ByronHsu authored Nov 6, 2024
    Configuration menu
    Copy the full SHA
    c304cc3 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. Merge branch 'main' into ce-z-loss

    @ByronHsu
    ByronHsu authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    fb7aff7 View commit details
    Browse the repository at this point in the history

  2. Update src/liger_kernel/ops/cross_entropy.py

    @ByronHsu
    ByronHsu authored Nov 7, 2024
    Configuration menu
    Copy the full SHA
    d2ab058 View commit details
    Browse the repository at this point in the history