Skip to content

feat: draft/Lora op #3453

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

feat: draft/Lora op #3453

wants to merge 2 commits into from

Conversation

danielafrimi
Copy link
Collaborator

No description provided.

Ubuntu added 2 commits April 9, 2025 11:20
Signed-off-by: Ubuntu <[email protected]>

lora_tests

Signed-off-by: Ubuntu <[email protected]>

CR fix

Signed-off-by: Ubuntu <[email protected]>

added lora test for mlp layer

Signed-off-by: Ubuntu <[email protected]>

small refactor in mlp test

Signed-off-by: Ubuntu <[email protected]>

setUp to setUp(cls)

Signed-off-by: Ubuntu <[email protected]>

hireracy change

Signed-off-by: Ubuntu <[email protected]>

wip

Signed-off-by: Ubuntu <[email protected]>

wip

Signed-off-by: Ubuntu <[email protected]>

wip

Signed-off-by: Ubuntu <[email protected]>

wip

Signed-off-by: Ubuntu <[email protected]>

groupedgemm works

Signed-off-by: Ubuntu <[email protected]>

works with some logs in the C++

Signed-off-by: Ubuntu <[email protected]>

works with some logs in the C++

Signed-off-by: Ubuntu <[email protected]>

test lora_plugin vs lora_op works

Signed-off-by: Ubuntu <[email protected]>

mlp works with lora op only if intermidate is match hidden states

Signed-off-by: Ubuntu <[email protected]>

mlp not working, but fix in the loraOp for the output shape

Signed-off-by: Ubuntu <[email protected]>

changed loraOp for the output shape, now the test of the plugins pass

Signed-off-by: Ubuntu <[email protected]>

mlp works with lora op

Signed-off-by: Ubuntu <[email protected]>

wip

Signed-off-by: Ubuntu <[email protected]>
Signed-off-by: Ubuntu <[email protected]>
@danielafrimi danielafrimi marked this pull request as draft April 10, 2025 15:02
@juney-nvidia juney-nvidia changed the title draft/Lora op feat: draft/Lora op Apr 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant