Skip to content

gemma-4 - #7

Open
fuddin-bit wants to merge 2 commits into
neuralmagic:mainfrom
fuddin-bit:benchmark-runs
Open

gemma-4#7
fuddin-bit wants to merge 2 commits into
neuralmagic:mainfrom
fuddin-bit:benchmark-runs

Conversation

@fuddin-bit

Copy link
Copy Markdown
Contributor

Summary

Added a gemma-4 base model to create a matrix of jobs we can use that run real benchmarks on H200s in "tap" mode so we have a library of traces to use with the simulator to be able to compare the traces such as time-first-token, inter latency between token, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant