the function of triton_start_loc #1334
Replies: 1 comment
-
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
when the sglang do decode, for examples, there are 2 seqs,the triton_start_loc will be [0, len(1st seq)]
could someone can explain the function, how to use it?
Beta Was this translation helpful? Give feedback.
All reactions