How to set Repetition penalty? #1104
Unanswered
vijaysridhara
asked this question in
Q&A
Replies: 1 comment
-
All the sampling parameters are properties of the sampling pipeline. See here for an example (in this case setting temp). There are various other properties on the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This is related to my previous question, as the Deepseek V2 is constantly repeating same response many times, over one asked question. Is there a possibility of setting repetition penalty?
Beta Was this translation helpful? Give feedback.
All reactions