Skip to content

Comments

support return_all_tokens & stop_seqs #2584

Merged
Jiang-Jia-Jun merged 6 commits intoPaddlePaddle:developfrom
ming1753:internet
Jan 8, 2025
Merged

support return_all_tokens & stop_seqs #2584
Jiang-Jia-Jun merged 6 commits intoPaddlePaddle:developfrom
ming1753:internet

Conversation

@ming1753
Copy link
Collaborator

@ming1753 ming1753 commented Jan 6, 2025

PR types(PR类型)

Serving

Description

  1. 新增环境变量:REDUCE_DIALOGUE_REPETITION
    对应导出静态图时候设置了--reduce_dialogue_repetition 1,新增两个输入降低多轮对话句间重复
  2. 支持return_all_tokens
  3. 支持stop_seqs

@paddle-bot
Copy link

paddle-bot bot commented Jan 6, 2025

Thanks for your contribution!

@ming1753 ming1753 changed the title support reduce_dialogue_repetition support return_all_tokens & stop_seqs Jan 7, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 97e541e into PaddlePaddle:develop Jan 8, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants