Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: Dual boost improves prompt before passing it down to the provided AIs #1326

Open
omarcresp opened this issue Feb 20, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@omarcresp
Copy link
Contributor

Feature request

Im using the dual boost feature with the following setup
main model (reasoning): deepseek-r1 (kluster)
first_provider (coder): claude 3.5
second_provider (coder): qwen-coder-32b (groq)

And having a reasoning model evaluating the coder results have gave me great results (high response times tough) but I think this approach could be better if instead of prompt -> providers -> main model -> response the flow could be something like prompt -> main model -> providers -> main model -> response

I have manually inserted the second flow in chat apps and I think it gives better results, specially when you didnt created a huge prompt, just asked in chat something to be change, then main model reasoned to improved the prompt based in the codebase context and the question and calls providers ai with an improved version of the user prompt

I can code this change, but since it would be a "refactor" on how the dual_boost feature works I rather ask you before start writing lines and lines of code that may or may not be included. Let me know your thoughts about this process and if you think is something wort exploring to add to the plugin @yetone

Motivation

Im trying to get agent like behavior if using dual_boost. and I think this approach could get even more results (after tested it in a very manual way using chats)

Other

No response

@omarcresp omarcresp added the enhancement New feature or request label Feb 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant