Ideas to enhance the experience #612
spaceychen
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
RT.
Model setting template: The basic settings for the same series models in the same usages are same, so no need fill in multiple times. template manager can be set up quickly!
For example:
BrainstormingTechnical-ArchitectureCodingQAOne-model-Multi-purpose. As we know, Programming tasks pursuing stability and brainstorming pursuing innovation, The model is the same but the basic settings are different. It would be great if one model instance could support multiple usage scenarios!
In this way, we can abstract all application model configurations into oMLX by routing.
For example:
http://localhost:8001/v1/qwen3.5-27b-4bit/for-coding-task# routing to instance-qwen3.5-27b-4bit + template-codinghttp://localhost:8001/v1/qwen3.5-27b-4bit/for-brainstorming-task# routing to instance-qwen3.5-27b-4bit + template-brainstormingBeta Was this translation helpful? Give feedback.
All reactions