SIgnalR and Stream #828
Closed
Rodrigo Roman (dedalo)
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Just completed adding signalr to a version of copilot chat demo, the user "sensation" when you update status, just telling what the kernel is doing in the backgound changes all the eperiencie.
I added status for the user intent like "Understanding message..." then for the planner "Thinking.." each action of the actionplanner has its prompt like "Seeking xxx information" then the last message when geting the completion says "Writing answer", I think this could be a great addition to the system, and also will let chat stream work.
Working right now to extend SemanticFunctionConfig with IsStream to let LocalFunc work diferent if you wnat to stream the result, no sure how to organize de callback function in a neat way, but like to know if this kind of feature is part of the roadmap.
All reactions