.NET Handoff Orchestration how to get ChatMessageContent in the InteractiveCallback

[Dan (Daniellled)]

In Handoff orchestration the Human Response Function is a single callback and as part of that callback the ChatMessageContent is not included. How are you supposed to get ChatMessageContent in the InteractiveCallback?

I thought about using Agent Response Callback and just capturing the ChatMessageContent and sharing it with the InteractiveCallback function. However, due to Relationship Between Runtime and Orchestrations the runtime and orchestrator should be considered multithreaded.

Think of an orchestration as a graph that defines how agents interact with each other. The runtime is the engine that executes this graph, managing the flow of messages and the lifecycle of agents. Developers can execute this graph multiple times with different inputs on the same runtime instance, and the runtime will ensure that each execution is isolated and independent.

[Tao Chen (TaoChenOSU)]

Hi Dan (@Daniellled),

Thank you for your question!

You're right, you will get the agent responses via the agent_response callback to interact with the agent in the handoff orchestration.

Could you share more details on your comment on multithreaded?

[Dan (Daniellled)]

What meant by the multithreaded comment was. Assume I am following this example. I have a UI where the user can post a question to the handoff orchestrator. When we get a response back the UI is updated, or if we need human in the loop the user can provide a response etc.

If the user opens the UI and writes "I'd like to track the status of my order". I would expect the conversation to follow what you have described in your example. However, what if the UI is a tabbed application and the user opens another tab and writes "I received my order and it was broken". Now I have two conversations running at the same time.

1. Do I need two instances of the Handoff Orchestrator?
2. Do I need two instances of the InProcessRuntime?
3. Do I need two instances of each of my ChatCompletionAgents?

Since the HandoffOrchestration constructor takes the ResponseCallback property I am assuming I would need an instance of the HandoffOrchestration for each conversation (or in the case of my example, each tab). If not, the event would get raised for each conversation and I wouldn't know which tab to forward the response to.

[Dan (Daniellled)]

Tao Chen (@TaoChenOSU) - Does my response provide you the information you need? In my mind if I have one event callback, and I invoke var result = await orchestration.InvokeAsync(input, runtime); twice with two different inputs I have no way of knowing which input the ResponseCallback invocation belongs to.

[Diego Modolo Ribeiro (diegomodolo)]

Hi Dan (@Daniellled), I am struggling to create a PoC using an UI for the Human in the loop scenario.
What I need is something similar to what you are using, but in my case I will have just "one tab".
Could you give me some insights on how to create an user interface for this scenario?
Thanks in advance.