Skip to content

Merge my latest changes into yours#2

Closed
dosier wants to merge 5 commits into
rubencagnie:streaming-toolsfrom
dosier:streaming-tools-ruben
Closed

Merge my latest changes into yours#2
dosier wants to merge 5 commits into
rubencagnie:streaming-toolsfrom
dosier:streaming-tools-ruben

Conversation

@dosier

@dosier dosier commented Sep 13, 2025

Copy link
Copy Markdown

Using new flow extensions to construct streams, removing index tool call usage for non-streaming responses.

Also after looking at the api of other LLM clients, it seems only openAI does the partial tool call stream objects... So I think it's better to have two types, ToolCall.Partial and ToolCall.Completed and offer extensions to merge ToolCall.Partial into ToolCall.Completed.

… package and update imports across modules. Add coroutines dependency to `prompt-model`.
# Conflicts:
#	prompt/prompt-executor/prompt-executor-clients/prompt-executor-anthropic-client/src/commonMain/kotlin/ai/koog/prompt/executor/clients/anthropic/AnthropicLLMClient.kt
#	prompt/prompt-executor/prompt-executor-clients/prompt-executor-google-client/src/commonMain/kotlin/ai/koog/prompt/executor/clients/google/GoogleLLMClient.kt
#	prompt/prompt-executor/prompt-executor-clients/prompt-executor-openai-client/src/commonMain/kotlin/ai/koog/prompt/executor/clients/openai/OpenAILLMClient.kt
#	prompt/prompt-model/src/commonMain/kotlin/ai/koog/prompt/streaming/StreamFrameExt.kt
@dosier

dosier commented Sep 13, 2025

Copy link
Copy Markdown
Author

Regarding dosier#1

@dosier

dosier commented Sep 13, 2025

Copy link
Copy Markdown
Author

Okay I think we should disregard the partial tool calls, openAI API specs seems to emit a tool call after it finished all the chunks that does contain the final tool call. Would simplify the API a lot.

@dosier

dosier commented Sep 13, 2025

Copy link
Copy Markdown
Author

Removed partial streaming in this version: #3

@dosier dosier closed this Sep 15, 2025
@dosier
dosier deleted the streaming-tools-ruben branch September 18, 2025 17:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant