I want the Realtime API to not only send the audio response but its text form too.
So I configure the modality:
OpenAIRealtimeSessionConfig(modalities = listOf("audio", "text")
And then I await the bot's response's transcription in this callback function, but none of the callback functions work - I tried onBotTranscript(), onBotLLMText() and onBotTTSText() - but none of those return the transcription of the response.
onUserTranscript() works properly.
Expected
- (user voice input): Who is snow white?
onUserTranscript: Who is snow white?
- (one of the bot transcription callbacks):
Snow White is a classic fairy tale character known for her beauty, kindness...
Actual
- (user voice input): Who is snow white?
onUserTranscript: Who is snow white?
- (one of the bot transcription callbacks): no data
Is this a bug or am I configuring the client wrongly?
I want the Realtime API to not only send the audio response but its text form too.
So I configure the modality:
And then I await the bot's response's transcription in this callback function, but none of the callback functions work - I tried
onBotTranscript(),onBotLLMText()andonBotTTSText()- but none of those return the transcription of the response.onUserTranscript()works properly.Expected
onUserTranscript:Who is snow white?Snow White is a classic fairy tale character known for her beauty, kindness...Actual
onUserTranscript:Who is snow white?Is this a bug or am I configuring the client wrongly?