Commit cabebd0
committed
AI Transport: Add a guide for token streaming using OpenAI SDK
This guide provides a concrete example of how to implement the
message-per-token pattern that Mike documented (the one linked to in
this guide).
I initially got Claude to generate this but replaced a fair chunk of its
output. I trusted that its prose is consistent with our tone of voice
and AI Transport marketing position (whether mine is, I have no idea)
and in general trusted its judgements about how to structure the
document. I would definitely welcome opinions on all of the above,
especially from those familiar with how we usually write docs.
I have tried to avoid repeating too much content from the
message-per-token page and have in particular not tried to give an
example of hydration since it seems like a provider-agnostic concept.1 parent e5ea672 commit cabebd0
2 files changed
+677
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
30 | 39 | | |
31 | 40 | | |
32 | 41 | | |
0 commit comments