Can a KV cache speed up the transformer here?

[geoffreya]

I saw someone speed up a transformer elsewhere by adding a KV cache. (repo: tortoise-tts-fast)

[gkucsko]

thanks, already part of bark as of a week ago!