Feature Request: Enable Subtitles/VTT Files with Livepeer Player for Closed Captioning

[sirgawain0x]

Description:
We would like to request the integration of subtitles or VTT files with the Livepeer player to support closed captioning. This feature would enhance accessibility by providing audio-to-text subtitles.

Integration Details:

• Coordination with the Livepeer AI team on their Discord server is required to make this integration work effectively.
• The integration will involve utilizing Livepeer AI's audio-to-text capabilities to generate subtitles in real-time.

Steps to Implement:

1. Enable support for subtitles or VTT files in the Livepeer player.
2. Coordinate with the Livepeer AI team on Discord to integrate their audio-to-text subtitle generation.

Benefits:

• Improved accessibility for users who rely on subtitles for comprehension.
• Enhanced user experience with real-time audio-to-text subtitles.

Contact:
For further details and coordination, please join the Livepeer AI team's Discord server.

Thank you for considering this feature request.

[liberalterian]

The initial functionality was completed on my last PR. I am working on finishing up the multi-language support with the SubtitlesDisplay and SubtitlesControl components I added to the components/Player directory.

I am going to set up a audio-to-text and translations endpoint in the /api/livepeer/subtitles directory and call them from the FildUpload#handleUpload() method.

Will update you I am done and submit a PR.

[liberalterian]

This feature is fully functioning and includes updates to the Upload page, FileUpload component, and CreateThumbnail component as well as the addition of the audioToText and translate server actions and the /audio-to-text and /translation endpoints.

I fixed the bugs that were holding the DB back and everything is working through the entire upload process and subtitles are displaying in the appropriate location. If necessary, you can use the environment variables I sent you for the DB but your DB instance should work fine and you can find the variables in the studio dashboard (envId, contextId, and modelId).

There are also tests included in my most recent PR that cover all of these updates and the entire upload process with only a few tests left to implement.

Let me know if you have any issues.