Generating subtitles for a live broadcast requires a streaming model because transcriptions should appear on screen shortly after the commentary is spoken. Amazon Transcribe streaming transcription enables you to send an audio stream and receive a transcription stream in real time. In batch transcription, the model issues a transcription using the full context provided in the audio segment. GOOD AFTERNOON EVERYBODY WELCOME ALONG TO ROUND 4 OF THE FORMULA 1 WORLD CHAMPIONSHIP IN 2019Īmazon Transcribe supports both batch and streaming transcription models. GOOD AFTERNOON EVERYBODY WELCOME ALONG TO ROUND 4 OF THE FORMER ONE For example, in the following sentence, the system uses the words ‘WORLD CHAMPIONSHIP’ towards the end of the sentence to inform context and allow ‘FORMER ONE’ to be correctly transcribed as ‘FORMULA 1’. ASR language models benefit from utilizing the words across a fully spoken sentence. The output of Automatic Speech Recognition (ASR) systems is highly context-dependent. Live transcriptions: Understanding use case specific terminology and context The following diagram shows the sequential process. The postprocessed text is then moderated by an F1 moderator before being transformed to captions that are displayed to the viewers. Custom vocabularies are passed as parameters to Amazon Transcribe, and the resulting captions are postprocessed. The solution works as a proxy to Amazon Transcribe. You will learn how to utilize Amazon Transcribe in real-time broadcasts and supercharge live captioning for your use case with custom vocabularies, postprocessing steps, and a human-in-the-loop validation layer. In the following sections, we take a deep dive into how AWS Professional Services partnered with F1 to build a robust, state-of-the-art, real-time race commentary captioning system by enhancing Amazon Transcribe to understand the particularities of the F1 world. With the advanced customization features available in Amazon Transcribe, we tailored the underlying language models to recognize domain-specific terms that are rare in general language use, which boosted transcription accuracy. Looking only at the 2021 season, 16/20 drivers had non-English names and 17/20 had non-Spanish names or non-French names. Moreover, F1 is a global sport, traveling across the world and drawing drivers from many different countries. Being a sport steeped in technology, commentators often refer to F1 domain-specific terminology such as DRS (Drag Reduction System), aerodynamic, downforce, or halo (a safety device) for example. With the excitement of an F1 race, it’s common to have commentators with differing accents move quickly from one topic to another as the race unfolds. This task provides many unique challenges. This was achieved using Amazon Transcribe to automatically convert the commentary into subtitles. F1 now provides real-time live captions in three languages across four series: F1 in British English, US Spanish and French and F2, F3, and Porsche Supercup in British English and US Spanish. This form of commentary greatly increases the engagement and excitement of viewers.į1 has a strong affinity to cutting edge technology, and partnered with AWS to build a scalable and sustainable closed caption solution for F1 TV, their Over-the-top (OTT) platform, that can support a growing calendar and language portfolio. The role of the race commentators is to weave the multitude of parallel events and information into a single exciting narrative. In this fast-paced and dynamic environment, milliseconds dictate the difference between pole position or second on the grid. The challengeįor F1, everything is about extreme speed: with pit stops as short as 2 seconds, speeds of up to 375 KPH (233 MPH), and 5g forces on drivers under braking and through corners. We discuss how they used Amazon Transcribe and its custom vocabulary feature as well as custom-built postprocessing logic to improve their live transcription accuracy in three languages. In this post, we share how Formula 1 joined forces with the AWS Professional Services team to make it happen. Amazon Transcribe is an automatic speech recognition (ASR) service that allows you to generate audio transcription. The Formula 1 (F1) live steaming service, F1 TV, has live automated closed captions in three different languages: English, Spanish, and French.įor the 2021 season, FORMULA 1 has achieved another technological breakthrough, building a fully automated workflow to create closed captions in three languages and broadcasting to 85 territories using Amazon Transcribe.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |