Updated time: 2021-10-01 16:38:15
05T-1100924
2021-10-01
Know-how
A problem with Taiwanese speech recognition is that the amount of training data is far from enough to build a practical system. It is feasible to collect speech data with reliable transcribed text to train acoustic models, but it is costly. In addition, because Taiwanese is a spoken language, not a commonly used written language, the text data used for language model training is also extremely scarce and difficult to collect. There are a large number of Taiwanese drama series with Chinese subtitles on YouTube. We can augment training data for Taiwanese speech recognition. The idea is to use the existing Taiwanese speech recognition system to convert the Chinese subtitles into the most probable Taiwanese word sequence by referring to the speech and Chinese-Taiwanese synonym dictionary.
- Novelty: This is the first technology that uses Chinese subtitles of Taiwanese dramas to automatically augment training data for Taiwanese speech recognition.
- Simple: A large number of Taiwanese dramas on the Internet can be used to quickly expand the training data of Taiwanese speech recognition.
- development of Taiwanese speech recognition system
- development of Chinese and Taiwanese machine translation system
- development of speech recognition system for other languages with similar information (such as Hakka and Aboriginal languages)
- development of machine translation system for other languages with similar information (such as Hakka and Aboriginal languages)

Fig1. An example Taiwanese word/phone graph generated from a Chinese word sequence. In the IPA sequence, each vowel contains an IPA symbol followed by a tone code.
Hsin-Min Wang, Ming-Tat Ko
If you are interested in this technology, please fill in the information on the webpage under the manufacturer option (Request for Technology Licensing, Material Transfer, or Sponsored Research) on the website of this office

Training data augmentation for Taiwanese speech recognition using Taiwanese dramas with Chinese subtitles