Efficient Utilization of Large Pre-Trained Models for Low Resource ASR

IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW), pp. 1–5

Abstract

Unsupervised representation learning has recently helped automatic speech recognition (ASR) to tackle tasks with limited labeled data. Following this, hardware limitations and applications give rise to the question how to take advantage of large pre-trained models efficiently and reduce their complexity. In this work, we study a challenging low resource conversational telephony speech corpus from the medical domain in Vietnamese and German. We show the benefits of using unsupervised techniques beyond simple fine-tuning of large pre-trained models, discuss how to adapt them to a practical telephony task including bandwidth transfer and investigate different data conditions for pre-training and fine-tuning. We outperform the project baselines by 22% relative using pre-training techniques. Further gains of 29% can be achieved by refinements of architecture and training and 6% by adding 0.8 h of in-domain adaptation data.

Authors 4

1. Peter Vieting Aachen Human Language Technology and Pattern Recognition Group Computer Science Department

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Human Language Technology and Pattern Recognition Group,Computer Science Department,Aachen,Germany,52074

2. Christoph Lüscher Aachen Human Language Technology and Pattern Recognition Group Computer Science Department

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Human Language Technology and Pattern Recognition Group,Computer Science Department,Aachen,Germany,52074

   AppTek GmbH, Aachen, Germany

3. Ralf Schlüter Aachen Human Language Technology and Pattern Recognition Group Computer Science Department

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Human Language Technology and Pattern Recognition Group,Computer Science Department,Aachen,Germany,52074

   AppTek GmbH, Aachen, Germany

4. Hermann Ney Aachen Human Language Technology and Pattern Recognition Group Computer Science Department

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University,Human Language Technology and Pattern Recognition Group,Computer Science Department,Aachen,Germany,52074

   AppTek GmbH, Aachen, Germany