The automatic analysis of classroom talk

  • Hanna Kronholm University of Jyväskylä
  • Daniela Caballero University of Chile
  • André Mansikkaniemi Aalto University
  • Roberto Araya University of Chile
  • Sami Lehesvuori University of Jyväskylä
  • Pasi Pertilä Tampere University of Technology
  • Tuomas Virtanen Tampere University of Technology
  • Mikko Kurimo Aalto University
  • Jouni Viiri University of Jyväskylä

Abstract

The SMART SPEECH Project is a joint venture between three Finnish universities and a Chilean university. The aim is to develop a mobile application that can be used to record classroom talk and enable observations to be made of classroom interactions. We recorded Finnish and Chilean physics teachers’ speech using both a conventional microphone/dictator setup and a microphone/mobile application setup. The recordings were analysed via automatic speech recognition (ASR). The average word error rate achieved for the Finnish teachers’ speech was under 40%. The ASR approach also enabled us to determine the key topics discussed within the Finnish physics lessons under scrutiny. The results here were promising as the recognition accuracy rate was about 85% on average.

Published
2017-11-01
How to Cite
Kronholm, H., Caballero, D., Mansikkaniemi, A., Araya, R., Lehesvuori, S., Pertilä, P., Virtanen, T., Kurimo, M., & Viiri, J. (2017). The automatic analysis of classroom talk. FMSERA Journal, 1(1), 142-151. Retrieved from https://journal.fi/fmsera/article/view/60940
Section
Vertaisarvioidut artikkelit