DISCO: Development and Integration of Speech technology into Courseware for language learning
Language
learners are known to fare best in one-on-one interactive learning
situations
in which they receive optimal corrective feedback. However, providing
this type
of tutoring by trained language instructors is time-consuming and
costly, and
therefore not feasible for the majority of language learners. This
particularly
applies to oral proficiency, where corrective feedback has to be
provided immediately
after the utterance has been spoken, thus making it even more difficult
to
provide sufficient practice in the classroom. The recent
appearance of Computer Assisted Language Learning (CALL) systems that
make use
of Automatic Speech Recognition (ASR) and other advanced automatic
techniques offers
new perspectives for training oral proficiency in a second language
(L2).
The present project aims to develop and
test a prototype of an ASR-based CALL application for training oral
proficiency
for Dutch as a
second language (DL2). The application optimizes learning
through
interaction in realistic communication situations and provides
intelligent
feedback on various aspects of DL2 speaking, viz. pronunciation,
morphology and
syntax. The communicative settings employed in Nieuwe Buren (New Neighbours, a method for DL2
training developed by Malmberg publishers) will constitute the starting
point
for the application.
This project addresses the
STEVIN priorities, tools and data for the development of CALL
applications,
educational system, robustness of speech recognition, confidence
measures and adaptation.
It combines speech and language technology techniques to form a
state-of-the-art
CALL application, which can be considered innovative from an
international
perspective.
The results of this project are
relevant for companies and institutions that conduct research and
develop
applications in educational speech and language technology, and also
for
publishers.
This project will be carried out within the framework of the Stevin Program.
Partners
CLST - Centre for Language and Speech Technology, Radboud
University Nijmegen
UA - Linguapolis,
Universiteit Antwerpen
RiL -
Radboud in’to Languages
PDL - Polderland Language & Speech Technology
Publications (in anti-chronological order)
J. van Doremalen, C. Cucchiarini, H. Strik (to appear)
Optimizing automatic speech recognition for low-proficient non-native speakers.
EURASIP Journal on Audio, Speech, and Music Processing.
[PDF]J. van Doremalen, C. Cucchiarini, H. Strik (2009)
Automatic Detection of Vowel Pronunciation Errors Using Multiple Information Sources.
To appear in proceedings of the biannual IEEE workshop on Automatic Speech Recognition and Understanding (ASRU) 2009.
[PDF]J. van Doremalen, H. Strik, C. Cucchiarini (2009)
Optimizing non-native speech recognition for CALL applications.
Proceedings of Interspeech-2009, Brighton, UK, pp. 592-595.
[PDF]J. van Doremalen, H. Strik, C. Cucchiarini (2009)
Utterance Verifiction in Language Learning Applications.
Proceedings of the SLaTE-2009 workshop, Warwickshire, England.
[PDF]H. Strik , F. Cornillie, J. Colpaert, J. van Doremalen, C. Cucchiarini (2009)
Developing a CALL System for Practicing Oral Proficiency: How to Design for Speech Technology, Pedagogy and Learners.
Proceedings of the SLaTE-2009 workshop, Warwickshire, England.
[PDF]F. Cornillie, J. Colpaert (2009)
Motivation revisited: empirical and theoretical validation of the Distributed Language Learning model.
EuroCALL 2009 conference handbook Ed. A. Gimeno, ISBN: 978-84-692-4598-9). Valencia, Spain. pp. 133-134.
[PDF]J. Colpaert, F. Cornillie (2009)
Designing for authenticity: a framework and guidelines for conversation simulation courseware.
Language Teaching Symposium 2009, Gent.
[PDF]C. Cucchiarini, A. Neri, H. Strik (2009)
Oral Proficiency Training in Dutch L2: the Contribution of ASR-based Corrective Feedback.
Speech Communication, Volume 51, Issue 10, October 2009, Pages 853-863.
[doi] [DOC]
[RTF] [TXT]H. Strik en C. Cucchiarini (2008)
DISCO - Nederlands leren spreken met hulp van de computer.
Special issue van DIXIT over 'Stevin en onderwijs', p. 18.
[PDF]C. Cucchiarini, J. van Doremalen, and H. Strik (2008)
DISCO: Development and Integration of Speech technology into Courseware for language learning.
Proceedings of Interspeech-2008, Brisbane, Australia, Sept. 26-29, 2008, pp. 2791-2794.
[PDF]H. Strik, J. van Doremalen and C. Cucchiarini (2008)
A CALL system for practicing speaking proficiency: pronunciation, morphology and syntax.
Proceedings of the XIIIth Int. CALL Conference, Antwerp, 30 August - 1 September 2008, pp. 123-125.
[PDF]Helmer Strik, Ambra Neri, and Catia Cucchiarini (2008)
Speech technology for language tutoring.
Proceedings of LangTech-2008, Rome, February 28-29, 2008.
[PDF]Presentations (in anti-chronological order)
F. Cornillie; Motivation revisited: empirical and theoretical validation of the Distributed Language Learning model.
EuroCALL 2009 conference, Gandia (Spain), 11-9-2009.
[PDF pres.]
[PDF hand-out]J. van Doremalen; Optimizing non-native speech recognition for CALL applications.
Interspeech-2009, Brighton (UK), 11-9-2009.
[PDF]H. Strik; Developing a CALL System for Practicing Oral Proficiency: How to Design for Speech Technology, Pedagogy and Learners.
SLaTE-2009 workshop, Warwickshire (UK), 4-9-2009.
[PDF]J. van Doremalen; Utterance Verification in Language Learning Applications.
SLaTE-2009 workshop, Warwickshire (UK), 3-9-2009.
[PDF]J. Colpaert; Designing for authenticity: a framework and guidelines for conversation simulation courseware.
Language Teaching Symposium 2009, Gent, 29-05-2009.
[PPT]J. Colpaert; Goal-oriented Distributed Learning.
Van E-learning tot bedrijfstheater: vernieuwende leervormen in bedrijfsopleidingen, Business Faculty, Brussels, 19-03-2009.
[]J. Colpaert; Beyond motivation: How Self is Self? An exercise in theoretical validation of empirical findings in CALL.
CALICO 2009, Arizona State University, Phoenix, 14-03-2009.
[]J. Colpaert, Invited master class (L. Gómez): Beyond motivation: designing for all learners and teachers.
Universidad de Concepción, Chile, 27-11-2008.
[]H. Strik; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Conference: Inburgering via Technologische Innovatie, Rotterdam, 20-11-2008.
[PPT]
[PDF]H. Strik; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Taal in Bedrijf, Brussels, 19-11-2008.
[]H. Strik; How to integrate ASR into CALL applications.
LESLLA 2008, Antwerp, 24-10-08.
[PPT]C. Cucchiarini; DISCO: Development and Integration of Speech technology into Courseware for language learning.
Interspeech, Brisbane, 26-09-2008.
[PPT]J. van Doremalen; A CALL system for practicing speaking proficiency: pronunciation, morphology and syntax.
CALL 2008, Antwerp, 01-09-08
[]H. Strik; Speech technology for language tutoring.
The language and speech technology conference, LangTech-2008, Rome, February 28-29, 2008.
[PPT]
[PDF]