COMPUTER AIDED ARTICULATORY TUTOR: A SCIENTIFIC STUDY

Authors

  • Arumugam Rathinavelu
  • Hemalatha Thiagarajan

DOI:

https://doi.org/10.47839/ijc.6.3.458

Keywords:

3D Modeling, MR Images, Speech perception, Speech production, Computer aided articulatory model

Abstract

This paper describes the use of Computer Aided Articulation Tutor (CAAT) to conduct phonetic training to the hearing-impaired (HI) children with inner articulators as visual cues. This Articulatory tutor was developed by using Magnetic Resonance Imaging (MRI) and computer graphics techniques. The articulators include the movement of jaw, lips, tongue and velum. Ten hearing impaired (HI) children between the ages 4 and 7 were selected and trained for 10 hours across 4 weeks on 24 words. Intelligibility of HI children was investigated to find out their performance in speech perception and articulation. The post-training results indicated that HI children improved in articulation of speech sounds placed at different contexts. This 3D visual simulation tool helped HI children in perceiving the speech information significantly.

References

Ling, D, Speech and the hearing impaired child: Theory and Practice, Alexander Graham Bell Association for the deaf, Inc, U.S.A, 1976.

Lundy, J.E.B., Age of language skills of deaf children in relation to theory mind development, Journal of deaf studies and deaf education 7:1, 2002, pp.41-56.

Pena-Brooks, A and Hegde, M.N, Assessment and treatment of articulation and phonological disorders in children, Pro-Ed Publishers, 2000.

Rathinavelu, A et al., Computer Aided Articulation Tutor using Three dimensional Visual cues for the children with hearing loss, Journal of Computer Science (ISSN - 0973-292 6), Vol.2, No.1, 2006, pp 76-82.

Rathinavelu, A and Gowrishankar, A., e-Learning for hearing impaired, Proceedings of the Apple University Consortium Conference 2001 (ISBN 0-947209-33-6), James Cook University Townsville, Queensland Australia, Sept 23-26, 2001, pp 21.1-21.6.

Rathinavelu, A., Early language learning for elementary students with hearing impairment in India, Masters’ Thesis, School of Communications and Multimedia, Edith Cowan University, Australia, 2003

Massaro, D.W., & Light, J., Using visible speech for training perception and production of speech for hard of hearing individuals. Journal of speech, Language, and hearing research, 47(2), 2004, pp.304-320.

Thirumali, M.S., Language acquisition thought and disorder, CIIL Occasional Monographs Series - 10, Mysore, India, 1977.

Fagel, S., Merging methods of speech visualization, ZAS Papers in Linguistics 40, 2005, pp.19-32

Siciliano, C et al., Lip readability of a synthetic talking face in normal hearing and hearing impaired listeners, Dept of Phonetic and Linguistics, University College London, 2003.

Vicsi et al., A Multilingual teaching and training system for children with speech disorders, Intl. Journal of Speech Technology, 2000, Vol.3, 289-300.

Thirumalai, M.S and Gayathri, S.G., Speech of the Hearing Impaired, CIIL Occasional Monographs Series - 43, Mysore, India, 1998.

Rathinavelu, A et al., Interactive multimedia tool to help vocabulary learning of hearing impaired children by using 3D VR objects as visual cues, National Journal of Technology (ISSN-0973-1334), Vol.2, No.1, 2006, pp.25-32.

Rathinavelu, A., Hemalatha, T and Savithri., Evaluation of a computer aided 3D lip sync instructional model Using VR Objects, ICDVRAT, Sept 18-20, Denmark, 2006, pp 67-73.

Eriksson et al., Design Recommendations for a computer-based speech training system based on End-user Interviews, Centre for Speech Technology (CTT), KTH, Stockholm, Sweden, 2004.

Granstrom, Multimodal Speech Synthesis/NGSLT-Speech Technology Course, Centre for speech Technology (CTT), KTH, Stockholm, Sweden, 1999.

Engwall, O., Modeling of the vocal tract in three dimensions, Centre for speech Technology (CTT), KTH, Stockholm, Sweden, 1999.

King, S et al., Creating Speech-Synchronized Animation, IEEE Transactions on visualization and computer graphics, Vol-11, No.3, May/June 2005, pp. 341-352.

Lewis, J. Automated Lip-Sync: Background and Techniques, The Journal of Visualization and Computer Animation, 2:118-122, 1991.

Parent, R, Computer Animation Algorithms and Techniques, Morgan Kaufmann Publishers, San Francisco, 2002

Bailly, G et al , Audio Visual Speech Synthesis, International Journal of Speech Technology, Kluwer Academic Publishers, Netherlands, 2003, pp.331-346.

Rajaram, S., Tamil Phonetic Reader, CIIL, Mysore, India, 2000.

Downloads

Published

2014-08-01

How to Cite

Rathinavelu, A., & Thiagarajan, H. (2014). COMPUTER AIDED ARTICULATORY TUTOR: A SCIENTIFIC STUDY. International Journal of Computing, 6(3), 100-105. https://doi.org/10.47839/ijc.6.3.458

Issue

2007, Volume 6, Issue 3

Section

Articles

License

International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:
•    Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
•    Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
•    Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.