VALE-Emotions: Teaching mobile application for individuals with Autism Spectrum Disorders

Authors

  • Diana Olmedo-Vizueta Escuela Superior Politécnica de Chimborazo
  • Jorge Hernandez-Ambato Escuela Superior Politécnica de Chimborazo
  • Diego Ávila-Pesantez Escuela Superior Politécnica de Chimborazo
  • Eleonora Bilotta Università della Calabria
  • Pietro Pantano Università della Calabria

DOI:

https://doi.org/10.29019/enfoqueute.v8n1.145

Keywords:

Emotions Recognition, Autism, Dynamic Facial Expressions, Mobile Application.

Abstract

In this paper, the development of an interactive mobile application to strengthen the learning of emotion recognition in children with Autism Spectrum Disorders (ASD) is presented. This App is part of an authoring Virtual Advanced Learning Environment (VALE) devoted to support teaching and learning activities. VALE-Emotions App is based on the six basic emotions studied by (Paul Ekman, 1992), but it is not only limited to the recognition of such emotions in their highest intensity levels. In fact, the app allows for determining the effective recognition of these emotions at different intensity levels. Such intensity levels are generated by an authoring Dynamic Facial Expressions (DFE) coding using virtual avatars. Each learning activity is carried out through training and tests applications, giving to the users the opportunity of freely developing, learning, and strengthen social skills in an entertaining way. The results of the experimentation of the VALE-Emotions on subjects with ASD are also reported. In general, the participants showed efficient response at the stimulus during the developed activities obtaining a high and fast recognition of certain emotions.

Downloads

Download data is not yet available.

References

Bertacchini, F., Bilotta, E., Gabriele, L., Olmedo Vizueta, D. E., Pantano, P., Rosa, F., … Valenti, A. (2013). An emotional learning environment for subjects with Autism Spectrum Disorder. 2013 International Conference on Interactive Collaborative Learning (ICL), (September), 653–659. https://doi.org/10.1109/ICL.2013.6644675
Bilotta, E., Gabriele, L., Servidio, R., & Tavernise, A. (2010). Espressioni facciali in agenti virtuali: Il software Face3D e il riconoscimento di emozioni. In F. Perussia & G. Pravettoni (Eds.), Giornale di Psicologia (Vol. 4, pp. 139–148). Milano: PSICOTECNICA edizioni.
Chen, J., Chen, D., Wang, L., & Lemon, O. (2010). An advanced learning environment aided by recognition of multi-modal social signals. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6483 LNCS, 41–51. https://doi.org/10.1007/978-3-642-17407-0_5
Ekman, P. (1982). Methods for measuring facial action. In C. University (Ed.), Handnook of Methods in Nonverbal Behavior Research (pp. 45–135). New York.
Ekman, P. (1984). Expression and the Nature of Emotion·. In K. Scherer & P. Ekman (Eds.), APPROACHES TO EMOTION (pp. 321–343). NJ: Lawrence Erlbaum: Hillsdale.
Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion (Vol. 6). U.S.A.: Lawrence Erlbaum Associates Limited. https://doi.org/10.1080/02699939208411068
Ekman, P. (1999a). Basic emotions. In Handbook of Cognition and Emotion (Vol. 98, pp. 45–60). https://doi.org/10.1002/0470013494.ch3
Ekman, P. (1999b). Facial Expressions. In Handbook of Cognition and Emotion. New York: John Wiley & Sons Ltd.
Ekman, P. (2003). Sixteen Enjoyable Emotions. Emotion Researcher.
Ekman, P., & Davidson, R. (1994). All Emotions Are Basic. In THE NATURE OF EMOTION (pp. 15–19). Oxford University.
Ekman, P., & Friesen, W. V. (1976). Measuring Facial Movement. Environmental Psychology and Nonverbal Behavior, 11(1(1)), 56–75.
Ekman, P., & Friesen, W. V. (1976). Pictures of Facial Affect. Palo Alto: Consulting Psychologists Press.
Fink, E., de Rosnay, M., Wierda, M., Koot, H. M., & Begeer, S. (2014). Brief Report: Accuracy and Response Time for the Recognition of Facial Emotions in a Large Sample of Children with Autism Spectrum Disorders. Journal of Autism and Developmental Disorders, 2363–2368. https://doi.org/10.1007/s10803-014-2084-z
Giacomo, T. Di, Joslin, C., Garchery, S., & Magnenat-Thalmann, N. (2003). Adaptation of facial and body animation for MPEG-based architectures. In Proceedings. 2003 International Conference on Cyberworlds. https://doi.org/10.1109/CYBER.2003.1253458
Grossman, J., Klin, A., Carter, A., & Volkmar, F. (2000). Verbal bias in recognition of facial emotions in children with Asperger syndrome. J Child Psychol Psychiatry, 41(3), 369–379.
Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial Emotion Recognition in Autism Spectrum Disorders : A Review of Behavioral and Neuroimaging Studies, (20), 290–322. https://doi.org/10.1007/s11065-010-9138-6
Kanner, L. (1943). Autistic disturbances of affective contact. Nervous Child (Vol. 2). https://doi.org/10.1105/tpc.11.5.949
Kim, K., Rosenthal, M. Z., Gwaltney, M., Jarrold, W., Hatt, N., Mcintyre, N., … Mundy, P. (2014). A Virtual Joy-Stick Study of Emotional Responses and Social Motivation in Children with Autism Spectrum Disorder. Science + Business Media. https://doi.org/10.1007/s10803-014-2036-7
Moussa, M., & Kasap, Z. (2010). MPEG-4 FAP animation applied to humanoid robot head. Proceeding of Summer …, 1–11. Retrieved from http://www.miralab.ch/repository/papers/574.pdf
Parsons, S., Mitchell, P., & Leonard, A. (2004). The use and understanding of virtual environments by adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 34(4), 449–466. https://doi.org/10.1023/B:JADD.0000037421.98517.8d
Porayska-Pomsta, K., Frauenberger, C., Pain, H., Rajendran, G., Smith, T., Menzies, R., … Lemon, O. (2012). Developing technology for autism: An interdisciplinary approach. Personal and Ubiquitous Computing, 16(2), 117–127. https://doi.org/10.1007/s00779-011-0384-2
Saiano, M., Pellegrino, L., Casadio, M., Summa, S., Garbarino, E., Rossi, V., … Sanguineti, V. (2015). Natural interfaces and virtual environments for the acquisition of street crossing and path following skills in adults with Autism Spectrum Disorders: a feasibility study. Journal of NeuroEngineering and Rehabilitation, 12(1), 1–13. https://doi.org/10.1186/s12984-015-0010-z
Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., … Askenazy, F. (2014). Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new Serious game : a pilot study, 1–17.
Stewart Bartlett, M., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999). Measuring facial expressions by computer image analysis. Society for Psychophysiological Research, 36, 253–263.
Stichter, J. P., Laffey, J., Galyen, K., & Herzog, M. (2013). iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth with High Functioning Autism. Journal of Autism and Developmental Disorders, (44), 417–430. https://doi.org/10.1007/s10803-013-1881-0
Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526. https://doi.org/10.1007/s10803-012-1695-5
Vesperini, S., Askenazy, F., Renaudo, N., Staccini, P., Hun, S., Legall, E., & Serret, S. (2015). Prosocial intervention in children and adolescents with autism spectrum disorder without intellectual disability: benefits of videotaping therapy sessions. Encephale, 41(1), 47–55.

Downloads

Published

2017-02-24

How to Cite

Olmedo-Vizueta, D., Hernandez-Ambato, J., Ávila-Pesantez, D., Bilotta, E., & Pantano, P. (2017). VALE-Emotions: Teaching mobile application for individuals with Autism Spectrum Disorders. Enfoque UTE, 8(1), pp. 358 – 373. https://doi.org/10.29019/enfoqueute.v8n1.145

Issue

Vol. 8 No. 1 (2017): INCISCOS 2016, Special Edition

Section

Miscellaneous

License

The articles and research published by the UTE University are carried out under the Open Access regime in electronic format.  This means that all content is freely available without charge to the user or his/her institution. Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author. This is in accordance with the BOAI definition of open access. By submitting an article to any of the scientific journals of the UTE University, the author or authors accept these conditions.

The UTE applies the Creative Commons Attribution (CC-BY) license to articles in its scientific journals. Under this open access license, as an author you agree that anyone may reuse your article in whole or in part for any purpose, free of charge, including commercial purposes. Anyone can copy, distribute or reuse the content as long as the author and original source are correctly cited. This facilitates freedom of reuse and also ensures that content can be extracted without barriers for research needs.

 

This work is licensed under a Creative Commons Attribution 3.0 International (CC BY 3.0).

 

The Enfoque UTE journal guarantees and declares that authors always retain all copyrights and full publishing rights without restrictions [© The Author(s)]. Acknowledgment (BY): Any exploitation of the work is allowed, including a commercial purpose, as well as the creation of derivative works, the distribution of which is also allowed without any restriction.