VALE-Emotions: Teaching mobile application for individuals with Autism Spectrum Disorders

  • Diana Olmedo-Vizueta Escuela Superior Politécnica de Chimborazo
  • Jorge Hernandez-Ambato Escuela Superior Politécnica de Chimborazo
  • Diego Ávila-Pesantez Escuela Superior Politécnica de Chimborazo
  • Eleonora Bilotta Università della Calabria
  • Pietro Pantano Università della Calabria
Keywords: Emotions Recognition, Autism, Dynamic Facial Expressions, Mobile Application.


In this paper, the development of an interactive mobile application to strengthen the learning of emotion recognition in children with Autism Spectrum Disorders (ASD) is presented. This App is part of an authoring Virtual Advanced Learning Environment (VALE) devoted to support teaching and learning activities. VALE-Emotions App is based on the six basic emotions studied by (Paul Ekman, 1992), but it is not only limited to the recognition of such emotions in their highest intensity levels. In fact, the app allows for determining the effective recognition of these emotions at different intensity levels. Such intensity levels are generated by an authoring Dynamic Facial Expressions (DFE) coding using virtual avatars. Each learning activity is carried out through training and tests applications, giving to the users the opportunity of freely developing, learning, and strengthen social skills in an entertaining way. The results of the experimentation of the VALE-Emotions on subjects with ASD are also reported. In general, the participants showed efficient response at the stimulus during the developed activities obtaining a high and fast recognition of certain emotions.


Download data is not yet available.


Bertacchini, F., Bilotta, E., Gabriele, L., Olmedo Vizueta, D. E., Pantano, P., Rosa, F., … Valenti, A. (2013). An emotional learning environment for subjects with Autism Spectrum Disorder. 2013 International Conference on Interactive Collaborative Learning (ICL), (September), 653–659.
Bilotta, E., Gabriele, L., Servidio, R., & Tavernise, A. (2010). Espressioni facciali in agenti virtuali: Il software Face3D e il riconoscimento di emozioni. In F. Perussia & G. Pravettoni (Eds.), Giornale di Psicologia (Vol. 4, pp. 139–148). Milano: PSICOTECNICA edizioni.
Chen, J., Chen, D., Wang, L., & Lemon, O. (2010). An advanced learning environment aided by recognition of multi-modal social signals. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 6483 LNCS, 41–51.
Ekman, P. (1982). Methods for measuring facial action. In C. University (Ed.), Handnook of Methods in Nonverbal Behavior Research (pp. 45–135). New York.
Ekman, P. (1984). Expression and the Nature of Emotion·. In K. Scherer & P. Ekman (Eds.), APPROACHES TO EMOTION (pp. 321–343). NJ: Lawrence Erlbaum: Hillsdale.
Ekman, P. (1992). An argument for basic emotions. Cognition & Emotion (Vol. 6). U.S.A.: Lawrence Erlbaum Associates Limited.
Ekman, P. (1999a). Basic emotions. In Handbook of Cognition and Emotion (Vol. 98, pp. 45–60).
Ekman, P. (1999b). Facial Expressions. In Handbook of Cognition and Emotion. New York: John Wiley & Sons Ltd.
Ekman, P. (2003). Sixteen Enjoyable Emotions. Emotion Researcher.
Ekman, P., & Davidson, R. (1994). All Emotions Are Basic. In THE NATURE OF EMOTION (pp. 15–19). Oxford University.
Ekman, P., & Friesen, W. V. (1976). Measuring Facial Movement. Environmental Psychology and Nonverbal Behavior, 11(1(1)), 56–75.
Ekman, P., & Friesen, W. V. (1976). Pictures of Facial Affect. Palo Alto: Consulting Psychologists Press.
Fink, E., de Rosnay, M., Wierda, M., Koot, H. M., & Begeer, S. (2014). Brief Report: Accuracy and Response Time for the Recognition of Facial Emotions in a Large Sample of Children with Autism Spectrum Disorders. Journal of Autism and Developmental Disorders, 2363–2368.
Giacomo, T. Di, Joslin, C., Garchery, S., & Magnenat-Thalmann, N. (2003). Adaptation of facial and body animation for MPEG-based architectures. In Proceedings. 2003 International Conference on Cyberworlds.
Grossman, J., Klin, A., Carter, A., & Volkmar, F. (2000). Verbal bias in recognition of facial emotions in children with Asperger syndrome. J Child Psychol Psychiatry, 41(3), 369–379.
Harms, M. B., Martin, A., & Wallace, G. L. (2010). Facial Emotion Recognition in Autism Spectrum Disorders : A Review of Behavioral and Neuroimaging Studies, (20), 290–322.
Kanner, L. (1943). Autistic disturbances of affective contact. Nervous Child (Vol. 2).
Kim, K., Rosenthal, M. Z., Gwaltney, M., Jarrold, W., Hatt, N., Mcintyre, N., … Mundy, P. (2014). A Virtual Joy-Stick Study of Emotional Responses and Social Motivation in Children with Autism Spectrum Disorder. Science + Business Media.
Moussa, M., & Kasap, Z. (2010). MPEG-4 FAP animation applied to humanoid robot head. Proceeding of Summer …, 1–11. Retrieved from
Parsons, S., Mitchell, P., & Leonard, A. (2004). The use and understanding of virtual environments by adolescents with autistic spectrum disorders. Journal of Autism and Developmental Disorders, 34(4), 449–466.
Porayska-Pomsta, K., Frauenberger, C., Pain, H., Rajendran, G., Smith, T., Menzies, R., … Lemon, O. (2012). Developing technology for autism: An interdisciplinary approach. Personal and Ubiquitous Computing, 16(2), 117–127.
Saiano, M., Pellegrino, L., Casadio, M., Summa, S., Garbarino, E., Rossi, V., … Sanguineti, V. (2015). Natural interfaces and virtual environments for the acquisition of street crossing and path following skills in adults with Autism Spectrum Disorders: a feasibility study. Journal of NeuroEngineering and Rehabilitation, 12(1), 1–13.
Serret, S., Hun, S., Iakimova, G., Lozada, J., Anastassova, M., Santos, A., … Askenazy, F. (2014). Facing the challenge of teaching emotions to individuals with low- and high-functioning autism using a new Serious game : a pilot study, 1–17.
Stewart Bartlett, M., Hager, J. C., Ekman, P., & Sejnowski, T. J. (1999). Measuring facial expressions by computer image analysis. Society for Psychophysiological Research, 36, 253–263.
Stichter, J. P., Laffey, J., Galyen, K., & Herzog, M. (2013). iSocial: Delivering the Social Competence Intervention for Adolescents (SCI-A) in a 3D Virtual Learning Environment for Youth with High Functioning Autism. Journal of Autism and Developmental Disorders, (44), 417–430.
Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517–1526.
Vesperini, S., Askenazy, F., Renaudo, N., Staccini, P., Hun, S., Legall, E., & Serret, S. (2015). Prosocial intervention in children and adolescents with autism spectrum disorder without intellectual disability: benefits of videotaping therapy sessions. Encephale, 41(1), 47–55.
How to Cite
Olmedo-Vizueta, D., Hernandez-Ambato, J., Ávila-Pesantez, D., Bilotta, E., & Pantano, P. (2017). VALE-Emotions: Teaching mobile application for individuals with Autism Spectrum Disorders. Enfoque UTE, 8(1), pp. 358 - 373.
General Engineering