Mobile Application for Behavioral and Social Skills Learning for Autism Children using Facial Expression Recognition

Authors

  • Gan Hao Zhan Asia Pacific University of Technology & Innovation (APU), Technology Park Malaysia, Bukit Jalil, Kuala Lumpur, Malaysia Author
  • Chandra Reka Ramachandiran Asia Pacific University of Technology & Innovation (APU), Technology Park Malaysia, Bukit Jalil, Kuala Lumpur, Malaysia Author

DOI:

https://doi.org/10.61841/8g926n60

Keywords:

Autism Spectrum Disorders, Behavioral Learning, Social Skills, Facial Expression Recognition, Mobile Application

Abstract

 Autism Spectrum Disorder is a neurodevelopment disease which is prevalent recently. This study addressed the possible factors that cause ASD, as well as the treatment for the disorders. However, with the implementation of current technology, this study aims to propose a mobile application as a solution that helps autism children for behavioral and social skills learning by using facial expression recognition, which can provide brief understanding of basic facial expression and emotion to children with ASD and slowly develop their social skills. Overall, the proposed mobile application is able to detect facial expression and emotion using live feed from camera of the mobile device. Besides, there is also simulation of certain environment to represent the daily life interaction with people which could aid in developing social communication skills. 

Downloads

Download data is not yet available.

References

[1] S. M. Myers, C. P. Johnson and Council on Children With Disabilities, "Management of Children With Autism

Spectrum Disorders," American Academy of Pediatrics, vol. 120, no. 5, 2007.

[2] C. Lord, E. H. Cook, B. L. Leventhal and D. G. Amaral, "Autism Spectrum Disorders," Neuron, Cell Press,

vol. 28, no. 2, pp. 355-363, 2000.

[3] NAMI, National Alliance on Mental Illness, "Autism," 2019. [Online]. Available:

https://www.nami.org/Learn-More/Mental-Health-Conditions/Autism/Overview. [Accessed 21 April 2019].

[4] Florida State University, "What is Autism Spectrum Disorder?," 2015. [Online]. Available:

https://militaryfamilieslearningnetwork.org/wp-content/uploads/2019/04/What_is_ASD.pdf. [Accessed 21

April 2019].

[5] L. E. Shapiro, 101 Ways To Teach Children Social Skills, United States of America: Bureau for at Risk Youth,

2004.

[6] W. W. Hartup, "Social relationships and their developmental," American Psychologist, vol. 44, no. 2, pp. 120-

126, 1989.

[7] P. A. Rao, D. C. Beidel and M. J. Murray, "Social Skills Interventions for Children with Asperger’s

Syndrome," Journal of Autism and Developmental Disorders, vol. 38, no. 2, pp. 353-361, 2008.

[8] M. Pantic, L. Rothkrantz and H. Koppelaar, "Automation of Non-Verbal Communication of Facial

Expressions," 1998.

[9] Revina and W. S. Emmanuel, "A Survey on Human Face Expression Recognition Techniques," Journal of

King Saud University - Computer and Information Sciences, 2018.

[10] R. Preiserowicz, "What are the Possible Causes for Autism Spectrum Disorder?," The Science Journal of the

Lander College of Arts and Sciences, vol. 9, no. 1, 2015.

[11] H. V. Ratajczak, "Theoretical aspects of autism: Causes—A review," Journal of Immunotoxicology, vol. 8, no.

1, pp. 68-79, 2011.

[12] Joshi, M. Percy and I. Brown, "Advances in Understanding Causes of Autism and Effective Interventions,"

Journal on Developmental Disabilities, vol. 9, no. 2, pp. 1-27, 2003.

[13] P. Karimi, E. Kamali, S. M. Mousavi and M. Karahmadi, "Environmental factors influencing the risk of

autism," Journal of Research in Medical Sciences, vol. 22, no. 1, p. 27, 2017.

[14] S. Bhat, U. R. Acharya, H. Adeli, G. M. Bairy and A. Adeli, "Autism: cause factors, early diagnosis and

therapies," Reviews in the neurosciences, vol. 25, no. 6, pp. 841-850, 2014.

[15] D. G. Amaral, "Examining the Causes of Autism," Cerebrum : the Dana Forum on Brain Science, vol. 1, 2017.

[16] H. Matsuzaki, K. Iwata, T. Manabe and N. Mori, "Triggers for Autism: Genetic and environmental Factors,"

Journal of Central Nervous System Disease, vol. 4, pp. 27-36, 2012.

[17] V. A. Weill, S. Zavodny and M. C. Souders, "Autism Spectrum Disorder in Primary Care," The Nurse

Practitioner , vol. 43, no. 2, 2018.

[18] H. Brentani, C. S. de Paula, D. Bordini, D. Rolim, F. Sato, J. Portolese, M. C. Pacifico and J. T. McCracken,

"Autism spectrum disorders: an overview on diagnosis and treatment," Revista Brasileira de Psiquiatria, vol.

35, pp. S62-S72, 2013.

[19] S. Boucenna, A. Narzisi, E. Tilmont, F. Muratori, G. Pioggia, D. Cohen and M. Chetouani, "Interactive

Technologies for Autistic Children: A Review," Cognitive Computation, vol. 6, no. 2, 2014.

[20] J. A. Vlachou and A. S. Drigas, "Mobile Technology for Students & Adults with Autistic Spectrum Disorders

(ASD)," International Journal of Interactive Mobile Technologies (iJIM), vol. 11, no. 1, 2017.

[21] N. Didehbani, T. Allen, M. Kandalaft, D. Krawczyk and S. Chapman, "Virtual Reality Social Cognition

Training for children with high functioning autism," Computers in Human Behavior, vol. 62, pp. 703-711,

2016.

[22] Sefik Ilkin Serengil, "Real Time Facial Expression Recognition on Streaming Data," 10 January 2018. [Online].

Available: https://sefiks.com/2018/01/10/real-time-facial-expression-recognition-on-streaming-data/.

[Accessed 29 April 2019].

[23] P. Mary Jeyanthi, Santosh Shrivastava Kumar “The Determinant Parameters of Knowledge Transfer among

Academicians in Colleges of Chennai Region”, Theoretical Economics Letters, 2019, 9, 752-760.

[24] P. Mary Jeyanthi, “An Empirical Study of Fraudulent and Bankruptcy in Indian Banking Sectors”, The

Empirical Economics Letters, Vol.18; No. 3, March 2019, ISSN: 1681-8997, which is in C category of ABDC

[25] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Hybrid Metaheuristic techniques”, International

Journal of Business Intelligence Research, - Volume 5, Issue 1, April-2014.

[26] P. Mary Jeyanthi, “INDUSTRY 4.O: The combination of the Internet of Things (IoT)and the Internet of People

(IoP)”, Journal of Contemporary Research in Management, Vol.13; No. 4 Oct-Dec, 2018, ISSN: 0973-9785.

[27] P. Mary Jeyanthi, "The transformation of Social media information systems leads to Global business: An

Empirical Survey", International Journal of Technology and Science (IJTS), issue 3, volume 5, ISSN Online:

2350-1111 (Online).

[28] P. Mary Jeyanthi,” An Empirical Study of Fraud Control Techniques using Business Intelligence in Financial

Institutions”, Vivekananda Journal of Research Vol. 7, Special Issue 1, May 2018,

[29] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Artificial bear

Optimization Approach”, International Journal of Scientific & Engineering Research, Volume 4,

Issue 8, August-2013.

[30] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Optimization techniques for Decision

Making”, International Journal of Engineering Research and Technology, Volume 2, Issue 8, August-2013.

[31] Mary Jeyanthi, S and Karnan, M.: “A New Implementation of Mathematical Models with metaheuristic

Algorithms for Business Intelligence”, International Journal of Advanced Research in Computer and

Communication Engineering, Volume 3, Issue 3, March-2014.

[32] Dr. Mary Jeyanthi: “Partial Image Retrieval Systems in Luminance and Color Invariants: An Empirical Study”,

International Journal of Web Technology (ISSN: 2278-2389) – Volume-4, Issue-2.

[33] Dr. Mary Jeyanthi: “CipherText Policy attribute-based Encryption for Patients Health Information in Cloud

Platform”, Journal of Information Science and Engineering (ISSN: 1016-2364)

[34] Mary Jeyanthi, P, Adarsh Sharma, Purva Verma: “Sustainability of the business and employment generation in

the field of UPVC widows” (ICSMS2019).

[35] Mary Jeyanthi, P: “An Empirical Survey of Sustainability in Social Media and Information Systems across

emerging countries”, International Conference on Sustainability Management and Strategy” (ICSMS2018).

[36] Mary Jeyanthi, P: “Agile Analytics in Business Decision Making: An Empirical Study”, International

Conference on Business Management and Information Systems” (ICBMIS2015).

[37] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence – soft computing Techniques”, International

Conference on Mathematics in Engineering & Business Management (ICMEB 2012).

[38] Mary Jeyanthi, S and Karnan, M.: “A Comparative Study of Genetic algorithm and Artificial Bear

Optimization algorithm in Business Intelligence”, International Conference on Mathematics in Engineering &

Business Management (ICMEB 2012).

[39] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Data Mining and Optimization for Decision

Making ”, 2011 IEEE International Conference on Computational Intelligence and Computing Research

(2011 IEEE ICCIC).

[40] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Data Mining and Decision making to overcome the

Financial Risk”, 2011 IEEE International Conference on Computational Intelligence and Computing Research

(2011 IEEE ICCIC).

[41] Dr. Mary Jeyanthi, S: “Pervasive Computing in Business Intelligence”, State level seminar on Computing and

Communication Technologies. (SCCT-2015)

[42] Dr.P.Mary Jeyanthi, “Artificial Bear Optimization (ABO) – A new approach of Metaheuristic algorithm for

Business Intelligence”, ISBN no: 978-93-87862-65-4, Bonfring Publication. Issue Date: 01-Apr-2019

[43] Dr.P.Mary Jeyanthi , “Customer Value Management (CVM) – Thinking Inside the box” – ISBN : 978-93-

87862-94-4, Bonfring Publication, Issue Date: 16-Oct-2019.

[44] Jeyanthi, P. M., & Shrivastava, S. K. (2019). The Determinant Parameters of Knowledge Transfer among

Academicians in Colleges of Chennai Region. Theoretical Economics Letters, 9(4), 752-760.

Downloads

Published

31.10.2019

How to Cite

Hao Zhan, G., & Ramachandiran, C. R. (2019). Mobile Application for Behavioral and Social Skills Learning for Autism Children using Facial Expression Recognition. International Journal of Psychosocial Rehabilitation, 23(4), 1273-1281. https://doi.org/10.61841/8g926n60