Mobile Application for Behavioral and Social Skills Learning for Autism Children using Facial Expression Recognition
DOI:
https://doi.org/10.61841/8g926n60Keywords:
Autism Spectrum Disorders, Behavioral Learning, Social Skills, Facial Expression Recognition, Mobile ApplicationAbstract
Autism Spectrum Disorder is a neurodevelopment disease which is prevalent recently. This study addressed the possible factors that cause ASD, as well as the treatment for the disorders. However, with the implementation of current technology, this study aims to propose a mobile application as a solution that helps autism children for behavioral and social skills learning by using facial expression recognition, which can provide brief understanding of basic facial expression and emotion to children with ASD and slowly develop their social skills. Overall, the proposed mobile application is able to detect facial expression and emotion using live feed from camera of the mobile device. Besides, there is also simulation of certain environment to represent the daily life interaction with people which could aid in developing social communication skills.
Downloads
References
[1] S. M. Myers, C. P. Johnson and Council on Children With Disabilities, "Management of Children With Autism
Spectrum Disorders," American Academy of Pediatrics, vol. 120, no. 5, 2007.
[2] C. Lord, E. H. Cook, B. L. Leventhal and D. G. Amaral, "Autism Spectrum Disorders," Neuron, Cell Press,
vol. 28, no. 2, pp. 355-363, 2000.
[3] NAMI, National Alliance on Mental Illness, "Autism," 2019. [Online]. Available:
https://www.nami.org/Learn-More/Mental-Health-Conditions/Autism/Overview. [Accessed 21 April 2019].
[4] Florida State University, "What is Autism Spectrum Disorder?," 2015. [Online]. Available:
https://militaryfamilieslearningnetwork.org/wp-content/uploads/2019/04/What_is_ASD.pdf. [Accessed 21
April 2019].
[5] L. E. Shapiro, 101 Ways To Teach Children Social Skills, United States of America: Bureau for at Risk Youth,
2004.
[6] W. W. Hartup, "Social relationships and their developmental," American Psychologist, vol. 44, no. 2, pp. 120-
126, 1989.
[7] P. A. Rao, D. C. Beidel and M. J. Murray, "Social Skills Interventions for Children with Asperger’s
Syndrome," Journal of Autism and Developmental Disorders, vol. 38, no. 2, pp. 353-361, 2008.
[8] M. Pantic, L. Rothkrantz and H. Koppelaar, "Automation of Non-Verbal Communication of Facial
Expressions," 1998.
[9] Revina and W. S. Emmanuel, "A Survey on Human Face Expression Recognition Techniques," Journal of
King Saud University - Computer and Information Sciences, 2018.
[10] R. Preiserowicz, "What are the Possible Causes for Autism Spectrum Disorder?," The Science Journal of the
Lander College of Arts and Sciences, vol. 9, no. 1, 2015.
[11] H. V. Ratajczak, "Theoretical aspects of autism: Causes—A review," Journal of Immunotoxicology, vol. 8, no.
1, pp. 68-79, 2011.
[12] Joshi, M. Percy and I. Brown, "Advances in Understanding Causes of Autism and Effective Interventions,"
Journal on Developmental Disabilities, vol. 9, no. 2, pp. 1-27, 2003.
[13] P. Karimi, E. Kamali, S. M. Mousavi and M. Karahmadi, "Environmental factors influencing the risk of
autism," Journal of Research in Medical Sciences, vol. 22, no. 1, p. 27, 2017.
[14] S. Bhat, U. R. Acharya, H. Adeli, G. M. Bairy and A. Adeli, "Autism: cause factors, early diagnosis and
therapies," Reviews in the neurosciences, vol. 25, no. 6, pp. 841-850, 2014.
[15] D. G. Amaral, "Examining the Causes of Autism," Cerebrum : the Dana Forum on Brain Science, vol. 1, 2017.
[16] H. Matsuzaki, K. Iwata, T. Manabe and N. Mori, "Triggers for Autism: Genetic and environmental Factors,"
Journal of Central Nervous System Disease, vol. 4, pp. 27-36, 2012.
[17] V. A. Weill, S. Zavodny and M. C. Souders, "Autism Spectrum Disorder in Primary Care," The Nurse
Practitioner , vol. 43, no. 2, 2018.
[18] H. Brentani, C. S. de Paula, D. Bordini, D. Rolim, F. Sato, J. Portolese, M. C. Pacifico and J. T. McCracken,
"Autism spectrum disorders: an overview on diagnosis and treatment," Revista Brasileira de Psiquiatria, vol.
35, pp. S62-S72, 2013.
[19] S. Boucenna, A. Narzisi, E. Tilmont, F. Muratori, G. Pioggia, D. Cohen and M. Chetouani, "Interactive
Technologies for Autistic Children: A Review," Cognitive Computation, vol. 6, no. 2, 2014.
[20] J. A. Vlachou and A. S. Drigas, "Mobile Technology for Students & Adults with Autistic Spectrum Disorders
(ASD)," International Journal of Interactive Mobile Technologies (iJIM), vol. 11, no. 1, 2017.
[21] N. Didehbani, T. Allen, M. Kandalaft, D. Krawczyk and S. Chapman, "Virtual Reality Social Cognition
Training for children with high functioning autism," Computers in Human Behavior, vol. 62, pp. 703-711,
2016.
[22] Sefik Ilkin Serengil, "Real Time Facial Expression Recognition on Streaming Data," 10 January 2018. [Online].
Available: https://sefiks.com/2018/01/10/real-time-facial-expression-recognition-on-streaming-data/.
[Accessed 29 April 2019].
[23] P. Mary Jeyanthi, Santosh Shrivastava Kumar “The Determinant Parameters of Knowledge Transfer among
Academicians in Colleges of Chennai Region”, Theoretical Economics Letters, 2019, 9, 752-760.
[24] P. Mary Jeyanthi, “An Empirical Study of Fraudulent and Bankruptcy in Indian Banking Sectors”, The
Empirical Economics Letters, Vol.18; No. 3, March 2019, ISSN: 1681-8997, which is in C category of ABDC
[25] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Hybrid Metaheuristic techniques”, International
Journal of Business Intelligence Research, - Volume 5, Issue 1, April-2014.
[26] P. Mary Jeyanthi, “INDUSTRY 4.O: The combination of the Internet of Things (IoT)and the Internet of People
(IoP)”, Journal of Contemporary Research in Management, Vol.13; No. 4 Oct-Dec, 2018, ISSN: 0973-9785.
[27] P. Mary Jeyanthi, "The transformation of Social media information systems leads to Global business: An
Empirical Survey", International Journal of Technology and Science (IJTS), issue 3, volume 5, ISSN Online:
2350-1111 (Online).
[28] P. Mary Jeyanthi,” An Empirical Study of Fraud Control Techniques using Business Intelligence in Financial
Institutions”, Vivekananda Journal of Research Vol. 7, Special Issue 1, May 2018,
[29] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Artificial bear
Optimization Approach”, International Journal of Scientific & Engineering Research, Volume 4,
Issue 8, August-2013.
[30] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Optimization techniques for Decision
Making”, International Journal of Engineering Research and Technology, Volume 2, Issue 8, August-2013.
[31] Mary Jeyanthi, S and Karnan, M.: “A New Implementation of Mathematical Models with metaheuristic
Algorithms for Business Intelligence”, International Journal of Advanced Research in Computer and
Communication Engineering, Volume 3, Issue 3, March-2014.
[32] Dr. Mary Jeyanthi: “Partial Image Retrieval Systems in Luminance and Color Invariants: An Empirical Study”,
International Journal of Web Technology (ISSN: 2278-2389) – Volume-4, Issue-2.
[33] Dr. Mary Jeyanthi: “CipherText Policy attribute-based Encryption for Patients Health Information in Cloud
Platform”, Journal of Information Science and Engineering (ISSN: 1016-2364)
[34] Mary Jeyanthi, P, Adarsh Sharma, Purva Verma: “Sustainability of the business and employment generation in
the field of UPVC widows” (ICSMS2019).
[35] Mary Jeyanthi, P: “An Empirical Survey of Sustainability in Social Media and Information Systems across
emerging countries”, International Conference on Sustainability Management and Strategy” (ICSMS2018).
[36] Mary Jeyanthi, P: “Agile Analytics in Business Decision Making: An Empirical Study”, International
Conference on Business Management and Information Systems” (ICBMIS2015).
[37] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence – soft computing Techniques”, International
Conference on Mathematics in Engineering & Business Management (ICMEB 2012).
[38] Mary Jeyanthi, S and Karnan, M.: “A Comparative Study of Genetic algorithm and Artificial Bear
Optimization algorithm in Business Intelligence”, International Conference on Mathematics in Engineering &
Business Management (ICMEB 2012).
[39] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Data Mining and Optimization for Decision
Making ”, 2011 IEEE International Conference on Computational Intelligence and Computing Research
(2011 IEEE ICCIC).
[40] Mary Jeyanthi, S and Karnan, M.: “Business Intelligence: Data Mining and Decision making to overcome the
Financial Risk”, 2011 IEEE International Conference on Computational Intelligence and Computing Research
(2011 IEEE ICCIC).
[41] Dr. Mary Jeyanthi, S: “Pervasive Computing in Business Intelligence”, State level seminar on Computing and
Communication Technologies. (SCCT-2015)
[42] Dr.P.Mary Jeyanthi, “Artificial Bear Optimization (ABO) – A new approach of Metaheuristic algorithm for
Business Intelligence”, ISBN no: 978-93-87862-65-4, Bonfring Publication. Issue Date: 01-Apr-2019
[43] Dr.P.Mary Jeyanthi , “Customer Value Management (CVM) – Thinking Inside the box” – ISBN : 978-93-
87862-94-4, Bonfring Publication, Issue Date: 16-Oct-2019.
[44] Jeyanthi, P. M., & Shrivastava, S. K. (2019). The Determinant Parameters of Knowledge Transfer among
Academicians in Colleges of Chennai Region. Theoretical Economics Letters, 9(4), 752-760.
Downloads
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.