الفهرس 
CHAPTER 1 INTRODUCTIONOnly 14 pages are availabe for public view
 |  | from | 91 |  |  |
| | | from | 91 | | |
Abstract
Special needs children autism spectrum disorder (ASD) and down syndrome (DS) children face numerous challenges in their education. Indeed, conventional education and assessment methods hardly attract their attention. Thus, they require a long time to learn and adjust by having a more attractive method.
In this thesis, we will assist children with disabilities in three consecutive stages.
The first one was by providing a non-traditional augmented reality (AR) environment for education, increasing language skills. The second stage was implementing an innovative assessment method using serious games (SG), the last stag, which relies on serious game evaluation through facial emotions recognition (FER).
An efficient and low-cost AR educational environment was introduced to children with special needs. This environment utilizes augmented reality and educational cards to teach the children comprehensive reading through cards, 3D model, and the manner of their pronunciation.
After the completion of all learning sessions, SG assessment was introduced. Moreover, the main purpose of this serious game is to assess comprehensive reading and understand the impact of AR as a learning methodology. As this assessment game was designed according to systemic gamification principles and contains the elements of the game formula. Most of research depends on user experience questionnaire (UEQ) to evaluate SG. FER technique will be introduced instead of traditional methodology in SG evaluation.
Using FER was a great methodology to get to the children’s emotions during their interactions with serious games. CNN model accuracy was 96.5%, 91.8%, and 84% for FER2013 plus, FER2013, and collected ASD datasets, respectively. The results of using FER to monitor children’s emotions were satisfactory to specialists and there was relation between the recorded emotion and children’s score in the serious game.
Keywords: - Augmented Reality, ASD, Down Syndrome, Education, Gamification, Serious Game, Convolutions Neural Network, Facial Emotion Recognition.