Learning analytics for ambient educational games targeting children with cognitive disabilities

A. Rigaki, M. Korozi, A. Leonidis, C. Stephanidis (2019) Learning analytics for ambient educational games targeting children with cognitive disabilities he 13th annual International Technology, Education and Development Conference, INTED2019, will be held in Valencia (Spain) on the 11th, 12th and 13th of March, 2019.

Abstract

The concept of Ambient Intelligence (AmI) is already playing an important role in enriching the educational experience. Such technologies offer students increased access to information within an augmented teaching environment, which encourages active learning and collaboration, enhancing their motivation to learn. Research work in this domain includes the learner-centered design and implementation of infrastructure technologies, prototypes of intelligent systems and applications, smart artifacts for learning and serious games. “Home game” is an innovative augmented table-top educational game that combines tangible interaction with a virtual environment, falling under the category of serious games. The system is structured into a set of mini-games (such as ‘Locate the room’ and ‘Find the wrong object’), which can be personalized for each player in terms of content and interaction paradigm, either automatically based on their profile settings or manually by the educators. Home Game is deployed in the Rehabilitation Centre for Children with Disabilities in Heraklion, Crete, Greece. The full paper will contain a detailed presentation of the User Interface and the learning analytics data that are displayed in each student’s personal dashboards, so as to facilitate educators in adjusting the learning process according the needs of each student. Furthermore, the results of an expert-based evaluation of the tool will be reported.

Vesti-AmI: The Intelligent Wardrobe

Plexousaki, A., Korozi, M., Leonidis, A., Kouroumalis, V., Stamatakis, E., Stivaktakis, N., Evdaimon, T., Katzourakis, A., & Stephanidis, C. (2019) Vesti-AmI: The Intelligent Wardrobe The Intelligent Wardrobe. 12th FORTH Retreat, ICE-HT, Patras, Greece, 15-16 October.

Abstract

The selection of clothes and accessories is part of the daily routine of individuals [1]; however, it is not a straightforward process for people with large inventories or limited time, while it is a challenging task for user with disabilities. In the recent past, the Internet-of-Things (IoT) and Ambient Intelligence (AmI) have been enhancing the domestic environment with new connected devices, appliances, and smart furniture, aspiring to assist independent living [2]. Building upon these developments, this work proposes Vesti-AmI; an intelligent wardrobe which, in cooperation with the existing technological infrastructure of the Intelligent Home, aims to assist people in getting ready for their various activities in a context-sensitive, user-friendly and intelligent manner. With respect to the target audience, the facilities of Vesti-AmI are foreseen to accommodate a wide variety of users, including adults, children, elderly people, and people with disabilities. Indicatively, Vesti-AmI permits end-users to: (i) browse clothing items manually or digitally, (ii) preview their choices on a Smart Mirror, (iii) retrieve and store clothing items (semi-)automatically, (iv) get outfit recommendations based on contextual information, and (v) keep their garments odor-, mold-, moisture-, and moth-free with the help of appropriate sensors and actuators that monitor the interior of the wardrobe. Vesti-AmI features a full-height hanging space appropriate for storing clothing like shirts or skirts, but also longer garments such as dresses. An electrically-powered closet rod automatically raises and lowers the clothes so as to bring them closer to the user, while a sophisticated mechanism permits the system to identify each hanging item and present it to the user upon request. The next two compartments contain shelves and drawers in order to provide organized storage solutions for folded clothes and accessories, and a custom-made in-closet steamer that permits users to freshen up their clothes. Sophisticated mechanisms permit the shelves and drawers to move in a vertical fashion (like a carousel), making the stored items easily accessible. Additionally, cameras hidden on the top of each drawer and shelf permit Vesti-AmI to be aware of their contents, while light and sound cues in combination with vibration feedback are employed to assist users (especially blind or visually challenged individuals) to locate the required items inside the wardrobe. In order to maximize time efficiency, an embedded "Smart Mirror" allows users to virtually try their clothes on in an immersive way. Vesti-AmI promotes multimodal interaction that includes touch interaction, air gestures and voice interaction, which can be used complementary to support all users (including those with disabilities). For example, voice interaction can be used by blind or visually challenged users to ask for certain items, while motion-based interaction and gestures can enable users to naturally select the outfit they wish to try on the “Smart Mirror”.

Home Game: an Educational Game for Children with Cognitive Impairments

Leonidis A., Arampatzis D., Korozi M., Adami I., Ntoa S., Stephanidis C. (2017) Home Game: an Educational Game for Children with Cognitive Impairments In the Proceeding of the 2017 conference on interaction design and children, June 27-30, 2017, Stanford, CA, USA. ACM

Abstract

This paper describes an educational game that aims to familiarize cognitive impaired children with household objects, the overall home environment and the daily activities that take place in it. In addition to touch-based interaction, the game supports physical manipulation through printed cards on a tabletop setup, using a webcam to detect and track the cards placed on the game board.

Analysis and Design of Three Multimodal Interactive Systems to Support the Everyday Needs of Children with Cognitive Impairments

Ntoa, S., Leonidis, A., Korozi, M., Papadaki, E., Margetis, G., Antona, M., & Stephanidis, C. (2015) Analysis and Design of Three Multimodal Interactive Systems to Support the Everyday Needs of Children with Cognitive Impairments In M. Antona & C. Stephanidis (Eds.), Universal Access in Human-Computer Interaction. Access to Learning, Health and Well-Being – Volume 9 of the combined Proceedings of the 17th International Conference on Human-Computer Interaction (HCI International 2015), Los Angeles, CA, USA, 2-7 August, pp. 637-648. Berlin Heidelberg: Lecture Notes in Computer Science Series of Springer

Abstract

The autonomy and independence of users with cognitive impairments can be fostered through cognitive technologies. The use of traditional computer interfaces has however proved to be difficult for these users. This paper proposes three innovative systems to train children with cognitive impairments in three fundamental everyday life activities: (a) familiarizing with the home environments, its objects and activities; (b) learning about money and practicing shopping skills; and (c) learning how to prepare and cook simple meals. All three systems feature multimodal interaction and support multimedia output.