Learning analytics for ambient educational games targeting children with cognitive disabilities

A. Rigaki, M. Korozi, A. Leonidis, C. Stephanidis (2019) Learning analytics for ambient educational games targeting children with cognitive disabilities he 13th annual International Technology, Education and Development Conference, INTED2019, will be held in Valencia (Spain) on the 11th, 12th and 13th of March, 2019.

Abstract

The concept of Ambient Intelligence (AmI) is already playing an important role in enriching the educational experience. Such technologies offer students increased access to information within an augmented teaching environment, which encourages active learning and collaboration, enhancing their motivation to learn. Research work in this domain includes the learner-centered design and implementation of infrastructure technologies, prototypes of intelligent systems and applications, smart artifacts for learning and serious games. “Home game” is an innovative augmented table-top educational game that combines tangible interaction with a virtual environment, falling under the category of serious games. The system is structured into a set of mini-games (such as ‘Locate the room’ and ‘Find the wrong object’), which can be personalized for each player in terms of content and interaction paradigm, either automatically based on their profile settings or manually by the educators. Home Game is deployed in the Rehabilitation Centre for Children with Disabilities in Heraklion, Crete, Greece. The full paper will contain a detailed presentation of the User Interface and the learning analytics data that are displayed in each student’s personal dashboards, so as to facilitate educators in adjusting the learning process according the needs of each student. Furthermore, the results of an expert-based evaluation of the tool will be reported.

Vesti-AmI: The Intelligent Wardrobe

Plexousaki, A., Korozi, M., Leonidis, A., Kouroumalis, V., Stamatakis, E., Stivaktakis, N., Evdaimon, T., Katzourakis, A., & Stephanidis, C. (2019) Vesti-AmI: The Intelligent Wardrobe The Intelligent Wardrobe. 12th FORTH Retreat, ICE-HT, Patras, Greece, 15-16 October.

Abstract

The selection of clothes and accessories is part of the daily routine of individuals [1]; however, it is not a straightforward process for people with large inventories or limited time, while it is a challenging task for user with disabilities. In the recent past, the Internet-of-Things (IoT) and Ambient Intelligence (AmI) have been enhancing the domestic environment with new connected devices, appliances, and smart furniture, aspiring to assist independent living [2]. Building upon these developments, this work proposes Vesti-AmI; an intelligent wardrobe which, in cooperation with the existing technological infrastructure of the Intelligent Home, aims to assist people in getting ready for their various activities in a context-sensitive, user-friendly and intelligent manner. With respect to the target audience, the facilities of Vesti-AmI are foreseen to accommodate a wide variety of users, including adults, children, elderly people, and people with disabilities. Indicatively, Vesti-AmI permits end-users to: (i) browse clothing items manually or digitally, (ii) preview their choices on a Smart Mirror, (iii) retrieve and store clothing items (semi-)automatically, (iv) get outfit recommendations based on contextual information, and (v) keep their garments odor-, mold-, moisture-, and moth-free with the help of appropriate sensors and actuators that monitor the interior of the wardrobe. Vesti-AmI features a full-height hanging space appropriate for storing clothing like shirts or skirts, but also longer garments such as dresses. An electrically-powered closet rod automatically raises and lowers the clothes so as to bring them closer to the user, while a sophisticated mechanism permits the system to identify each hanging item and present it to the user upon request. The next two compartments contain shelves and drawers in order to provide organized storage solutions for folded clothes and accessories, and a custom-made in-closet steamer that permits users to freshen up their clothes. Sophisticated mechanisms permit the shelves and drawers to move in a vertical fashion (like a carousel), making the stored items easily accessible. Additionally, cameras hidden on the top of each drawer and shelf permit Vesti-AmI to be aware of their contents, while light and sound cues in combination with vibration feedback are employed to assist users (especially blind or visually challenged individuals) to locate the required items inside the wardrobe. In order to maximize time efficiency, an embedded "Smart Mirror" allows users to virtually try their clothes on in an immersive way. Vesti-AmI promotes multimodal interaction that includes touch interaction, air gestures and voice interaction, which can be used complementary to support all users (including those with disabilities). For example, voice interaction can be used by blind or visually challenged users to ask for certain items, while motion-based interaction and gestures can enable users to naturally select the outfit they wish to try on the “Smart Mirror”.

BubbleFeed: Visualizing RSS Information in Public Spaces

Karouzaki, E., Partarakis, N., Antona, M., & Stephanidis, C. (2018) BubbleFeed: Visualizing RSS Information in Public Spaces In Interactivity, Game Creation, Design, Learning, and Innovation (pp. 151-161). Springer, Cham.

Abstract

Public interaction displays contribute to upgrading the quality of public spaces since they attract many users and stimulate social interaction. In this paper, BubbleFeed is presented, a system for visualizing RSS news from multiple sources in public spaces. RSS news headlines are displayed inside virtual interactive bubbles ascending from the bottom of a vertical screen to the top, resembling the bubbles formed in a glass of soft drink. Besides touching the bubbles to expand and read the respective news stories, playful user interaction is supported to promote better engagement and motivate multiple users to participate. To support custom news feeds and Facebook posts in addition to RSS feeds, we have built a tool and a library that produce RSS files from the respective sources. BubbleFeed also supports displaying weather information, hosting media galleries and providing useful information such as Wi-Fi hotspot maps.

Home Game: an Educational Game for Children with Cognitive Impairments

Leonidis A., Arampatzis D., Korozi M., Adami I., Ntoa S., Stephanidis C. (2017) Home Game: an Educational Game for Children with Cognitive Impairments In the Proceeding of the 2017 conference on interaction design and children, June 27-30, 2017, Stanford, CA, USA. ACM

Abstract

This paper describes an educational game that aims to familiarize cognitive impaired children with household objects, the overall home environment and the daily activities that take place in it. In addition to touch-based interaction, the game supports physical manipulation through printed cards on a tabletop setup, using a webcam to detect and track the cards placed on the game board.

Analysis and Design of Three Multimodal Interactive Systems to Support the Everyday Needs of Children with Cognitive Impairments

Ntoa, S., Leonidis, A., Korozi, M., Papadaki, E., Margetis, G., Antona, M., & Stephanidis, C. (2015) Analysis and Design of Three Multimodal Interactive Systems to Support the Everyday Needs of Children with Cognitive Impairments In M. Antona & C. Stephanidis (Eds.), Universal Access in Human-Computer Interaction. Access to Learning, Health and Well-Being – Volume 9 of the combined Proceedings of the 17th International Conference on Human-Computer Interaction (HCI International 2015), Los Angeles, CA, USA, 2-7 August, pp. 637-648. Berlin Heidelberg: Lecture Notes in Computer Science Series of Springer

Abstract

The autonomy and independence of users with cognitive impairments can be fostered through cognitive technologies. The use of traditional computer interfaces has however proved to be difficult for these users. This paper proposes three innovative systems to train children with cognitive impairments in three fundamental everyday life activities: (a) familiarizing with the home environments, its objects and activities; (b) learning about money and practicing shopping skills; and (c) learning how to prepare and cook simple meals. All three systems feature multimodal interaction and support multimedia output.

Immersing Users in Landscapes Using Large Scale Displays in Public Spaces

Drossis, G., Ntelidakis, A., Grammenos, D., Zabulis, X., & Stephanidis, C. (2015) Immersing Users in Landscapes Using Large Scale Displays in Public Spaces In N. Streitz & P. Markopoulos (Eds.), Distributed, Ambient, and Pervasive Interactions – Volume 21 of the combined Proceedings of the 17th International Conference on Human-Computer Interaction (HCI International 2015), Los Angeles, CA, USA, 2-7 August, pp. 152-162. Berlin Heidelberg: Lecture Notes in Computer Science Series of Springer

Abstract

This paper reports on the design and implementation of BeThereNow, a public interactive information system where users are depicted immersed in various sceneries. The work is focused on the domain of info-tainment in public spaces using large displays and aims on short-time usage. The implemented system employs a mixed reality application through which users are informed about different sceneries and also create personalized digital postcards. This process is accomplished using computer vision algorithms in order to depict users and objects, while removing the background of the scene. Finally, the lessons learned from the long-term deployment of the system out-in-the-wild are presented, providing an insight on the users’ actions and reactions and feedback on future research directions.

iEat: An Interactive Table for Restaurant Customers’ Experience Enhancement

Margetis, G., Grammenos, D., Zabulis, X., & Stephanidis, C (2013) iEat: An Interactive Table for Restaurant Customers’ Experience Enhancement In C. Stephanidis (Ed.), HCI International 2013 - Posters' Extended Abstracts, Part II - Volume 29 of the combined Proceedings of HCI International 2013 (15th International Conference on Human-Computer Interaction), Las Vegas, Nevada, USA, 21-26 July, pp. 666-670. Berlin Heidelberg: Communications in Computer and Information Science (CCIS 374, ISBN: 978-3-642-39475-1).

Abstract

An active field of research today is the technological enrichment of everyday activities using augmented reality and ambient intelligence technologies. To this end, augmenting dinner tables is a challenging task, requiring a high-quality user experience unobtrusively supporting and enhancing the user’s main goal: eating and socializing. This work presents an augmented restaurant table, facilitating customers’ ordering and enhancing their experience through entertainment and socialization features, as well as through interaction with physical objects placed upon the table surface.

Macedonia from Fragments to Pixels: A permanent exhibition of interactive systems at the Archaeological Museum of Thessaloniki

Grammenos, D., Zabulis, X., Michel, D., Padeleris, P., Sarmis, T., Georgalis, G., Koutlemanis, P., Tzevanidis, K., Argyros, A.A., Sifakis, M., Adam-Veleni, P., Stephanidis, C. (2012) Macedonia from Fragments to Pixels: A permanent exhibition of interactive systems at the Archaeological Museum of Thessaloniki In Marinos Ioannides; Dieter Fritsch; Johanna Leissner; Rob Davies; Fabio Remondino & Rossella Caffo, ed., 'EuroMed' , Springer, , pp. 602-609.

Abstract

The theme of this paper is an exhibition of prototypical interactive systems with subjects drawn from ancient Macedonia, named "Macedonia from fragments to pixels". Since 2010, the exhibition is hosted by the Archaeological Museum of Thessaloniki and is open daily to the general public. Up to now, more than 165.000 people have visited it. The exhibition comprises 7 interactive systems which are based on some research outcomes of the Ambient Intelligence Programme of the Institute of Computer Science, Foundation for Research and Technology - Hellas. The digital content of these systems includes objects from the Museum’s permanent collection and from Macedonia.

Design and Development of Four Prototype Interactive Edutainment Exhibits for Museums

Grammenos D., Zabulis X., Michel D., Sarmis T., Georgalis G., Tzevanidis K., Argyros A, A., Stephanidis C. (2011) Design and Development of Four Prototype Interactive Edutainment Exhibits for Museums In Proceedings of the 6th international conference on Universal access in human-computer interaction: context diversity - Volume Part III (UAHCI'11), Constantine Stephanidis (Ed.), Vol. Part III. Springer-Verlag, Berlin, Heidelberg, 173-182.

Abstract

This paper describes the outcomes stemming from the work of a multidisciplinary R&D project of ICS-FORTH, aiming to explore and experiment with novel interactive museum exhibits, and to assess their utility, usability and potential impact. More specifically, four interactive systems are presented in this paper which have been integrated, tested and evaluated in a dedicated, appropriately designed, laboratory space. The paper also discusses key issues stemming from experience and observations in the course of qualitative evaluation sessions with a large number of participants.