STAR: A See-Through Augmented Reality Exhibit Showcase Built for Transparent Display

Gerakianaki, A., Zidianakis, E., Neroutsou, V., Ntagianta, A., Adami, I., Ntoa, S., Antona, M., & Stephanidis, C. (2025) STAR: A See-Through Augmented Reality Exhibit Showcase Built for Transparent Display In P. Zaphiris, A. Ioannou, R. Sottilare, J. Schwarz & M. Rauterberg (Eds.), HCI International 2024 - Late Breaking Papers: Part V – Volume 67 (LNCS 15378) of the combined Proceedings of the 26th International Conference on Human-Computer Interaction (HCI International 2024), Washington DC, USA, 29 June - 4 July 2024 (pp. 263-279). Switzerland AG: Springer Nature.

Abstract

Motivated by the potential of Augmented Reality (AR) applications for transparent displays, this work presents a See-Through Augmented Reality (STAR) Exhibit Showcase, an interactive system that provides information and multimedia content for physical exhibits through a seamless User Experience (UX). The research described addresses underlying key inquiries about the effect of ambient light conditions, multi-user interaction, and methods for achieving accessibility. To validate the system, a case study was implemented for the city of Kalamata, demonstrating the potential of AR in promoting and enhancing user engagement with local products. Two heuristic evaluation sessions were conducted to identify usability problems and improve the UX.

CreteAR: Enhancing Learning Experiences Through Tangible Transformable Artifacts and Extended Reality

Tosios, A., Leonidis, A., Korozi, M., Stivaktakis, N. M., Apostolakis, E., Roulios, M., ... & Stephanidis, C. (2024) CreteAR: Enhancing Learning Experiences Through Tangible Transformable Artifacts and Extended Reality Human Factors in Design, Engineering, and Computing, 159(159).

Abstract

This paper discusses the design and development of CreteAR, a system that integrates Extended Reality (XR) with a transformable physical model of the island of Crete to enhance learning experiences. CreteAR features an XR application for handheld devices that overlays information on a scale model, which is equipped with mechatronics to elevate or conceal showcases containing culturally significant items. Users can interact with both the digital content and the physical model, activating the showcases and accessing information through a companion display. The paper explores relevant literature, analyzes similar systems, and details the design process, including user requirements and expert feedback. CreteAR was initially conceived as a prototype, but it holds the potential to contribute to the development of broader applications across various domains beyond the scope of Crete’s geography and heritage. It was designed to deliver an immersive and handson learning experience, emphasizing social interaction and cooperative exploration, engaging users in dynamic and meaningful interactions.

Design for Intelligent Environments

Stephanidis, C., Leonidis, A., Korozi, M., Kouroumalis, V., Adami, I., & Ntoa, S. (2024) Design for Intelligent Environments In C. Stephanidis & G. Salvendy (Eds.), Human-Computer Interaction in Intelligent Environments. Volume V of the book series 'Human-Computer Interaction: Foundations and Advances'. (pp. 1-43), CRC Press, Taylor and Francis Group.

Abstract

This chapter aims to introduce the reader to the concept of Intelligent Environments (IEs) (Brumitt et al., 2000) and the challenges of designing them. Along with the introduction of concepts, disambiguation of terms, and presentation of the current state of research, this chapter focuses on the description of the AmI Design Process, a design process and a framework with supporting tools, developed in the context of the Ambient Intelligence Programme 1 of ICS-FORTH 2 . The framework can be used as a reference or a guide to researchers and practitioners on how to tackle the complexity of designing IEs and managing the design process based on the user-centered design principles (Abras et al., 2004) and the Design Thinking process (Brown, 2008; Park & McKilligan, 2018) offering a holistic approach to the challenge that is to solving problems. This chapter also provides a use case of the design of an IE that was carried out with the described process and tools.

Gamified VR Storytelling for Cultural Tourism Using 3D Reconstructions, Virtual Humans, and 360° Videos

Kontogiorgakis, E., Zidianakis, E., Kontaki, E., Partarakis, N., Manoli, K., Ntoa, S., & Stephanidis, C. (2024) Gamified VR Storytelling for Cultural Tourism Using 3D Reconstructions, Virtual Humans, and 360° Videos Technologies, 12(6), 73, Open Access Article, published online: 22 May 2024.

Abstract

This work addresses the lack of methodologies for the seamless integration of 360° videos, 3D digitized artifacts, and virtual human agents within a virtual reality environment. The proposed methodology is showcased in the context of a tour guide application and centers around the innovative use of a central hub, metaphorically linking users to various historical locations. Leveraging a treasure hunt metaphor and a storytelling approach, this combination of digital structures is capable of building an exploratory learning experience. Virtual human agents contribute to the scenario by offering personalized narratives and educational content, contributing to an enriched cultural heritage journey. Key contributions of this research include the exploration of the symbolic use of the central hub, the application of a gamified approach through the treasure hunt metaphor, and the seamless integration of various technologies to enhance user engagement. This work contributes to the understanding of context-specific cultural heritage applications and their potential impact on cultural tourism. The output of this research work is the reusable methodology and its demonstration in the implemented showcase application that was assessed by a heuristic evaluation.

Gamified experiences using 360° photography

In the Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA ’23), Corfu, Greece, 5-7 July (pp. 53-61). New York, NY, USA: ACM. Open Access, published online: 10 August 2023. (2023) Gamified experiences using 360° photography Xhako, A., Zidianakis, E., Kontaki, E., Manoli, K., Ntoa, S., Partarakis, N., & Stephanidis, C.

Abstract

The emergence of 360° video and photography has provided new challenges regarding the exploitation of such technologies in various contexts with the most promising one being education. Combining 360° video with VR technology and gamified elements in interaction design has been proven to be beneficial from an educational perspective. This paper provides a methodology for gamified educational experiences using 360o- media, an example of its application and preliminary evaluation findings. The implemented application is a virtual treasure hunt game taking place within a public library that allows players to explore various dimensions of their city and cultural heritage through gamified concepts. The preliminary evaluation has provided positive comments regarding the efficiency of the presented approach and the simplicity of implementation making this approach promising for further exploitation by the Cultural and Creative Industries.

Integrating Ambient Intelligence Technologies for Empowering Agriculture

Stratakis, C., Stivaktakis, N.M., Bouloukakis, M., Leonidis, A., Doxastaki, M., Kapnas, G., Evdaimon, T., Korozi, K., Kalligiannakis, E., & Stephanidis, C. (2021) (2022) Integrating Ambient Intelligence Technologies for Empowering Agriculture In the Proceedings of the 13th EFITA International online Conference, 25-26 May 2021. Engineering Proceedings 2021, 9(1), 41. Open Access, published online: 11 January 2022

Abstract

This work blends the domain of Precision Agriculture with the prevalent paradigm of Ambient Intelligence, so as to enhance the interaction between farmers and Intelligent Environments, and support their various daily agricultural activities, aspiring to improve the quality and quantity of cultivated plants. In this paper, two systems are presented, namely the Intelligent Greenhouse and the AmI seedbed, targeting a wide range of agricultural activities, starting from planting the seeds, caring for each individual sprouted plant up to their transplantation in the greenhouse, where the provision for the entire plantation lasts until the harvesting period.

An Intelligent Modular Student Desk

Prinianakis, A., Stefanidi, H., Leonidis, A., Korozi, M., Katzourakis, A., Stamatakis, E. and Antona, M. (2021) An Intelligent Modular Student Desk 15th International Technology, Education and Development Conference

Abstract

With the emergence of the Ambient Intelligence (AmI) paradigm, Intelligent Environments became a reality and have already permeated various domains of everyday life such as work, health, entertainment and education. The Intelligent Classroom of ICS-FORTH, adheres to the human-oriented nature of AmI environments -whose primary goal is to satisfy the needs of the people living in them- and features a collection of interdependent technologically-enhanced artefacts (i.e., desk, teacher’s workstation, whiteboard) that are capable of exchanging information and communicating with each other, offering a unified interaction experience. The student’s desk is a key classroom artefact, where students spend most of their class time, so this work aspiring to enhance their daily educational activities introduces an Intelligent Desk, namely modDesk, featuring a modular design. Its construction allows customizable surfaces to be added or removed on demand, so as to support the specific and different needs of each course. Considering that related studies recommend to equip students with a display along with an appropriate input method as it would be beneficial for the educational process, the surfaces of modDesk feature built-in monitors and input devices, but also enable students to connect their handheld devices (e.g., Smartphones, Tablets). Via sophisticated mechanisms the desk identifies any external devices that are docked to its surface or that are in close proximity, and determines the capabilities they offer. Based on the identified capabilities, modDesk adapts to offer better support to the student. This new generation desk aims to further increase students’ engagement and motivation, providing hands-on experience and offering personal study spaces featuring specialized equipment.

Going Beyond Second Screens: Applications for the Multi-display Intelligent Living Room

Leonidis, A., Korozi, M., Kouroumalis, V., Adamakis, E., Milathianakis, D. & Stephanidis, C. (2021) Going Beyond Second Screens: Applications for the Multi-display Intelligent Living Room ACM International Conference on Interactive Media Experiences

Abstract

This work aims to investigate how the amenities offered by Intelligent Environments can be used to shape new types of useful, exciting and fulfilling experiences while watching sports or movies. Towards this direction, two ambient media players were developed aspiring to offer live access to secondary information via the available displays of an Intelligent Living Room, and to appropriately exploit the technological equipment so as to support natural interaction. Expert-based evaluation experiments revealed some factors that can influence the overall experience significantly, without hindering the viewers’ immersion to the main media.

GRETA: Pervasive and AR Interfaces for Controlling Intelligent Greenhouses

Bekiaris, I., Leonidis, A., Korozi, M., Stratakis, C., Zidianakis, E., Doxastaki, M. and Stephanidis, C. (2021) GRETA: Pervasive and AR Interfaces for Controlling Intelligent Greenhouses The 17th International Conference on Intelligent Environments (IE2021) will be held in Dubai, United Arab Emirates at Middlesex University Dubai from June 21 – June 24, 2021.

Abstract

Abstract— Considering the prevalence of Ambient Intelligence, this work aims to enhance the interaction between farmers and Intelligent Environments, in order to support their various daily Agricultural activities, aspiring to improve the quality and quantity of cultivated species. Towards this direction, the Greta system was designed and developed, following a user-centered design process, permitting farmers/agronomists to easily monitor and control an Intelligent Greenhouse via a set of useful and usable applications. Greta offers a progressive web app (PWAs) targeting PCs, handheld devices, and technologically-enhanced artifacts of Smart Homes, while it also delivers an Augmented Reality application that visualizes the greenhouse’s interior conditions in a sophisticated manner, and provides context-sensitive assistance regarding cultivation activities. In more detail, the system interoperates with the ambient facilities of an Intelligent Greenhouse allowing end-users to: monitor the conditions inside the greenhouse, remotely control the state of various actuators, be notified regarding the available/active automations, be aware of the optimal conditions for their plants to grow and receive relevant guidelines, be informed regarding any diseases, and communicate with experts for receiving treatment advice. This work describes the design methodology and functionality of Greta, and documents the results of a series of expert-based evaluation experiments.

Improving Stress Management and Sleep Hygiene in Intelligent Homes

Leonidis, A., Korozi, M., Sykianaki, E., Tsolakou, E., Kouroumalis, V., Ioannidi, D., Stavridakis, A., Antona, M. and Stephanidis, C. (2021) Improving Stress Management and Sleep Hygiene in Intelligent Homes Journal Article, Sensors 2021, 21, 2398.

Abstract

High stress levels and sleep deprivation may cause several mental or physical health issues, such as depression, impaired memory, decreased motivation, obesity, etc. The COVID-19 pandemic has produced unprecedented changes in our lives, generating significant stress, and worries about health, social isolation, employment, and finances. To this end, nowadays more than ever, it is crucial to deliver solutions that can help people to manage and control their stress, as well as to reduce sleep disturbances, so as to improve their health and overall quality of life. Technology, and in particular Ambient Intelligence Environments, can help towards that direction, when considering that they are able to understand the needs of their users, identify their behavior, learn their preferences, and act and react in their interest. This work presents two systems that have been designed and developed in the context of an Intelligent Home, namely CaLmi and HypnOS, which aim to assist users that struggle with stress and poor sleep quality, respectively. Both of the systems rely on real-time data collected by wearable devices, as well as contextual information retrieved from the ambient facilities of the Intelligent Home, so as to offer appropriate pervasive relaxation programs (CaLmi) or provide personalized insights regarding sleep hygiene (HypnOS) to the residents. This article will describe the design process that was followed, the functionality of both systems, the results of the user studies that were conducted for the evaluation of their end-user applications, and a discussion about future plans.

1 2 3 14