This paper presents a user experience study of interaction with printed maps for providing digitally augmented tourism information. The Interactive Maps system has been implemented based on an interactive printed matter framework which provides all the necessary components for developing smart applications that offer printed matter interaction, and has been deployed and evaluated in the context of the publicly available Tourism InfoPoint of the Municipality of Heraklion. The results of the evaluation highlight that interacting with digitally augmented paper is quite easy and natural, while the overall user experience is positive.
The case of mixed-reality projector-camera systems is considered and, in particular, those which employ hand-held boards as interactive displays. This work focuses upon the accurate, robust, and timely detection and pose estimation of such boards, to achieve high-quality augmentation and interaction. The proposed approach operates a camera in the near infrared spectrum to filter out the optical projection from the sensory input. However, the monochromaticity of input restricts the use of color for the detection of boards. In this context, two methods are proposed. The first regards the pose estimation of boards which, being computationally demanding and frequently used by the system, is highly parallelized. The second uses this pose estimation method to detect and track boards, being efficient in the use of computational resources so that accurate results are provided in real-time. Accurate pose estimation facilitates touch detection upon designated areas on the boards and high-quality projection of visual content upon boards. An implementation of the proposed approach is extensively and quantitatively evaluated, as to its accuracy and efficiency. This evaluation, along with usability and pilot application investigations, indicate the suitability of the proposed approach for use in interactive, mixed-reality applications.
The autonomy and independence of users with cognitive impairments can be fostered through cognitive technologies. The use of traditional computer interfaces has however proved to be difficult for these users. This paper proposes three innovative systems to train children with cognitive impairments in three fundamental everyday life activities: (a) familiarizing with the home environments, its objects and activities; (b) learning about money and practicing shopping skills; and (c) learning how to prepare and cook simple meals. All three systems feature multimodal interaction and support multimedia output.
This paper reports on the design and implementation of BeThereNow, a public interactive information system where users are depicted immersed in various sceneries. The work is focused on the domain of info-tainment in public spaces using large displays and aims on short-time usage. The implemented system employs a mixed reality application through which users are informed about different sceneries and also create personalized digital postcards. This process is accomplished using computer vision algorithms in order to depict users and objects, while removing the background of the scene. Finally, the lessons learned from the long-term deployment of the system out-in-the-wild are presented, providing an insight on the users’ actions and reactions and feedback on future research directions.
Natural interaction refers to people interacting with technology as they are used to interact with the real world in everyday life, through gestures, expressions, movements, etc., and discovering the world by looking around and manipulating physical objects . In the domain of cultural heritage research has been conducted in a number of directions including (a) Personalised Information in Museums, (b) Interactive Exhibits, (c) Interactive Games Installations in Museums, (d) Museum Mobile Applications, (e) Museums presence on the Web and (f) Museum Social Applications. Most museums target family groups and organize family-oriented events in their programs but how families choose to visit particular museums in response to their leisure needs has rarely been highlighted. This work exploits the possibility of extending the usage of AmI technology, and thus the user experience, within leisure spaces provided by museums such as cafeterias. The Museum Coffee Table is an augmented physical surface where physical objects can be used for accessing information about artists and their creations. At the same entertainment for children is facilitated through the integration of popular games on the surface. As a result, the entire family can seat around the table, drink coffee and complete their visit to the museum acquiring additional knowledge and playing games.
Pervasive computing environments have permeated current research and practice, unobtrusively augmenting existing environments with digital content. The present work, following a pervasive computing approach, proposes a framework to augment an educational environment, being a typical classroom or any studying environment. In this context, the work presented in this paper investigates unobtrusive interaction and support of active educational or studying activities through appropriate context-sensitive information. To this end, passive visual sensing is employed in order to unobtrusively perceive the current context and users’ actions, thus providing novel ways to implement natural interaction. The suitability of the proposed interaction technologies and overall approach has been demonstrated through three interactive applications integrated in the framework, each one supporting different interaction techniques and addressing different educational activities. Finally, a user experience evaluation of the three test-bed applications has been carried out, aiming to assess the applicability of the approach and the suitability of each of the proposed technologies to the educational tasks in hand.
The “Interactive Documents” system augments documents, books, and leaflets on the surfaces on which they are read. The augmented content complements that of the printed document interactively; the user can touch regions of interest both within the printed matter and the augmented content.