ParlAmI: A Multimodal Approach for Programming Intelligent Environments

Stefanidi E.; Foukarakis M.; Arampatzis D.; Korozi M.; Leonidis A.; Antona M. (2019) ParlAmI: A Multimodal Approach for Programming Intelligent Environments The PErvasive Technologies Related to Assistive Environments (PETRA). A special issue of Technologies (ISSN 2227-7080). Technologies 2019

Abstract

The proliferation of Internet of Things (IoT) devices and services and their integration in intelligent environments creates the need for a simple yet effective way of controlling and communicating with them. Towards such a direction, this work presents ParlAmI, a conversational framework featuring a multimodal chatbot that permits users to create simple “if-then” rules to define the behavior of an intelligent environment. ParlAmI delivers a disembodied conversational agent in the form of a messaging application named MAI, and an embodied conversational agent named nAoMI employing the programmable humanoid robot NAO. This paper describes the requirements and architecture of ParlAmI, the infrastructure of the “Intelligent Home” in which ParlAmI is deployed, the characteristics and functionality of both MAI and nAoMI, and finally presents the findings of a user experience evaluation that was conducted with the participation of sixteen users.

AmITV: Enhancing the Role of TV in Ambient Intelligence Environments.

Anyfantis, Nikolaos, Evangelos Kalligiannakis, Achilleas Tsiolkas, Asterios Leonidis, Maria Korozi, Prodromos Lilitsis, Margherita Antona and Constantine Stephanidis. (2018) AmITV: Enhancing the Role of TV in Ambient Intelligence Environments. PETRA (2018).

Abstract

The proliferation of Internet of Things (IoT) devices and services and their integration in Ambient Intelligence (AmI) Environments revealed a new range of roles that TVs are expected to play so as to improve quality of life. This work introduces AmITV, an integrated multimodal system that permits end-users to use the TV not only as a traditional entertainment center, but also as (i) a control center for manipulating any intelligent device, (ii) an intervention host that presents appropriate content when they need help or support, (iii) an intelligent agent that communicates with the users in a natural manner and assists them throughout their daily activities, (iv) a notification medium that informs them about interesting or urgent events, and (v) a communication hub that permits them to exchange messages in real-time or asynchronously. This paper presents two motivational scenarios inspired from Home and Hotel Intelligent Environments and the infrastructure behind AmITV. Additionally, it describes how it realizes the newly emerged roles of TVs as a multimodal, intelligent and versatile interaction hub with the ambient facilities of the entire technologically-augmented environment.

Programming Intelligent Environments in Natural Language: An Extensible Interactive Approach

Stefanidi, E., Korozi, M., Leonidis, A., & Antona, M. (2018, June) (2018) Programming Intelligent Environments in Natural Language: An Extensible Interactive Approach In Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference (pp. 50-57). ACM.

Abstract

The proliferation of Ambient Intelligence (AmI) devices and services and their integration in smart environments creates the need for a simple yet effective way of controlling and communicating with them. Towards that direction, the application of the Trigger -- Action model has attracted a lot of research with many systems and applications having been developed following that approach. This work introduces ParlAmI, a multimodal conversational interface aiming to give its users the ability to determine the behavior of AmI environments, by creating rules using natural language as well as a GUI. The paper describes ParlAmI, its requirements and functionality, and presents the findings of a user-based evaluation which was conducted.

Employing Virtual Humans for Interaction, Assistance and Information Provision in Ambient Intelligence Environments

Birliraki, C., Grammenos, D., & Stephanidis, C. (2015) Employing Virtual Humans for Interaction, Assistance and Information Provision in Ambient Intelligence Environments In N. Streitz & P. Markopoulos (Eds.), Distributed, Ambient, and Pervasive Interactions – Volume 21 of the combined Proceedings of the 17th International Conference on Human-Computer Interaction (HCI International 2015), Los Angeles, CA, USA, 2-7 August, pp. 249-261. Berlin Heidelberg: Lecture Notes in Computer Science Series of Springer

Abstract

This paper reports on the design, development and evaluation of a framework which implements virtual humans for information provision. The framework can be used to create interactive multimedia information visualizations (e.g., images, text, audio, videos, 3D models) and provides a dynamic data modeling mechanism for storage and retrieval and implements communication through multimodal interaction techniques. The interaction may involve human-to-agent, agent-to-environment or agent-to-agent communication. The framework supports alternative roles for the virtual agents who may act as assistants for existing systems, standalone “applications” or even as integral parts of emerging smart environments. Finally, an evaluation study was conducted with the participation of 10 people to study the developed system in terms of usability and effectiveness, when it is employed as an assisting mechanism for another application. The evaluation results were highly positive and promising, confirming the system’s usability and encouraging further research in this area.

The booTable Experience: Iterative Design and Prototyping of an Alternative Interactive Tabletop

Grammenos, D., Georgalis, Y., Kazepis, N., Drossis, G., Ftylitakis, N. (2010) The booTable Experience: Iterative Design and Prototyping of an Alternative Interactive Tabletop In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10). ACM, New York, NY, USA, 272-281.

Abstract

This paper introduces booTable, an interactive coffee table prototype constructed by recycled paper aiming to build upon the paradigm of surface computing, but endeavoring to overcome a number of identified limitations of current design practice. In this respect, the paper first runs through the design requirements, decisions and rationale towards creating a first version of the prototype. Then, the outcomes of the prototyping process are described, along with the results of an informal assessment session and related critique. Following that, the revisions made towards the development of a second version of the prototype are laid out and the final result is presented.

1 2