Augmenting Physical Surfaces with Location-Aware Digital Information

An augmented-reality approach for supplementing physical surfaces with digital information, through the use of pieces of plain paper that act as personal, location-aware, interactive screens. The system comprises a surface, a projector, an RGB camera, a PC and speakers. Additionally, rectangular pieces of plain white cardboard of various sizes are used. Cardboard pieces are surrounded by a colored frame. A computer vision system is used to track the position and pose of the paper surfaces, as well as the activation of any related interactive areas by the users’ fingers. This information is passed through a custom middleware layer to an application developed in Actionscript 3.0 using Adobe Flash, which implements the system’s user interface.


Up to now, the system has been instantiated and tested in three setups: (i) a map of Macedonia, Greece, including ancient Greek cities with archaeological interest; (ii) a glass case containing a scale model and (iii) a part of Rigas Velestinlis’ Charta. The first two systems are currently installed and available to the general public at the Archaeological Museum of Thessaloniki, Greece, as part of a permanent exhibition of interactive systems.


P. Koutlemanis, X. Zabulis (2017). Tracking of multiple planar projection boards for interactive mixed-reality applications. in Multimedia Tools and Applications, 1-31, Oct, 2017

Grammenos, D., Zabulis, X., Michel, D., Padeleris, P., Sarmis, T., Georgalis, G., Koutlemanis, P., Tzevanidis, K., Argyros, A.A., Sifakis, M., Adam-Veleni, P., Stephanidis, C. (2012). Macedonia from Fragments to Pixels: A permanent exhibition of interactive systems at the Archaeological Museum of Thessaloniki. In Marinos Ioannides; Dieter Fritsch; Johanna Leissner; Rob Davies; Fabio Remondino & Rossella Caffo, ed., 'EuroMed' , Springer, , pp. 602-609.

Grammenos D., Zabulis X., Michel D., Argyros A. A. (2011). Augmented Reality Interactive Exhibits in Cartographic Heritage: An implemented case-study open to the general public. In the Proceedings of the 6th International Workshop on Digital Approaches in Cartographic Heritage, 7 – 8 April 2011, the Hague, Netherlands, e-Perimetron, Vol. 6, No. 2, 2011, 57-67.

Grammenos D., Zabulis X., Michel D., Sarmis T., Georgalis G., Tzevanidis K., Argyros A, A., Stephanidis C. (2011). Design and Development of Four Prototype Interactive Edutainment Exhibits for Museums. In Proceedings of the 6th international conference on Universal access in human-computer interaction: context diversity - Volume Part III (UAHCI'11), Constantine Stephanidis (Ed.), Vol. Part III. Springer-Verlag, Berlin, Heidelberg, 173-182.

Grammenos, D., Michel, D., Zabulis, X., and Argyros, A., A. (2011). PaperView: augmenting physical surfaces with location-aware digital information. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction (TEI '11). ACM, New York, NY, USA, 57-60.