A way that users can interact with Ambient Intelligence environments is through the use of objects. By visually finding objects that persons use in the environment and estimating their pose, the environment and the objects themselves can be augmented. In this way, conventional objects may be augmented to become interactive displays. Printed matter, such as books, cards, or pamphlets, is a special class of objects because they contain information that reveals user interest. By recognizing images and text of items that a user reads it is possible to augment their content, as well as, provide new ways of interaction with them.