Study Buddy

Study-Buddy is a system aiming to provide seamless, context-aware support to students, by monitoring their interactions with reading material and presenting related information in a nearby screen.

The system is composed of a smart reading lamp incorporates a small camera and an embedded computer with WiFi connection. The camera of the reading lamp targets to the student’s reading area (i.e., the area of the desk where the book is placed). Interaction with the Study-Buddy system is initiated when a user indicates a word in the book, by using a black pointer (e.g., pen) and carrying out one of the following gestures: pointing at the word, underlining the word or circling the word.

Whenever the smart reading lamp observes that the reader needs help about a word or a phrase, it scans the area trying to recognize the indicated words, using OCR software. Then, it collects useful information about the recognized words, such as related images and words’ definition Finally, it transmits the aforementioned information to a near the reader computational device (e.g., tablet, smart phone, etc.) which runs LexiMedia.

LexiMedia can be used in the context of learning a foreign language, or while learning one’s mother language as a young student. The software provides:

    • Word preview, including up to three definitions for the given word, five representative images and five related videos
    • Dictionary data, including all the definitions available for the word, as well as synonyms and examples for each definition
    • Related to the specified word images and videos
    • Visited words history

Publications

Margetis, G., Antona, M., & Stephanidis, C. (2015). A Framework for Supporting Natural Interaction with Printed Matter in Ambient Intelligence Environments. In the Proceedings of the 5th International Conference on Ambient Computing, Applications, Services and Technologies (AMBIENT 2015), Nice, France, 19-24 July (pp. 72-78). USA: IARIA XPS Press.

Margetis, G., Ntoa, S., Bouhli, M., & Stephanidis, C. (2011). Study-Buddy: Improving the Learning Process through Technology-Augmented Studying Environments. In C. Stephanidis (Ed.), HCI International 2011 - Posters' Extended Abstracts (Part II) - Volume 23 of the combined Proceedings of HCI International 2011 (14th International Conference on Human-Computer Interaction), Orlando, FL, USA, 9-14 July, pp. 504-508. Berlin Heidelberg: Communications in Computer and Information Science (CCIS 174, ISBN: 978-3-642-22094-4).