Cristian Reyes | Eva Mohedano | Kevin McGuinness | Noel O'Connor | Xavier Giro-i-Nieto |
A joint collaboration between:
Insight Centre for Data Analytics | Dublin City University (DCU) | Universitat Politecnica de Catalunya (UPC) | UPC ETSETB TelecomBCN | UPC Image Processing Group |
Abstract
This work presents a retrieval pipeline and evaluation scheme for the problem of finding the last appearance of personal objects in a large dataset of images captured from a wearable camera. Each personal object is modelled by a small set of images that define a query for a visual search engine.The retrieved results are reranked considering the temporal timestamps of the images to increase the relevance of the later detections. Finally, a temporal interleaving of the results is introduced for robustness against false detections. The Mean Reciprocal Rank is proposed as a metric to evaluate this problem. This application could help into developing personal assistants capable of helping users when they do not remember where they left their personal belongings.
Video
Slides
Publication
Our preprint is available on arXiv.
Please cite with the following Bibtex code:
@inproceedings {Reyes:2016:LTA,
author = {Reyes, Cristian and Mohedano, Eva and McGuinness, Kevin and O{\textquoteright}Connor, N. and Giro-i-Nieto, X.}
title = {Where is my Phone ? Personal Object Retrieval from Egocentric Images},
booktitle = {Proceedings of the First International Workshop on Lifelogging Tools and Applications},
series = {LTA '16},
year = {2016},
location = {Amsterdam, The Netherlands},
publisher = {ACM},
}