Cristian Reyes Eva Mohedano Kevin McGuinness Noel O'Connor Xavier Giro-i-Nieto
Cristian Reyes Eva Mohedano Kevin McGuinness Noel O'Connor Xavier Giro-i-Nieto

A joint collaboration between:

logo-insight logo-dcu logo-upc logo-etsetb logo-gpi
Insight Centre for Data Analytics Dublin City University (DCU) Universitat Politecnica de Catalunya (UPC) UPC ETSETB TelecomBCN UPC Image Processing Group

Abstract

This work presents a retrieval pipeline and evaluation scheme for the problem of finding the last appearance of personal objects in a large dataset of images captured from a wearable camera. Each personal object is modelled by a small set of images that define a query for a visual search engine.The retrieved results are reranked considering the temporal timestamps of the images to increase the relevance of the later detections. Finally, a temporal interleaving of the results is introduced for robustness against false detections. The Mean Reciprocal Rank is proposed as a metric to evaluate this problem. This application could help into developing personal assistants capable of helping users when they do not remember where they left their personal belongings.

Video



Slides

Time sensitive egocentric image retrieval for finding objects in lifelogs from Xavier Giro

Publication

Our preprint is available on arXiv.

Image of the paper

Please cite with the following Bibtex code:

@inproceedings {Reyes:2016:LTA,
    author = {Reyes, Cristian and Mohedano, Eva and McGuinness, Kevin and O{\textquoteright}Connor, N. and Giro-i-Nieto, X.}
    title = {Where is my Phone ? Personal Object Retrieval from Egocentric Images},
    booktitle = {Proceedings of the First International Workshop on Lifelogging Tools and Applications},
    series = {LTA '16},
    year = {2016},
    location = {Amsterdam, The Netherlands},
    publisher = {ACM},
}