CVPR 2016 logo Paper accepted at 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops
Amaia Salvador Xavier Giro-i-Nieto Ferran Marqués Shin'ichi Satoh
Amaia Salvador Xavier Giro-i-Nieto Ferran Marques Shin'ichi Satoh

A joint collaboration between:

logo-upc logo-etsetb logo-gpi logo-nii
Universitat Politecnica de Catalunya (UPC) UPC ETSETB TelecomBCN UPC Image Processing Group National Institute of Informatics



Image representations derived from pre-trained Convolutional Neural Networks (CNNs) have become the new state of the art in computer vision tasks such as instance retrieval. This work explores the suitability for instance retrieval of image- and region-wise representations pooled from an object detection CNN such as Faster R-CNN. We take advantage of the object proposals learned by a Region Proposal Network (RPN) and their associated CNN features to build an instance search pipeline composed of a first filtering stage followed by a spatial reranking. We further investigate the suitability of Faster R-CNN features when the network is fine-tuned for the same objects one wants to retrieve. We assess the performance of our proposed system with the Oxford Buildings 5k, Paris Buildings 6k and a subset of TRECVid Instance Search 2013, achieving competitive results.


Our preprint is publicly available on arXiv.

Please cite with the following Bibtex code:

  title={Faster R-CNN Features for Instance Search},
  author={Salvador, Amaia and Giro-i-Nieto, Xavier and Marques, Ferran and Satoh, Shin'ichi},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},

Image of the paper

You may also want to refer to our publication with the more human-friendly Chicago style:

Amaia Salvador, Xavier Giro-i-Nieto, Ferran Marques and Shin'ichi Satoh. "Faster R-CNN Features for Instance Search." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2016.

Talk on video

2016-05-Seminar-AmaiaSalvador-DeepVision from Image Processing Group on Vimeo.


Convolutional Features for Instance Search from Xavier Giro

Code Instructions

This python repository contains the necessary tools to reproduce the retrieval pipeline based on off-the-shelf Faster R-CNN features.



Behind the scenes



We would like to especially thank Albert Gil Moreno and Josep Pujal from our technical support team at the Image Processing Group at UPC.

AlbertGil-photo JosepPujal-photo
Albert Gil Josep Pujal
We gratefully acknowledge the support of NVIDIA Corporation with the donation of the GeForce GTX Titan Z and Titan X used in this work. logo-nvidia
The Image ProcessingGroup at the UPC is a SGR14 Consolidated Research Group recognized and sponsored by the Catalan Government (Generalitat de Catalunya) through its AGAUR office. logo-catalonia
This work has been developed in the framework of the project BigGraph TEC2013-43935-R, funded by the Spanish Ministerio de Economía y Competitividad and the European Regional Development Fund (ERDF). logo-spain


If you have any general doubt about our work or code which may be of interest for other researchers, please use the public issues section on this github repo. Alternatively, drop us an e-mail at or