Scalable Recognition with a Vocabulary Tree

The code provided in this repository has been developed for teaching purposes at the Imperial College London.
It is part of the Computer Vision Day of the Business School Executive Education Program for Sberbank.

Contributors

• https://github.com/epignatelli
• https://github.com/astanziola
• https://github.com/aab01

Getting started

1. Install the conda environment

A. If you are on windows

conda env create -f env\sberbank_win.yml

B. If you are on macOS or on linux platforms

conda env create -f env\sberbank_unix.yml

2. Start jupyter and open the notebook

conda activate cbir
jupyter lab

3. Open a terminal from jupyter and type

python cbir/download.py

Acknowledgements

The authors acknowledge the Executive Education of the Business School at the Imperial College for the support.
We thank Professor Anil Bharath of the Department of Bioengineering for the guidance and the opportunity of being part of the Computer Vision Day.
Thanks to Kai Arulkumaran and to Stathi Fotiadis for the feedback before the session and the assistance in teaching the session (2020).

Literature

Datasets:

• Hamming embedding and weak geometric consistency for large scale image search (INRIA Holydays) - download
• Large-scale Landmark Retrieval/Recognition under a Noisy and Diverse Dataset
• INSTRE: a New Benchmark for Instance-Level Object Retrieval and Recognition

Database indexing:

• PQk-means: Billion-scale Clustering forProduct-quantized Codes
• Scalable Recognition with a Vocabulary Tree
• Object retrieval with large vocabularies and fast spatial matching

Features extraction:

• Neural Codes for Image Retrieval
• Scale-Invariant Feature Transform
• Slides on SIFT (Lect. 11 and 12)
• Object Recognition from Local Scale-Invariant Features
• Distinctive Image Features from Scale-Invariant Keypoints
• Speeded Up Robust Feature (SURF)
• Using very deep autoencoders for content-based image retrieval
• Video Google: A Text Retrieval Approach to Object Matching in Videos

End-to-end

• Large Scale Online Learning of Image Similarity Through Ranking (Triplet loss)
• In Defense of the Triplet Loss for Person Re-Identification

Surveys

• A survey on Image Retrieval Methods
• Recent Advance in Content-based ImageRetrieval: A Literature Survey

Code

• https://towardsdatascience.com/bag-of-visual-words-in-a-nutshell-9ceea97ce0fb
• https://github.com/ducha-aiki/pytorch-sift