Sketch-based Image Similarity Search with a Pen and Paper Interface

Authors
Ihab Al Kabary and Heiko Schuldt
Type
In Proceedings
Date
2012/8
Appears in
Proceedings of the 2012 International Conference on Research and Development in Information Retrieva
Location
Portland, OR, USA
Abstract
We present a novel and innovative user interface for query-by-sketching based image retrieval that exploits emergent interactive paper and digital pen technology. Users can draw sketches with a digital pen on interactive paper in a user-friendly way. The pen is able to capture the stroke vectors and to interactively stream them to the underlying content-based image retrieval (CBIR) system via the pen's Bluetooth interface. We present the integration of interactive paper/digital pen technology with QbS, our CBIR system tailored to Query-by-Sketching, and we demonstrate the use of the paper and pen interface together with QbS for three different collections:MIRFLICKR-25K, a cartoon collection, and a collection of medieval paper watermarks.