Product image search with deep attribute mining and re-ranking

With the high-growing of e-commerce, more and more users have changed to buy from websites rather than in stores. To deal with mass products, the traditional text-based product search has become incompetent to meet use’s requirement. In this paper, we explore deep learning with convolutional neural networks (CNN) to resolve query’s classification, and propose an efficient approach for product image search. For a query image, we first train a CNN model of a large database containing various product images to discriminate the query’s category. Then we search similar products from the established category and utilize these visual results to parse the query with attribute. Finally we use the extracted attribute tags to finish the textual re-ranking and obtain the most relevant retrieved product list. Experimental evaluation shows that our approach significantly outperforms state of art in product image search.