Ask’nSeek: A New Game for Object Detection and Labeling

Axel Carlier¹, Oge Marques², and Vincent Charvillat¹

¹IRIT-ENSEEIHT, University of Toulouse, France
Axel.Carlier@enseeiht.fr
Vincent.Charvillat@enseeiht.fr

²Florida Atlantic University, USA
omarques@fau.edu

Abstract. This paper proposes a novel approach to detect and label objects within images and describes a two-player web-based guessing game – Ask’nSeek – that supports these tasks in a fun and interactive way. Ask’nSeek asks users to guess the location of a hidden region within an image with the help of semantic and topological clues. The information collected from game logs is combined with results from content analysis algorithms and used to feed a machine learning algorithm that outputs the outline of the most relevant regions within the image and their names. Two noteworthy aspects of the proposed game are: (i) it solves two computer vision problems – object detection and labeling – in a single game; and (ii) it learns spatial relations within the image from game logs. The game has been evaluated through user studies, which confirmed that it was easy to understand, intuitive, and fun to play.

LNCS 7583, p. 249 ff.

Full article in PDF | BibTeX

lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012