Chinese Shadow Puppetry with an Interactive Interface Using the Kinect Sensor

Hui Zhang^{1, 2}, Yuhao Song¹, Zhuo Chen¹, Ji Cai¹, and Ke Lu¹

¹Dept. of Computer Science, United International College, 28, Jinfeng Road, Tangjiawan, Zhuhai, Guangdong, China

²Shenzhen Key Lab of Intelligent Media and Speech, PKU-HKUST Shenzhen Hong Kong Institution, Shenzhen, China

Abstract. This paper addresses the problem of using body gestures to control the Chinese shadow puppets with the Microsoft Kinect sensor. By analyzing the motion of the actors in the Chinese famous drama, Wusong Fights the Tiger, we propose a general framework for controlling two shadow puppets, a human model and an animal model. A performer can conduct simple actions such as turning the head, stretching the arms or kicking the legs. However, it is more difficult for a normal performer to simulate more complicated movements, for example, back flips and splits. Therefore we define some special postures to represent these difficult movements. Besides, in order to be compatible with the Chinese drama style, we use water color to paint the background scenery and the foreground characters. We show some preliminary results which demonstrate the effectiveness of this work.

Keywords: Kinect, shadow puppetry, gesture

LNCS 7583, p. 352 ff.

Full article in PDF | BibTeX

lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012