Large Display Interaction using Video Avatar and Hand Gesture Recognition.pdf

Large Display Interaction using Video Avatar and Hand Gesture Recognition Sang Chul Ahn, Tae-Seong Lee, Ig-Jae Kim, Yong-Moo Kwon, and Hyoung-Gon Kim Imaging Media Research Center, KIST 39-1 Hawolgok-dong, Sungbuk-gu, Seoul KOREA 136-791 {asc, kij, lts, ymk, hgk}@imrc.kist.re.kr Abstract. This paper presents a new system for interacting with a large display using live video avatar of a user and hand gesture recognition. The system en- ables a user to appear on a screen as a video avatar and to interact with items therein. The user can interact with the large display remotely by walking and touching icons through his video avatar. In order to build the system, we devel- oped live video composition, active IR vision-based hand gesture recognition, and 3D human body tracking system, and incorporated a voice recognition sys- tem, too. Using this system, a user can interact efficiently with an embedded computer in a space that equipped with a large display. 1 Introduction HCI(Human Computer Interaction) has been one of the most important research is- sues since the computer became one of the necessities of our daily lives. Many re- searchers are working on developing new interaction paradigms for efficient com- puter usage over mice and keyboards. As related works, there have been some re- searches to control computers by vision-based interaction. For instance, Kjeldsen tried to use gestures for computer interface[1]. The Perceptual Window offered a head motion based interaction technique[2]. Further, HCI techniques have been ap- plied to virtual environment control[3], and building a smart interactive space[4,5]. Nowadays, as computers are getting smaller and smaller, and are embedded inside a lot of things around us. This embedded computing environment doesn’t allow us to use mouse and keyboard type interface any more. We need a new type of interaction mechanism with things that have computing capability. In this environment, we don’t care whe