Master’s Research Paper Presentation • Human-Computer Interaction Finger People: Using Hand-gesture Puppetry for Video Game InputExport this event to calendar

Friday, January 11, 2019 11:00 AM EST

Noah Murad, Master’s candidate
David R. Cheriton School of Computer Science

We examine using a human hand to functionally represent an onscreen game character for direct control of simple video games. One example of this type of hand-gesture puppetry is where the index and middle fingers are a character's legs and rest of the hand representing the body. With this type of "Finger People'' input, the player can control how a character runs, jumps, and attacks. The system uses a single camera capture of the player's hand with a recognition pipeline combining optical flow and a convolutional neural network. A study shows novice gamers enjoy using this method of control over traditional keyboard game input. 

We describe and demonstrate different types of hand-gesture puppetry, and argue the method is advantageous compared to other gesture recognition systems because it requires one hand to operate, it has no specialized hardware requirements, and it implements a unique paradigm for video games.

Location 
DC - William G. Davis Computer Research Centre
3126
200 University Avenue West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
27
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
  1. 2024 (96)
    1. April (19)
    2. March (27)
    3. February (25)
    4. January (25)
  2. 2023 (296)
    1. December (20)
    2. November (28)
    3. October (15)
    4. September (25)
    5. August (30)
    6. July (30)
    7. June (22)
    8. May (23)
    9. April (32)
    10. March (31)
    11. February (18)
    12. January (22)
  3. 2022 (245)
  4. 2021 (210)
  5. 2020 (217)
  6. 2019 (255)
  7. 2018 (217)
  8. 2017 (36)
  9. 2016 (21)
  10. 2015 (36)
  11. 2014 (33)
  12. 2013 (23)
  13. 2012 (4)
  14. 2011 (1)
  15. 2010 (1)
  16. 2009 (1)
  17. 2008 (1)