Announcements

Schedule

week 1
Jan 4

Introduction

Krueger, M. W., Gionfriddo, T., Hinrichsen, K. (1985). VIDEOPLACE - an artificial reality. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 35–40). New York, NY, USA: ACM. http://doi.org/10.1145/317456.317463

slides

E1: Hello Opencv

week 2
Jan 11

Sign up for seminar

maynes07 image processing ( Dan)

Maynes-Aminzade, D., Winograd, T., & Igarashi, T. (2007). Eyepatch: Prototyping Camera-based Interaction Through Examples. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (pp. 33–42). New York, NY, USA: ACM. http://doi.org/10.1145/1294211.1294219

micro-reviews seminar tutorial code

Vogel, D., Cudmore, M., Casiez, G., Balakrishnan, R., & Keliher, L. (2009). Hand Occlusion with Tablet-sized Direct Pen Input. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 557–566). ACM. http://doi.acm.org/10.1145/1518701.1518787

seminar tutorial code

E2: Image Processing

week 3
Jan 18

kane09 background subtraction ( Sharaf)

Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B., Rea, A. D., Philipose, M., & LaMarca, A. (2009). Bonfire: A Nomadic System for Hybrid Laptop-tabletop Interaction. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (pp. 129–138). New York, NY, USA: ACM. http://doi.org/10.1145/1622176.1622202

micro-reviews seminar tutorial code

wilson06 connected components ( Lisa)

Wilson, A. D. (2006). Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proceedings of the 19th annual ACM symposium on User interface software and technology (pp. 255–258). New York, NY, USA: ACM. http://doi.org/10.1145/1166253.1166292

micro-reviews seminar tutorial code

harrison11 derivatives ( Jeremy)

Harrison, C., Benko, H., & Wilson, A. D. (2011). OmniTouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology (pp. 441–450). New York, NY, USA: ACM. http://doi.org/10.1145/2047196.2047255

micro-reviews seminar tutorial code

E3: Blobs

week 4
Jan 25

chan15 skin detection ( Blaine)

Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 549-556. http://dx.doi.org/10.1145/2807442.2807450

micro-reviews seminar tutorial code

cao03 colour tracking ( Ten)

Cao, X., & Balakrishnan, R. (2003). VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (pp. 173–182). New York, NY, USA: ACM. http://doi.org/10.1145/964696.964716

micro-reviews seminar tutorial code

truong16 motion detection ( Suman)

Anh Truong, Floraine Berthouzoz, Wilmot Li, and Maneesh Agrawala. 2016. QuickCut: An Interactive Tool for Editing Narrated Video. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 497-507. https://doi.org/10.1145/2984511.2984569

micro-reviews seminar tutorial code

E4: Colour

week 5
Feb 1

Project ideas due

costanza09 adjacency tree ( Miti)

Costanza, E., & Huang, J. (2009). Designable Visual Markers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1879–1888). New York, NY, USA: ACM. http://doi.org/10.1145/1518701.1518990

micro-reviews seminar tutorial code

rekimoto98 fiducial marker tracking ( Ryan)

Rekimoto, J. (1998). Matrix: a realtime object identification and registration method for augmented reality. In Computer Human Interaction, 1998. Proceedings. 3rd Asia Pacific (pp. 63–68). http://doi.org/10.1109/APCHI.1998.704151

micro-reviews seminar tutorial code

li10 simple shape detection ( Sean)

Li, Y., Cao, X., Everitt, K., Dixon, M., & Landay, J. A. (2010). FrameWire: A Tool for Automatically Extracting Interaction Logic from Paper Prototyping Tests. In Proc. CHI (pp. 503–512). New York, NY, USA: ACM. http://doi.org/10.1145/1753326.1753401

micro-reviews seminar tutorial code

E5: Tags

week 6
Feb 8

Project proposal due

barnes08 SIFT tracking ( Jade)

Barnes, C., Jacobs, D. E., Sanders, J., Goldman, D. B., Rusinkiewicz, S., Finkelstein, A., & Agrawala, M. (2008). Video Puppetry: A Performative Interface for Cutout Animation. In ACM SIGGRAPH Asia 2008 Papers (pp. 124:1–124:9). New York, NY, USA: ACM. http://doi.org/10.1145/1457515.1409077

micro-reviews seminar tutorial code

drag08 optical flow ( Siddhartha)

Dragicevic, P., Ramos, G., Bibliowitcz, J., Nowrouzezahrai, D., Balakrishnan, R., & Singh, K. (2008). Video Browsing by Direct Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 237–246). New York, NY, USA: ACM. http://doi.org/10.1145/1357054.1357096

micro-reviews seminar tutorial code

Yang, X.-D., Hasan, K., Bruce, N., & Irani, P. (2013). Surround-see: Enabling Peripheral Vision on Smartphones During Active Use. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (pp. 291–300). New York, NY, USA: ACM. http://doi.org/10.1145/2501988.2502049

E6: Features

week 7
Feb 15

Project literature review due

wilson04 stereo ( Yuwei)

Wilson, A. D. (2004). TouchLight: an imaging touch screen and display for gesture-based interaction. In Proceedings of the 6th international conference on Multimodal interfaces (pp. 69–76). State College, PA, USA: ACM. http://doi.org/10.1145/1027933.1027946

micro-reviews seminar tutorial code

malik04 image rectification ( Ananya)

Malik, S., & Laszlo, J. (2004). Visual touchpad: a two-handed gestural input device. In Proceedings of the 6th international conference on Multimodal interfaces (pp. 289–296). New York, NY, USA: ACM. http://doi.org/10.1145/1027933.1027980

micro-reviews seminar tutorial code

David Kim, Shahram Izadi, Jakub Dostal, Christoph Rhemann, Cem Keskin, Christopher Zach, Jamie Shotton, Timothy Large, Steven Bathiche, Matthias Nießner, D. Alex Butler, Sean Fanello, and Vivek Pradeep. 2014. RetroDepth: 3D silhouette sensing for high-precision input on and above physical surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1377-1386. http://dx.doi.org/10.1145/2556288.2557336

E7: Calibration

Feb 22

No Class: Reading Week

week 8
Mar 1

bailly12 k-curvature finger tracking ( Jane)

Bailly, G., Müller, J., Rohs, M., Wigdor, D., & Kratz, S. (2012). ShoeSense: a new perspective on gestural interaction and wearable applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1239–1248). New York, NY, USA: ACM. http://doi.org/10.1145/2207676.2208576

micro-reviews seminar tutorial code

gorod04 face detection ( Babar)

Gorodnichy, D. O., & Roth, G. (2004). Nouse “use your nose as a mouse” perceptual vision technology for hands-free games and interfaces. Image and Vision Computing, 22(12), 931–942. http://doi.org/10.1016/j.imavis.2004.03.021

micro-reviews seminar tutorial code

Ricardo Jota and Daniel Wigdor. 2015. Palpebrae superioris: exploring the design space of eyelid gestures. In Proceedings of the 41st Graphics Interface Conference (GI '15). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 273-280. http://dl.acm.org/citation.cfm?id=2788938

E8: Tracking

week 9
Mar 8

Project design reviews 1 PM - 5 PM (click to signup)

week 10
Mar 15

raskar98 binary coded structured light ( Bharath)

Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998. The office of the future: a unified approach to image-based modeling and spatially immersive displays. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques (SIGGRAPH '98). ACM, New York, NY, USA, 179-188. http://dx.doi.org/10.1145/280814.280861

micro-reviews seminar tutorial code

jones13 hough planes ( Josh)

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, New York, NY, USA, 637-644. http://doi.acm.org/10.1145/2642918.2647383

micro-reviews seminar tutorial code

Jones, B. R., Benko, H., Ofek, E., & Wilson, A. D. (2013). IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 869–878). New York, NY, USA: ACM. http://doi.org/10.1145/2470654.2466112

week 11
Mar 22

No Class: drop in office hours 1:30 - 4:30 PM in DC 3145

Dixon, M., & Fogarty, J. (2010). Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure. In Proc. of CHI (pp. 1525–1534). http://doi.acm.org/10.1145/1753326.1753554

Weichel, C., Lau, M., Kim, D., Villar, N., & Gellersen, H. W. (2014). MixFab: A Mixed-reality Environment for Personal Fabrication. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (pp. 3855–3864). New York, NY, USA: ACM. http://doi.org/10.1145/2556288.2557090

Kotaro Hara, Jin Sun, Robert Moore, David Jacobs, and Jon Froehlich. 2014. Tohme: detecting curb ramps in google street view using crowdsourcing, computer vision, and machine learning. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, New York, NY, USA, 189-204. http://doi.acm.org/10.1145/2642918.2647403

week 12
Mar 29

Final Demos (click for schedule)

Final project paper and video due Apr 3