Associate Professor

Research interests

photo of Professor Jesse HoeyDr. Jesse Hoey is an associate professor in the David R. Cheriton School of Computer Science at the University of Waterloo, where he leads the Computational Health Informatics Laboratory (CHIL). He is also an adjunct scientist at the Toronto Rehabilitation Institute in Toronto, Canada, where he is co-leader of the AI and Robotics Research Team. He develops artificially intelligent (AI) agents that are socially and emotionally aware, such that they can work in harmony with human partners, while respecting ethical, moral and normative orders in society.  

A key area of application for emotionally aligned AI agents is collaborative networks. Understanding the social forces behind self-organized collaboration is increasingly important in today’s society. More than ever, technological and social innovations are enabled by information and communication technologies and are generated through informal, distributed processes of collaboration, rather than in formal, hierarchical or market-based organizations.

Affect (emotion) is an essential element that fosters and promotes group cohesion and collaboration. Shared responsibility and positive affective interactions make the group salient and endow it with a moral and normative force upon the individual group members. Groups thus endowed are powerful agents for the mobilization of collaborative human efforts and collective action. Dr.Hoey's vision is to build intelligent computational agents that parsimoniously integrate both emotion and cognition, that are able to become members of an emerging socio-technical world.

Professor Hoey's research is funded in part by the AGEWELL NCE, the Canadian Foundation for Innovation, the American Alzheimer's Association, the Social Sciences and Humanities Research Council of Canada and the Natural Sciences and Engineering Research Council of Canada. He collaborates closely with researchers in Canada (Toronto, Guelph, Sherbrooke, UBC), the USA (Duke, Indiana, Georgia), the UK (Newcastle, Dundee, Belfast, Heriot-Watt, Edinburgh), France (INRIA/Sophia-Antipolis), Germany (Bielefeld, Potsdam, Rostock), and Mexico (Puebla, Cuernevaca, Ensenada). His recent projects include a Bayesian generalisation of Affect Control Theory, an emotionally aware tutoring system, and emotionally aware camera-based system to help persons with dementia during handwashing, and socially aware ambient displays that help with communication and situation awareness for persons with dementia.

Degrees and awards

  • BSc (McGill), MSc, PhD (British Columbia)
  • American Sociological Association Section on Mathematical Sociology Outstanding Article Award (2016)
  • American Sociological Association Section on Social Psychology Outstanding Recent Contribution in Social Psychology Paper Award (2016)
  • Microsoft/AAAI Distinguished Contribution Award, IJCAI Workshop on Assisted Cognition (2009)
  • Best Paper Award, International Conference on Computer Vision Systems (2007)

Industrial and sabbatical experience

Professor Hoey spent four years in Scotland as an Assistant Professor in the School of Computing at the University of Dundee. In 2014-2015, he spent a sabbatical year with the STARS (Spatio-Temporal Activity Recognition Systems) Research Group at INRIA in Sophia-Antipolis, France. In 2015, he was a guest lecturer at the Potsdam University of Applied Sciences.

Representative publications

Jesse Hoey, Tobias Schroeder, Jonathan H. Morgan, Kimberly B. Rogers, Deepak Rishi and Meiyappan Nagappan. Artificial Intelligence and Social Simulation: Studying Group Dynamics on a Massive Scale. Small Group Research, 49, 6, December, 2018

Julie M Robillard and Jesse Hoey. Emotion and Motivation in Cognitive Assistive Technologies for Dementia. Computer, 51, 3, March, 2018

Wasif Khan and Jesse Hoey. How Different Identities Affect Cooperation. Proc.s of the Humaine Association Conference on Affective Computing and Intelligent Interaction, San Antonio, TX, 2017

Stefan Teipel, Claudio Babiloni, Jesse Hoey, Jeffrey Kaye, Thomas Kirste and Oliver Burmeister. Information and Communication Technology Solutions for Outdoor Navigation in Dementia. Alzheimer's and Dementia, 12, 6, June, 2016

Jesse Hoey, Tobias Schroeder and Areej Alhothali. Affect control processes: Intelligent Affective Interaction using a Partially Observable Markov Decision Process. Artificial Intelligence, 230, 2016

Tobias Schroeder, Jesse Hoey and Kimberly B. Rogers. Modeling Dynamic Identities and Uncertainty in Social Interactions: Bayesian Affect Control Theory. American Sociological Review, 81, 4, 2016

Areej Alhothali and Jesse Hoey. Good News or Bad News: Using Affect Control Theory to Analyze Readers Reaction Towards News Articles. Proc. Conference of the North American Chapter of the Association for Computational Linguistics — Human Language Technologies (NAACL HLT), Denver, CO, 2015

Nabiha Asghar and Jesse Hoey. Intelligent Affect: Rational Decision Making for Socially Aligned Agents. Proceedings of Uncertainty in Artificial Intelligence, Amsterdam, 2015

Jesse Hoey and Tobias Schroeder. Bayesian Affect Control Theory of Self. Proc. AAAI Conference on Artificial Intelligence, Austin, Texas, 2015

Michelle E. Karg, Ali-Akbar Samadani, Rob Gorbet, Kolja Kuhnlenz , Jesse Hoey and Dana Kulic Body. Movements for Affective Expression: A Survey of Automatic Recognition and Generation. IEEE Transactions on Affective Computing, 2014

George Zhu, Daniel Lizotte and Jesse Hoey. Scalable Approximate Policies for Markov Decision Process Models of Hospital Elective Admissions. Artificial Intelligence in Medicine, 61, 2014

Marek Grzes, Pascal Poupart and Jesse Hoey. Isomorph-free Branch and Bound Search for Finite State Controllers. Proceedings of International Joint Conference on Artificial Intelligence, Beijing, China, 2013

Jesse Hoey, Craig Boutilier, Pascal Poupart, Patrick Olivier, Andrew Monk and Alex Mihailidis. People, Sensors, Decisions: Customizable and Adaptive Technologies for Assistance in Healthcare. ACM Transactions on Interactive Intelligent Systems, 2, 4, New York, NY, December, 2012

Liming Chen, Jesse Hoey, Chris D. Nugent, Diane Cook and Zhiwen Yu. Sensor-Based Activity Recognition. IEEE Transactions on Systems, Man, and Cybernetics – Part C: Applications and Reviews, 42, 6, 2012

Affiliation: 
University of Waterloo
Contact information: