Algorithmic and Social HRI

Creating robot behaviors that promote safer, more reliable, and more effective interactions with humans

Substantial effort has been invested in expanding the role of robots into a multitude of new domains, from schools, to grocery stores, to warehouses. But as robots are increasingly expected to work in close quarters or even interact with humans, the challenges in human-robot interaction have become more pronounced. Behaviors that allow robots to engage with humans safely, efficiently, and smoothly are difficult to create, which is exacerbated by human perceptions of and responses to robots, which is itself still an open problem.

The goal of this subteam is to create robot behaviors that promote safer, more reliable, and more effective interactions with humans. We use an interdisciplinary approach, leveraging work from cognitive learning theory, cumulative prospect theory, social psychology, and experimental economics to conduct foundational research in human-robot interaction and collaboration.


1. Projects

1.1 Technical Fluency in Human-Agent Interaction

Students: Stéphane Aroca-Ouellette


  • S. Aroca-Ouellette, M. Aroca-Ouellette, U. Biswas, K. Kann, and A. Roncone, “Hierarchical Reinforcement Learning for Ad Hoc Teaming” in Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023. [PDF] [BIB]

Drastic variance in human knowledge, ability, and preference result in rich diversity of human behavior. For successful integration of autonomous agents in human endeavours, these agents must be able to efficiently adapt to a wide range previously unseen collaborators. For example, when working with a less experienced teammate, an agent should likely prioritize understandable behavior over complicated behaviors in order to build trust and allow the teammate to adjust to the task. In contrast, when working with a more experience teammate, the agent can instead focus on more optimal behaviors. To accomplish this, an agent must be able to not have a range of behaviors, but also identify the necessary traits of their partner. In this stream of research, we explore how to imbue autonomous agents with these abilities.

1.2 Reference Dependent Risk Attitudes in HRI

Students: Clare Lohrmann

Prior research has shown that humans struggle to accurately judge the ability of robots. This gap in expectations creates misplaced trust, which can result in disappointment and erosion of trust. We hypothesize that this decrease in trust is caused by the human tendency towards loss aversion. Loss aversion, a part of Prospect Theory, states that people prioritize avoiding losses (or the feeling of loss) over accumulating gains when making decisions. Further work in experimental economics has indicated that “a prior expectation to take on risk decreases aversion to both the anticipated and additional risk”, meaning that when individuals are made aware that they are taking on risk, they experience less loss, and are less risk averse in the future. [Kȍszegi and Rabin, 2007]. In this project, we are testing the applicability of these experimental economics concepts in the context of human-robot interaction, in an effort to limit the expectations gap and promote more positive outcomes. With knowledge of how applicable these concepts are to HRI, along with information about the effects of risk awareness on human behavior with robots, we hope to be able to create new models of robot behavior that guide humans to more accurate perceptions of robot ability, without eroding trust.


Humans have a tendency to underestimate the value of outcomes.

1.3 Student-Robot Teaming and Robots in the Classroom

Students: Kaleb Bishop

Recent work in cognitive learning theory and social psychology present new opportunities to improve and rethink the application of robots in the classroom. Why are robots such powerful agents of tutoring, and how can we use their unique social roles to develop student skills in reading, STEM, and beyond, and address educational inequality across lines of race, gender, and ability? Current projects, conducted in conjunction with the NSF AI Institute for Student-AI Teaming (iSAT) and the Engineering Education and AI-Augmented Learning IRT, include study into HRI design considerations for students of color and developing a robot tutoring system to address grounded reading skills.


iSAT's vision for student-AI teaming and classroom orchestration.

1.4 Task and Role Assignment for Human Robot Collaboration

To incorporate robots into human teams, robots need explainable task representations and better understanding of the social dynamics of the human team to be an effective member. Our goal is to equip the robot with the ability to insert itself into an existing human team to promote collaboration and improve efficiency. How can the robot decompose complex tasks and find the optimal role assignments for the team? How does the robot balance the preferences of the human and the optimality of the task assignment? How does the robot know what roles to take?

Students: Yi-Shiuan Tung

1.5 Robotic Intent Signaling System

Students: Mitchell Scott, Shreyas Kadekodi, Caleb Escobedo, Clare Lohrmann

The creation of information channels between robots and humans is complicated and fraught with potential pitfalls; the goal being a simplistic system that effectively carries information from one party to another consistently and clearly. While much work has gone into creating robot signals and modes of communication, most research seeks to answer the question “Does this system communicate what it was intended to?”, be it the robot’s path, intent, or status. Research is conducted in a controlled environment, so the applicability of these systems to environments constrained by space or time is unknown. We are currently examining the effectiveness of a projection-based trajectory system in a cluttered and fast paced environment. Through this work we hope to determine when this method of communication is most effective, and if/when the environment becomes too crowded or too fast moving for the communication to be effective.

2. Publications

2023 International Conference on Autonomous Agents and Multiagent Systems [AAMAS]

London, Uk, May 28-June 02

Hierarchical Reinforcement Learning for Ad Hoc Teaming [PDF] [BIB]

Stéphane Aroca-Ouellette, Miguel Aroca-Ouellette, Upasana Biswas, Katharina Kann, Alessandro Roncone
Extended abstract

2023 ACM/IEEE International Conference on Human-Robot Interaction [HRI]

Stockholm, Sweden, March 13-16

Interactive Policy Shaping for Human-Robot Collaboration with Transparent Matrix Overlays [PDF] [BIB]

Jake Brawer, Debasmita Ghose, Kate Candon, Meiying Qin, Alessandro Roncone, Marynel Vázquez, and Brian Scassellati

Best Technical Paper Award!!

2023 6th International Workshop on Virtual, Augmented, and Mixed-Reality for Human-Robot Interactions (VAM-HRI)

Stockholm, Sweden, March 13

Improving Human Legibility in Collaborative Robot Tasks through Augmented Reality and Workspace Preparation [PDF] [BIB]

Yi-Shiuan Tung, Matthew B. Luebbers, Alessandro Roncone, Bradley Hayes

2023 Workshop on Language-Based AI Agent Interaction with Children [AIAIC]

Los Angeles, USA, February 21

Designing an AI Partner for Jigsaw classrooms [PDF] [BIB]

Jie Cao, Rachel Dickler, Marie Grace, Jeffrey B. Bush, Alessandro Roncone, Leanne M. Hirshfield, Marilyn A. Walker, Martha S. Palmer

2022 IEEE International Conference on Robot & Human Interactive Communication

Naples, Italy, August 29

Bilevel Optimization for Just-in-Time Robotic Kitting and Delivery via Adaptive Task Segmentation and Scheduling [PDF] [BIB]

Yi-Shiuan Tung, Kayleigh Bishop, Bradley Hayes, Alessandro Roncone

2022 Frontiers in Robotics and AI

How to be Helpful? Supportive Behaviors and Personalization for Human-Robot Collaboration [PDF] [BIB]

Olivier Mangin, Alessandro Roncone, and Brian Scassellati

2021 ACM International Conference on Human-Robot Interaction [HRI], Workshop on Robots for Learning

Boulder, CO, U.S.A., March 12

Teaching Grounded Reading Skills via an Interactive Robot Tutor [PDF] [BIB]

Kayleigh "Kaleb" Bishop, Bradley Hayes, Alessandro Roncone

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems [IROS]

Madrid, Spain, October 1-5

Situated Human-Robot Collaboration: predicting intent from grounded natural language [PDF] [BIB]

Jake Brawer, Olivier Mangin, Alessandro Roncone, and Brian Scassellati

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems [IROS]

Madrid, Spain, October 1-5

Preference-Based Assistance Prediction for Human-Robot Collaboration Tasks [PDF] [BIB]

Elena Corina Grigore, Alessandro Roncone, Olivier Mangin, and Brian Scassellati

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems [IROS]

Madrid, Spain, October 1-5

The HRC Model set for Human-Robot Collaboration Research [PDF] [BIB]

Sofya Zeylikman, Sarah Widder, Alessandro Roncone, Olivier Mangin, and Brian Scassellati

2018 International Conference on Autonomous Agents and Multiagent Systems [AAMAS]

Stockholm, Sweden, July 11-13

Predicting Supportive Behaviors for Human-Robot Collaboration [PDF] [BIB]

Elena Corina Grigore, Olivier Mangin, Alessandro Roncone, and Brian Scassellati
Extended abstract

2017 IEEE International Conference on Robotics and Automation [ICRA]

Singapore, Singapore May 29-June 3

Transparent Role Assignment and Task Allocation in Human Robot Collaboration [PDF] [BIB]

Alessandro Roncone, Olivier Mangin, and Brian Scassellati