INFO 5356-030: Introduction to Human-Robot Interaction
Cornell Tech
Fall 2024, 2022
Course Description
Robots are making their way into our everyday lives, working across many applications including in people’s home, healthcare, and retail settings to name a few. As these systems become more integrated into our lives, they must be designed to be useful, functional, and socially acceptable; however, this remains a key challenge for the field of human-robot interaction (HRI). This course covers core computational, engineering, social challenges, and approaches for effective HRI in human-centered environments. Topics include research methods, robot design and anthromorphization, perception of people, groups and teams, spatial interaction, emotion and intent design in HRI, social signal processing – recognition and synthesis, and augmented and virtual reality (AR/VR) for HRI. Students should expect to learn about seminal research in HRI, gain hands-on experience with physical mobile robots, implement systems for real-time interactions with users, and learn to use digital fabrication tools such as laser cutting and 3D printing.
Prerequisites: CS 2800 or equivalent, experience programming in Python, or permission of the instructor.
Reading: Bartneck, Christoph, Tony Belpaeme, Friederike Eyssel, Takayuki Kanda, Merel Keijsers, and Selma Šabanović. Human-robot interaction: An introduction. Cambridge University Press, 2020.
Introduction to HRI Course
Learning Outcomes
-
Program physical mobile robots to perform complex behaviors for HRI using control architectures.
-
Engage in robot design and prototyping of new robot embodiments and behaviors.
-
Understand important topics in HRI and the impact of robots in real-world settings.
-
Design a gamified user study to measure and evaluate the robot’s effectiveness and user perceptions of the robot.
Introduction to HRI Course
Course Schedule
![Screen Shot 2024-12-21 at 10.10.43 PM.png](https://static.wixstatic.com/media/16ca55_4a5f8f255aa0403ba34465e6a88fa89e~mv2.png/v1/fill/w_980,h_965,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2010_10_43%20PM.png)
Introduction to HRI Course
Robotic Platform for Teaching
![](https://static.wixstatic.com/media/16ca55_778d086a77c644cbbfe7616e28a41971~mv2.webp/v1/fill/w_500,h_500,al_c,q_80,enc_avif,quality_auto/16ca55_778d086a77c644cbbfe7616e28a41971~mv2.webp)
TURTLEBOT4
9kg
Payload Capacity
The HRI course utilized the TurtleBot 4 platform that is built on the iRobot® Create 3 educational robot – a sturdy mobile base that provides an array of intelligent sensors for accurate localization and positioning with a speed up to .3 m/s. The Create 3 has a standalone Robot Operating 2 interface and unlike previous TurtleBots, it includes integrated batteries and a charging dock.
Introduction to HRI Course
Final Projects
We organized a K-12 event in collaboration with the Cornell Tech K-12 initiative team including Diane Levitt, Sophie Lachez, and Meg Ray. 50 NYC Dock Street School students from predominantly underserved communities participated in a 3-hour event. Students in the HRI course demonstrated cumulative knowledge at this event including programming the robot to perform complex behaviors, designing and prototyping a robotic embodiment to capture the role the robot plays in the game, demonstrating their robot with four groups of middle school students, and administering study surveys after games to evaluate how the participants perceived their robot.
Dr. Robot
The robot advances through the human body when participants correctly respond to questions about the human body in a web-based interfaced.
![dr_robot.gif](https://static.wixstatic.com/media/16ca55_4d2272c6dd0e47c998b088da0cf5f24c~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/dr_robot_gif.gif)
![BW-7033.jpg](https://static.wixstatic.com/media/16ca55_4e04b30622b44d33993355c474bc2637~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-7033.jpg)
![BW-7033.jpg](https://static.wixstatic.com/media/16ca55_4e04b30622b44d33993355c474bc2637~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-7033.jpg)
![IMG_1527.HEIC](https://static.wixstatic.com/media/16ca55_8e3229d5800e4fc2913d116513c219eb~mv2.png/v1/fill/w_980,h_1307,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/IMG_1527_HEIC.png)
Mario’s Coin Quest
The robot moves left or right at based on 3D red and green blocks on the ground, and collects coins along the way. The player with the most coins wins!
![marios_coin_quest.gif](https://static.wixstatic.com/media/16ca55_db5b5ccee7a9476f9c428a66025798ed~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/marios_coin_quest_gif.gif)
Pong Soccer
The blue and yellow teams throw balls into the blue and yellow side of the soccer ball to make the robot advance to their goal.
![pong_soccer.gif](https://static.wixstatic.com/media/16ca55_7977594e4a774e8295e275b8a2ff1f63~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/pong_soccer_gif.gif)
Rat Roulette
The robot splits to select a number at a fixed probability and navigates to the participant standing at the selected number and color (red and black) to give them a block of cheese.
![rat_roulette.gif](https://static.wixstatic.com/media/16ca55_55033386d891409387f41a8b2d5fd17c~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/rat_roulette_gif.gif)
RoboSketch
The robot follows a participant to draw a shape on the ground.
![robosketch.gif](https://static.wixstatic.com/media/16ca55_84e957e4975b4d7fbc151851444acb8b~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/robosketch_gif.gif)
![BW-6860.jpg](https://static.wixstatic.com/media/16ca55_9bae32c4980d45e28669aed696781058~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6860.jpg)
![BW-6919.jpg](https://static.wixstatic.com/media/16ca55_aba7bd36e30d474d99b6ccc4e11522f9~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6919.jpg)
![BW-6883.jpg](https://static.wixstatic.com/media/16ca55_5f1d943dc7a841359f21885998b7f4a4~mv2.jpg/v1/fill/w_980,h_1469,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6883.jpg)
![BW-6880.jpg](https://static.wixstatic.com/media/16ca55_ae7fe1cd160e46cea053c2fe1853442d~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6880.jpg)
Red Light, Green Light
The robot says ‘red light’ and participants stop moving, and it says ‘green light’ for participants to move forward. If you move during ‘red light’, you are out!
![greenlight_redlight.gif](https://static.wixstatic.com/media/16ca55_2dd6afb3b6724e3d9bbd80dc93b1c413~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/greenlight_redlight_gif.gif)
![Screen Shot 2024-12-21 at 12.23.07 AM.png](https://static.wixstatic.com/media/16ca55_088051708065477590ee58bb8dce16f1~mv2.png/v1/fill/w_980,h_573,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_23_07%20AM.png)
![Screen Shot 2024-12-21 at 12.23.07 AM.png](https://static.wixstatic.com/media/16ca55_088051708065477590ee58bb8dce16f1~mv2.png/v1/fill/w_980,h_573,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_23_07%20AM.png)
![BW-6905.jpg](https://static.wixstatic.com/media/16ca55_33ba9577317149af824fa1d32f73a671~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6905.jpg)
![Screen Shot 2024-12-21 at 12.24.37 AM.png](https://static.wixstatic.com/media/16ca55_8c7162e6b917437c86430e724be674c5~mv2.png/v1/fill/w_980,h_602,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_24_37%20AM.png)
![Screen Shot 2024-12-21 at 12.24.37 AM.png](https://static.wixstatic.com/media/16ca55_8c7162e6b917437c86430e724be674c5~mv2.png/v1/fill/w_980,h_602,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_24_37%20AM.png)
![BW-6915.jpg](https://static.wixstatic.com/media/16ca55_3b8f69c2bdbf413ab18c0c78b2f7b504~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6915.jpg)
![BW-6964.jpg](https://static.wixstatic.com/media/16ca55_49e92c83873145078b435c7837b03562~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6964.jpg)
![BW-6920.jpg](https://static.wixstatic.com/media/16ca55_861122d8b9cf4bc6a3d8cf28479a1a43~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6920.jpg)
Cat and Mouse
The robot rotates and stops randomly. If you are caught in front of the robot, you are out!
![tomtarget.gif](https://static.wixstatic.com/media/16ca55_d01f7a0474164cada23249beb562e490~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/tomtarget_gif.gif)
![BW-6950.jpg](https://static.wixstatic.com/media/16ca55_5ef80ed38bbe4ff8b16cad58b5ce0be9~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6950.jpg)
![Screen Shot 2024-12-21 at 12.21.08 AM.png](https://static.wixstatic.com/media/16ca55_b88e5f9c1e2a42d59bae08bdc372121c~mv2.png/v1/fill/w_980,h_586,al_c,q_90,usm_0.66_1.00_0.01,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_21_08%20AM.png)
Time's Up!
The robot plays music and participant teams guess where the song comes from using flash cards. The robot detects QR codes to recognize correct or incorrect robot music references. Participants that select the correct music references win!
![times_up.gif](https://static.wixstatic.com/media/16ca55_87b090e48e8043488d480d5e67371919~mv2.gif/v1/fill/w_460,h_522,al_c,pstr/times_up_gif.gif)
![BW-6967.jpg](https://static.wixstatic.com/media/16ca55_2220019cbc1c4c528a364fb5afcfcad2~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6967.jpg)
![BW-6967.jpg](https://static.wixstatic.com/media/16ca55_2220019cbc1c4c528a364fb5afcfcad2~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6967.jpg)
![BW-6957.jpg](https://static.wixstatic.com/media/16ca55_6abb05d7ff6146cda44f7e94e85fc472~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-6957.jpg)
Credits: We thank Niti Parkih, the Cornell Tech MakerLab Director, for providing educational tools for digital fabrication, and William Leon for creating 3D models of the final project robots.
![Screen Shot 2024-12-21 at 12.28.48 AM.png](https://static.wixstatic.com/media/16ca55_9f3a6f419d154b60924ea8a09449a342~mv2.png/v1/fill/w_818,h_428,al_c,q_85,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_28_48%20AM.png)
![Screen Shot 2024-12-21 at 12.28.48 AM.png](https://static.wixstatic.com/media/16ca55_9f3a6f419d154b60924ea8a09449a342~mv2.png/v1/fill/w_818,h_428,al_c,q_85,enc_avif,quality_auto/Screen%20Shot%202024-12-21%20at%2012_28_48%20AM.png)
![BW-7038.jpg](https://static.wixstatic.com/media/16ca55_074c49bfc487420f868b51e69f249783~mv2.jpg/v1/fill/w_980,h_654,al_c,q_85,usm_0.66_1.00_0.01,enc_avif,quality_auto/BW-7038.jpg)