Learning Interface of Robot Pepper

Designing a learning environment for a study on social robots in learning contexts.

A research project at Julius-Maximilians-Universität Würzburg

UX/UI design
AI logic
Prompting
Figma

My Role

  • Design & programming of digital learning program
  • Development of educational content and visuals
  • Integration of tablet interface with robot’s behavior

© SoftBank Robotics This initiative is independently conducted by our research team at Julius-Maximilians Universität Würzburg using Pepper by SoftBank Robotics

Context

As part of a research project, we were conducting a study on learning with social robots. We used social robot Pepper as a tutor, teaching participants about First Aid verbally and via its tablet attached to its chest.

The Goal

In order to create the learning environment for the study, the goal was to develop a digital learning interface displayed on Pepper’s tablet and integrate it with the robot’s embodied communication.

Target Group

Adults, ages 18-50

Main characteristics:
busy, cook for themselves, familiar with mobile apps

Learning Objectives

Note: Although the primary goal of the study was not to teach specific content, participants were required to take part in a learning activity to allow for the measurement of learning gain. For this purpose, First Aid was selected as the learning material due to its universal applicability across cultures.

By the end of the tutoring, participants were expected to:

  • Recall and recognize First Aid principles and steps for appropriate First Aid responses, including stabilizing circulation, stopping bleeding, performing CPR, and placing a person in the recovery position.
  • Apply theoretical knowledge to simulated scenarios by identifying suitable actions in multiple-choice and sorting tasks.

Digital Learning Interface

Pepper Learning Interface - Step 1
Pepper Learning Interface - Step 2
Pepper Learning Interface - Step 3
Pepper Learning Interface - Step 4

click to explore the
interface!

The Study

What is the study about?

  • Will you learn better with a robot tutor that has the same cultural background as you?
  • Should we take culture into account when programming social robot’s communication?

What did we do?

Participants learned about First Aid in a study session with robot tutor Pepper. The robot’s cultural communication style either matched or mismatched the participant’s culture. Does that improve learning?

Skills & Learnings

  • Instructional design procedures
  • Research experience
  • Insights into working with social robots

As part of a research project we were conducting a study on learning with social robots.

What is the study about?

  • Will you learn better with a robot tutor that has the same cultural background as you?
  • Should we take culture into account when programming social robot’s communication?

What did we do?

In a study session, social robot Pepper was teaching participants about First Aid as a tutor, both verbally and via a tablet attached to its chest. The robot’s cultural communication style either matched or mismatched the participant’s culture. Does that improve learning?

In order to create the learning environment for the study, the goal was to develop a digital learning interface displayed on Pepper’s tablet and integrate it with the robot’s embodied communication.

International and German university students

Main characteristics: diverse cultural backgrounds, varying language proficiency, experienced in digital learning environments

By the end of the tutoring, participants were expected to:

  • Recall and recognize First Aid principles and steps for appropriate First Aid responses, including stabilizing circulation, stopping bleeding, performing CPR, and placing a person in the recovery position.
  • Apply theoretical knowledge to simulated scenarios by identifying suitable actions in multiple-choice and sorting tasks.

Note: Although the primary goal of the study was not to teach specific content, participants were required to take part in a learning activity to allow for the measurement of learning gain. For this purpose, First Aid was selected as the learning material due to its universal applicability across cultures.

Learning Interface

swipe to explore the interface!

Pepper Learning Interface - Step 1
Pepper Learning Interface - Step 2
Pepper Learning Interface - Step 3
Pepper Learning Interface - Step 4

My Role

  • Design & programming of digital learning program
  • Development of educational content and visuals
  • Integration of tablet interface with robot’s behavior