Language Control

User Sessions

The user study had 12 participants (7 males, 5 females, mean age 23). The UR5 robot guided users through a predefined trajectory demonstrated by the therapist. Users sat beside the robot, placed their hand on the desk. The robot guided their hand along the trajectory with speech instructions while users varied resistance arbitrarily.

Control Schemes Evaluated and Compared

  • Admittance Controller with Decoupled Audio (AC): This baseline is a pure admittance controller. The audio is a single prerecorded audio file that starts simultaneously with the trajectory. Physical and Audio Paces are not modulated at all.
  • Language Controller without Adaptive Paraphrasing (LC-noAP): Our controller but without the ability to adaptively paraphrase the speech.
  • Language Controller (LC): Our controller with adaptive paraphrasing by traversing a phrase graph.

User 1

ACLC-noAPLC

User 2

ACLC-noAPLC

User 3

ACLC-noAPLC

User 4

ACLC-noAPLC

User 5

ACLC-noAPLC

User 6

ACLC-noAPLC

User 7

ACLC-noAPLC

User 8

ACLC-noAPLC

User 9

ACLC-noAPLC

User 10

ACLC-noAPLC

User 11

ACLC-noAPLC

User 12

ACLC-noAPLC