Sequentially Teaching Sequential Tasks ( ST ) 2 : Teaching Robots Long-Horizon Manipulation Skills

IEEE Robotics & Automation Magazine, vol. 33, pp. 130–141

Abstract

Learning from demonstration (LfD) has proved useful for teaching robots complex skills with high sample efficiency. However, teaching long-horizon tasks with multiple skills is challenging as deviations tend to accumulate, the distributional shift becomes more evident, and human teachers become fatigued over time, thereby increasing the likelihood of failure. To address these challenges, we introduce (ST)2a sequential method for learning long-horizon manipulation tasks that allows users to control teaching flow by specifying keypoints, enabling structured and incremental demonstrations. Using this framework, we study how users respond to two teaching paradigms: 1) a traditional monolithic approach in which users demonstrate the entire task trajectory at once, and 2) a sequential approach, in which the task is segmented and demonstrated step by step. We conducted an extensive user study on the restocking task with 16 participants in a realistic retail store environment, evaluating the user preferences and effectiveness of the methods. A user-level analysis showed superior performance for the sequential approach in most cases (10 users), compared with the monolithic approach (five users), with one tie. Our subjective results indicate that some teachers prefer sequential teaching—as it allows them to teach complicated tasks iteratively—or others prefer teaching in one go due to its simplicity.

Authors 4

1. Zlatan Ajanović Aachen Computer Science Department

   RWTH Aachen University

   Affiliation as printed

   Computer Science Department, RWTH Aachen University, Aachen, Germany

2. Ravi Prakash

   Indian Institute of Science Bangalore

   Affiliation as printed

   Cyber Physical Systems, Indian Institute of Science Bengaluru, Bengaluru, India

3. Leandro de Souza Rosa

   University of Bologna

   Affiliation as printed

   Alma Mater Studiorum Università di Bologna, Bologna, Italy

4. Jens Kober

   Delft University of Technology

   Affiliation as printed

   Cognitive Robotics Department, Delft University of Technology, Delft, CD, The Netherlands