Graduation Semester and Year
2021
Language
English
Document Type
Thesis
Degree Name
Master of Science in Computer Engineering
Department
Computer Science and Engineering
First Advisor
Manfred Huber
Abstract
Programming robot systems to perform certain tasks is a big challenge especially if such programming is to be performed by persons who are not experts in robotics. For example, when programming a robot to serve as an exercise trainer, the person defining the motions might more naturally be a person in the exercise domain rather than a robotics expert. To address this, this thesis investigates programming by demonstration or teleoperation using full direct body motion. The goal is to reproduce gaits, gestures, and postures on a humanoid robot from observed human demonstrations. Fine motor movements such as movement of fingers will be excluded from this thesis’ paradigm. Mimicking said such movements is straight forward if human and robot dynamics and kinematics are the same. The robot can move exactly like how his human demonstrator moves. This, however, is never the case, thus leading to a multidimensional correspondence problem. In this thesis an approach is presented that attempts to resolve this by addressing four components. First it addresses linking the degrees of freedom of two similar but different bodies, the human, and a humanoid robot. Second, it handles linking the image frame related to the observation of the demonstrator to the demonstrator structure to be able to track locations that have changed, using 3D computer vision with a human skeleton model. As such skeleton observations are usually noisy, a third process is aimed at of filtering out sensor noise and recognition errors, resulting in an observed motion trajectory. Lastly, to account for the differences between the human and robotic bodies both in terms of kinematics and dynamic stability, a modeling and learning framework, PILCO, is adapted to address mapping into an executable imitation that obeys the stability requirements and limitations of the humanoid robot system.
Keywords
Robotics, Machine learning
Disciplines
Computer Sciences | Physical Sciences and Mathematics
License
This work is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 4.0 International License.
Recommended Citation
Villa, Francisco, "ADAPTIVE HUMAN-ROBOT MOTION TRANSFER FOR COMPLETE BODY IMITATION" (2021). Computer Science and Engineering Theses. 382.
https://mavmatrix.uta.edu/cse_theses/382
Comments
Degree granted by The University of Texas at Arlington