Graduation Semester and Year
2017
Language
English
Document Type
Dissertation
Degree Name
Doctor of Philosophy in Computer Science
Department
Computer Science and Engineering
First Advisor
Fillia Makedon
Abstract
A traffic accident, a battlefield injury, or a stroke can lead to brain or musculoskeletal injuries that impact motor and cognitive functions and can drastically change a person's life. In such situations, rehabilitation plays a critical role in the ability of the patient to partially or totally regain motor function, but the optimal training approach remains unclear. Robotic technologies are recognized as powerful tools to promote neuroplasticity and stimulate motor re-learning. Moreover, they deliver high-intensity, repetitive, active and task-oriented training; in addition, they provide objective measurements for patient evaluation. The primary focus of this research is to investigate the development of a safe human-robot interaction assessment and training system by utilizing physiological, kinematic and dynamic modalities. Such system places the user in the robot's control loop, by feeding back a patient's biomechanical, physiological and cognitive states. A proposed vision-based upper-limb monitoring system and a developed adaptive haptic guidance control mechanism will involve human intentions to generate adaptive perception and behaviors for the Barrett WAM robotic arm. To facilitate this, a combined integration of computer vision, artificial intelligence, and human-robot interaction research are employed on the multi-sensing robotic platform. Computational methods for a multimodal upper-limb robot-aided system are proposed in this dissertation; first, a virtual reality environment that assesses the user's physiological and psychological stages; second, an interface capable of estimating a patient's performance utilizing motion analysis and pattern recognition methods; third, an unobtrusive method for reconstructing upper-limb kinematics during robot-aided tasks with end-effector machines using Microsoft Kinect's skeletal tracking is presented and experimentally validated; fourth, an adaptive haptic guidance robotic controller is employed to modulate the complexity of the assigned motor tasks and increase the hand coordination abilities of the user. Finally, we show seven applications of robots in assistive environments, and we present the human-robot interaction usability case studies that are critical evaluation components of this thesis.
Keywords
Robotics, Haptics, Computer vision, Artificial intelligence, Human-robot interaction
Disciplines
Computer Sciences | Physical Sciences and Mathematics
License
This work is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 4.0 International License.
Recommended Citation
Lioulemes, Alexandros, "An Intelligent Multimodal Upper-Limb Rehabilitation Robotic System" (2017). Computer Science and Engineering Dissertations. 349.
https://mavmatrix.uta.edu/cse_dissertations/349
Comments
Degree granted by The University of Texas at Arlington