%0 Journal Article %J Device %D 2023 %T Fluidically programmed wearable haptic textiles %A Barclay Jumet %A Zane A. Zook %A Anas Yousaf %A Anoop Rajappan %A Doris Xu %A Te Faye Yap %A Nathaniel Fino %A Zhen Liu %A Marcia K. O’Malley %A Daniel J. Preston %K analog control %K fluidic control %K haptic sleeve %K human-machine interaction %K human-robot interaction %K Navigation %K point force %K smart textiles %K spatiotemporal haptics %K tactile cues %X

Summary Haptic feedback offers a useful mode of communication in visually or auditorily noisy environments. The adoption of haptic devices in our everyday lives, however, remains limited, motivating research on haptic wearables constructed from materials that enable comfortable and lightweight form factors. Textiles, a material class fitting these needs and already ubiquitous in clothing, have begun to be used in haptics, but reliance on arrays of electromechanical controllers detracts from the benefits that textiles offer. Here, we mitigate the requirement for bulky hardware by developing a class of wearable haptic textiles capable of delivering high-resolution information on the basis of embedded fluidic programming. The designs of these haptic textiles enable tailorable amplitudinal, spatial, and temporal control. Combining these capabilities, we demonstrate wearables that deliver spatiotemporal cues in four directions with an average user accuracy of 87%. Subsequent demonstrations of washability, repairability, and utility for navigational tasks exemplify the capabilities of our approach.

%B Device %P 100059 %G eng %U https://www.sciencedirect.com/science/article/pii/S2666998623000832 %R https://doi.org/10.1016/j.device.2023.100059 %> https://mahilab.rice.edu/sites/default/files/publications/DeviceJumet2023.pdf %0 Journal Article %J Science Robotics %D 2023 %T Touching reality: Bridging the user-researcher divide in upper-limb prosthetics %A J. D. Brown %A E. Battaglia %A S. Engdahl %A G. Levay %A A. C. Parks %A E. Skinner %A M. K. O’Malley %X

Realistically improving upper-limb prostheses is only possible if we listen to users’ actual technological needs. Realistically improving upper-limb prostheses is only possible if we listen to users' actual technological needs.

%B Science Robotics %V 8 %P eadk9421 %G eng %U https://www.science.org/doi/abs/10.1126/scirobotics.adk9421 %R 10.1126/scirobotics.adk9421 %> https://mahilab.rice.edu/sites/default/files/publications/SciRoboticsBrown2023_prosthesis_users.pdf %0 Journal Article %J Journal of Endovascular Therapy %D 2022 %T Evaluation of Robotic-Assisted Carotid Artery Stenting in a Virtual Model Using Motion-Based Performance Metrics %A Legeza, Peter T %A Lettenberger, Ahalya B %A Murali, Barathwaj %A Johnson, Lianne R %A Berczeli, Marton %A Byrne, Michael D %A Britz, Gavin %A O’Malley, Marcia K %A Lumsden, Alan B %B Journal of Endovascular Therapy %P 15266028221125592 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Legaza_JET2022.pdf %0 Journal Article %J The International Journal of Robotics Research %D 2022 %T Physical interaction as communication: Learning robot objectives online from human corrections %A Dylan P. Losey %A Andrea Bajcsy %A Marcia K. O’Malley %A Anca D. Dragan %X

When a robot performs a task next to a human, physical interaction is inevitable: the human might push, pull, twist, or guide the robot. The state of the art treats these interactions as disturbances that the robot should reject or avoid. At best, these robots respond safely while the human interacts; but after the human lets go, these robots simply return to their original behavior. We recognize that physical human–robot interaction (pHRI) is often intentional: the human intervenes on purpose because the robot is not doing the task correctly. In this article, we argue that when pHRI is intentional it is also informative: the robot can leverage interactions to learn how it should complete the rest of its current task even after the person lets go. We formalize pHRI as a dynamical system, where the human has in mind an objective function they want the robot to optimize, but the robot does not get direct access to the parameters of this objective: they are internal to the human. Within our proposed framework human interactions become observations about the true objective. We introduce approximations to learn from and respond to pHRI in real-time. We recognize that not all human corrections are perfect: often users interact with the robot noisily, and so we improve the efficiency of robot learning from pHRI by reducing unintended learning. Finally, we conduct simulations and user studies on a robotic manipulator to compare our proposed approach with the state of the art. Our results indicate that learning from pHRI leads to better task performance and improved human satisfaction.

%B The International Journal of Robotics Research %V 41 %P 02783649211050958 %8 Jan 2022 %G eng %U https://doi.org/10.1177/02783649211050958 %& 20-44 %R 10.1177/02783649211050958 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_IJRR2021.pdf %0 Conference Proceedings %B 2021 43rd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC) %D 2021 %T Comparing Manual and Robotic-Assisted Carotid Artery Stenting Using Motion-Based Performance Metrics %A Lettenberger, Ahalya B. %A Murali, Barathwaj %A Legeza, Peter %A Byrne, Michael D. %A Lumsden, Alan B. %A O’Malley, Marcia K. %B 2021 43rd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC) %P 1388-1391 %8 2021 %G eng %R 10.1109/EMBC46164.2021.9630895 %> https://mahilab.rice.edu/sites/default/files/publications/Lettenberger_EMBC_2021_motion-based-metrics-manual-robot.pdf %0 Journal Article %J IEEE Transactions on Haptics %D 2021 %T Effects of Interfering Cue Separation Distance and Amplitude on the Haptic Detection of Skin Stretch %A Low, Andrew Kin Wei %A Zook, Zane %A Fleck, Joshua %A O'Malley, Marcia K %X

Multi-sensory haptic cues, which contain several types of tactile stimuli that are presented concurrently to the user, have been shown to be useful for conveying information-rich cues. One limitation of multi-sensory cues is that user perception of individual cue components can be hindered by more salient components of the composite cue. In this paper, we investigate how amplitude and distance between cues affect the perception of multi-sensory haptic cues. Specifically, participants' absolute threshold perception of stretch cues was measured in the presence of interfering squeeze cues using a modular testbed. We evaluated ten conditions of varying interference amplitude and distance between cues. We found that interference cue amplitude and distance between cues both have a statistically significant effect on the absolute perception of stretch cues. As interference cue amplitude increases, and as distance between cues decreases, absolute perception of stretch cues worsens. These results inform design considerations for future wearable multi-sensory haptic devices, so that cue salience can be maximized and interference effects minimized.

%B IEEE Transactions on Haptics %V 14 %P 254-259 %8 April-June 2021 %G eng %U https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4543165https://ieeexplore.ieee.org/document/9415164/http://xplorestaging.ieee.org/ielx7/4543165/4543166/09415164.pdf?arnumber=9415164 %! IEEE Trans. Haptics %R 10.1109/TOH.454316510.1109/TOH.2021.3075387 %> https://mahilab.rice.edu/sites/default/files/publications/Low_ToH2021.pdf %0 Journal Article %J IEEE Transactions on Haptics %D 2020 %T Multi-Sensory Stimuli Improve Distinguishability of Cutaneous Haptic Cues %A Sullivan, Jennifer L %A Dunkelberger, Nathan %A Bradley, Joshua %A Young, Joseph %A Israr, Ali %A Lau, Frances %A Klumb, Keith %A Abnousi, Freddy %A O'Malley, Marcia K %B IEEE Transactions on Haptics %V 13 %P 286-297 %8 April-June 2020 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Sullivan_ToH_2020_multi-sensory.pdf %0 Journal Article %J NeuroImage: Clinical %D 2020 %T Neural activity modulations and motor recovery following brain-exoskeleton interface mediated stroke rehabilitation %A Nikunj A. Bhagat %A Nuray Yozbatiran %A Jennifer L. Sullivan %A Ruta Paranjape %A Colin Losey %A Zachary Hernandez %A Zafer Keser %A Robert Grossman %A Gerard E. Francisco %A Marcia K. O'Malley %A Jose L. Contreras-Vidal %K Brain-machine interface %K Clinical trial %K Exoskeletons %K Movement related cortical potentials %K stroke rehabilitation %X

Brain-machine interfaces (BMI) based on scalp EEG have the potential to promote cortical plasticity following stroke, which has been shown to improve motor recovery outcomes. However, the efficacy of BMI enabled robotic training for upper-limb recovery is seldom quantified using clinical, EEG-based, and kinematics-based metrics. Further, a movement related neural correlate that can predict the extent of motor recovery still remains elusive, which impedes the clinical translation of BMI-based stroke rehabilitation. To address above knowledge gaps, 10 chronic stroke individuals with stable baseline clinical scores were recruited to participate in 12 therapy sessions involving a BMI enabled powered exoskeleton for elbow training. On average, 132 ± 22 repetitions were performed per participant, per session. BMI accuracy across all sessions and subjects was 79 ± 18% with a false positives rate of 23 ± 20%. Post-training clinical assessments found that FMA for upper extremity and ARAT scores significantly improved over baseline by 3.92 ± 3.73 and 5.35 ± 4.62 points, respectively. Also, 80% participants (7 with moderate-mild impairment, 1 with severe impairment) achieved minimal clinically important difference (MCID: FMA-UE >5.2 or ARAT >5.7) during the course of the study. Kinematic measures indicate that, on average, participants’ movements became faster and smoother. Moreover, modulations in movement related cortical potentials, an EEG-based neural correlate measured contralateral to the impaired arm, were significantly correlated with ARAT scores (ρ = 0.72, p < 0.05) and marginally correlated with FMA-UE (ρ = 0.63, p = 0.051). This suggests higher activation of ipsi-lesional hemisphere post-intervention or inhibition of competing contra-lesional hemisphere, which may be evidence of neuroplasticity and cortical reorganization following BMI mediated rehabilitation therapy.

%B NeuroImage: Clinical %V 28 %P 102502 %G eng %U http://www.sciencedirect.com/science/article/pii/S2213158220303399 %R https://doi.org/10.1016/j.nicl.2020.102502 %> https://mahilab.rice.edu/sites/default/files/publications/NeuroImage_2020_Bhagat_BMI_EEG_exo.pdf %0 Conference Proceedings %B 2019 IEEE World Haptics Conference (WHC)2019 IEEE World Haptics Conference (WHC) %D 2019 %T A Cutaneous Haptic Cue Characterization Testbed %A Fleck, Joshua J. %A Zook, Zane A. %A Andrew Low %A O'Malley, Marcia K. %B 2019 IEEE World Haptics Conference (WHC)2019 IEEE World Haptics Conference (WHC) %I IEEE %C Tokyo, Japan %G eng %U https://ieeexplore.ieee.org/document/8816086/http://xplorestaging.ieee.org/ielx7/8807988/8816072/08816086.pdf?arnumber=8816086 %R 10.1109/WHC.2019.8816086 %> https://mahilab.rice.edu/sites/default/files/publications/A_Cutaneous_Haptic_Cue_Characterization_Testbed_smaller_0.pdf %0 Conference Proceedings %B 2019 IEEE World Haptics Conference (WHC)2019 IEEE World Haptics Conference (WHC) %D 2019 %T Effect of Interference on Multi-Sensory Haptic Perception of Stretch and Squeeze %A Zook, Zane A. %A Fleck, Joshua J. %A Andrew Low %A O'Malley, Marcia K. %B 2019 IEEE World Haptics Conference (WHC)2019 IEEE World Haptics Conference (WHC) %I IEEE %C Tokyo, Japan %G eng %U https://ieeexplore.ieee.org/document/8816139/http://xplorestaging.ieee.org/ielx7/8807988/8816072/08816139.pdf?arnumber=8816139 %R 10.1109/WHC.2019.8816139 %> https://mahilab.rice.edu/sites/default/files/publications/Effect-Interference-Zook.pdf %0 Journal Article %J IEEE Robotics and Automation Letters %D 2019 %T Enabling Robots to Infer how End-Users Teach and Learn through Human-Robot Interaction %A Losey, Dylan P %A O'Malley, Marcia K %B IEEE Robotics and Automation Letters %V 4 %P 1956-1963 %8 2019 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Losey_RAL2019.pdf %0 Journal Article %J Journal of Rehabilitation and Assistive Technologies Engineering %D 2019 %T Improving short-term retention after robotic training by leveraging fixed-gain controllers %A Dylan P Losey %A Laura H Blumenschein %A Janelle P Clark %A Marcia K O’Malley %K Control systems %K haptic device %K motor learning %K neurorehabilitation %K Robot-assisted rehabilitation %X

IntroductionWhen developing control strategies for robotic rehabilitation, it is important that end-users who train with those strategies retain what they learn. Within the current state-of-the-art, however, it remains unclear what types of robotic controllers are best suited for promoting retention. In this work, we experimentally compare short-term retention in able-bodied end-users after training with two common types of robotic control strategies: fixed- and variable-gain controllers.MethodsOur approach is based on recent motor learning research, where reward signals are employed to reinforce the learning process. We extend this approach to now include robotic controllers, so that participants are trained with a robotic control strategy and auditory reward-based reinforcement on tasks of different difficulty. We then explore retention after the robotic feedback is removed.ResultsOverall, our results indicate that fixed-gain control strategies better stabilize able-bodied users’ motor adaptation than either a no controller baseline or variable-gain strategy. When breaking these results down by task difficulty, we find that assistive and resistive fixed-gain controllers lead to better short-term retention on less challenging tasks but have opposite effects on the learning and forgetting rates.ConclusionsThis suggests that we can improve short-term retention after robotic training with consistent controllers that match the task difficulty.

%B Journal of Rehabilitation and Assistive Technologies Engineering %V 6 %8 01/2019 %G eng %U https://doi.org/10.1177/2055668319866311 %R 10.1177/2055668319866311 %> https://mahilab.rice.edu/sites/default/files/publications/Losey2019RATE.pdf %0 Journal Article %J ACM Transactions on Human-Robot Interaction (THRI) %D 2019 %T Learning the Correct Robot Trajectory in Real-Time from Physical Human Interactions %A Losey, Dylan P %A O'Malley, Marcia K %B ACM Transactions on Human-Robot Interaction (THRI) %V 9 %P 1 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Losey_ACMTHRI_2019.pdf %0 Conference Proceedings %B 2019 International Conference on Robotics and Automation (ICRA) %D 2019 %T On the role of wearable haptics for force feedback in teleimpedance control for dual-arm robotic teleoperation %A Clark, Janelle P %A Lentini, Gianluca %A Barontini, Federica %A Catalano, Manuel G %A Bianchi, Matteo %A O’Malley, Marcia K %X Robotic teleoperation enables humans to safely complete exploratory procedures in remote locations for applications such as deep sea exploration or building assessments following natural disasters. Successful task completion requires meaningful dual arm robotic coordination and proper understanding of the environment. While these capabilities are inherent to humans via impedance regulation and haptic interactions, they can be challenging to achieve in telerobotic systems. Teleimpedance control has allowed impedance regulation in such applications, and bilateral teleoperation systems aim to restore haptic sensation to the operator, though often at the expense of stability or workspace size. Wearable haptic devices have the potential to apprise the operator of key forces during task completion while maintaining stability and transparency. In this paper, we evaluate the impact of wearable haptics for force feedback in teleimpedance control for dual-arm robotic teleoperation. Participants completed a peg-in-hole, box placement task, aiming to seat as many boxes as possible within the trial period. Experiments were conducted both transparent and opaque boxes. With the opaque box, participants achieved a higher number of successful placements with haptic feedback, and we saw higher mean interaction forces. Results suggest that the provision of wearable haptic feedback may increase confidence when visual cues are obscured. %B 2019 International Conference on Robotics and Automation (ICRA) %I IEEE %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Clark_2019_ICRA_TeleimpedanceWithHaptics_0.pdf %0 Journal Article %J ASME Applied Mechanics Reviews %D 2018 %T Closure to “A review of intent detection, arbitration, and communication aspects of shared control for physical human-robot interaction" %A Dylan P. Losey %A Craig G. McDonald %A Edoardo Battaglia %A Marcia K. O'Malley %X

In their discussion article on our review paper, Professors James Schmiedeler and Patrick Wensing have provided an insightful and informative perspective of the roles of intent detection, arbitration, and communication as three pillars of a framework for the implementation of shared control in physical human–robot interaction (pHRI). The authors both have significant expertise and experience in robotics, bipedal walking, and robotic rehabilitation. Their commentary introduces commonalities between the themes of the review paper and issues in locomotion with the aid of an exoskeleton or lower-limb prostheses, and presents several important topics that warrant further exploration. These include mechanical design as it pertains to the physical coupling between human and robot, modeling the human to improve intent detection and the arbitration of control, and finite-state machines as an approach for implementation. In this closure, we provide additional thoughts and discussion of these topics as they relate to pHRI.

%B ASME Applied Mechanics Reviews %V 70 %8 02/2018 %G eng %U http://appliedmechanicsreviews.asmedigitalcollection.asme.org/article.aspx?articleID=2672398 %R 10.1115/1.4039225 %> https://mahilab.rice.edu/sites/default/files/publications/amr_2018_closure.pdf %0 Conference Proceedings %B International Symposium on Wearable Computing ISWC %D 2018 %T Conveying Language Through Haptics: A Multi-sensory Approach %A Dunkelberger, Nathan %A Sullivan, Jenny %A Bradley, Joshua %A Walling, Nickolas P %A Manickam, Indu %A Dasarathy, Gautam %A Israr, Ali %A Lau, Frances W. Y. %A Klumb, Keith %A Knott, Brian %A Abnousi, Freddy %A Baraniuk, Richard %A O'Malley, Marcia K %K haptics %K multi-sensory %K speech %K wearable %B International Symposium on Wearable Computing ISWC %I ACM %C Singapore %8 10/2018 %@ 978-1-4503-5967-2 %G eng %U http://doi.acm.org/10.1145/3267242.3267244 %R 10.1145/3267242.3267244 %> https://mahilab.rice.edu/sites/default/files/publications/NathanDunkelberger_ISWC.pdf %0 Journal Article %J Journal of vascular surgery %D 2018 %T Electromagnetic tracking of flexible robotic catheters enables "assisted navigation" and brings automation to endovascular navigation in an in vitro study %A Schwein, Adeline %A Kramer, Benjamin %A Chinnadurai, Ponraj %A Virmani, Neha %A Walker, Sean %A O'Malley, Marcia %A Lumsden, Alan B %A Bismuth, Jean %B Journal of vascular surgery %V 67 %P 1274–1281 %8 06/2017 %G eng %U https://doi.org/10.1016/j.jvs.2017.01.072 %R 10.1016/j.jvs.2017.01.072 %> https://mahilab.rice.edu/sites/default/files/publications/Schwein2017JVS.pdf %0 Conference Proceedings %B EuroHaptics %D 2018 %T Improving Perception Accuracy with Multi-sensory Haptic Cue Delivery %A Dunkelberger, Nathan %A Bradley, Joshua %A Sullivan, Jennifer L. %A Israr, Ali %A Lau, Frances %A Klumb, Keith %A Abnousi, Freddy %A O'Malley, Marcia K. %E Prattichizzo, Domenico %E Shinoda, Hiroyuki %E Tan, Hong Z. %E Ruffaldi, Emanuele %E Frisoli, Antonio %X

This paper presents a novel, wearable, and multi-sensory haptic feedback system intended to support the transmission of large sets of haptic cues that are accurately perceived by the human user. Previous devices have focused on the optimization of haptic cue transmission using a single modality and have typically employed arrays of haptic tactile actuators to maximize information throughput to a user. However, when large cue sets are to be transmitted, perceptual interference between transmitted cues can decrease the efficacy of single-sensory systems. Therefore, we present MISSIVE (Multi-sensory Interface of Stretch, Squeeze, and Integrated Vibration Elements), a wearable system that conveys multi-sensory haptic cues to the user's upper arm, allowing for increased perceptual accuracy compared to a single-sensory vibrotactile array of a comparable size, conveying the same number of cues. Our multi-sensory haptic cues are comprised of concurrently rendered, yet perceptually distinct elements: radial squeeze, lateral skin stretch, and localized cutaneous vibration. Our experiments demonstrate that our approach can increase perceptual accuracy compared to a single-sensory vibrotactile system of comparable size and that users prefer MISSIVE.

%B EuroHaptics %I Springer International Publishing %C Pisa, Italy %V II %P 289-301 %8 June 13-16 %@ 978-3-319-93399-3 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/dunkelberger%202018%20eurohaptics%20compressed.pdf %0 Conference Proceedings %B 2nd Annual Conference on Robot Learning %D 2018 %T Including Uncertainty when Learning from Human Corrections %A Losey, Dylan P %A O'Malley, Marcia K %B 2nd Annual Conference on Robot Learning %C Zurich, Switzerland %8 09/2018 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Losey2018includinguncertainty.pdf %0 Conference Proceedings %B Human-Robot Interaction %D 2018 %T Learning from Physical Human Corrections, One Feature at a Time %A Andrea Bajcsy %A Dylan P. Losey %A Marcia K. O'Malley %A Anca D. Dragan %X

We focus on learning robot objective functions from human guidance: specifically, from physical corrections provided by the person while the robot is acting. Objective functions are typically parametrized in terms of features, which capture aspects of the task that might be important. When the person intervenes to correct the robot's behavior, the robot should update its understanding of which features matter, how much, and in what way. Unfortunately, real users do not provide optimal corrections that isolate exactly what the robot was doing wrong. Thus, when receiving a correction, it is difficult for the robot to determine which features the person meant to correct, and which features were changed unintentionally. In this paper, we propose to improve the efficiency of robot learning during physical interactions by reducing unintended learning. Our approach allows the human-robot team to focus on learning one feature at a time, unlike state-of-the-art techniques that update all features at once. We derive an online method for identifying the single feature which the human is trying to change during physical interaction, and experimentally compare this one-at-a-time approach to the all-at-once baseline in a user study. Our results suggest that users teaching one-at-a-time perform better, especially in tasks that require changing multiple features.

%B Human-Robot Interaction %I ACM/IEEE %C Chicago, USA %8 03/2018 %G eng %R 10.1145/3171221.3171267 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_HRI2018.pdf %0 Journal Article %J ASME Applied Mechanics Reviews %D 2018 %T A review of intent detection, arbitration, and communication aspects of shared control for physical human-robot interaction %A Dylan P. Losey %A Craig G. McDonald %A Edoardo Battaglia %A Marcia K. O'Malley %X

As robotic devices are applied to problems beyond traditional manufacturing and industrial settings, we find that interaction between robots and humans, especially physical interaction, has become a fast developing field. Consider the application of robotics in healthcare, where we find telerobotic devices in the operating room facilitating dexterous surgical procedures, exoskeletons in the rehabilitation domain as walking aids and upper-limb movement assist devices, and even robotic limbs that are physically integrated with amputees who seek to restore their independence and mobility. In each of these scenarios, the physical coupling between human and robot, often termed physical human robot interaction (pHRI), facilitates new human performance capabilities and creates an opportunity to explore the sharing of task execution and control between humans and robots. In this review, we provide a unifying view of human and robot sharing task execution in scenarios where collaboration and cooperation between the two entities are necessary, and where the physical coupling of human and robot is a vital aspect. We define three key themes that emerge in these shared control scenarios, namely, intent detection, arbitration, and feedback. First, we explore methods for how the coupled pHRI system can detect what the human is trying to do, and how the physical coupling itself can be leveraged to detect intent. Second, once the human intent is known, we explore techniques for sharing and modulating control of the coupled system between robot and human operator. Finally, we survey methods for informing the human operator of the state of the coupled system, or the characteristics of the environment with which the pHRI system is interacting. At the conclusion of the survey, we present two case studies that exemplify shared control in pHRI systems, and specifically highlight the approaches used for the three key themes of intent detection, arbitration, and feedback for applications of upper limb robotic rehabilitation and haptic feedback from a robotic prosthesis for the upper limb.

%B ASME Applied Mechanics Reviews %V 70 %8 02/2018 %G eng %U http://appliedmechanicsreviews.asmedigitalcollection.asme.org/article.aspx?articleID=2671581 %R DOI: 10.1115/1.4039145 %> https://mahilab.rice.edu/sites/default/files/publications/amr_2018_review.pdf %0 Conference Proceedings %B Haptics Symposium (HAPTICS) %D 2018 %T Toward improved surgical training: Delivering smoothness feedback using haptic cues %A W. H. Jantscher %A S. Pandey %A P. Agarwal %A S. H. Richardson %A B. R. Lin %A M. D. Byrne %A M. K. O'Malley %K biomechanics %K biomedical education %K computer based training %K coordinated movement %K delayed nature %K dexterity %K Feedback %K frequency-domain measure %K haptic cues %K Haptic interfaces %K Measurement %K medical computing %K mirror tracing task %K mirror-tracing task %K Mirrors %K motor skill acquisition %K movement smoothness %K Navigation %K qualitative nature %K real-time feedback %K skilled movement %K smoothness-based feedback %K spectral arc length %K surgery %K surgical training %K Task analysis %K training %K vibrotactile cue %X

Surgery is a challenging domain for motor skill acquisition, and compounding this difficulty is the often delayed and qualitative nature of feedback that is provided to trainees. In this paper, we explore the effectiveness of providing real-time feedback of movement smoothness, a characteristic associated with skilled and coordinated movement, via a vibrotactile cue. Subjects performed a mirror-tracing task that requires coordination and dexterity similar in nature to that required in endovascular surgery. Movement smoothness, measured by spectral arc length, a frequency-domain measure of movement smoothness, was encoded in a vibrotactile cue. Performance of the mirror tracing task with smoothness-based feedback was compared to position-based feedback (where the subject was alerted when they moved outside the path boundary) and to a no-feedback control condition. Although results of this pilot study failed to indicate a statistically significant effect of smoothness-based feedback on performance, subjects receiving smoothness-based feedback altered their task completion strategies to improve speed and accuracy, while those receiving position-based feedback or no feedback only improved in terms of increased accuracy. In tasks such as surgery where both speed and accuracy are vital to positive patient outcomes, the provision of smoothness-based feedback to the surgeon has the potential to positively influence performance.

%B Haptics Symposium (HAPTICS) %I IEEE %C San Francisco, CA %P 241-246 %8 03/2018 %G eng %R 10.1109/HAPTICS.2018.8357183 %> https://mahilab.rice.edu/sites/default/files/publications/jantscher%202018%20ieee.pdf %0 Journal Article %J IEEE Transactions on Robotics %D 2018 %T Trajectory deformations from physical human–robot interaction %A Dylan P. Losey %A Marcia K. O'Malley %X

Robots are finding new applications where physical interaction with a human is necessary, such as manufacturing, healthcare, and social tasks. Accordingly, the field of physical human–robot interaction (pHRI) has leveraged impedance control approaches, which support compliant interactions between human and robot. However, a limitation of traditional impedance control is that—despite provisions for the human to modify the robot’s current trajectory—the human cannot affect the robot’s future desired trajectory through pHRI. In this paper, we present an algorithm for physically interactive trajectory deformations which, when combined with impedance control, allows the human to modulate both the actual and desired trajectories of the robot. Unlike related works, our method explicitly deforms the future desired trajectory based on forces applied during pHRI, but does not require constant human guidance. We present our approach and verify that this method is compatible with traditional impedance control. Next, we use constrained optimization to derive the deformation shape. Finally, we describe an algorithm for real-time implementation, and perform simulations to test the arbitration parameters. Experimental results demonstrate reduction in the human’s effort and improvement in the movement quality when compared to pHRI with impedance control alone.

%B IEEE Transactions on Robotics %V 34 %P 126-138 %8 02/2018 %G eng %U http://ieeexplore.ieee.org/document/8115323/ %R 10.1109/TRO.2017.2765335 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_TRO_2018.pdf %0 Conference Proceedings %B International Conference on Robotics and Automation (ICRA) %D 2017 %T Effects of Discretization on the K-Width of Series Elastic Actuators %A Dylan P. Losey %A Marcia K. O'Malley %X

Rigid haptic devices enable humans to physically interact with virtual environments, and the range of impedances that can be safely rendered using these rigid devices is quantified by the Z-Width metric. Series elastic actuators (SEAs) similarly modulate the impedance felt by the human operator when interacting with a robotic device, and, in particular, the robot's perceived stiffness can be controlled by changing the elastic element's equilibrium position. In this paper, we explore the K-Width of SEAs, while specifically focusing on how discretization inherent in the computer-control architecture affects the system's passivity. We first propose a hybrid model for a single degree-of-freedom (DoF) SEA based on prior hybrid models for rigid haptic systems. Next, we derive a closed-form bound on the K-Width of SEAs that is a generalization of known constraints for both rigid haptic systems and continuous time SEA models. This bound is first derived under a continuous time approximation, and is then numerically supported with discrete time analysis. Finally, experimental results validate our finding that large pure masses are the most destabilizing operator in human-SEA interactions, and demonstrate the accuracy of our theoretical K-Width bound.

%B International Conference on Robotics and Automation (ICRA) %I IEEE %C Singapore %P 421-426 %8 05/2017 %@ 978-1-5090-4633-1 %G eng %U http://ieeexplore.ieee.org/abstract/document/7989054/ %R 10.1109/ICRA.2017.7989054 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_ICRA_2017.pdf %0 Conference Proceedings %B International Conference on Rehabilitation Robotics (ICORR) %D 2017 %T Improving robotic stroke rehabilitation by incorporating neural intent detection: Preliminary results from a clinical trial %A Sullivan, J.L. %A Bhagat, N.A. %A Yozbatiran, N. %A Paranjape, R. %A Losey, C.G. %A Grossman, R.G. %A Contreras-Vidal, J.L. %A Francisco, G.E. %A O'Malley, M.K. %B International Conference on Rehabilitation Robotics (ICORR) %I IEEE %C London, UK %8 07/2018 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Sullivan_ICORR%202017_BMI%20Exo.pdf %0 Conference Proceedings %B Conference on Robot Learning (CoRL) %D 2017 %T Learning Robot Objectives from Physical Human Interaction %A Andrea Bajcsy %A Dylan P. Losey %A Marcia K. O'Malley %A Anca D. Dragan %K learning from demonstration %K physical human-robot interaction %X

When humans and robots work in close proximity, physical interaction is inevitable. Traditionally, robots treat physical interaction as a disturbance, and resume their original behavior after the interaction ends. In contrast, we argue that physical human interaction is informative: it is useful information about how the robot should be doing its task. We formalize learning from such interactions as a dynamical system in which the task objective has parameters that are part of the hidden state, and physical human interactions are observations about these parameters. We derive an online approximation of the robot’s optimal policy in this system, and test it in a user study. The results suggest that learning from physical interaction leads to better robot task performance with less human effort.

%B Conference on Robot Learning (CoRL) %I PMLR %C Mountain View, CA %P 217-226 %8 11/2017 %G eng %U http://proceedings.mlr.press/v78/bajcsy17a.html %> https://mahilab.rice.edu/sites/default/files/publications/CoRL_2017.pdf %0 Conference Proceedings %B International Conference on Rehabilitation Robotics (ICORR) %D 2017 %T Maintaining Subject Engagement during Robotic Rehabilitation with a Minimal Assist-as-Needed (mAAN) Controller %A Ali Utku Pehlivan %A Dylan P. Losey %A Rose, Chad G. %X

One challenge of robotic rehabilitation interventions is devising ways to encourage and maintain high levels of subject involvement over long duration therapy sessions. Assist-as-needed controllers have been proposed which modulate robot intervention in movements based on measurements of subject involvement. This paper presents a minimal assist-as-needed controller, which modulates allowable error bounds and robot intervention based on sensorless force measurement accomplished through a nonlinear disturbance observer. While similar algorithms have been validated using healthy subjects, this paper presents a validation of the proposed mAAN control algorithm's ability to encourage user involvement with an impaired individual. User involvement is inferred from muscle activation, measured via surface electromyography (EMG). Experimental validation shows increased EMG muscle activation when using the proposed mAAN algorithm compared to non-adaptive algorithms.

%B International Conference on Rehabilitation Robotics (ICORR) %I IEEE %C London, UK %8 07/2017 %G eng %R 10.1109/ICORR.2017.8009222 %> https://mahilab.rice.edu/sites/default/files/publications/Pehlivan_2017_Maintaining.pdf %0 Conference Proceedings %B Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference on %D 2016 %T A bio-inspired algorithm for identifying unknown kinematics from a discrete set of candidate models by using collision detection %A Dylan P. Losey %A C. G. McDonald %A Marcia K. O'Malley %X

Many robots are composed of interchangeable modular components, each of which can be independently controlled, and collectively can be disassembled and reassembled into new configurations. When assembling these modules into an open kinematic chain, there are some discrete choices dictated by the module geometry; for example, the order in which the modules are placed, the axis of rotation of each module with respect to the previous module, and/or the overall shape of the assembled robot. Although it might be straightforward for a human user to provide this information, there is also a practical benefit in the robot autonomously identifying these unknown, discrete forward kinematics. To date, a variety of techniques have been proposed to identify unknown kinematics; however, these methods cannot be directly applied during situations where we seek to identify the correct model amid a discrete set of options. In this paper, we introduce a method specifically for finding discrete robot kinematics, which relies on collision detection, and is inspired by the biological concepts of body schema and evolutionary algorithms. Under the proposed method, the robot maintains a population of possible models, stochastically identifies a motion which best distinguishes those models, and then performs that motion while checking for a collision. Models which correctly predicted whether a collision would occur produce candidate models for the next iteration. Using this algorithm during simulations with a Baxter robot, we were able to correctly determine the order of the links in 84% of trials while exploring around 0.01% of all possible models, and we were able to correctly determine the axes of rotation in 94% of trials while exploring < 0.1% of all possible models.

%B Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference on %P 418-423 %@ 978-1-5090-3287-7 %G eng %U http://ieeexplore.ieee.org/abstract/document/7523663/ %R 10.1109/BIOROB.2016.7523663 %> https://mahilab.rice.edu/sites/default/files/publications/BioRob_2016_Algorithm.pdf %0 Journal Article %J Journal of Vascular Surgery %D 2016 %T Flexible robotics with electromagnetic tracking improve safety and efficiency during in vitro endovascular navigation %A Adeline Schwein %A Kramer, B.D. %A Ponraj Chinnadurai %A Sean Walker %A O'Malley, M.K. %A Alan Lumsden %A Jean Bismuth %B Journal of Vascular Surgery %V 63 %P 285-286 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Schwein2016%20-%20Flexible%20robotics%20tracking.pdf %0 Conference Proceedings %B Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference on %D 2016 %T Improving the retention of motor skills after reward-based reinforcement by incorporating haptic guidance and error augmentation %A Dylan P. Losey %A Laura H. Blumenschein %A Marcia K. O'Malley %X

There has been significant research aimed at leveraging programmable robotic devices to provide haptic assistance or augmentation to a human user so that new motor skills can be trained efficiently and retained long after training has concluded. The success of these approaches has been varied, and retention of skill is typically not significantly better for groups exposed to these controllers during training. These findings point to a need to incorporate a more complete understanding of human motor learning principles when designing haptic interactions with the trainee. Reward-based reinforcement has been studied for its role in improving retention of skills. Haptic guidance, which assists a user to complete a task, and error augmentation, which exaggerates error in order to enhance feedback to the user, have been shown to be beneficial for training depending on the task difficulty, subject ability, and task type. In this paper, we combine the presentation of reward-based reinforcement with these robotic controllers to evaluate their impact on retention of motor skill in a visual rotation task with tunable difficulty using either fixed or moving targets. We found that with the reward-based feedback paradigm, both haptic guidance and error augmentation led to better retention of the desired visuomotor offset during a simple task, while during a more complex task, only subjects trained with haptic guidance demonstrated performance superior to those trained without a controller.

%B Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference on %P 857-863 %@ 978-1-5090-3287-7 %G eng %U http://ieeexplore.ieee.org/abstract/document/7523735/ %R 10.1109/BIOROB.2016.7523735 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_BioRob_Improving.pdf %0 Journal Article %J IEEE Transactions on Robotics %D 2016 %T Minimal assist-as-needed controller for upper limb robotic rehabilitation %A Ali Utku Pehlivan %A Dylan P. Losey %A Marcia K. O'Malley %X

Robotic rehabilitation of the upper limb following neurological injury is most successful when subjects are engaged in the rehabilitation protocol. Developing assistive control strategies that maximize subject participation is accordingly an active area of research, with aims to promote neural plasticity and, in turn, increase the potential for recovery of motor coordination. Unfortunately, state-of-the-art control strategies either ignore more complex subject capabilities or assume underlying patterns govern subject behavior and may therefore intervene suboptimally. In this paper, we present a minimal assist-as-needed (mAAN) controller for upper limb rehabilitation robots. The controller employs sensorless force estimation to dynamically determine subject inputs without any underlying assumptions as to the nature of subject capabilities and computes a corresponding assistance torque with adjustable ultimate bounds on position error. Our adaptive input estimation scheme is shown to yield fast, stable, and accurate measurements regardless of subject interaction and exceeds the performance of current approaches that estimate only position-dependent force inputs from the user. Two additional algorithms are introduced in this paper to further promote active participation of subjects with varying degrees of impairment. First, a bound modification algorithm is described, which alters allowable error. Second, a decayed disturbance rejection algorithm is presented, which encourages subjects who are capable of leading the reference trajectory. The mAAN controller and accompanying algorithms are demonstrated experimentally with healthy subjects in the RiceWrist-S exoskeleton.

%B IEEE Transactions on Robotics %V 32 %P 113-124 %8 02/2016 %G eng %U http://ieeexplore.ieee.org/abstract/document/7360218/ %& 113 %R 10.1109/TRO.2015.2503726 %> https://mahilab.rice.edu/sites/default/files/publications/TRO_2016.pdf %0 Conference Proceedings %B Workshop on Self-Organizing Maps (WSOM) %D 2016 %T SOM and LVQ classification of endovascular surgeons using motion-based metrics %A Kramer, B.D. %A Dylan P. Losey %A Marcia K. O'Malley %X

An increase in the prevalence of endovascular surgery requires a growing number of proficient surgeons. Current endovascular surgeon evaluation techniques are subjective and time-consuming; as a result, there is a demand for an objective and automated evaluation procedure. Leveraging reliable movement metrics and tool-tip data acquisition, we here use neural network techniques such as LVQs and SOMs to identify the mapping between surgeons’ motion data and imposed rating scales. Using LVQs, only 50 % testing accuracy was achieved. SOM visualization of this inadequate generalization, however, highlights limitations of the present rating scale and sheds light upon the differences between traditional skill groupings and neural network clusters. In particular, our SOM clustering both exhibits more truthful segmentation and demonstrates which metrics are most indicative of surgeon ability, providing an outline for more rigorous evaluation strategies.

%B Workshop on Self-Organizing Maps (WSOM) %P 227-237 %8 01/2016 %G eng %U https://link.springer.com/chapter/10.1007/978-3-319-28518-4_20 %R https://doi.org/10.1007/978-3-319-28518-4_20 %> https://mahilab.rice.edu/sites/default/files/publications/WSOM_2016.pdf %0 Journal Article %J IEEE/ASME Transactions on Mechatronics %D 2016 %T A Time-Domain Approach To Control Of Series Elastic Actuators: Adaptive Torque And Passivity-Based Impedance Control %A Dylan P. Losey %A Andrew Erwin %A Craig G. McDonald %A Fabrizio Sergi %A Marcia K. O'Malley %X

Robots are increasingly designed to physically interact with humans in unstructured environments, and as such must operate both accurately and safely. Leveraging compliant actuation, typically in the form of series elastic actuators (SEAs), can guarantee this required level of safety. To date, a number of frequency-domain techniques have been proposed which yield effective SEA torque and impedance control; however, these methods are accompanied by undesirable stability constraints. In this paper, we instead focus on a time-domain approach to the control of SEAs, and adapt two existing control techniques for SEA platforms. First, a model reference adaptive controller is developed, which requires no prior knowledge of system parameters and can specify desired closed-loop torque characteristics. Second, the time-domain passivity approach is modified to control desired impedances in a manner that temporarily allows the SEA to passively render impedances greater than the actuator's intrinsic stiffness. This approach also provides conditions for passivity when augmenting any stable SEA torque controller with an arbitrary impedance. The resultant techniques are experimentally validated on a custom prototype SEA.

%B IEEE/ASME Transactions on Mechatronics %V 21 %P 2085 - 2096 %G eng %U http://ieeexplore.ieee.org/abstract/document/7457670/ %R 10.1109/TMECH.2016.2557727 %> https://mahilab.rice.edu/sites/default/files/publications/Losey_TMECH.pdf %0 Journal Article %J Journal of Vascular Surgery %D 2015 %T Kinematics effectively delineate accomplished users of endovascular robotics with a physical training model %A Cassidy Duran %A Sean Estrada %A Marcia O'Malley %A Alan B. Lumsden %A Jean Bismuth %B Journal of Vascular Surgery %V 61 %P 535-541 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Duran_et_al_JVS2015.pdf %0 Journal Article %J Journal of Vascular Surgery %D 2015 %T The model for Fundamentals of Endovascular Surgery (FEVS) successfully defines the competent endovascular surgeon %A Cassidy Duran %A Sean Estrada %A O'Malley, M.K. %A Malachi Sheahan %A Murray Shames %A Jason T Lee %A Jean Bismuth %B Journal of Vascular Surgery %V 62 %P 1660-1666 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/2015_JVS_Duran_press.pdf %0 Conference Proceedings %B International Conference on Rehabilitation Robotics %D 2013 %T Design of a series elastic actuator for a compliant parallel wrist rehabilitation robot %A Fabrizio Sergi %A Melissa M. Lee %A Marcia K. O'Malley %B International Conference on Rehabilitation Robotics %8 06/2013 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Sergi_SEA_paper_2.pdf %0 Conference Proceedings %B IEEE BioROB %D 2012 %T Mechanical Design of RiceWrist-S: a Forearm-Wrist Exoskeleton for Stroke and Spinal Cord Injury Rehabilitation %A A.U. Pehlivan %A S. Lee %A O'Malley, M.K. %B IEEE BioROB %G eng %> https://mahilab.rice.edu/sites/default/files/publications/BIOROB_2012_Pehlivan_press.pdf %0 Conference Proceedings %B MMVR18 %D 2011 %T Comparison of Reaching Kinematics During Mirror and Parallel Robot Assisted Movements %A Zahra KADIVAR %A Cynthia SUNG %A Zachary THOMPSON %A Marcia O’MALLEY %A Michael LIEBSCHNER %A Deng, Zhigang %B MMVR18 %C Newport Beach, CA %8 02/2011 %> https://mahilab.rice.edu/sites/default/files/publications/1295-MMVR18-Kadivar_Z.pdf %0 Conference Proceedings %B Robotics and Automation (ICRA), 2011 IEEE International Conference on %D 2011 %T Design of a low-cost series elastic actuator for multi-robot manipulation %A Campbell, E. %A Kong, Z.C. %A Hered, W. %A Lynch, A.J. %A O'Malley, M.K. %A McLurkin, J. %B Robotics and Automation (ICRA), 2011 IEEE International Conference on %8 may %G eng %R 10.1109/ICRA.2011.5980534 %> https://mahilab.rice.edu/sites/default/files/publications/campbell2011ieee.pdf %0 Book Section %B Pumps and Pipes %D 2011 %T Surgical Robotics: Innovations, Development, and Shortcomings %A Bismuth, Jean %A O'Malley, Marcia K. %E Davies, Mark G. %E Lumsden, Alan B. %E Kline, William E. %E Kakadiaris, Ioannis %X

Robotic devices have been used in the industrial field for over 40 years, while their introduction has been slower into the medical field with many requirements driven by the nature of human tissue and safety. These surgical assistance systems provide intelligent, versatile tools that augment a physician's ability to treat patients. Steerable robotic catheters may overcome many of the limitations of standard catheter technology, enhance target vessel cannulation, and reduce instrumentation, while improving overall physician performance. External robotics allows access to a body cavity through percutaneous ports with a high precision, high magnification manipulation of tissue. Robotics-driven imaging systems enhance dynamic data acquisition and provide high speed integration, facilitating image-guided navigation and augmenting other robotic systems. A lack of haptics remains a significant safety issue.

%B Pumps and Pipes %I Springer US %C Boston, MA %P 33-44 %@ 978-1-4419-6012-2 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Bismuth2011pumpspipes.pdf %0 Journal Article %J Journal of vascular surgery : official publication, the Society for Vascular Surgery [and] International Society for Cardiovascular Surgery, North American Chapter %D 2010 %T Incorporating simulation in vascular surgery education %A Jean Bismuth %A Michael A. Donovan %A O'Malley, M.K. %A Hosam F. El Sayed %A Joseph J. Naoum %A Eric K. Peden %A Mark G. Davies %A Alan B. Lumsden %B Journal of vascular surgery : official publication, the Society for Vascular Surgery [and] International Society for Cardiovascular Surgery, North American Chapter %I Mosby-Year Book %P - %8 2010/08/05 %@ 0741-5214 %G eng %U http://linkinghub.elsevier.com/retrieve/pii/S0741521410013054?showall=true %> https://mahilab.rice.edu/sites/default/files/publications/bismuth2010jvascsurg.pdf %0 Journal Article %J IEEE Transactions on Neural Systems and Rehabilitation Engineering %D 2010 %T Normalized movement quality measures for therapeutic robots strongly correlate with clinical motor impairment measures %A Ozkan Celik %A O'Malley, M.K. %A Boake, Corwin %A H.S. Levin %A Yozbatiran, Nuray %A Reistetter, Timothy %X In this paper, we analyze the correlations between four clinical measures (Fugl–Meyer upper extremity scale, Motor Activity Log, Action Research Arm Test, and Jebsen-Taylor Hand Function Test) and four robotic measures (smoothness of movement, trajectory error, average number of target hits per minute, and mean tangential speed), used to assess motor recovery. Data were gathered as part of a hybrid robotic and traditional upper extremity rehabilitation program for nine stroke patients. Smoothness of movement and trajectory error, temporally and spatially normalized measures of movement quality defined for point-to-point movements, were found to have significant moderate to strong correlations with all four of the clinical measures. The strong correlations suggest that smoothness of movement and trajectory error may be used to compare outcomes of different rehabilitation protocols and devices effectively, provide improved resolution for tracking patient progress compared to only pre- and post-treatment measurements, enable accurate adaptation of therapy based on patient progress, and deliver immediate and useful feedback to the patient and therapist. %B IEEE Transactions on Neural Systems and Rehabilitation Engineering %V 18 %P 433-444 %U http://dx.doi.org/10.1109/TNSRE.2010.2047600 %> https://mahilab.rice.edu/sites/default/files/publications/911-Celik2010TNSRE.pdf %0 Conference Proceedings %B World Congress on Medical Physics and Biomedical Engineering, September 7-12, 2009, Munich, Germany %D 2009 %T On the efficacy of haptic guidance schemes for human motor learning %A Patoglu, Volkan %A Li, Yvonne %A O’Malley, Marcia K %B World Congress on Medical Physics and Biomedical Engineering, September 7-12, 2009, Munich, Germany %I Springer %P 203-206 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/Patoglu2009iupesm.pdf %0 Journal Article %J ACM Transactions on Applied Perception %D 2009 %T Negative Efficacy of Fixed Gain Error Reducing Shared Control for Training in Virtual Environments %A Yanfang Li %A Volkan Patoglu %A O'Malley, M.K. %X

Virtual reality with haptic feedback provides a safe and versatile practice medium for many manual control tasks. Haptic guidance has been shown to improve performance of manual control tasks in virtual environments; however, the efficacy of haptic guidance for training in virtual environments has not been studied conclusively. This article presents experimental results that show negative efficacy of haptic guidance during training in virtual environments. The haptic guidance in this study is a fixed-gain error-reducing shared controller, with the control effort overlaid on the dynamics of the manual control task during training. Performance of the target-hitting manual control task in the absence of guidance is compared for three training protocols. One protocol contained no haptic guidance and represented virtual practice. Two protocols utilized haptic guidance, varying the duration of exposure to guidance during the training sessions. Exposure to the fixed-gain error-reducing shared controller had a detrimental effect on performance of the target-hitting task at the conclusion of a month-long training protocol, regardless of duration of exposure. While the shared controller was designed with knowledge of the task and an intuitive sense of the motions required to achieve good performance, the results indicate that the acquisition of motor skill is a complex phenomenon that is not aided with haptic guidance during training as implemented in this experiment.

%B ACM Transactions on Applied Perception %V 6 %8 01/2009 %> https://mahilab.rice.edu/sites/default/files/publications/103-Li-Patoglu-O%27Malley_TAP_6%281%29_2009FINAL.pdf %0 Journal Article %J IEEE Transactions on Haptics %D 2009 %T Passive and Active Discrimination of Natural Frequency of Virtual Dynamic System %A Ali Israr %A Yanfang Li %A Volkan Patoglu %A O'Malley, M.K. %B IEEE Transactions on Haptics %V 2 %P 40-51 %8 02/2009 %R 10.1109/TOH.2008.21 %> https://mahilab.rice.edu/sites/default/files/publications/102-Israr-Li-Patoglu-O%27Malley_IEEEToH_2%281%29_2009FINAL.pdf %0 Conference Proceedings %B Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperation Systems, (WHC'09) %D 2009 %T Progressive shared control for training in virtual environments %A Yanfang Li %A Joel C. Huegel %A Volkan Patoglu %A O'Malley, M.K. %K Haptic interface %K performance %K shared control %K training %B Third Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperation Systems, (WHC'09) %I IEEE %C Salt Lake City, UT, USA %P 332-337 %8 03/2009 %> https://mahilab.rice.edu/sites/default/files/publications/109-LiPSC-WHC.pdf %0 Conference Proceedings %B IEEE 11th International Conference on Rehabilitation Robotics (ICORR 2009) %D 2009 %T Validation of a smooth movement model for a human reaching task %A Joel C. Huegel %A Lynch, Andrew %A O'Malley, M.K. %X

This paper presents the experiment design, results, and analysis of a human user study that tests and validates the minimum hand jerk (MHJ) model for a human forearm reaching movement task when manipulating a multi-mass object. This work validates and extends prior work that demonstrated the MHJ criteria, a mathematical approach to human movement modeling, more accurately represents movements with multi-mass objects than the alternate optimally smooth transport (OST) model. To validate the prior work, we developed a visual and haptic virtual environment with a five-mass system with friction connected by springs and viscous dampers. The point to point reaching task we implemented required participants to move their hand with the set of masses to a target position, thereby generating movement profiles for analysis. Our experimental design uniquely extends the application of the MHJ criteria to forearm pronation movements and our results show that the MHJ model holds. Our extension to forearm movements and the more general MHJ criteria are economic models of human movements applicable to fields such as computer animation and virtual environments.

%B IEEE 11th International Conference on Rehabilitation Robotics (ICORR 2009) %P 799-804 %> https://mahilab.rice.edu/sites/default/files/publications/530-Huegel2009ICORRpublished.pdf %0 Conference Proceedings %B IEEE International Conference on Robotics and Automation, 2008 (ICRA 2008). %D 2008 %T Comparison of robotic and clinical motor function improvement measures for sub-acute stroke patients %A Ozkan Celik %A O'Malley, M.K. %A Boake, Corwin %A H.S. Levin %A Fischer, Steven %A Reistetter, Timothy %K robotic rehabilitation %X

In this paper, preliminary results in motor function improvement for four sub-acute stroke patients that underwent a hybrid robotic and traditional rehabilitation program are presented. The therapy program was scheduled for three days a week, four hours per day (approximately 60% traditional constraint induced therapy activities and 40% robotic therapy). A haptic joystick was used to implement four different operating modes for robotic therapy: unassisted (U), constrained (C), assisted (A), and resisted (R) modes. A target hitting task involving the positioning of a pointer on twelve targets was completed by the patients. Two different robotic measures were utilized to quantify the motor function improvement through the sessions: trajectory error (TE) and smoothness of movement (SM). Fugl-Meyer (FM) and motor activity log (MAL) scales were used as clinical measures. Analysis of results showed that the group demonstrates a significant motor function improvement with respect to both clinical and robotic measures. Regression analyses were carried out on corresponding clinical and robotic measure result pairs. A significant relation between FM scale and robotic measures was found for both of the analyzed modes. Regression of robotic measures on MAL scores resulted in no significance. A regression analysis that compared the two clinical measures revealed a very low agreement. Our findings suggest that it might be possible to obtain objective robotic measures that are significantly correlated to widely-used and reliable clinical measures in considerably different operating modes and control schemes.

%B IEEE International Conference on Robotics and Automation, 2008 (ICRA 2008). %C Pasadena, CA %P 2477–2482 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/74-CelikICRA2008.pdf %0 Conference Proceedings %B 16th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS) %D 2008 %T Passive and active kinesthetic perception just-noticeable-difference for natural frequency of virtual dynamic systems %A Yanfang Li %A Ali Israr %A Volkan Patoglu %A O'Malley, M.K. %K Haptic interfaces %K visual perception %X

This paper investigates the just-noticeable-difference (JND) for natural frequency of virtual second order dynamic systems. Using a one degree-of-freedom haptic device, visual and/or haptic sensory feedback were presented during interactions with the system. Participants were instructed to either perceive passively or actively excite the system in order to discriminate natural frequencies. The JND for this virtual resonance task ranged from 3.99 % to 6.96 % for reference frequencies of 1 Hz and 2 Hz. Results show that sensory feedback has a significant effect on JND in passive perception, with combined visual and haptic feedback enabling the best discrimination performance. In active perception, there is no significant difference on JND with haptic and combined visual and haptic feedback. There is also no significant difference between active perception and passive perception for this JND experiment. The presentation of systems with equivalent natural frequencies but different spring stiffness resulted in no large bias toward larger stiffness and no significant difference in JND for equivalent systems. This finding indicates that human participants do not discriminate natural frequency based on the maximum force magnitude perceived, as indicated by prior studies.

%B 16th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS) %I IEEE %C Reno, NE, USA %P 25 - 31 %8 03/2008 %G eng %U http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4479908 %M 9872945 %R 10.1109/HAPTICS.2008.4479908 %> https://mahilab.rice.edu/sites/default/files/publications/58-HapticSymposium2008_Li.pdf %0 Conference Proceedings %B Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (WHC'07) %D 2007 %T Towards just noticeable differences for natural frequency of manually excited virtual dynamic systems %A Yanfang Li %A Volkan Patoglu %A Huang, Deborah %A O'Malley, M.K. %K Display devices %K Dynamical systems %K Natural frequencies %X

This paper explores the experiment design to determine a human's ability to discriminate the natural frequency of manually excited virtual dynamic systems. We use a one degree-of-freedom haptic interface with a coupled graphical display to render a virtual mass-spring system, which is excited by the human operator using his/her dominant hand. The results from the preliminary experiment indicate a JND value of approximately 8%. However, results also indicate that excitation strategies have a significant effect on the discrimination threshold determination of this dynamic property. In this paper, along with a discussion of the preliminary results, a refined experiment design that accounts for different factors influencing the discrimination of manually excited natural frequency is presented. © 2007 IEEE.

%B Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, (WHC'07) %I IEEE %C Tsukuba, Japan %P 569 - 570 %8 03/2007 %G eng %U http://dx.doi.org/10.1109/WHC.2007.118 %R 10.1109/WHC.2007.118 %> https://mahilab.rice.edu/sites/default/files/publications/59-00%20-%20Towards%20Just%20Noticeable%20Differences%20for%20Natural%20Frequency%20of%20Manually%20Excited%20Virtual%20Dynamic%20Systems.pdf %0 Journal Article %J Archives of Physical Medicine and Rehabilitation, Supplement 2 / Neuroplasticity and Brain Imaging Research: Implications for Rehabilitation %D 2006 %T Assessing and Inducing Neuroplasticity with TMS and Robotics %A O'Malley, M.K. %A T. Ro %A H.S. Levin %B Archives of Physical Medicine and Rehabilitation, Supplement 2 / Neuroplasticity and Brain Imaging Research: Implications for Rehabilitation %V 87(12) %P 59-66 %U http://linkinghub.elsevier.com/retrieve/pii/S0003999306012792 %> https://mahilab.rice.edu/sites/default/files/publications/14-PIIS0003999306012792.pdf %0 Journal Article %J Archives of physical medicine and rehabilitation %D 2006 %T Assessing and inducing neuroplasticity with transcranial magnetic stimulation and robotics for motor function %A O'Malley, Marcia K %A Ro, Tony %A Levin, Harvey S %B Archives of physical medicine and rehabilitation %V 87 %P 59–66 %8 12/2006 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/omalley2006neuroplasticity.pdf %0 Conference Proceedings %B Proceedings of EuroHaptics 2006 %D 2006 %T Shared Control for Training in Virtual Environments: Learning Through Demonstration? %A Yanfang Li %A Volkan Patoglu %A O'Malley, M.K. %B Proceedings of EuroHaptics 2006 %G eng %> https://mahilab.rice.edu/sites/default/files/publications/73-00%20-%20Li_Patoglu_OMalley_Eurohaptics06.pdf %0 Journal Article %J Journal of Dynamic Systems, Measurement and Control, Transactions of the ASME %D 2006 %T Shared control in haptic systems for performance enhancement and training %A O'Malley, M.K. %A Abhishek Gupta %A Gen, Matthew %A Yanfang Li %K Control equipment %K Damping %K Data reduction %K Haptic interfaces %K Robotics %K Robots %X

This paper presents a shared-control interaction paradigm for haptic interface systems, with experimental data from two user studies. Shared control, evolved from its initial telerobotics applications, is adapted as a form of haptic assistance in that the haptic device contributes to execution of a dynamic manual target-hitting task via force commands from an automatic controller. Compared to haptic virtual environments, which merely display the physics of the virtual system, or to passive methods of haptic assistance for performance enhancement based on virtual fixtures, the shared-control approach offers a method for actively demonstrating desired motions during virtual environment interactions. The paper presents a thorough review of the literature related to haptic assistance. In addition, two experiments were conducted to independently verify the efficacy of the shared-control approach for performance enhancement and improved training effectiveness of the task. In the first experiment, shared control is found to be as effective as virtual fixtures for performance enhancement, with both methods resulting in significantly better performance in terms of time between target hits for the manual target-hitting task than sessions where subjects feel only the forces arising from the mass-spring-damper system dynamics. Since shared control is more general than virtual fixtures, this approach may be extremely beneficial for performance enhancement in virtual environments. In terms of training enhancement, shared control and virtual fixtures were no better than practice in an unassisted mode. For manual control tasks, such as the one described in this paper, shared control is beneficial for performance enhancement, but may not be viable for enhancing training effectiveness. Copyright © 2006 by ASME.

%B Journal of Dynamic Systems, Measurement and Control, Transactions of the ASME %V 128 %P 75 - 85 %G eng %U http://scitation.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=JDSMAA000128000001000075000001&idtype=cvips&gifs=yes %& 75 %R 10.1115/1.2168160 %> https://mahilab.rice.edu/sites/default/files/publications/52-00%20-%20JDSMC%20Shared%20control.pdf %0 Conference Proceedings %B First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'05) %D 2005 %T Human-machine admittance and transparency adaptation in passive user interaction with a haptic interface %A McJunkin, Samuel %A Yanfang Li %A O'Malley, M.K. %K Haptic interfaces %K Human computer interaction %K Manipulators %K Virtual reality %X

This paper addresses human adaptation to changes in coupling impedance and force amplitude during passive user induced (PUI) interactions with a haptic interface. PUI interactions are characterized as event-based haptic interactions or haptic recordings that are replayed to the user. In the study, virtual environments are displayed to passive users with variable coupling stiffness and force amplitudes, and transparency bandwidth and human-machine admittance are measured. Results indicate that transparency bandwidth and the human-machine admittance do not change significantly for permutations of force amplitudes and coupling impedances, nor do they vary significantly across users. The reason for this invariance is that, during a PUI interaction, users tend approach a similar displacement profile. As a result, all users will have similar apparent admittance and transparency. The findings give sufficient justification for the use of universal compensators that improve transparency bandwidth, and that can be designed based solely on a priori transparency measurements for a typical user

%B First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'05) %C Pisa, Italy %P 283 - 9 %8 03/2005 %G eng %U http://www2.computer.org/portal/web/csdl/doi/10.1109/WHC.2005.76 %R 10.1109/WHC.2005.76 %> https://mahilab.rice.edu/sites/default/files/publications/64-00%20-%20Human-machine%20admittance%20and%20transparency%20adaptation%20in%20passive%20user%20interaction%20with%20-%20mcjunk.pdf