TY - JOUR T1 - Touch as an auxiliary proprioceptive cue for movement control JF - Indian Journal of Pure and Applied Physics Y1 - 2019 A1 - A. Moscatelli A1 - M. Bianchi A1 - S. Ciotti A1 - G. C. Bettelani A1 - C. V. Parise A1 - F. Lacquaniti A1 - A. Bicchi ER - TY - JOUR T1 - Simplifying Telerobotics: Wearability and Teleimpedance Improves Human-Robot Interactions in Teleoperation JF - IEEE Robotics Automation Magazine Y1 - 2018 A1 - S. Fani A1 - S. Ciotti A1 - M. G. Catalano A1 - G. Grioli A1 - A. Tognetti A1 - G. Valenza A1 - A. Ajoudani A1 - M. Bianchi KW - application fields KW - augmented teleoperation KW - Autonomous robots KW - communication KW - effective design KW - effective simplification KW - environmental constraints KW - feedback KW - Force feedback KW - fundamental requirement KW - haptic feedback devices KW - haptic interfaces KW - human workspace KW - human-robot interaction KW - human-robot interactions KW - human-robot interfaces KW - ideal scenario KW - integrated approach KW - integrated interface KW - integrated system KW - interaction forces KW - intuitive information exchange KW - Kinematics KW - KUKA lightweight robotic arm KW - lightweight design KW - manipulators KW - master KW - position control KW - reduced versions KW - Robot sensing systems KW - robotic devices KW - robotic hand-arm system KW - robotic manipulator KW - robotic teleoperation KW - simplified information exchange KW - slave robot KW - stiffness control KW - synergy KW - Task analysis KW - teleimpedance techniques KW - Telemedicine KW - teleoperator system KW - telerobotics KW - TI control KW - vision KW - wearability KW - wearable feedback KW - wearable hand/arm VL - 25 ER - TY - CONF T1 - Touch-Based Grasp Primitives for Soft Hands: Applications to Human-to-Robot Handover Tasks and Beyond T2 - 2018 IEEE International Conference on Robotics and Automation (ICRA) Y1 - 2018 A1 - M. Bianchi A1 - G. Averta A1 - E. Battaglia A1 - C. Rosales A1 - M. Bonilla A1 - A. Tondo A1 - M. Poggiani A1 - G. Santaera A1 - S. Ciotti A1 - M. G. Catalano A1 - A. Bicchi JF - 2018 IEEE International Conference on Robotics and Automation (ICRA) ER - TY - JOUR T1 - W-FYD: a Wearable Fabric-based Display for Haptic Multi-Cue Delivery and Tactile Augmented Reality JF - IEEE Transactions on Haptics Y1 - 2018 A1 - S. Fani A1 - S. Ciotti A1 - E. Battaglia A1 - A. Moscatelli A1 - M. Bianchi KW - Haptics KW - Robotics AB -

Despite the importance of softness, there is no evidence of wearable haptic systems able to deliver controllable softness cues. Here, we present the Wearable Fabric Yielding Display (W-FYD), a fabric-based display for multi-cue delivery that can be worn on user's finger and enables, for the first time, both active and passive softness exploration. It can also induce a sliding effect under the finger-pad. A given stiffness profile can be obtained by modulating the stretching state of the fabric through two motors. Furthermore, a lifting mechanism allows to put the fabric in contact with the user's finger-pad, to enable passive softness rendering. In this paper, we describe the architecture of W-FYD, and a thorough characterization of its stiffness workspace, frequency response and softness rendering capabilities. We also computed device Just Noticeable Difference in both active and passive exploratory conditions, for linear and non-linear stiffness rendering as well as for sliding direction perception. The effect of device weight was also considered. Furthermore, performance of participants and their subjective quantitative evaluation in detecting sliding direction and softness discrimination tasks are reported. Finally, applications of W-FYD in tactile augmented reality for open palpation are discussed, opening interesting perspectives in many fields of human-machine interaction.

VL - 11 UR - http://ieeexplore.ieee.org/document/8003491/ IS - 2 ER - TY - CONF T1 - From humans to robots: The role of cutaneous impairment in human environmental constraint exploitation to inform the design of robotic hands T2 - Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2017 9th International Congress on Y1 - 2017 A1 - G. Averta A1 - C. Della Santina A1 - E. Battaglia A1 - S. Ciotti A1 - V. Arapi A1 - S. Fani A1 - M. Bianchi AB -

Human hands are capable of a variety of movements, thanks to their extraordinary biomechanical structure and rely- ing on the richness of human tactile information. Recently, soft robotic hands have opened exciting possibilities and, at the same time, new issues related to planning and control. In this work, we propose to study human strategies in environmental constraint exploitation to grasp objects from a table. We have considered both the case where participants’ fingertips were free and with a rigid shell worn on them to understand the role of cutaneous touch. Main kinematic strategies were quantified and classified in an unsupervised manner. The principal strategies appear to be consistent in both experimental conditions, although cluster cardinality differs. Furthermore, as expected, tactile feedback improves both grasp precision and quality performance. Results opens interesting perspective for sensing and control of soft manipulators.

JF - Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2017 9th International Congress on PB - IEEE CY - Munich N1 -

This work has been awarded with the "Best Student Paper Award" and the "Best Paper in Session - Robotics"

ER - TY - JOUR T1 - Postural Hand Synergies during Environmental Constraint Exploitation JF - Fronters in Neurorobotics Y1 - 2017 A1 - C. Della Santina A1 - M. Bianchi A1 - G. Averta A1 - S. Ciotti A1 - V. Arapi A1 - S. Fani A1 - E. Battaglia A1 - M. G. Catalano A1 - M. Santello A1 - A. Bicchi KW - Haptics KW - Robotics AB -

Humans are able to intuitively exploit the shape of an object and environmental constraints to achieve stable grasps and perform dexterous manipulations. In doing that, a vast range of kinematic strategies can be observed. However, in this work we formulate the hypothesis that such ability can be described in terms of a synergistic behavior in the generation of hand postures, i.e., using a reduced set of commonly used kinematic patterns. This is in analogy with previous studies showing the presence of such behavior in different tasks, such as grasping. We investigated this hypothesis in experiments performed by six subjects, who were asked to grasp objects from a flat surface. We quantitatively characterized hand posture behavior from a kinematic perspective, i.e., the hand joint angles, in both pre-shaping and during the interaction with the environment. To determine the role of tactile feedback, we repeated the same experiments but with subjects wearing a rigid shell on the fingertips to reduce cutaneous afferent inputs. Results show the persistence of at least two postural synergies in all the considered experimental conditions and phases. Tactile impairment does not alter significantly the first two synergies, and contact with the environment generates a change only for higher order Principal Components. A good match also arises between the first synergy found in our analysis and the first synergy of grasping as quantified by previous work. The present study is motivated by the interest of learning from the human example, extracting lessons that can be applied in robot design and control. Thus, we conclude with a discussion on implications for robotics of our findings.

UR - https://www.frontiersin.org/articles/10.3389/fnbot.2017.00041/full ER - TY - CONF T1 - Synergy-driven performance enhancement of vision-based 3D hand pose reconstruction T2 - Wireless mobile communication and healthcare : 6th International conference, MobiHealth 2016, Milan, Italy, November 14-16, 2016, Proceedings Y1 - 2017 A1 - S. Ciotti A1 - E. Battaglia A1 - I. Oikonomidis A1 - A. Makris A1 - A. Tsoli A1 - A. Bicchi A1 - A. A. Agyros A1 - M. Bianchi JF - Wireless mobile communication and healthcare : 6th International conference, MobiHealth 2016, Milan, Italy, November 14-16, 2016, Proceedings ER - TY - CONF T1 - Tactile Slip and Hand Displacement: Bending Hand Motion with Tactile Illusions T2 - IEEE World Haptic Conference Y1 - 2017 A1 - M. Bianchi A1 - A. Moscatelli A1 - S. Ciotti A1 - G. C. Bettelani A1 - F. Fioretti A1 - F. Lacquaniti A1 - A. Bicchi KW - Haptics AB -

Touch provides an important cue to perceive the physical properties of the external objects. Recent studies showed that tactile sensation also contributes to our sense of hand position and displacement in perceptual tasks. In this study, we tested the hypothesis that, sliding our hand over a stationary surface, tactile motion may provide a feedback for guiding hand trajectory. We asked participants to touch a plate having parallel ridges at different orientations and to perform a self-paced, straight movement of the hand. In our daily-life experience, tactile slip motion is equal and opposite to hand motion. Here, we used a well-established perceptual illusion to dissociate, in a controlled manner, the two motion estimates. According to previous studies, this stimulus produces a bias in the perceived direction of tactile motion, predicted by tactile flow model. We showed a systematic deviation in the movement of the hand towards a direction opposite to the one predicted by tactile flow, supporting the hypothesis that touch contributes to motor control of the hand. We suggested a model where the perceived hand motion is equal to a weighted sum of the estimate from classical proprioceptive cues (e.g., from musculoskeletal system) and the estimate from tactile slip.

JF - IEEE World Haptic Conference PB - IEEE CY - Fürstenfeldbruck (Munich), Germany, June 6-9, 2017 N1 -

 This work is supported in part by the European Research Council under the Advanced Grant SoftHands “A Theory of Soft Synergies for a New Generation of Artificial Hands” no. ERC-291166, by the EU H2020 project “SOFTPRO: Synergy-based Open-source Foundations and Technologies for Prosthetics and RehabilitatiOn” (no. 688857) and by the EU FP7 project (no. 601165), “WEARable HAPtics for Humans and Robots (WEARHAP)”. We thank Priscilla Balestrucci and Colleen P. Ryan for helpful comments and suggestions.

ER - TY - JOUR T1 - A Multi-Modal Sensing Glove for Human Manual-Interaction Studies JF - Electronics Y1 - 2016 A1 - M. Bianchi A1 - R. Haschke A1 - G. Büscher A1 - S. Ciotti A1 - N. Carbonaro A1 - A. Tognetti KW - Haptics AB -

We present an integrated sensing glove that combines two of the most visionary wearable sensing technologies to provide both hand posture sensing and tactile pressure sensing in a unique, lightweight, and stretchable device. Namely, hand posture reconstruction employs Knitted Piezoresistive Fabrics that allows us to measure bending. From only five of these sensors (one for each finger) the full hand pose of a 19 degrees of freedom (DOF) hand model is reconstructed leveraging optimal sensor placement and estimation techniques. To this end, we exploit a-priori information of synergistic coordination patterns in grasping tasks. Tactile sensing employs a piezoresistive fabric allowing us to measure normal forces in more than 50 taxels spread over the palmar surface of the glove. We describe both sensing technologies, report on the software integration of both modalities, and describe a preliminary evaluation experiment analyzing hand postures and force patterns during grasping. Results of the reconstruction are promising and encourage us to push further our approach with potential applications in neuroscience, virtual reality, robotics and tele-operation.

VL - 5 UR - http://www.mdpi.com/2079-9292/5/3/42/pdf IS - 3 N1 -

This work is supported in part by the European Research Council under the Advanced Grant “SoftHands: A Theory of Soft Synergies for a New Generation of Artificial Hands” (No. ERC-291166), by the EU H2020 projects “SoftPro: Synergy-based Open-source Foundations and Technologies for Prosthetics and RehabilitatiOn” (No. 688857) and “SOMA: Soft Manipulation” (No. 64559) and by the EU FP7 project (No. 601165) “WEARable HAPtics for Humans and Robots (WEARHAP)”.

ER - TY - JOUR T1 - A Synergy-Based Optimally Designed Sensing Glove for Functional Grasp Recognition JF - Sensors Y1 - 2016 A1 - S. Ciotti A1 - E. Battaglia A1 - N. Carbonaro A1 - A. Bicchi A1 - A. Tognetti A1 - M. Bianchi KW - Haptics AB -

Achieving accurate and reliable kinematic hand pose reconstructions represents a challenging task. The main reason for this is the complexity of hand biomechanics, where several degrees of freedom are distributed along a continuous deformable structure. Wearable sensing can represent a viable solution to tackle this issue, since it enables a more natural kinematic monitoring. However, the intrinsic accuracy (as well as the number of sensing elements) of wearable hand pose reconstruction (HPR) systems can be severely limited by ergonomics and cost considerations. In this paper, we combined the theoretical foundations of the optimal design of HPR devices based on hand synergy information, i.e., the inter-joint covariation patterns, with textile goniometers based on knitted piezoresistive fabrics (KPF) technology, to develop, for the first time, an optimally-designed under-sensed glove for measuring hand kinematics. We used only five sensors optimally placed on the hand and completed hand pose reconstruction (described according to a kinematic model with 19 degrees of freedom) leveraging upon synergistic information. The reconstructions we obtained from five different subjects were used to implement an unsupervised method for the recognition of eight functional grasps, showing a high degree of accuracy and robustness.

VL - 16 UR - http://www.mdpi.com/1424-8220/16/6/811 IS - 6 ER - TY - CONF T1 - A Wearable Fabric-based Display for Haptic Multi-Cue Delivery T2 - IEEE Haptics Symposium Y1 - 2016 A1 - M. Bianchi A1 - E. Battaglia A1 - M. Poggiani A1 - S. Ciotti A1 - A. Bicchi KW - Haptics KW - Robotics AB -

Softness represents one of the most informative

haptic properties, which plays a fundamental role in both

everyday tasks and more complex procedures. Thus, it is not

surprising that much effort has been devoted to designing haptic

systems able to suitably reproduce this information. At the

same time, wearability has gained an increasing importance as

a novel paradigm to enable a more effective and naturalistic

human robot interaction. Capitalizing upon our previous works

on grounded softness devices, in this paper we present the

Wearable Fabric Yielding Display (W-FYD), a fabric-based

tactile display for multi-cue delivery that can be worn by

user’s finger. W-FYD enables to implement both passive and

active tactile exploration. Different levels of stiffness can be

reproduced by modulating the stretching state of a fabric

through two DC motors. An additional vertical degree of

freedom is implemented through a lifting mechanism, which

enables to convey softness stimuli to the user’s finger pad.

Furthermore, a sliding effect on the finger can be also induced.

Experiments with humans show the effectiveness of W-FYD for

haptic multi-cue delivery.

JF - IEEE Haptics Symposium PB - IEEE CY - Philadelphia, USA, April 8-11, 2016 UR - http://ieeexplore.ieee.org/search/searchresult.jsp?queryText=A%20Wearable%20Fabric-based%20Display%20for%20Haptic%20Multi-Cue%20Delivery&newsearch=true ER -