Body-parts Remapping

Body ownership can be induced to fake or virtual bodies (illusory body ownership). Observers feel as though a rubber hand is their own hand through simultaneous and synchronous visual-tactile stimulations; It is the rubber hand illusion [1]. When a virtual avatar’s movement is synchronized with an observer’s movement, the observer feels as if the avatar is their own body (full body illusion) [2]. Thus, visual-motor synchronicity also induces illusory body ownership. Illusory body ownership can be induced even for bodies of a different age [3] or race [4]. However, the associations between body parts are maintained; For example, the real right hand corresponds to the rubber right hand.Sasaki et al (2017) [5] created a four-arm interaction by adding two robot arms that were synchronized with the left and right leg movements. In this line, we aimed to investigate if illusory body ownership could be induced by the visual-motor synchronicity of different body parts, and investigate if a body-part remapping can be implemented.
Participants moved their right thumb freely, and observed a virtual right arm through a head-mounted display (HMD: Oculus Rift DK2) for 5 min. The virtual right arm was synchronous or asynchronous with the observers’ actions. A motion capture system (Noitom Perception Neuron) detected the observer’s right thumb movements, and applied them to the virtual arm in the synchronous condition. Two prerecorded motions of an experimenter’s right thumb were applied to motions of the virtual right arm in the asynchronous condition. A virtual knife was presented to measure the SCR (skin conductance response) at the end of each trial. The SCR was measured by BIOPAC MP150. Participants pointed to the position where they felt the tip of their right thumb met with their left index finger under the table (self-localization task). The virtual right arm was presented on the right of the body. After the task, participants were asked to complete a questionnaire regarding body ownership on a seven-level Likert scale from 1 (I did not feel that at all) to 7 (I felt it extremely strongly).
We found that the questionnaire scores were higher in the synchronous condition than in the asynchronous condition. These results suggest that the participants felt as though their own right thumb became the virtual right arm, and illusory body ownership was induced though the synchronization of different body parts. We did not obtain a significant startle response. Self-localization drifted toward the virtual right arm more in the synchronous condition than in the asynchronous condition. It is considered that the right thumb was pulled into the position of the virtual right arm.Our study will enable us to control an arm using a finger with body ownership. Thus, two arms can operate concurrently and independently using a finger and an arm. This may contribute to supporting people with limb deficits.

PRESENTATION

Kondo, R., Tani, Y., Sugimoto, M., Minamizawa, K., Inami, M. and Kitazaki, M. (2018). Illusory body ownership between different body parts: Synchronization of right thumb and right arm. IEEE Virtual Reality 2018, Reutlingen, Germany, March 18-22.

REFERENCES

[1] Botvinick, M., & Cohen, J. (1998). Rubber hands' feel'touch that eyes see. Nature, 391(6669), 756.
[2] Gonzalez-Franco, M., Perez-Marcos, D., Spanlang, B., & Slater, M. (2010, March). The contribution of real-time mirror reflections of motor actions on virtual body ownership in an immersive virtual environment. In IEEE VR 2010 (pp. 111-114).
[3] Banakou, D., Groten, R., & Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proceedings of the National Academy of Sciences, 110(31), 12846-12851.
[4] Peck, T. C., Seinfeld, S., Aglioti, S. M., & Slater, M. (2013). Putting yourself in the skin of a black avatar reduces implicit racial bias. Consciousness and cognition, 22(3), 779-787.
[5] Sasaki, T., Saraiji, M. H. D., Fernando, C. L., Minamizawa, K., & Inami, M. (2017, July). MetaLimbs: multiple arms interaction metamorphism. In ACM SIGGRAPH 2017 Emerging Technologies (p. 16).

Publications

Re-association of Body Parts: Illusory Ownership of a Virtual Arm Associated with the Contralateral Real Finger by Visuo-motor Synchrony.Frontiers in Robotics and AI: Virtual Environments, 7:26.Kondo, R., Tani, Y., Sugimoto, M., Minamizawa, K., Inami, M., and Kitazaki, M.DOI10.3389/frobt.2020.00026