MMSpace: Kinetic Telepresence

[To Japanese Page]

Past project at NTT Communication Science Laboratories

A novel research prototype, called MMSpace, was developed for realistic social telepresence in small group-to-group conversations. MMSpace consists of kinetic display avatars, which can change pose and position by automatically mirroring the remote user’s head motions. To fully explore its potential beyond previous alternatives, MMSpace has the following novel features. First, it targets symmetric group-to-group telepresence. Second, the kinetic avatars of MMSpace can produce highly accurate, low latency, and silent physical motions, by using 4-Degree-of-Freedom (DoF) direct-drive actuators, and they can express a wide range of natural human behaviors like head gestures and changing attitudes, as well as indicating the focus of attention. Third, MMSpace supports eye contact between every pair of participants, by integrating i) directional visual attention cues indicated by avatar’s kinetic pose change, ii) line-of-sight alignment among the positions of persons, avatars and cameras, and iii) attention-based camera switching, which allows an avatar to always show its owner’s face looking directly toward the person that the avatar’s owner is looking at. The prototype targets the 2 x 2 setting, and subjective evaluations based on group discussions indicate that the kinetic display avatar is superior to static displays in various aspects including gaze-awareness, eye-contact, perception of other nonverbal behaviors, mutual understanding, and sense of telepresence.

Keyword

Teleconference, Telepresence, Computer Mediated Communications, Nonverbal Behaviors, Projection Mapping

Related Papers

  • Kazuhiro Otsuka, “Behavioral analysis of kinetic telepresence for small symmetric group-to-group meetings”, IEEE Transactions on Multimedia, Vol.20, No.6, pp.1432–1447, June 2018 [OpenAccess]
  • Kazuhiro Otsuka, “MMSpace: Kinetically-augmented telepresence for small group-to-group conversations,” In Proceedings of IEEE Virtual Reality 2016 (VR2016), pp. 19-28, March, 2016 [PDF ]

©2016 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

Demo Movie (presented at CHI2017 Video Showcase)

NTT CSL Open House 2016 Poster

Multimodal Communications and Informatics Lab. / マルチモーダル情報処理研究室(大塚研究室)