Zubin Choudhary
Skip Abstract Section
Abstract
Extended reality (XR) technologies, such as virtual reality (VR) and augmented reality (AR), provide users, their avatars, and embodied agents a shared platform to collaborate in a spatial context. Although traditional face-to-face communication is limited by users’ proximity, meaning that another human’s non-verbal embodied cues become more difficult to perceive the farther one is away from that person, researchers and practitioners have started to look into ways to accentuate or amplify such embodied cues and signals to counteract the effects of distance with XR technologies. In this article, we describe and evaluate the Big Head technique, in which a human’s head in VR/AR is scaled up relative to their distance from the observer as a mechanism for enhancing the visibility of non-verbal facial cues, such as facial expressions or eye gaze. To better understand and explore this technique, we present two complimentary human-subject experiments in this article. In our first experiment, we conducted a VR study with a head-mounted display to understand the impact of increased or decreased head scales on participants’ ability to perceive facial expressions as well as their sense of comfort and feeling of “uncannniness” over distances of up to 10 m. We explored two different scaling methods and compared perceptual thresholds and user preferences. Our second experiment was performed in an outdoor AR environment with an optical see-through head-mounted display. Participants were asked to estimate facial expressions and eye gaze, and identify a virtual human over large distances of 30, 60, and 90 m. In both experiments, our results show significant differences in minimum, maximum, and ideal head scales for different distances and tasks related to perceiving faces, facial expressions, and eye gaze, and we also found that participants were more comfortable with slightly bigger heads at larger distances. We discuss our findings with respect to the technologies used, and we discuss implications and guidelines for practical applications that aim to leverage XR-enhanced facial cues.
- [1] . 2010. Annotating with ‘sticky’ light for remote guidance. In ACM SIGGRAPH ASIA 2010 Posters. 1.Google Scholar
- [2] . 2012. Designing effective gaze mechanisms for virtual agents. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 705–714.Google ScholarDigital Library
- [3] . 2012. A head-eye coordination model for animating gaze shifts of virtual characters. In Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction. 1–6.Google ScholarDigital Library
- [4] . 2015. Virtual proxemics: Locomotion in the presence of obstacles in large immersive projection environments. In Proceedings of IEEE Virtual Reality (VR’15). 75–80.Google ScholarCross Ref
- [5] . 2003. Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin 29, 7 (2003), 819–833.Google ScholarCross Ref
- [6] . 2014. Variations in eyeball diameters of the healthy adults. Journal of Ophthalmology 2014 (2014), 503645.Google ScholarCross Ref
- [7] . 2010. Avatars as information: Perception of consumers based on their avatars in virtual worlds. Psychology & Marketing 27, 8 (2010), 741–765.Google ScholarCross Ref
- [8] . 2001. The MagicBook—Moving seamlessly between reality and virtuality. IEEE Computer Graphics and Applications 21, 3 (2001), 6–8.Google ScholarDigital Library
- [9] . 2016. “The speaking celt” augmented reality avatars guide through a museum–case study. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. 1484–1491.Google ScholarDigital Library
- [10] . 2012. Analyzing effects of geometric rendering parameters on size and distance estimation in on-axis stereographics. In Proceedings of the ACM Symposium on Applied Perception (SAP’12). 111–118.Google ScholarDigital Library
- [11] . 2012. First impressions: Users’ judgments of virtual agents’ personality and interpersonal attitude in first encounters. In Proceedings of the International Conference on Intelligent Virtual Agents. 67–80.Google ScholarDigital Library
- [12] . 2021. Scaled user embodied representations in virtual and augmented reality. In Proceedings of the Workshop on User-Embodied Interaction in Virtual Reality (UIVR’21).Google Scholar
- [13] . 2021. Revisiting distance perception with scaled embodied cues in social virtual reality. In Proceedings of IEEE Virtual Reality (VR’21). 1–10.Google ScholarCross Ref
- [14] . 2020. Virtual big heads: Analysis of human perception and comfort of head scales in social virtual reality. In Proceedings of IEEE Virtual Reality (VR’20). 425–433.Google Scholar
- [15] . 2021. Real-time magnification in augmented reality. In Proceedings of the ACM Symposium on Spatial User Interaction (SUI’21). 1–2.Google ScholarDigital Library
- [16] . 2000. The Role of Eye Gaze in Avatar Mediated Conversational Interfaces.
Technical Report . Microsoft Research.Google Scholar - [17] . 2016. Virtual interactive presence in global surgical education: International collaboration through augmented reality. World Neurosurgery 86 (2016), 103–111.Google ScholarCross Ref
- [18] . 2012. The effect of virtual agents’ emotion displays and appraisals on people’s decision making in negotiation. In Proceedings of the International Conference on Intelligent Virtual Agents. 53–66.Google ScholarDigital Library
- [19] . 2002. All robots are not created equal: The design and perception of humanoid robot heads. In Proceedings of the ACM Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques. 321–326.Google ScholarDigital Library
- [20] . 2013. Wait, are you sad or angry? Large exposure time differences required for the categorization of facial expressions of emotion. Journal of Vision 13, 4 (2013), 13.Google ScholarCross Ref
- [21] . 2009. Body and mind: A study of avatar personalization in three virtual worlds. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. 1151–1160.Google ScholarDigital Library
- [22] . 2012. My avatar and me—Gender and personality predictors of avatar-self discrepancy. Computers in Human Behavior 28, 1 (2012), 97–106.Google ScholarDigital Library
- [23] . 1989. The argument and evidence about universals in facial expressions. In Handbook of Social Psychophysiology. Wiley, 143–164.Google Scholar
- [24] . 1993. Facial expression and emotion. American Psychologist 48, 4 (1993), 384.Google ScholarCross Ref
- [25] . 1997. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press.Google Scholar
- [26] . 2020. Exploring the limitations of environment lighting on optical see-through head-mounted displays. In Proceedings of the ACM Conference on Spatial User Interfaces (SUI’20). 1–8.Google ScholarDigital Library
- [27] . 2020. A review of visual perception research in optical see-through augmented reality. In Proceedings of the International Conference on Artificial Reality and Telexistence and the Eurographics Symposium on Virtual Environments. 1–9.Google Scholar
- [28] . 2020. Effects of dark mode graphics on visual acuity and fatigue with virtual reality head-mounted displays. In Proceedings of IEEE Virtual Reality (VR’20). 434–442.Google Scholar
- [29] . 2021. An extended analysis on the benefits of dark mode user interfaces in optical see-through head-mounted displays. ACM Transactions on Applied Perception 18, 3 (2021), 1–22.Google ScholarDigital Library
- [30] . 2017. Human-avatar symbiosis for the treatment of auditory verbal hallucinations in schizophrenia through virtual/augmented reality and brain-computer interfaces. Frontiers in Neuroinformatics 11 (2017), 64.Google ScholarCross Ref
- [31] . 2010. More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces. In Proceedings of IEEE Virtual Reality (VR’10). 79–86.Google ScholarDigital Library
- [32] . 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. 529–536.Google ScholarDigital Library
- [33] . 2021. Big Head Mode. Retrieved November 12, 2022 from https://www.giantbomb.com/big-head-mode/3015-403/.Google Scholar
- [34] . 2009. Social mobile augmented reality for retail. In Proceedings of the 2009 IEEE International Conference on Pervasive Computing and Communications. IEEE, Los Alamitos, CA, 1–3.Google ScholarDigital Library
- [35] . 1979. Long-distance of transmission of facial affect signals. Ethology and Sociobiology 1, 1 (1979), 77–82.Google ScholarCross Ref
- [36] . 1963. A system for the notation of proxemic behavior. American Anthropologist 65, 5 (1963), 1003–1026.Google ScholarCross Ref
- [37] . 1969. The Hidden Dimension: Man’s Use of Space in Public and in Private. Anchor Books.Google Scholar
- [38] . 2014. Body space in social interactions: A comparison of reaching and comfort distance in immersive virtual reality. PloS One 9 (2014), e111511.Google Scholar
- [39] . 2009. Personal space regulation by the human amygdala. Nature Neuroscience 12 (2009), 1226–1227.Google ScholarCross Ref
- [40] . 2018. Revisiting trends in augmented reality research: A review of the 2nd decade of ISMAR (2008–2017). IEEE Transactions on Visualization and Computer Graphics 24, 11 (2018), 2947–2962.Google ScholarCross Ref
- [41] . 2019. Effects of patient care assistant embodiment and computer mediation on user experience. In Proceedings of the IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR’19). 17–177.Google ScholarCross Ref
- [42] . 1999. A collaboration support technique by integrating a shared virtual reality and a shared augmented reality. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. 48–53.Google ScholarCross Ref
- [43] . 2015. Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Transactions on Visualization and Computer Graphics 22, 7 (2015), 1912–1931.Google ScholarDigital Library
- [44] . 2021. Current practices, challenges, and design implications for collaborative AR/VR application development. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–15.Google ScholarDigital Library
- [45] . 2014. The segmentation of the HMD market: Optics for smart glasses, smart eyewear, AR and VR headsets. In Photonics Applications for Aviation, Aerospace, Commercial, and Harsh Environments V, Vol. 9202. International Society for Optics and Photonics, 92020D.Google Scholar
- [46] . 2019. Digital optical elements and technologies (EDO19): Applications to AR/VR/MR. In Digital Optical Technologies 2019, Vol. 11062. International Society for Optics and Photonics, 1106222.Google Scholar
- [47] . 2010. Perceptual issues in augmented reality revisited. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR’10). 3–12.Google ScholarCross Ref
- [48] . 2017. The effect of avatar realism in immersive social virtual realities. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1–10.Google ScholarCross Ref
- [49] . 2014. Does the mask govern the mind?: Effects of arbitrary gender representation on quantitative task performance in avatar-represented virtual groups. Cyberpsychology, Behavior, and Social Networking 17, 4 (2014), 248–254.Google ScholarCross Ref
- [50] . 2017. Exploring the effect of vibrotactile feedback through the floor on social presence in an immersive virtual environment. In Proceedings of IEEE Virtual Reality (VR’17).105–111.Google Scholar
- [51] . 2019. Mixed reality tabletop gameplay: Social interaction with a virtual human capable of physical influence. IEEE Transactions on Visualization and Computer Graphics 24, 8 (2019), 1–12.Google ScholarCross Ref
- [52] . 2006. Face matching under time pressure and task demands. In Proceedings of the 28th Annual Conference of the Cognitive Science Society. 1675–1680.Google Scholar
- [53] . 2012. Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics 31, 4 (2012), 1–11.Google ScholarDigital Library
- [54] . 2017. I am the passenger: Challenges in supporting AR/VR HMDs in-motion. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct. 251–251.Google ScholarDigital Library
- [55] . 2012. The uncanny valley [from the field]. IEEE Robotics & Automation Magazine 19, 2 (2012), 98–100.Google ScholarCross Ref
- [56] . 2019. A systematic review of the convergence of augmented reality, intelligent virtual agents, and the Internet of Things. In Artificial Intelligence in IoT. Transactions on Computational Science and Computational Intelligence. Springer, 1–24.Google Scholar
- [57] . 2019. Effects of shared gaze parameters on visual target identification task performance in augmented reality. In Proceedings of the ACM Symposium on Spatial User Interaction (SUI’19). 1–11.Google ScholarDigital Library
- [58] . 2016. Let the avatar brighten your smile: Effects of enhancing facial expressions in virtual environments. PloS One 11, 9 (2016), e0161794.Google ScholarCross Ref
- [59] . 2018. A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing 49 (2018), 215–228.Google ScholarCross Ref
- [60] . 2022. Effects of transparency on perceived humanness: Implications for rendering skin tones using optical see-through displays. IEEE Transactions on Visualization and Computer Graphics 28, 5 (2022), 2179–2189.Google ScholarCross Ref
- [61] . 2020. Collaboration in virtual and augmented reality: A systematic overview. In Proceedings of the International Conference on Augmented Reality, Virtual Reality, and Computer Graphics. 141–156.Google ScholarDigital Library
- [62] . 2017. Exploring enhancements for remote mixed reality collaboration. In Proceedings of ACM SIGGRAPH Asia Mobile Graphics and Interactive Applications. 16.Google ScholarDigital Library
- [63] . 2018. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- [64] . 2017. Empathic mixed reality: Sharing what you feel and interacting with what you see. In Proceedings of the IEEE International Symposium on Ubiquitous Virtual Reality. 38–41.Google ScholarCross Ref
- [65] . 2013. The perception of egocentric distances in virtual environments—A review. ACM Computing Surveys 46, 2 (2013), Article 23, 40 pages.Google ScholarDigital Library
- [66] . 2015. A review of eye gaze in virtual agents, social robotics and HCI: Behaviour generation, user interaction and perception. Computer Graphics Forum 34 (2015), 299–326.Google Scholar
- [67] . 2010. Triangulation. In Encyclopedia of Research Design. SAGE, Thousand Oaks, CA, 1.Google ScholarCross Ref
- [68] . 2009. Virtual friend or threat? The effects of facial expression and gaze interaction on psychophysiological responses and emotional experience. Psychophysiology 46, 5 (2009), 922–931.Google ScholarCross Ref
- [69] . 2010. The impact of facial emotional expressions on behavioral tendencies in women and men. Journal of Experimental Psychology: Human Perception and Performance 36, 2 (2010), 500.Google ScholarCross Ref
- [70] . 2007. The uncanny valley: Effect of realism on the impression of artificial human faces. Presence 16, 4 (2007), 337–351.Google ScholarDigital Library
- [71] . 2011. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision 11, 8 (2011), 11.Google ScholarCross Ref
- [72] . 1999. Public speaking in virtual reality: Facing an audience of avatars. IEEE Computer Graphics and Applications 19, 2 (1999), 6–9.Google ScholarDigital Library
- [73] . 2009. Smile through your fear and sadness: Transmitting and identifying facial expression signals over a range of viewing distances. Psychological Science 20, 10 (2009), 1202–1208.Google ScholarCross Ref
- [74] . 2018. Communication behavior in embodied virtual reality. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- [75] . 2011. Augmented mirror: Interactive augmented reality system based on kinect. In Proceedings of the IFIP Conference on Human-Computer Interaction. 483–486.Google ScholarCross Ref
- [76] . 2019. The influence of size in augmented reality telepresence avatars. In Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, Los Alamitos, CA, 538–546.Google ScholarCross Ref
- [77] . 2007. Evaluation of real-world and computer-generated stylized facial expressions. ACM Transactions on Applied Perception 4, 3 (2007), 16–es.Google ScholarDigital Library
- [78] . 2019. Information Visualization: Perception for Design. Morgan Kaufmann.Google Scholar
- [79] . 2019. Anticipating Widespread Augmented Reality: Insights from the 2018 AR Visioning Workshop. Technical Report. University of Central Florida and Office of Naval Research.Google Scholar
- [80] . 2007. The unbearable likeness of being digital: The persistence of nonverbal social norms in online virtual environments. Cyberpsychology & Behavior 10, 1 (2007), 115–121.
DOI: Google ScholarCross Ref - [81] . 2019. The effect of avatar appearance on social presence in an augmented reality remote collaboration. In Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, Los Alamitos, CA, 547–556.Google ScholarCross Ref
- [82] . 2019. AR displays: Next-generation technologies to solve the vergence–accommodation conflict. Applied Sciences 9, 15 (2019), 3147. https://www.mdpi.com/2076-3417/9/15/3147.Google ScholarCross Ref
- [83] . 2015. To stylize or not to stylize? The effect of shape and material stylization on the perception of computer-generated faces. ACM Transactions on Graphics 34, 6 (2015), 1–12.Google ScholarDigital Library
- [84] . 2017. Investigating the impacts of avatar gender, avatar age, and region theme on avatar physical activity in the virtual world. Computers in Human Behavior 68 (2017), 378–387.Google ScholarDigital Library
Index Terms
- Virtual Big Heads in Extended Reality: Estimation of Ideal Head Scales and Perceptual Thresholds for Comfort and Facial Cues
Recommendations
Using Head-Mounted Displays for Virtual Reality: Investigating Subjective Reactions to Eye-Tracking Scenarios
Virtual, Augmented and Mixed RealityAbstractVirtual reality head-mounted displays (HMDs) have recently incorporated eye-tracking into hardware design. For the present study, the Varjo VR-1 and HTC Vive Pro Eye HMDs were used for three eye-tracking scenarios; and immersion, simulator ...
Perceptual thresholds of visual size discrimination in augmented and virtual reality
AbstractThe perception of size in virtual objects in Augmented Reality (AR) and Virtual Reality (VR) is a not trivial issue, as the effectiveness of manipulating and interacting with virtual content depends on the accuracy of size perception. However, ...
Graphical abstractDisplay Omitted
Highlights- A comparative experiment to understand the difference in size perception in AR vs VR.
- The thresholds for size discrimination in AR and VR are not the same.
- The accuracy of judgments is asymmetric for increases and decreases of ...
A comparison of two cost-differentiated virtual reality systems for perception and action tasks
SAP '14: Proceedings of the ACM Symposium on Applied PerceptionRecent advances in technology and the opportunity to obtain commodity-level components have made the development and use of three-dimensional virtual environments more available than ever before. How well such components work to generate realistic ...
Comments