Lendy Mulot
Claudio Pacchierotti
Abstract
Ultrasound mid-air haptic (UMH) devices can remotely render vibrotactile shapes on the skin of unequipped users, e.g., to draw haptic icons or render virtual object shapes. Spatio-temporal modulation (STM), the state-of-the-art UMH shape-rendering method, provides large freedom in shape design and produces the strongest possible stimuli for this technology. Yet, STM shapes are often reported to be blurry, complicating shape identification. Dynamic tactile pointers (DTP) were recently introduced as a technique to overcome this issue. By tracing a contour with an amplitude-modulated focal point, they significantly improve shape identification accuracy over STM, but at the cost of much lower stimulus intensity. Building upon this, we propose spatio-temporally-modulated Tactile Pointers (STP), a novel method for rendering clearer and sharper UMH shapes while at the same time producing strong vibrotactile sensations. We ran two human participant experiments, which show that STP shapes are perceived as significantly stronger than DTP shapes, while shape identification accuracy is significantly improved over STM and on par with that obtained with DTP. Our work has implications for effective shape rendering with UMH and provides insights that could inform future psychophysical investigation into vibrotactile shape perception in UMH.
- . 1988. Four channels mediate the mechanical aspects of touch. Journal of the Acoustical Society of America 84, 5 (1988), 1680–1694.Google Scholar
Cross Ref
- . 2021. Validating the salience of haptic icons for automotive mid-air haptic gesture interfaces. In Contemporary Ergonomics & Human Factors 2022, 82.Google Scholar
- . 2013. UltraHaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proc. of the 26th ACM Symposium on User Interface Software & Technology. ACM, 505–514.Google Scholar
- . 2022. Ultrasound haptic feedback for touchless user interfaces: Design patterns. In Ultrasound Mid-air Haptics for Touchless Interfaces. Springer, 71–98.Google ScholarCross Ref
- . 2018. Using spatiotemporal modulation to draw tactile patterns in mid-air. In Proc. of the Eurohaptics Conference. Springer, 270–281.Google ScholarCross Ref
- . 2019. Sampling strategy for ultrasonic mid-air haptics. In Proc. of the CHI Conference on Human Factors in Computing Systems. 1–11.Google ScholarDigital Library
- . 2022. Ultrasound Mid-air Haptics for Touchless Interfaces. Springer Cham.
DOI: Google ScholarCross Ref - . 2020. Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE Transactions on Haptics 13 (2020), 806–817.Google ScholarDigital Library
- . 2012. Handwriting transmission system using noncontact tactile display. In Proc. of the IEEE Haptics Symposium.399–401.Google Scholar
- . 2019. Investigating the recognition of local shapes using mid-air ultrasound haptics. In Proc. of the IEEE World Haptics Conference (WHC’19). IEEE, 503–508.Google ScholarCross Ref
- . 2022. Ultrasound mid-air tactile feedback for immersive virtual reality interaction. In Ultrasound Mid-air Haptics for Touchless Interfaces. Springer, 147–183.Google ScholarCross Ref
- . 2015. Active touch perception produced by airborne ultrasonic haptic hologram. In 2015 IEEE World Haptics Conference (WHC’15). IEEE, 362–367.Google ScholarCross Ref
- . 2016. High spatial resolution midair tactile display using 70 kHz ultrasound. In Proc. of the Eurohaptics Conference. Springer, 57–67.Google ScholarDigital Library
- . 2008. Non-contact method for producing tactile sensation using airborne ultrasound. In Proc. of the Eurohaptics Conference.504–513.Google ScholarDigital Library
- . 2012. Application of psychophysical techniques to haptic research. IEEE Transactions on Haptics 6, 3 (2012), 268–284.Google ScholarDigital Library
- . 2018. Spatiotemporal modulation for mid-air haptic feedback from an ultrasonic phased array. Journal of the Acoustical Society of America 143, 3 (2018), 1836–1836.Google ScholarCross Ref
- . 2009. Relation between index finger width and hand width anthropometric measures. In Proc. of the Annual International Conference on IEEE Engineering in Medicine and Biology Society.823–826.Google ScholarCross Ref
- . 2016. Haptogram: Ultrasonic point-cloud tactile stimulation. IEEE Access 4 (2016), 7758–7769.Google ScholarCross Ref
- . 2014. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics 33, 6 (2014), 1–10.Google ScholarDigital Library
- . 2019. Mid-air haptic algorithms for rendering 3D shapes. In 2019 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE’19). IEEE, 1–6.Google Scholar
- . 2021. DOLPHIN: A framework for the design and perceptual evaluation of ultrasound mid-air haptic stimuli. In Proc. of the ACM Symposium on Applied Perception. 1–10.Google Scholar
- . 2013. Talking about tactile experiences. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems. 1659–1668.Google ScholarDigital Library
- . 2019. PsychoPy2: Experiments in behavior made easy. Behavior Research Methods 51 (2019), 195–203.Google ScholarCross Ref
- . 2020. A survey of mid-air ultrasound haptics and its applications. IEEE Transactions on Haptics 14 (2020), 2–19.Google Scholar
- . 2023. Shear shock waves mediate haptic holography via focused ultrasound. Science Advances 9, 9 (2023), eadf2037.Google ScholarCross Ref
- . 2019. Mid-air haptic bio-holograms in mixed reality. In Proc. of the 2019 IEEE ISMAR-Adjunct. 348–352.Google Scholar
- . 2019. Invisible touch: How identifiable are mid-air haptic shapes? In ACM CHI: Conference on Human Factors in Computing Systems. 1–6.Google Scholar
- . 2019. Tactile sensitivity in ultrasonic haptics: Do different parts of hand and different rendering methods have an impact on perceptual threshold? Virtual Reality & Intelligent Hardware 1, 3 (2019), 265–275.Google ScholarCross Ref
- . 2018. Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli. In Proc. of the Eurohaptics Conference.276–288.Google ScholarCross Ref
Index Terms
- Improving the Perception of Mid-air Tactile Shapes with Spatio-temporally-modulated Tactile Pointers
Recommendations
Rendering volumetric haptic shapes in mid-air using ultrasound
We present a method for creating three-dimensional haptic shapes in mid-air using focused ultrasound. This approach applies the principles of acoustic radiation force, whereby the non-linear effects of sound produce forces on the skin which are strong ...
Visually Augmenting Underfoot Tactile Perception in Augmented Virtuality
VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and TechnologyUnderfoot haptics, a largely unexplored area, offers rich tactile information close to that of hand-based interactions. Haptic feedback gives a sense of physicality to virtual environments making for a more realistic and immersive experience. Augmented ...
Head-mounted display with mid-air tactile feedback
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and TechnologyVirtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the ...
Comments