当前位置: X-MOL 学术Robotica › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A novel tactile sensor with multimodal vision and tactile units for multifunctional robot interaction
Robotica ( IF 2.7 ) Pub Date : 2024-03-05 , DOI: 10.1017/s0263574724000286
Pengwen Xiong , Yuxuan Huang , Yifan Yin , Yu Zhang , Aiguo Song

Robots with multi-sensors always have a problem of weak pairing among different modals of the collected information produced by multi-sensors, which leads to a bad perception performance during robot interaction. To solve this problem, this paper proposes a Force Vision Sight (FVSight) sensor, which utilizes a distributed flexible tactile sensing array integrated with a vision unit. This innovative approach aims to enhance the overall perceptual capabilities for object recognition. The core idea is using one perceptual layer to trigger both tactile images and force-tactile arrays. It allows the two heterogeneous tactile modal information to be consistent in the temporal and spatial dimensions, thus solving the problem of weak pairing between visual and tactile data. Two experiments are specially designed, namely object classification and slip detection. A dataset containing 27 objects with deep presses and shallow presses is collected for classification, and then 20 slip experiments on three objects are conducted. The determination of slip and stationary state is accurately obtained by covariance operation on the tactile data. The experimental results show the reliability of generated multimodal data and the effectiveness of our proposed FVSight sensor.



中文翻译:

一种具有多模态视觉和触觉单元的新型触觉传感器,用于多功能机器人交互

多传感器机器人往往存在多传感器采集信息的不同模态之间配对较弱的问题,导致机器人交互时感知性能较差。为了解决这个问题,本文提出了一种力视觉视觉(FVSight)传感器,它利用与视觉单元集成的分布式柔性触觉传感阵列。这种创新方法旨在增强物体识别的整体感知能力。其核心思想是使用一个感知层来触发触觉图像和力触觉阵列。它使得两种异构的触觉模态信息在时间和空间维度上保持一致,从而解决了视觉和触觉数据弱配对的问题。特别设计了两个实验,即物体分类和滑动检测。收集包含27个深压和浅压物体的数据集进行分类,然后对3个物体进行20次滑移实验。通过对触觉数据的协方差运算准确地获得滑移和静止状态的确定。实验结果表明了生成的多模态数据的可靠性以及我们提出的 FVSight 传感器的有效性。
更新日期:2024-03-05
down
wechat
bug