E-BTS: Event-Based Tactile Sensor for Haptic Teleoperation in Augmented Reality
Mukashev D. Seitzhan S. Chumakov J. Khajikhanov S. Yergibay M. Zhaniyar N. Chibar R. Mazhitov A. Rubagotti M. Kappassov Z.
2025Institute of Electrical and Electronics Engineers Inc.
IEEE Transactions on Robotics
2025#41450 - 463 pp.
The prompt and robust detection of tactile information is a relevant and challenging problem, and a considerable research effort is, thus, being put into innovative transduction methods for tactile sensors. In this article, we investigate the possibility of using event-based cameras to sense contact forces applied to objects by a robot end effector. The proposed optical tactile sensor incorporates a soft hemispherical pad made of silicone rubber with imprinted markers and a pulsewidth modulation light source that emits optical pulses, allowing robust detection of the markers to track deformations of the pad. To test the effectiveness of our sensor, experiments were carried out attaching it to a teleoperated robot arm to finely control it when out of the users field of view, as accurately as if the user could see it. In the experiments, an augmented reality display and a haptic device were used to convey the force detected by the event-based tactile sensor back to the human operator. The experiments included a practical application of a soft tissue puncturing tool, and psychophysical test results from ten participants were recorded, to validate efficacy and usability of the system.
Augmented reality (AR) , event-based vision , haptics , remote sensing , tactile sensors , visual force feedback (VFF)
Text of the article Перейти на текст статьи
Nazarbayev University, Institute of Smart Systems and Artificial Intelligence, Astana, 010000, Kazakhstan
Nazarbayev University, Department of Robotics, School of Engineering and Digital Sciences, Astana, 010000, Kazakhstan
Nazarbayev University
Nazarbayev University
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026