当前位置: X-MOL 学术IEEJ Trans. Electr. Electron. Eng. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
HAPOVER: A Haptic Pronunciation Improver Device
IEEJ Transactions on Electrical and Electronic Engineering ( IF 1 ) Pub Date : 2024-03-09 , DOI: 10.1002/tee.24048
Rıza Ilhan 1 , Kadir Kaçanoğlu 2
Affiliation  

This research article describes the HAPOVER (a haptic pronunciation improver device), which was produced to help second language learners' pronunciation skills as part of their foreign language learning process. The device comprises eight independent vibration motors connected to the fingers other than the thumb. The developed tactile feedback device was utilized to enhance pronunciation via speech processing and using vibration motor. The acoustic difference between the reference and the participant's recorded pronunciation signal was calculated with the help of Mel Frequency Cepstral Coefficients (MFCC) and Dynamic Time Warping (DTW) and converted into haptic codes that guide the speaker. The article describes the haptic codes' features and the creation method thereof. The device was tested by psychophysical evaluation. The results indicate an 80.74% improvement in word pronunciation with haptic guidance post training. Therefore, the results corroborate that word pronunciation data can be transmitted via tactile codes. © 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC.

中文翻译:

HAPOVER:触觉发音改进设备

这篇研究文章介绍了 HAPOVER(一种触觉发音改进设备),该设备旨在帮助第二语言学习者提高发音技能,作为外语学习过程的一部分。该设备包括八个独立的振动电机,连接到除拇指之外的其他手指。开发的触觉反馈设备用于通过语音处理和振动电机来增强发音。借助梅尔频率倒谱系数 (MFCC) 和动态时间规整 (DTW) 计算参考信号与参与者录制的发音信号之间的声学​​差异,并将其转换为指导说话者的触觉代码。文章介绍了触觉代码的特点及其创建方法。该设备通过心理物理学评估进行了测试。结果表明,训练后通过触觉指导,单词发音提高了 80.74%。因此,结果证实单词发音数据可以通过触觉代码传输。© 2024 日本电气工程师协会和 Wiley periodicals LLC。
更新日期:2024-03-09
down
wechat
bug