This paper presents an audiovisual perceptual analysis of the wh-question and wh-exclamation intonation in Brazilian Portuguese using auditory–visual congruent and incongruent stimuli, to investigate the relative importance of each modality in signaling pragmatic meanings. Ten Brazilian Portuguese speakers (five female) were filmed while producing both speech acts 10 times. Next, artificial stimuli were created: audio and visual cues were either matched (audio and video from the same speech act) or mismatched (audio and video from the different speech acts), resulting in 10 congruent and 10 incongruent stimuli of the wh-questions and the wh-exclamations. The perceptual experiment was taken by 36 Brazilians who identified the stimulus as a question or an exclamation. Results from the logistic regression showed that the factor ‘congruence’ was significant and had a significant interaction with ‘speakers’, which means that the congruent stimuli increased the comprehension of the Brazilian Portuguese wh-questions and wh-exclamations. In contrast, the incongruent stimuli tended to lower listeners’ identification, but to a degree depending on individual speakers’ strategies. Although variation in the accuracy of expressing both speech acts was also found across speakers, this study corroborates that the visual channel impacts the perceptual identification of the pragmatic intonation function of distinguishing sentence mode.

中文翻译：

---

视觉通道有助于理解巴西葡萄牙语 wh 疑问句和 wh 感叹句的语调：来自一致和不一致刺激的证据

本文利用听觉-视觉一致和不一致刺激对巴西葡萄牙语中的 wh 疑问句和 wh 感叹语调进行视听感知分析，以研究每种语态在传达语用意义方面的相对重要性。 10 名讲巴西葡萄牙语的人（5 名女性）在表演两种言语行为时被拍摄了 10 次。接下来，创建人工刺激：音频和视觉线索要么匹配（来自同一言语行为的音频和视频），要么不匹配（来自不同言语行为的音频和视频），从而产生 wh 问题的 10 个一致和 10 个不一致的刺激和 wh 感叹号。 36 名巴西人进行了这项感知实验，他们将刺激识别为问题或感叹。逻辑回归结果表明，“一致性”因素很显着，并且与“说话者”有显着的交互作用，这意味着一致性刺激增加了巴西葡萄牙语 wh 疑问句和 wh 感叹词的理解。相反，不一致的刺激往往会降低听众的识别度，但在一定程度上取决于个别说话者的策略。尽管不同说话者表达两种言语行为的准确性也存在差异，但本研究证实视觉通道影响区分句子模式的语用语调功能的感知识别。