International Open Access Journal Platform

视听语义一致性影响工作记忆

Audio-visual Semantic Coherence Affects Working Memory

Psychology of China / 2024,6(4): 651-663 / 2024-04-28 1439 1706

View Download PDF

• Authors: 程嘉      李静静      王爱君     
• Information:

  苏州大学心理学系心理与行为科学研究中心，苏州

• Keywords: Audiovisual integration; Semantic congruency; Working memory 视听整合；语义一致性；工作记忆
• Abstract: Audiovisual integration refers to the process in which visual and auditory information isintegrated into a single multisensory event, which can affect the encoding, maintenance, retrievalprocess of working memory. Along with the continuously go deep into of the multisensory research,multiple factors have been found to exert influences on working memory, but the cognitive and neuralmechanisms of the effect of audiovisual integration on working memory remain unclear. Audiovisualsemantic congruency refers to the congruency of content and meaning between the visual and auditorysensory inputs. Visual and auditory information complement and support each other, rather than conflictor contradict each other. Recent studies show that semantic congruency can improve multisensoryworking memory performance. Future studies needs to further explore the impact of audiovisualintegration on working memory maintenance in cognitive mechanism, and further explore the effect ofsemantic congruency on multisensory working memory by comprehensively considering the propertiesof materials and attention effects, so as to exend researches to people of different ages. In terms of neuralmechanism, future studies should enrich researches on the impact of attention on the working memoryretrieval process, and explore the role of different brain regions on multisensory working memory, so asto establish a more complete theoretical model. 视听整合是指视听信息被整合成多感觉事件的过程，能够对工作记忆的编码、保持和提取过程产生影响。随着多感觉研究不断深入，语义一致性被发现能够影响工作记忆，但是其中的认知和神经机制仍不清楚。视听语义一致性是指视觉和听觉两个感官输入之间的内容和意义的一致性，视觉和听觉的信息相互补充和支持，而不是产生冲突或矛盾。近期研究结果表明，语义一致性能够提高人们对视听信息的理解和认知，提升多感觉工作记忆表现。未来的研究需要在认知机制方面进一步探讨视听整合对工作记忆保持过程的影响，进一步探究语义一致性对工作记忆的作用。在神经机制方面，未来的研究需要进一步探讨语义一致中的注意效应对工作记忆提取过程的影响，以此建立更加完善的理论模型。
• DOI: https://doi.org/10.35534/pc.0604074
• Cite: 程嘉，李静静，王爱君．视听语义一致性影响工作记忆［J］．中国心理学前沿，2024，6（4）：651-663．