Semantic congruency modulates the speed-up of multisensory responses

Responses to multisensory signals are often faster compared to their unisensory components. This speed-up is typically attributed to target redundancy in that a correct response can be triggered by one or the other signal. In addition, semantic congruency of signals can also modulate multisensory responses; however, the contribution of semantic content is difficult to isolate … Read more

No selective integration required: A race model explains responses to audiovisual motion-in-depth

Looming motion is an ecologically salient signal that often signifies danger. In both audition and vision, humans show behavioral biases in response to perceiving looming motion, which is suggested to indicate an adaptation for survival. However, it is an open question whether such biases occur also in the combined processing of multisensory signals. Towards this … Read more

The role of context in experiments and models of multisensory decision making

The availability of signals from multiple senses is often beneficial for perceptual decisions. To study such benefits, models of multisensory decision-making are typically fed with the behavioural performance as measured separately with unisensory component signals. Critically, by doing so, the approach implicitly makes the so-called context invariance assumption, which states that processing of a signal … Read more

RSE-box: An analysis and modelling package to study response times to multiple signals

Responses to two redundant sensory signals are typically faster than responses to the individual component signals. This redundant signals effect (RSE) is extensively studied not only with an impressive variety of signals but also across different subject populations focusing on development, aging, and many clinical samples. Yet, a standardized methodology to analyse and interpret the … Read more

A comparative analysis of response times shows that multisensory benefits and interactions are not equivalent

Multisensory signals allow faster responses than the unisensory components. While this redundant signals effect (RSE) has been studied widely with diverse signals, no modelling approach explored the RSE systematically across studies. For a comparative analysis, here, we propose three steps: The first quantifies the RSE compared to a simple, parameter-free race model. The second quantifies … Read more

Multisensory decisions: The test of a race model, its logic, and power

The use of separate multisensory signals is often beneficial. A prominent example is the speed-up of responses to two redundant signals relative to the components, which is known as the redundant signals effect (RSE). A convenient explanation for the effect is statistical facilitation, which is inherent in the basic architecture of race models (Raab, 1962, … Read more

Principles of multisensory behavior

The combined use of multisensory signals is often beneficial. Based on neuronal recordings in the superior colliculus of cats, three basic rules were formulated to describe the effectiveness of multisensory signals: the enhancement of neuronal responses to multisensory compared with unisensory signals is largest when signals occur at the same location (“spatial rule”), when signals … Read more

Noise and correlations in parallel perceptual decision making

Perceptual decisions involve the accumulation of sensory evidence over time, a process that is corrupted by noise [1]. Here, we extend the decision-making framework to crossmodal research [2, 3] and the parallel processing of two distinct signals presented to different sensory modalities like vision and audition. Contrary to the widespread view that multisensory signals are … Read more