Colavita Visual Dominance Effect

The Colavita visual dominance effect refers to the phenomenon in which study participants respond more often to the visual component of an audiovisual stimulus, when presented with bimodal stimuli.

Research has shown that vision is the most dominant sense for human beingsPosner, M.I., Nissen, M.J., Klein, M., (1976)"Visual Dominance:An Information Processing Account of its Origins and Significance" Psychological Review, 83(2):157-171 who do not suffer from sensory difficulties (e.g. blindness, cataracts). Theorists have proposed that the Colavita visual dominance effect demonstrates a bias toward visual sensory information, because the presence of auditory stimuli is commonly neglected during audiovisual events.

Francis B. Colavita, whom the Colavita visual dominance effect is named, was the first to demonstrate this phenomenon in 1974. Colavita's original experiments found that visual dominance for audiovisual events persists under a number of conditions, which has been further established as a robust effect by other researchers.

The Colavita visual dominance effect

In 1974, Colavita conducted an experiment, which provided evidence for visual dominance in humans when performing an audiovisual discrimination task.Colavita, F.B. (1974). Human sensory dominance. Perception & Psychophysics,16(2), 409-412.

In his experiment, Colavita (1974) presented participants with an auditory ( tone) or visual (light) stimulus, to which they were instructed to respond by pressing the ‘tone key’ or ‘light key’ respectively. Throughout the experiment, unimodal auditory trials, unimodal visual trials and a small number of audiovisual bimodal trials were randomly presented.

Colavita deceived the participants by informing them that the bimodal trials in the experiment occurred "accidentally". During practice trials, Colavita would "accidentally" present audiovisual stimuli, and would then draw the participants’ attention to what had just happened and would apologize for such ‘accident’. In addition, the participants were not instructed on how to respond on such trials or whether this type of trials would occur again.Koppen C., Spence C. (2007a). Seeing the light: exploring the Colavita visual dominance effect. Experimental Brain Research 180,737–754.

The results showed that participants had almost equivalent response times for auditory and visual stimuli in unimodal trials. Additionally, Colavita found that participants pressed the ‘light key’ in the majority of the bimodal trials. This was seen as evidence of visual dominance because participants failed to acknowledge the presence of the auditory stimulus in most bimodal trials. However, due to Colavita's deception of the "accidental" occurrence of bimodal trials, researchers have proposed that experimenter expectancy effects, task demands or methodological problems may have contributed to the visual dominance effect reported in Colavita's original study.Sinnett, S., Spence, C. & Soto-Faraco, S. (2007).Visual Dominance and attention: The Colavita effect revisited. Perception and Psychophysics, 69(5), 673-686. Nevertheless, subsequent experiments have discontinued the use of deception, and continue to show a robust Colavita visual dominance effect.

For example, Sinnet and his colleagues conducted an experiment in which they presented participants with three response keys, one for each type of response (unimodal visual, unimodal auditory and bimodal audiovisual); instead of just two, and they instructed participants to press the bimodal key when responding to audiovisual stimuli. This new manipulation resulted in a significant reduction of the Colavita effect because errors in bimodal trials were only committed in a small number of trials. In another experiment, Sinnett and his colleagues conducted a pre-specified target detection task where auditory targets were more frequent than visual or bimodal targets. This led to the elimination of the Colavita effect. The authors suggested that this was due to the introduction of a bias toward auditory stimuli.Koppen, C. & Spence, C. (2007b). Audiovisual asynchrony modulates the Colavita visual dominance effect. Brain Research, 1186, 224-232. Ngo and her colleagues conducted a similar study where the results were replicated, because their findings showed that under the appropriate conditions and task demand, the Colavita effect can be reversed.Ngo, M.K., Cadieux, M.L., Sinnett, S., Soto-Faraco, S. & Spence, C. (2011). Reversing the Colavita visual dominance effect. Experimental Brain Research, 214, 607-618. Also, Sinnett and his colleagues mention that animals and humans increase their reliance on auditory stimuli in high-arousal situations and when facing potential threats, which could imply that the Colavita effect is situation and context dependent.

Colavita also varied the intensity of the visual and the auditory stimuli to determine whether matching the intensity of both stimuli, or if increasing the intensity of only the auditory stimulus would decrease the occurrence of the Colavita effect. However, none of the experimental manipulations regarding the intensity of the stimuli decreased the occurrence of the Colavita effect. Further research has been conducted to replicate Colavita's experiment and to extend the Colavita effect to more complex stimuli. For example, Sinnett, Spence and Soto-Faraco conducted an experiment in 2007, in which pictures and sounds were used as stimuli instead of the light and tone. The rationale for using more complex stimuli was that this type of stimuli would increas
perceptual load
requiring more attentional resources.Lavie, N. (2005). Distracted and Confused? Selective attention under load. Trends in Cognitive Sciences, 9(2), 75-82. The findings from this study showed that the Colavita effect continues to occur when stimuli become more complex.

Explanation of visual dominance effect

According to Hartcher-O’Brien and colleagues, the Colavita and visual dominance effects can be generally attributed to an imbalance in the ability to access processing resources, namely between vision and other sensory modalities. Failure of a stimulus to access awareness when multiple stimuli are presented at the same time may result in sensory dominance.Hartcher-O'Brien, J., Levitan, C., Spence, C. (2010). Extending visual dominance over touch for input off the body.''Brain Research'', 1362: 48-55 For decades, there has been a continuous debate regarding whether the Colavita effect occurs at a sensory level or at the level of attention, involving exogenous (involuntary or reflexive) or endogenous (voluntary) attention. Research has found inconclusive results regarding this debate.

Posner and colleagues conducted a study to look at the origin and significance of visual dominance. They proposed that attentional resources are endogenously (voluntarily) biased towards vision in order to compensate for the low alerting capability of visual signals. Posner and colleagues proposed that visual stimuli do not alert attention automatically, whereas other sensory modalities do. In order for the visual stimulus to serve as an effective alerting mechanism, the person must process it through active attention. Consequently, when attention is directed towards vision, the attentive mechanisms to other sensory modalities are reduced. The low alerting capability of visual signals is compensated by individuals’ attentional bias towards visual modalities. This is viewed by Posner and colleagues (1976) as an endogenous (voluntary) strategy in responding to one's environment.

Conversely, Koppen and Spence suggest that attentional bias towards the visual modality may be exogenously (reflexively) mediated. That is to say, visual stimuli may in fact capture a person's attention more effectively than stimuli from other sensory modalities.

Koppen and Spence (2007a) investigated what role exogenous (reflexive) attention plays in sensory modality, and found that the Colavita effect can be regulated (but not terminated), depending on which sensory modality (audition or vision) individuals focus their exogenous attention on. Visual stimuli were more effective at capturing attention than auditory stimuli. Thus, Koppen and Spence propose that the Colavita effect may reflect differences in the exogenous attention-capturing qualities of visual versus auditory stimuli.

Sinnett, Spence, and Faraco (2007) conducted an experiment in which they noted that, when attention was manipulated in the direction of the auditory stimulus, the Colavita effect was able to be reduced, but not reversed, to create auditory dominance. As a result, they proposed that visual dominance cannot be based entirely on attentional mechanisms, but must occur at a sensory level. This inability to reverse the Colavita effect when attention is directed to an auditory stimulus, suggests that visual dominance may involve innate biases towards visual modalities. In one of their experiments, in order to reduce the magnitude of visual dominance, Sinnett and his colleagues (2007) created a strong bias towards the auditory modality. To do this, they increased the proportion of auditory targets, which resulted in faster reaction times to unimodal auditory targets than to unimodal visual targets. Participants showed a small (nonsignificant) bias towards making more erroneous unimodal auditory responses, and no reversal of the Colavita effect was observed. These results support the claim that visual dominance occurs at a sensory level, before the engagement of attention.

Another theory that has been used in the explanation of the Colavita effect is the ‘Failure of Binding’. This theory suggests that participants bind together the visual and auditory components of an audiovisual stimulus, which can hinder the processing of the auditory component of the audiovisual stimulus. This occurs because the visual component alone provides enough information about the audiovisual stimulus. This theory only applies when the visual and auditory stimuli presented are congruent. When they are incongruent, the visual component is not an accurate representation of the auditory component. In this case, incongruency can act as a cue to inform participants that a bimodal target occurred.

Spatial and temporal coincidence

The Colavita effect has been shown to be affected by factors that contribute to the intermodal binding of auditory and visual stimuli during perception. These factors of interest are spatial and temporal coincidence between the auditory and visual stimuli, which modulate the Colavita effect through temporal separation and temporal order.

For example, results from an experiment, conducted by Koppen and Spence (2007b), showed a larger Colavita effect when auditory and visual stimuli were presented closer together in time. When the stimuli were presented further apart in time, the Colavita effect was reduced. Their results also showed that the Colavita effect was largest when the visual stimulus was presented before the auditory stimulus during the bimodal trials. Conversely, the Colavita effect was reversed or reduced when the auditory stimulus preceded the visual stimulus . In addition, Koppen and Spence conducted an experiment in which participants showed a significantly larger Colavita effect when the auditory and visual stimuli were presented from the same spatial location, rather than from different locations.Koppen, C. & Spence, C. (2007c) Spatial coincidence modulates the Colavita visual dominance effect. ''Neuroscience Letters'', 417(2):107-111 Based on these results, Koppen and his colleagues proposed that the ‘unity effect’ can adequately explain the role of spatial and temporal coincidence between stimuli in modulating the Colavita effect.Koppen, C., Alsius, A., & Spence, C. (2008). Semantic congruency and the Colavita visual dominance effect. Experimental Brain Research 184,533-546 According to the Unity effect, intersensory bias is greater when the participants unconsciously bind the two sensory events and believe that a single unimodal object is being perceived, rather than two separate events.

Semantic Congruency

Research has shown that multisensory cues from an object may share certain semantic features, which may contribute to cross-modal binding of sensory information. Sinnett and his colleagues conducted an experiment using meaningful stimuli, and their findings showed that the Colavita effect continued to exist when using complex and meaningful stimuli were used.

In addition, a study conducted by Laurienti and colleagues showed that, under certain conditions, responses to audiovisual stimuli can be affected by semantic congruence or incongruence. More specifically, their findings showed that participants responded faster to congruent auditory and visual stimuli than to incongruent stimuli.Laurienti, P. J., Kraft, R. A., Maldijian, J. A., Burdette, J. H. & Wallace, M. T. (2004) Semantic congruency is a critical factor in multisensory behavioural performance. ''Experimental Brain Research''158:405-414 In addition, Koppen, Alsius and Spence conducted a study which investigated whether the Colavita effect would be modulated by the semantic congruency between the visual and auditory stimulus, using stimuli of similar semantic meaning and complexity. The findings from this study showed that semantic congruency had no effect on the magnitude of the Colavita effect in the experiments, yet it had a significant effect on participants’ performance in the speeded discrimination task. Participants showed a pattern that reflected difficulties with separating the auditory stimulus from the visual stimulus when these stimuli had congruent semantic meaning and were presented simultaneously. For incongruent stimuli, participants had faster response times, which could also be explained by the previously mentioned theory of ‘Failure of Binding’.

No Colavita effect in people with one eye

Previous research has shown that people with one eye have enhanced spatial vision, implying that vision in the remaining working eye compensates for the loss of the simultaneous use of both eyes.Moro, S.S., Steeves J.K.E. (2012). No Colavita effect:equal auditory and visual processing in people with one eye. Exp Brain Res 216: 367-373 Furthermore, individuals who have lost the ability to use one sensory system develop an enhanced ability in the use of the remaining senses. It is thought that intact sensory systems may adapt and compensate for the loss of one of the senses. However, little is known about cross-sensory adaption in cases of developmental partial sensory deprivation, such as monocular enucleation, where individuals have one eye surgically removed early in life.

In an experiment, Moro and Steeves tested whether participants with one eye showed the Colavita visual dominance effect, and compared their performance to binocular viewers (use of both eyes) and monocular (eye-patched) control participants. In their experiment, Moro and Steeves used a stimulus detection and discrimination task, which had three conditions: unimodal visual targets, unimodal auditory targets, and bimodal (visual and auditory presented together) targets. The binocular and monocular participants both displayed the Colavita visual dominance effect; however the monocular enucleation group did not. Moro and Steeves demonstrated that people with one eye show equivalent auditory and visual processing, compared with binocular and monocular viewing controls, when asked to discriminate between audio, visual, and bimodal stimuli.

The lack of visual dominance in the enucleated participants cannot be due to the overall reduction in visual input, as the monocular control group wearing an eye patch performed the same as the binocular normal control group. Moro and Steeves concluded that people with one eye develop an unbiased allocation of sensory resources, which places less emphasis on vision when bimodal stimuli are presented. Although the lack of Colavita effect in people with one eye begins to explore the possibility that a decrease in visual dominance potentially allows for the adaption of other senses, such as audition.

Visual dominance in other aspects

Research has shown that vision is the most dominant sense out of the five senses that human beings possess. Vision can dominate over audition in localization judgement, over touch for shape judgement, and over proprioception when trying to determine the position of one's limb in space. Individuals’ perception of auditory stimuli is often influenced by visual stimuli. Visual dominance has been demonstrated in a multisensory illusion called the McGurk effect, where a visual stimulus paired with an incongruent auditory stimulus leads to the misperception of auditory information, resulting in individuals hearing a sound different from the real auditory input. According to Posner and colleagues individuals’ visual system lacks the capacity to properly alert them of possible threats. Therefore, it is possible that visual dominance results from the attention system's attempt to compensate for the visual system's improper alerting capabilities.

Visual dominance in animals

Research has shown that vision is also the dominant modality in a number of other animal species; this is thought to be due to the majority of biologically important information being received visually. Visual dominance effects over audition have been reported in cows
rats
Miller, L. (1973).Compounding of discriminative stimuli that maintain responding on separate response levers. ''Journal of the Experimental Analysis of Behaviour'', 20(1), 57-69 and pigeons.Randich, A., Klein, R.M., & LoLORDO, V.M. (1978). Visual dominance in the pigeon. Journal of the Experimental Analysis of Behavior,30, 129-137. For example, Miller conducted an experiment, in which, his findings showed a visual dominance effect for rats. In this experiment, rats were trained to press a lever in response to a visual (light) and to an auditory (tone) stimulus, which could be presented individually or simultaneously. The findings from this experiment showed that rats' response rates were more frequent on the 'light' lever, than on the 'tone' lever, when both stimuli were presented simultaneously.

Vision has also been shown to be a dominant modality in pigeons, according to a study by Randich, Klien and LoLordo. Pigeons were trained to perform an auditory-visual discrimination task by depressing two different foot treadles, one when an auditory tone was presented, and another treadle in the presence of a red light. The results from this experiment showed that pigeons demonstrated the Colavita visual dominance effect. When presented with a bimodal (auditory and visual) stimulus, the pigeons always responded on the visual treadle, implying visual dominance. Furthermore, in a subsequent task, Randich and his colleagues delayed the presentation of the visual stimulus relative to the auditory stimulus. Visual treadle responses by pigeons still occurred with a delay interval of less than 500ms, showing that visual dominance still prevailed when visual stimulus onset was delayed.

The development of visual dominance

The developmental trajectory for sensory dominance and multisensory interactions still remains to be characterised. There have been many experiments exploring sensory dominance in adult human, animal models and even infants, but there is a dearth of information covering the age range of later childhood and adolescence. While visual dominance prevails in adults, it has been shown that infants and young children demonstrate auditory dominance.

Lewkowicz (1988a-1988b) presented 6- and 10-month-olds with audiovisual compounds differing in temporal characteristics (i.e., rate or duration of stimuli presentation) of either the visual or auditory component.Lewkowicz, D. J., (1988a). Sensory dominance in infants: Six-month-old infants' response to auditory-visual compounds. ''Developmental Psychology'', 24:155-171 Results showed that infants (particularly those aged 6 months) detected temporal changes in the auditory, but not visual modality, indicating auditory dominance in infants. Lewkowicz (1988a) suggests that auditory dominance in early development might be an indication of the ontogenetically asynchronous development of the sensory systems. Furthermore, it is important to note that the auditory system starts being responsive to external input much before birth. The visual system is the least stimulated sense in utero throughout gestation, as it only receives very low light intensities. This suggests that the visual receptors will only start being fully stimulated after birth.

Further behavioural studies have shown that this auditory dominance persists up to 4 years of age.Robinson, C. W., & Sloutsky, V. M. (2004). Auditory dominance and its change in the course of development. ''Child Development''75:1387-1401 Nava and Pavani (2013) investigated the development of multisensory interactions in three school aged groups of children (6-7, 9-10, and 10-11 respectively) using the Colavita paradigm, with the aim of directly assessing whether auditory dominance persists beyond 4 years of age and to examine when adult like visual dominance begins to emerge.Nava, E., & Pavani, F., (2013) Changes in sensory dominance during childhood: Converging evidence from the colavita effect and the sound-induced flash illusion, ''Child Development'' 84(2):604-616 They found that auditory dominance persists until 6 years of age, and that the transition toward visual dominance starts at school age. In particular, Experiment 1 showed that children aged 6 to 7 years do not exhibit a Colavita effect, implying auditory dominance. 9- to 10-year-old children and 11- to 12-year-old children exhibited adult like visual dominance of the Colavita effect, suggesting that sensory dominance undergoes a developmental change in late childhood. Nava and Pavani (2013) suggest that visual dominance begins to emerge at the ages of 9 to 10 and is consolidated by 11 to 12 years of age.

This pattern of sensory dominance, suggests a gradual change in multisensory perception during development, with the consolidation of adult-like processing of multisensory inputs starting from late childhood, where auditory dominance switches with visual dominance.

See also

* visual capture

References

{{reflist

Vision
Cognitive neuroscience