Multisensory integration in speech and motion perception.

Item

Title
Multisensory integration in speech and motion perception.
Identifier
AAI3325399
identifier
3325399
Creator
Ross, Lars Arne.
Contributor
Adviser: John J. Foxe
Date
2008
Language
English
Publisher
City University of New York.
Subject
Psychology, Cognitive
Abstract
This thesis is concerned with the interaction of the senses in the perception of events in the external environment. It is organized in four parts. In the first part I (chapter I) will give a general introduction into the field of multisensory integration. The second part (Chapter II and III) comprises two behavioral studies that explore the benefit of the exposure to visual articulation in the perception of speech in noisy environmental conditions. In the first study (chapter II) we replicate the substantial benefit that visual articulation ads to the perception of speech, but also show that this benefit does not obey a previously established (and commonly accepted) rule of multisensory integration called "the principle of inverse effectiveness." The first study will lay the ground-work for the second clinical investigation (Chapter III) where I will show that patients with schizophrenia do not experience the same benefit from visual speech as healthy controls and that this multisensory decrement is especially pronounced in situations where controls usually experience the greatest benefit.;The third section of this thesis (Chapter IV) will report an investigation of the effect of auditory stimulation in the perception of dynamic visual events. We used the "bistable motion illusion", where a brief sound affects the perception of the motion direction of two moving visual objects, as a paradigm to study the effects of the auditory stimulus on visual processing. The use of event-related potentials allowed insight into the spatio-temporal dynamics of brain processes underlying this illusion.;Finally, in the fourth and last part of this thesis (Chapter V) I will give an overview of selected projects that directly or indirectly emerged from the work of this thesis. These projects are at various stages of progress and are performed with my direct participation. This section is meant as an "outlook" to my present and future scientific work in the domain of multisensory integration and are supposed to serve as a guide for the reader to understand the thesis work in a larger context.
Type
dissertation
Source
PQT Legacy CUNY.xlsx
degree
Ph.D.
Item sets
CUNY Legacy ETDs