18: Haptic perception in interaction with other senses

Adams WJ, Graf EW, Ernst MO (2004). Experience can change the ‘light-from-above’ prior. Nature Neuroscience 7(10): 1057-1058

Alais D, Burr D (2004) The ventriloquist effect results from near-optimal bimodal integration. Curr Biol 14: 257-262

Atkins JE, Fiser J, Jacobs RA (2001) Experiencedependent visual cue integration based on consistencies between visual and haptic percepts. Vision Res 41(4): 449-461

Backus BT, Banks MS (1999) Estimator reliability and distance scaling in stereoscopic slant perception. Perception 28(2): 217-242

Banks MS, Backus BT (1998) Extra-retinal and perspective cues cause the small range of the induced effect. Vision Res 38(2): 187-194

Banks MS, Hooge IT, Backus BT (2001) Perceiving slant about a horizontal axis from stereopsis. J Vision 1(2): 55-79

Battaglia PW, Jacobs RA, Aslin RN (2003) Bayesian integration of visual and auditory signals for spatial localization. J Optical Society of America. A, Optics, image science, and vision 20(7): 1391-1397

Bayes T (1783) An essay towards solving a problem in the doctrine of chances. Philosophical Transactions of the Royal Society 53: 370-418

Bedford FL (2001) Towards a general law of numerical/ object identity. Cahiers de Psychologie Cognitives/ Current Psychology of Cognition 20: 113-175

Bernstein IH, Clark MH, Edelstein BA (1969) Effects of an auditory signal on visual reaction time. J Exp Psychol 80(3): 567-569

Bertelson P, Radeau M (1981) Crossmodal bias and perceptual fusion with auditory-visual discordance. Perception & Psychophysics 29: 578-584

Bresciani J-P, Dammeier F, Ernst MO (2006) Vision and touch are automatically integrated for the perception of sequences of events. J Vision 6(5): 554-564

Bresciani J-P, Ernst MO, Drewing K, Bouyer G, Maury V, Kheddar A (2005) Feeling what you hear: auditory signals can modulate tactile tap perception. Exp Brain Res 162(2): 172-180

Buckley D, Frisby JP (1993) Interaction of stereo, texture and outline cues in the shape perception of three-dimensional ridges. Vision Res 33: 919-933

Bülthoff HH, Mallot HA (1988) Integration of depth modules: stereo and shading. J Optical Society of America. A, Optics and image science 5(10): 1749-1758

Choe C, Welch R, Gilford R, Juola J (1975). The “ventriloquist effect”: Visual dominance or response bias? Perception & Psychophysics 18: 55-60

Clark JJ, Yuille AL (1990) Data Fusion for Sensory Information Processing Systems. Kluwer Academic Publishers

Colin C, Radeau M, Deltenre P, Morais J (2001) Rules of intersensory integration in spatial scene analysis and speech reading. Psychologica Belgica 41: 131-144

Drewing K, Ernst MO (2006) Integration of force and position cues for shape perception through active touch. Brain Res 1078(1): 92-100

Ernst MO (2005) A bayesian view on multimodal cue integration. In: G Knoblich, M Grosjean, I Thornton, M Shiffrar (eds): Human body perception from the inside out, chapter 6, (105-131). Oxford University Press, New York, NY

Ernst MO (2007) Learning to integrate arbitrary signals from vision and touch. J Vision 7(5): 1-14

Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415(6870): 429-433

Ernst MO, Banks MS, Bülthoff HH (2000) Touch can change visual slant perception. Nature Neuroscience 3(1): 69-73

Ernst MO, Bülthoff HH (2004) Merging the senses into a robust percept. Trends in Cognitive Sci 8(4): 162-169

Frisby JP, Buckley D, Horsman JM (1995) Integration of stereo, texture, and outline cues during pinhole viewing of real ridge-shaped objects and stereograms of ridges. Perception 24(2): 181-198

Gepshtein S, Banks MS (2003) Viewing geometry determines how vision and haptics combine in size perception. Curr Biol 13(6): 483-488

Gepshtein S, Burge J, Ernst MO, Banks MS (2005) The combination of vision and touch depends on spatial proximity. J Vision 5(11): 1013-1023

Gielen SC, Schmidt RA, den Heuvel PJV (1983) On the nature of intersensory facilitation of reaction time. Perception & Psychophysics 34(2): 161-168

Hay JC, Pick HL, Ikeda K (1965) Visual capture produced by prism spectacles. Psychonomic Sci 2: 215-216

Helbig HB, Ernst MO (2007) Optimal integration of shape information from vision and touch. Exp Brain Res 179(4): 595-606

Helbig HB, Ernst MO (2007a) Knowledge about a common source can promote visual haptic integration. Perception 36: 1523-1533

Hershenson M (1962) Reaction time as a measure of intersensory facilitation. J Exp Psychology 63: 289-293

Hillis JM, Watt SJ, Landy MS, Banks MS (2004) Slant from texture and disparity cues: optimal cue combination. J Vision 4(12): 967-992

Howard IP, Rogers BJ (2002) Seeing in Depth. Volume II Depth Perception. I. Porteous, Toronto

Howard IP, Templeton WB (1966) Human spatial orientation. Wiley, New York

Jack CE, Thurlow WR (1973). Effects of degree of visual association and angle of displacement on the “ventriloquism” effect. Perceptual and Motor Skills 37(3): 967-979

Jackson CV (1953) Visual factors in auditory localization. Quarterly J Exp Psychology 5: 52-65

Jacobs RA (1999) Optimal integration of texture and motion cues to depth. Vision Res 39(21): 3621-3629

Johnston EB, Cumming BG, Landy MS (1994) Integration of stereopsis and motion shape cues. Vision Res 34(17): 2259-2275

Johnston EB, Cumming BG, Parker AJ (1993) Integration of depth modules: stereopsis and texture. Vision Res 33(5-6): 813-826

Kinney JAS, Luria SM (1970) Conflicting visual and tactual-kinesthetic stimulation. Perception and Psychophysics 8(3): 189-192

Klemm O (1909) Lokalisation von Sinneseindrücken bei disparaten Nebenreizen (localization of sense impressions with discordant additional stimulation). Psychologische Studien 5: 73-161

Knill DC (1998) Ideal observer perturbation analysis reveals human strategies for inferring surface orientation from texture. Vision Res 38(17): 2635-2656

Knill DC (1998b) Surface orientation from texture: ideal observers, generic observers and the information content of texture cues. Vision Res 38(11): 1655-1682

Knill DC (2001) Contour into texture: information content of surface contours and texture flow. J Opt Soc Am A Opt Image Sci Vis 18(1): 12-35

Knill DC, Kersten D, Yuille AL (1996) Introduction: A Bayesian formulation of visual perception. In: DC Knill, W Richards (eds): Perception as Bayesian Inference. Cambridge University Press, Cambridge, UK 1-21

Knill DC, Saunders JA (2003) Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Res 43(24): 2539-2558

Körding KP, Beierholm U, Ma WJ, Quartz S, Tenenbaum JB, Shams L (2007) Causal inference in multisensory perception. PLoS ONE 2(9): e943

Körding KP, Wolpert DM (2004) Bayesian integration in sensorimotor learning. Nature 427(6971): 244-247

Landy MS, Kojima H (2001) Ideal cue combination for localizing texture-defined edges. J Optical Society of America. A, Optics, image science, and vision 18(9): 2307-2320

Landy MS, Maloney LT, Johnston EB, Young M (1995) Measurement and modeling of depth cue combination: in defense of weak fusion. Vision Res 35(3): 389-412

Luria SM, Kinney JA (1970) Underwater vision. Science 167(924): 1454-1461

Maloney LT (2001) Statistical decision theory and biological vision. In: D Heyer, R Mausfeld (eds): Perception and the Physical World. Wiley, Chichester, UK

Mamassian P, Landy MS, Maloney LT (2002) Bayesian modeling of visual perception. In: RPN Rao, BA Olshausen, MS Lewicki (eds): Probabilistic Models of the Brain: Perception and Neural Function. MIT Press, Cambridge, MA, 13-36

Meredith MA, Stein BE (1986) Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Res 365(2): 350-354

Miller EA (1972) Interaction of vision and touch in conflict and nonconflict form perception tasks. J Exp Psychology 96(1): 114-123

Morrell LK (1968) Temporal characteristics of sensory interaction in choice reaction times. J Exp Psychology 77(1): 14-18

Nickerson RS (1973) Intersensory facilitation of reaction time: energy summation or preparation enhancement? Psychol Rev 80(6): 489-509

O’Hare JJ (1991) Perceptual integration. J Washington Acad Sci 81: 44-59

Power RP, Grahman A (1976) Dominance of touch by vision: Generalization of the hypothesis to a tactually experienced population. Perception 5: 161-166

Radeau M, Bertelson P (1974) The after-effects of ventriloquism. The Quarterly J Exp Psychology 26(1): 63-71

Radeau M, Bertelson P (1976) The effect of a textured visual field on modality dominance in a ventriloquism situation. Perception & Psychophysics 20: 227-235

Radeau M, Bertelson P (1977) Adaptation to auditory- visual discordance and ventriloquism in semirealistic situations. Perception & Psychophysics 22: 137-146

Radeau M, Bertelson P (1978) Cognitive factors and adaptation to auditory-visual discordance. Perception & Psychophysics 23(4): 341-343

Radeau M, Bertelson P (1987) Auditory-visual interaction and the timing of inputs. Psychological Res 49: 17-22

Ramachandran VS (1988) Perception of shape from shading. Nature 331: 163-166

Rock I, Victor J (1964) Vision and touch: An experimentally created conflict between the two senses. Science 143: 594-596

Rogers BJ, Bradshaw MF (1995) Disparity scaling and the perception of frontoparallel surfaces. Perception 24(2): 155-179

Ross HE, Nawaz S (2003) Why do objects appear enlarged under water? Arquivos Brasileiros de Oftalmologia 66: 69-76

Shams L, Kamitani Y, Shimojo S (2002) Visual illusion induced by sound. Cognitive Brain Res 14(1): 147-152

Shams L, Ma WJ, Beierholm U (2005) Soundinduced flash illusion as an optimal percept. Neuroreport 16(17): 1923-1927

Shipley T (1964) Auditory flutter-driving of visual flicker. Science 145: 1328-1330

Singer G, Day RN (1969) Visual capture of haptually judged depth. Perception and Psychophysics 5: 315-316

Slutsky DA, Recanzone GH (2001) Temporal and spatial dependency of the ventriloquism effect. Neuroreport 12(1): 7-10

Thomas GJ (1941) Experimental study of the influence of vision on sound localization. J Exp Psychology 28: 163-177

Thurlow WR, Jack CE (1973) Certain determinants of the “ventriloquism effect”. Perceptual and Motor Skills 36(3): 1171-1184

Trommershäuser J, Landy MS, Maloney LT (2006) Humans rapidly estimate expected gain in movement planning. Psychol Sci 17(11): 981-988

Trommershäuser J, Maloney LT, Landy MS (2003) Statistical decision theory and the selection of rapid, goal-directed movements. J Opt Soc Am A Opt Image Sci Vis 20(7): 1419-1433

van Beers RJ, Sittig AC, van der Gon JJD (1998) The precision of proprioceptive position sense. Exp Brain Res 122(4): 367-377

van Beers RJ, Sittig AC, van der Gon JJD (1999) Integration of proprioceptive and visual positioninformation: An experimentally supported model. J Neurophysiology 81(3): 1355-1364

van Beers RJ, Wolpert DM, Haggard P (2002) When feeling is more important than seeing in sensorimotor adaptation. Curr Biol 12(20): 834-837

Warren DH, Cleaves WT (1971) Visual-proprioceptive interaction under large amounts of conflict. J Exp Psychology 90(2): 206-214

Warren DH, Welch RB, McCarthy TJ (1981) The role of visual-auditory “compellingness” in the ventriloquism effect: implications for transitivity among the spatial senses. Perception & Psychophysics 30(6): 557-564

Welch R, Warren D (1986) Intersensory interactions. In: K Boff, L Kaufman, JP Thomas (eds): Handbook of Perception and Human Performance. Wiley, New York, 25.1-25.36

Welch RB (1972) The effect of experienced limb identity upon adaptation to simulated displacement of the visual field. Perception & Psychophysics 12: 453-456

Welch RB, DuttonHurt LD, Warren DH (1986) Contributions of audition and vision to temporal rate perception. Perception & Psychophysics 39(4): 294-300

Welch RB, Warren DH (1980) Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88(3): 638-667

Witkin HA, Wapner S, Leventhal T (1952) Sound localization with conflicting visual and auditory cues. J Exp Psychology 43(1): 58-67

Wu W-C, Basdogan C, Srinivasan MA (1999) Visual, haptic, and bimodal perception of size and stiffness in virtual environments. ASME Dynamic Systems and Control Division, DSC-Vol. 67: 19-26

Young MJ, Landy MS, Maloney LT (1993) A perturbation analysis of depth perception from combinations of texture and motion cues. Vision Res 33(18): 2685-2696

Yuille AL, Bülthoff HH (1996) Bayesian theory and psychophysics. In D Knill, W Richards (eds): Perception as Bayesian Inference. Cambridge University Press, Cambridge, MA