In praise of artifice reloaded: Caution with natural image databases in modeling vision

2019

Subjective image quality databases are a major source of raw data on how the visual system works in naturalistic environments. These databases describe the sensitivity of many observers to a wide range of distortions of different nature and intensity seen on top of a variety of natural images. Data of this kind seems to open a number of possibilities for the vision scientist to check the models in realistic scenarios. However, while these natural databases are great benchmarks for models developed in some other way (e.g., by using the well-controlled artificial stimuli of traditional psychophysics), they should be carefully used when trying to fit vision models. Given the high dimensionalit…

Topographic Independent Component Analysis reveals random scrambling of orientation in visual space

2017

Neurons at primary visual cortex (V1) in humans and other species are edge filters organized in orientation maps. In these maps, neurons with similar orientation preference are clustered together in iso-orientation domains. These maps have two fundamental properties: (1) retinotopy, i.e. correspondence between displacements at the image space and displacements at the cortical surface, and (2) a trade-off between good coverage of the visual field with all orientations and continuity of iso-orientation domains in the cortical space. There is an active debate on the origin of these locally continuous maps. While most of the existing descriptions take purely geometric/mechanistic approaches whi…

The Wilson-Cowan model describes Contrast Response and Subjective Distortion

2017

The Brain’s Camera. Optimal Algorithms for Wiring the Eye to the Brain Shape How We See

2016

The problem of sending information at long distances, without significant attenuation and at a low cost, is common to both artificial and natural environments. In the brain, a widespread strategy to solve the cost-efficiency trade off in long distance communication is the presence of convergent pathways, or bottlenecks. In the visual system, for example, to preserve resolution, information is acquired by a first layer with a large number of neurons (the photoreceptors in the retina) and then compressed into a much smaller number of units in the output layer (the retinal ganglion cells), to send that information to the brain at the lowest possible metabolic cost. Recently, we found experimen…

Towards a Functional Explanation of the Connectivity LGN - V1

2016

The principles behind the connectivity between LGN and V1 are not well understood. Models have to explain two basic experimental trends: (i) the combination of thalamic responses is local and it gives rise to a variety of oriented Gabor-like receptive felds in V1 [1], and (ii) these filters are spatially organized in orientation maps [2]. Competing explanations of orientation maps use purely geometrical arguments such as optimal wiring or packing from LGN [3-5], but they make no explicit reference to visual function. On the other hand, explanations based on func- tional arguments such as maximum information transference (infomax) [6,7] usually neglect a potential contribution from LGN local…

Derivatives and inverse of a linear-nonlinear multi-layer spatial vision model

2016

Linear-nonlinear transforms are interesting in vision science because they are key in modeling a number of perceptual experiences such as color, motion or spatial texture. Here we first show that a number of issues in vision may be addressed through an analytic expression of the Jacobian of these linear-nonlinear transforms. The particular model analyzed afterwards (an extension of [Malo & Simoncelli SPIE 2015]) is illustrative because it consists of a cascade of standard linear-nonlinear modules. Each module roughly corresponds to a known psychophysical mechanism: (1) linear spectral integration and nonlinear brightness-from-luminance computation, (2) linear pooling of local brightness…