Publication
A. A. Lazar and
Y. B. Slutskiy
Multisensory Encoding, Decoding, and Identification
Advances in Neural Information Processing Systems 26 , C.J.C. Burges, L. Bottou, M. Welling, Z. Ghahramani and K.Q. Weinberger , pp. 3208-3216 , December 2013 , Lake Tahoe, Nevada, United States
BibTex PDF
We investigate a spiking neuron model of multisensory integration. Multiple stimuli
from different sensory modalities are encoded by a single neural circuit comprised
of a multisensory bank of receptive fields in cascade with a population of
biophysical spike generators. We demonstrate that stimuli of different dimensions
can be faithfully multiplexed and encoded in the spike domain and derive tractable
algorithms for decoding each stimulus from the common pool of spikes. We also
show that the identification of multisensory processing in a single neuron is dual
to the recovery of stimuli encoded with a population of multisensory neurons, and
prove that only a projection of the circuit onto input stimuli can be identified. We
provide an example of multisensory integration using natural audio and video and
discuss the performance of the proposed decoding and identification algorithms.
Multisensory Encoding, Decoding, and Identification
Advances in Neural Information Processing Systems 26 , C.J.C. Burges, L. Bottou, M. Welling, Z. Ghahramani and K.Q. Weinberger , pp. 3208-3216 , December 2013 , Lake Tahoe, Nevada, United States
BibTex PDF
Reference
@inproceedings{2013,
author = "A. A. Lazar and Y. B. Slutskiy",
title = "Multisensory Encoding, Decoding, and Identification",
year = 2013,
booktitle = "Advances in Neural Information Processing Systems 26",
publisher = "C.J.C. Burges, L. Bottou, M. Welling, Z. Ghahramani and K.Q. Weinberger",
pages = "3208-3216",
month = "Dec"
}