A Directionally Selective Neural Network with Separated ON and OFF Pathways for Translational Motion Perception in a Visually Cluttered Environment
With respect to biological findings underlying fly's physiology in the past decade, we present a directionally selective neural network, with a feed-forward structure and entirely low-level visual processing, so as to implement direction selective neurons in the fly's visual system, which are mainly sensitive to wide-field translational movements in four cardinal directions. In this research, we highlight the functionality of ON and OFF pathways, separating motion information for parallel computation corresponding to light-on and light-off selectivity. Through this modeling study, we demonstrate several achievements compared with former bio-plausible translational motion detectors, like the elementary motion detectors. First, we thoroughly mimic the fly's preliminary motion-detecting pathways with newly revealed fly's physiology. Second, we improve the speed response to moving dark/light features via the design of ensembles of same polarity cells in the dual-pathways. Moreover, we alleviate the impact of irrelevant motion in a visually cluttered environment like the shifting of background and windblown vegetation, via the modeling of spatiotemporal dynamics. We systematically tested the DSNN against stimuli ranging from synthetic and real-world scenes, to notably a visual modality of a ground micro robot. The results demonstrated that the DSNN outperforms former bio-plausible translational motion detectors. Importantly, we verified its computational simplicity and effectiveness benefiting the building of neuromorphic vision sensor for robots.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Bioinspired Approach-Sensitive Neural Network for Collision Detection in Cluttered and Dynamic Backgrounds
Rapid, accurate and robust detection of looming objects in cluttered moving backgrounds is a significant and challenging problem for robotic visual systems to perform collision detection and avoidance tasks. Inspired by …
Decision MakingA Directionally Selective Small Target Motion Detecting Visual Neural Network in Cluttered Backgrounds
Discriminating targets moving against a cluttered background is a huge challenge, let alone detecting a target as small as one or a few pixels and tracking it in flight. In the fly's visual system, a class of specific ne…
Translational Motion Compensation for Soft Tissue Velocity Images
Purpose: Advancements in MRI Tissue Phase Velocity Mapping (TPM) allow for the acquisition of higher quality velocity cardiac images providing better assessment of regional myocardial deformation for accurate disease dia…
Motion CompensationFDNet: A Deep Learning Approach with Two Parallel Cross Encoding Pathways for Precipitation Nowcasting
With the goal of predicting the future rainfall intensity in a local region over a relatively short period time, precipitation nowcasting has been a long-time scientific challenge with great social and economic impact. T…
Optical Flow EstimationEmergence of robust looming selectivity via coordinated inhibitory neural computations
In the locust's lobula giant movement detector neural pathways, four categories of inhibition, i.e., global inhibition, self-inhibition, lateral inhibition, and feed-forward inhibition, have been functionally explored in…