Efficient Video Neural Network Processing Based on Motion Estimation
Video neural network (VNN) processing using the conventional pipeline first converts Bayer video information into human understandable RGB videos using image signal processing (ISP) on a pixel by pixel basis. Then, VNN processing is performed on a frame by frame basis. Both ISP and VNN are computationally expensive with high power consumption and latency. In this paper, we propose an efficient VNN processing framework. Instead of using ISP, computer vision tasks are directly accomplished using Bayer pattern information. To accelerate VNN processing, motion estimation is introduced to find temporal redundancies in input video data so as to avoid repeated and unnecessary computations. Experiments show greater than 67\% computation reduction, while maintaining computer vision task accuracy for typical computer vision tasks and data sets.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion EstimationSimilar Papers 제목 키워드 기반
Video Enhancement with Task-Oriented Flow
Many video enhancement algorithms rely on optical flow to register frames in a video sequence. Precise flow estimation is however intractable; and optical flow itself is often a sub-optimal representation for particular …
DenoisingMotion EstimationOptical Flow EstimationSuper-Resolution+4A Multi-scale Video Denoising Algorithm for Raw Image
Video denoising for raw image has always been the difficulty of camera image processing. On the one hand, image denoising performance largely determines the image quality, moreover denoising effect in raw image will affe…
DenoisingImage DenoisingMotion EstimationVideo DenoisingMacroblock Classification Method for Video Applications Involving Motions
In this paper, a macroblock classification method is proposed for various video processing applications involving motions. Based on the analysis of the Motion Vector field in the compressed video, we propose to classify …
Change DetectionClassificationGeneral ClassificationMotion EstimationA hybrid motion estimation technique for fisheye video sequences based on equisolid re-projection
Capturing large fields of view with only one camera is an important aspect in surveillance and automotive applications, but the wide-angle fisheye imagery thus obtained exhibits very special characteristics that may not …
Motion EstimationImproving Streaming Video Segmentation with Early and Mid-Level Visual Processing
Despite recent advances in video segmentation, many opportunities remain to improve it using a variety of low and mid-level visual cues. We propose improvements to the leading streaming graph-based hierarchical video seg…
Motion SegmentationSegmentationVideo SegmentationVideo Semantic Segmentation