Efficient Neural Network Compression via Transfer Learning for Industrial Optical Inspection
In this paper, we investigate learning the deep neural networks for automated optical inspection in industrial manufacturing. Our preliminary result has shown the stunning performance improvement by transfer learning from the completely dissimilar source domain: ImageNet. Further study for demystifying this improvement shows that the transfer learning produces a highly compressible network, which was not the case for the network learned from scratch. The experimental result shows that there is a negligible accuracy drop in the network learned by transfer learning until it is compressed to 1/128 reduction of the number of convolution filters. This result is contrary to the compression without transfer learning which loses more than 5% accuracy at the same compression rate.
Code (0)
등록된 구현이 없습니다.
Tasks
Neural Network CompressionTransfer LearningSimilar Papers 제목 키워드 기반
Evaluating Magic Leap 2 Tool Tracking for AR Sensor Guidance in Industrial Inspections
Rigorous evaluation of commercial Augmented Reality (AR) hardware is crucial, yet public benchmarks for tool tracking on modern Head-Mounted Displays (HMDs) are limited. This paper addresses this gap by systematically as…
YOLO Network For Defect Detection In Optical lenses
Mass-produced optical lenses often exhibit defects that alter their scattering properties and compromise quality standards. Manual inspection is usually adopted to detect defects, but it is not recommended due to low acc…
Defect DetectionRethinking Transfer Learning for Industrial Inspection: DINOv3 vs. ImageNet Pretraining Across RGB and X-ray Tasks
Vision foundation models pretrained on web-scale data have recently shown strong transfer capabilities on many downstream tasks, but their effectiveness for industrial visual inspection remains unclear. Industrial data d…
Semantic SegmentationInstance SegmentationTransfer LearningObject DetectionAttacking Compressed Vision Transformers
Vision Transformers are increasingly embedded in industrial systems due to their superior performance, but their memory and power requirements make deploying them to edge devices a challenging task. Hence, model compress…
Model CompressionA qualitative investigation of optical flow algorithms for video denoising
A good optical flow estimation is crucial in many video analysis and restoration algorithms employed in application fields like media industry, industrial inspection and automotive. In this work, we investigate how well …
DenoisingOptical Flow EstimationVideo Denoising