paper-with-me

Papers

Cross domain knowledge compression in realtime optical flow prediction on ultrasound sequences

2022-02-04 · WBIR Workshop Biomedical_Imaging_Registration 2022 7 · Anonymous

In this paper, we propose an approach for realtime optical flow estimation in ultrasound sequences of vein and arteries based on knowledge distillation. Knowledge distillation is a technique to train a faster, smaller model by learning from cues of other models. Mobile devices with limited resources could be key in providing effective point-of-care healthcare and motivate the search of more lightweight solutions in the deep learning based image analysis. For ultrasound video analysis motion correspondences of image contents (anatomies) have to be computed for temporal context and for real time application, fast solutions are required. We use a PWC-Net's optical flow estimation output as soft targets to train a lightweight optical flow estimator. We analyse how well it works on the challenging task of fast segmentation propagation of vein and arteries in ultrasound images. Experiments show that even though we did not fine-tune the teachers on this task, a model trained with soft targets outperformed a model trained directly with labels and without a teacher.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationOptical Flow Estimation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Pool of Experts: Realtime Querying Specialized Knowledge in Massive Neural Networks

2021-07-03 · Hakbin Kim, Dong-Wan Choi

In spite of the great success of deep learning technologies, training and delivery of a practically serviceable model is still a highly time-consuming process. Furthermore, a resulting model is usually too generic and he…

Knowledge DistillationModel Compression

End-to-End Optimized Speech Coding with Deep Neural Networks

2017-10-25 · Srihari Kankanahalli

Modern compression algorithms are often the result of laborious domain-specific research; industry standards such as MP3, JPEG, and AMR-WB took years to develop and were largely hand-designed. We present a deep neural ne…

CPUFeature EngineeringQuantization

Nonlinear optical encoding enabled by recurrent linear scattering

2023-07-17 · Fei Xia, Kyungduk Kim, Yaniv Eliezer, SeungYun Han 외

Optical information processing and computing can potentially offer enhanced performance, scalability and energy efficiency. However, achieving nonlinearity-a critical component of computation-remains challenging in the o…

Data CompressionDecoderDeep LearningEdge-computing+5

PocketDVDNet: Realtime Video Denoising for Real Camera Noise

2026-01-23 · Crispian Morris, Imogen Dexter, Fan Zhang, David R. Bull 외 arxiv

Live video denoising under realistic, multi-component sensor noise remains challenging for applications such as autofocus, autonomous driving, and surveillance. We propose PocketDVDNet, a lightweight video denoiser devel…

Knowledge DistillationAutonomous DrivingModel CompressionVideo Denoising

SLAM++: Simultaneous Localisation and Mapping at the Level of Objects

2013-06-01 · CVPR 2013 6 · Renato F. Salas-Moreno, Richard A. Newcombe, Hauke Strasdat, Paul H. J. Kelly 외

We present the major advantages of a new 'object oriented' 3D SLAM paradigm, which takes full advantage in the loop of prior knowledge that many scenes consist of repeated, domain-specific objects and structures. As a ha…

3D Object RecognitionDescriptiveObjectObject Recognition+1