paper-with-me

Papers

Multipath CNN with alpha matte inference for knee tissue segmentation from MRI

2021-09-29 · Sheheryar Khan, Basim Azam, Yongcheng Yao, Weitian Chen

Precise segmentation of knee tissues from magnetic resonance imaging (MRI) is critical in quantitative imaging and diagnosis. Convolutional neural networks (CNNs), which are state of the art, have limitations owing to the lack of image-specific adaptation, such as low tissue contrasts and structural inhomogeneities, thereby leading to incomplete segmentation results. This paper presents a deep learning based automatic segmentation framework for knee tissue segmentation. A novel multipath CNN-based method is proposed, which consists of an encoder decoder-based segmentation network in combination with a low rank tensor-reconstructed segmentation network. Low rank reconstruction in MRI tensor sub-blocks is introduced to exploit the structural and morphological variations in knee tissues. To further improve the segmentation from CNNs, trimap generation, which effectively utilizes superimposed regions, is proposed for defining high, medium and low confidence regions from the multipath CNNs. The secondary path with low rank reconstructed input mitigates the conditions in which the primary segmentation network can potentially fail and overlook the boundary regions. The outcome of the segmentation is solved as an alpha matting problem by blending the trimap with the source input. Experiments on Osteoarthritis Initiative (OAI) datasets and a self prepared scan validate the effectiveness of the proposed method. We specifically demonstrate the application of the proposed method in a cartilage segmentation based thickness map for diagnosis purposes.

📄 PDF Abstract BibTeX arXiv:2109.14249

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderImage MattingSegmentation

Similar Papers 제목 키워드 기반

MR-Transformer: Vision Transformer for Total Knee Replacement Prediction Using Magnetic Resonance Imaging

2024-05-05 · Chaojie Zhang, Shengjia Chen, Ozkan Cigdem, Haresh Rengaraj Rajamohan 외

A transformer-based deep learning model, MR-Transformer, was developed for total knee replacement (TKR) prediction using magnetic resonance imaging (MRI). The model incorporates the ImageNet pre-training and captures thr…

Deep LearningPrediction

PolarMatte: Fully Computational Ground-Truth-Quality Alpha Matte Extraction for Images and Video using Polarized Screen Matting

2024-01-01 · CVPR 2024 1 · Kenji Enomoto, TJ Rhodes, Brian Price, Gavin Miller

The creation of high-quality alpha mattes as ground-truth data for video matting is typically a laborious task. The trade-off between accuracy manual corrections and capture constraints often produces erroneous resul…

Image MattingVideo Matting

Fast Multi-Level Foreground Estimation

2020-06-26 · Thomas Germer, Tobias Uelwer, Stefan Conrad, Stefan Harmeling

Alpha matting aims to estimate the translucency of an object in a given image. The resulting alpha matte describes pixel-wise to what amount foreground and background colors contribute to the color of the composite image…

Image Matting

Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation

2019-09-20 · ICCV 2019 10 · Qiqi Hou, Feng Liu

Natural image matting is an important problem in computer vision and graphics. It is an ill-posed problem when only an input image is available without any external information. While the recent deep learning approaches …

Data AugmentationDecoderImage Matting

Arthroscopic Multi-Spectral Scene Segmentation Using Deep Learning

2021-03-03 · Shahnewaz Ali, Dr. Yaqub Jonmohamadi, Yu Takeda, Jonathan Roberts 외

Knee arthroscopy is a minimally invasive surgical (MIS) procedure which is performed to treat knee-joint ailment. Lack of visual information of the surgical site obtained from miniaturized cameras make this surgical proc…

Deep LearningScene Segmentation