paper-with-me

Papers

MSKdeX: Musculoskeletal (MSK) decomposition from an X-ray image for fine-grained estimation of lean muscle mass and muscle volume

2023-05-31 · Yi Gu, Yoshito Otake, Keisuke Uemura, Masaki Takao, Mazen Soufi, Yuta Hiasa, Hugues Talbot, Seiji Okata, Nobuhiko Sugano, Yoshinobu Sato

Musculoskeletal diseases such as sarcopenia and osteoporosis are major obstacles to health during aging. Although dual-energy X-ray absorptiometry (DXA) and computed tomography (CT) can be used to evaluate musculoskeletal conditions, frequent monitoring is difficult due to the cost and accessibility (as well as high radiation exposure in the case of CT). We propose a method (named MSKdeX) to estimate fine-grained muscle properties from a plain X-ray image, a low-cost, low-radiation, and highly accessible imaging modality, through musculoskeletal decomposition leveraging fine-grained segmentation in CT. We train a multi-channel quantitative image translation model to decompose an X-ray image into projections of CT of individual muscles to infer the lean muscle mass and muscle volume. We propose the object-wise intensity-sum loss, a simple yet surprisingly effective metric invariant to muscle deformation and projection direction, utilizing information in CT and X-ray images collected from the same patient. While our method is basically an unpaired image-to-image translation, we also exploit the nature of the bone's rigidity, which provides the paired data through 2D-3D rigid registration, adding strong pixel-wise supervision in unpaired training. Through the evaluation using a 539-patient dataset, we showed that the proposed method significantly outperformed conventional methods. The average Pearson correlation coefficient between the predicted and CT-derived ground truth metrics was increased from 0.460 to 0.863. We believe our method opened up a new musculoskeletal diagnosis method and has the potential to be extended to broader applications in multi-channel quantitative image translation tasks. Our source code will be released soon.

📄 PDF Abstract BibTeX arXiv:2305.19920

Code (0)

등록된 구현이 없습니다.

Tasks

Computed Tomography (CT)Image-to-Image TranslationTranslation

Similar Papers 제목 키워드 기반

A fine-grained attention and geometric correspondence model for musculoskeletal risk classification in athletes using multimodal visual and skeletal features

2025-09-07 · Md. Abdur Rahman, Mohaimenul Azam Khan Raiaan, Tamanna Shermin, Md Rafiqul Islam 외 arxiv

Musculoskeletal disorders pose significant risks to athletes, and early risk assessment is essential for prevention. However, most existing methods are designed for controlled settings and fail to reliably assess risk in…

Multimodal Deep Learning

ShadingNet: Image Intrinsics by Fine-Grained Shading Decomposition

2019-12-09 · Anil S. Baslamisli, Partha Das, Hoang-An Le, Sezer Karaoglu 외

In general, intrinsic image decomposition algorithms interpret shading as one unified component including all photometric effects. As shading transitions are generally smoother than reflectance (albedo) changes, these me…

DisentanglementIntrinsic Image Decomposition

Hyperspectral Image Recovery Constrained by Multi-Granularity Non-Local Self-Similarity Priors

2025-08-02 · Zhuoran Peng, Yiqing Shen arxiv

Hyperspectral image (HSI) recovery, as an upstream image processing task, holds significant importance for downstream tasks such as classification, segmentation, and detection. In recent years, HSI recovery methods based…

PartNet: A Recursive Part Decomposition Network for Fine-grained and Hierarchical Shape Segmentation

2019-03-02 · CVPR 2019 6 · Fenggen Yu, Kun Liu, Yan Zhang, Chenyang Zhu 외

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. …

3D Instance Segmentation3D Part SegmentationSegmentationSemantic Segmentation

Ultrasound Tomography of Musculoskeletal Tissues with Generative Neural Physics

2025-08-17 · Zhijun Zeng, Youjia Zheng, Chang Su, Qianhang Wu 외 arxiv

Ultrasound Tomography (UT) is a radiation-free, high-resolution modality, but remains limited for musculoskeletal imaging due to the high computational cost and instability of full-waveform inversion in strongly scatteri…