paper-with-me

Papers

DKMA-ULD: Domain Knowledge augmented Multi-head Attention based Robust Universal Lesion Detection

2022-03-14 · British Machine Vision Conference 2021 11 · Manu Sheoran, Meghal Dani, Monika Sharma, Lovekesh Vig

Incorporating data-specific domain knowledge in deep networks explicitly can provide important cues beneficial for lesion detection and can mitigate the need for diverse heterogeneous datasets for learning robust detectors. In this paper, we exploit the domain information present in computed tomography (CT) scans and propose a robust universal lesion detection (ULD) network that can detect lesions across all organs of the body by training on a single dataset, DeepLesion. We analyze CT-slices of varying intensities, generated using heuristically determined Hounsfield Unit(HU) windows that individually highlight different organs and are given as inputs to the deep network. The features obtained from the multiple intensity images are fused using a novel convolution augmented multi-head self-attention module and subsequently, passed to a Region Proposal Network (RPN) for lesion detection. In addition, we observed that traditional anchor boxes used in RPN for natural images are not suitable for lesion sizes often found in medical images. Therefore, we propose to use lesion-specific anchor sizes and ratios in the RPN for improving the detection performance. We use self-supervision to initialize weights of our network on the DeepLesion dataset to further imbibe domain knowledge. Our proposed Domain Knowledge augmented Multi-head Attention based Universal Lesion Detection Network DMKA-ULD produces refined and precise bounding boxes around lesions across different organs. We evaluate the efficacy of our network on the publicly available DeepLesion dataset which comprises of approximately 32K CT scans with annotated lesions across all organs of the body. Results demonstrate that we outperform existing state-of-the-art methods achieving an overall sensitivity of 87.16%.

📄 PDF Abstract BibTeX arXiv:2203.06886

Code (0)

등록된 구현이 없습니다.

Tasks

Computed Tomography (CT)Lesion DetectionMedical Object DetectionRegion Proposal

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
RoIPool 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Similar Papers 제목 키워드 기반

BiMind: A Dual-Head Reasoning Model with Attention-Geometry Adapter for Incorrect Information Detection

2026-04-07 · Zhongxing Zhang, Emily K. Vraga, Jisu Huh, Jaideep Srivastava arxiv

Incorrect information poses significant challenges by disrupting content veracity and integrity, yet most detection approaches struggle to jointly balance textual content verification with external knowledge modification…

Unveiling Knowledge Utilization Mechanisms in LLM-based Retrieval-Augmented Generation

2025-05-17 · Yuhao Wang, Ruiyang Ren, Yucheng Wang, Wayne Xin Zhao 외

Considering the inherent limitations of parametric knowledge in large language models (LLMs), retrieval-augmented generation (RAG) is widely employed to expand their knowledge scope. Since RAG has shown promise in knowle…

Open-Domain Question AnsweringQuestion AnsweringRAGRetrieval+1

Multi-head Temporal Attention-Augmented Bilinear Network for Financial time series prediction

2022-01-14 · Mostafa Shabani, Dat Thanh Tran, Martin Magris, Juho Kanniainen 외

Financial time-series forecasting is one of the most challenging domains in the field of time-series analysis. This is mostly due to the highly non-stationary and noisy nature of financial time-series data. With progress…

Financial AnalysisTime SeriesTime Series AnalysisTime Series Forecasting+1

SemRAG: Semantic Knowledge-Augmented RAG for Improved Question-Answering

2025-07-10 · Kezhen Zhong, Basem Suleiman, Abdelkarim Erradi, Shijing Chen arxiv

This paper introduces SemRAG, an enhanced Retrieval Augmented Generation (RAG) framework that efficiently integrates domain-specific knowledge using semantic chunking and knowledge graphs without extensive fine-tuning. I…

Knowledge Graphs

Retrieval Augmented Generation using Engineering Design Knowledge

2023-07-13 · L. Siddharth, Jianxi Luo

Aiming to support Retrieval Augmented Generation (RAG) in the design process, we present a method to identify explicit, engineering design facts - {head entity :: relationship :: tail entity} from patented artefact descr…

Common Sense ReasoningEdge ClassificationKnowledge GraphsRAG+5