paper-with-me

Papers

Unveiling Discrete Clues: Superior Healthcare Predictions for Rare Diseases

2025-01-23 · Chuang Zhao, Hui Tang, Jiheng Zhang, Xiaomeng Li

Accurate healthcare prediction is essential for improving patient outcomes. Existing work primarily leverages advanced frameworks like attention or graph networks to capture the intricate collaborative (CO) signals in electronic health records. However, prediction for rare diseases remains challenging due to limited co-occurrence and inadequately tailored approaches. To address this issue, this paper proposes UDC, a novel method that unveils discrete clues to bridge consistent textual knowledge and CO signals within a unified semantic space, thereby enriching the representation semantics of rare diseases. Specifically, we focus on addressing two key sub-problems: (1) acquiring distinguishable discrete encodings for precise disease representation and (2) achieving semantic alignment between textual knowledge and the CO signals at the code level. For the first sub-problem, we refine the standard vector quantized process to include condition awareness. Additionally, we develop an advanced contrastive approach in the decoding stage, leveraging synthetic and mixed-domain targets as hard negatives to enrich the perceptibility of the reconstructed representation for downstream tasks. For the second sub-problem, we introduce a novel codebook update strategy using co-teacher distillation. This approach facilitates bidirectional supervision between textual knowledge and CO signals, thereby aligning semantically equivalent information in a shared discrete latent space. Extensive experiments on three datasets demonstrate our superiority.

📄 PDF Abstract BibTeX arXiv:2501.16373

Code (1)

data-designer/udchealth 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

Unveiling Performance Challenges of Large Language Models in Low-Resource Healthcare: A Demographic Fairness Perspective

2024-11-30 · Yue Zhou, Barbara Di Eugenio, Lu Cheng

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning fra…

Fairness

GEO-Detective: Unveiling Location Privacy Risks in Images with LLM Agents

2025-11-27 · Xinyu Zhang, Yixin Wu, Boyang Zhang, Chenhao Lin 외 arxiv

Images shared on social media often expose geographic cues. While early geolocation methods required expert effort and lacked generalization, the rise of Large Vision Language Models (LVLMs) now enables accurate geolocat…

Band-Attention Modulated RetNet for Face Forgery Detection

2024-04-09 · Zhida Zhang, Jie Cao, Wenkui Yang, Qihang Fan 외

The transformer networks are extensively utilized in face forgery detection due to their scalability across large datasets.Despite their success, transformers face challenges in balancing the capture of global context, w…

Encoding Implicit Relation Requirements for Relation Extraction: A Joint Inference Approach

2018-11-09 · Li-Wei Chen, Yansong Feng, Songfang Huang, Bingfeng Luo 외

Relation extraction is the task of identifying predefined relationship between entities, and plays an essential role in information extraction, knowledge base construction, question answering and so on. Most existing rel…

Knowledge Base ConstructionQuestion AnsweringRelationRelation Extraction

Unveiling Latent Causal Rules: A Temporal Point Process Approach for Abnormal Event Explanation

2024-02-03 · Yiling Kuang, Chao Yang, Yang Yang, Shuang Li

In high-stakes systems such as healthcare, it is critical to understand the causal reasons behind unusual events, such as sudden changes in patient's health. Unveiling the causal reasons helps with quick diagnoses and pr…

Point Processes