paper-with-me

Papers

Coordinated Transformer with Position \& Sample-aware Central Loss for Anatomical Landmark Detection

2023-05-18 · Qikui Zhu, Yihui Bi, Danxin Wang, Xiangpeng Chu, Jie Chen, Yanqing Wang

Heatmap-based anatomical landmark detection is still facing two unresolved challenges: 1) inability to accurately evaluate the distribution of heatmap; 2) inability to effectively exploit global spatial structure information. To address the computational inability challenge, we propose a novel position-aware and sample-aware central loss. Specifically, our central loss can absorb position information, enabling accurate evaluation of the heatmap distribution. More advanced is that our central loss is sample-aware, which can adaptively distinguish easy and hard samples and make the model more focused on hard samples while solving the challenge of extreme imbalance between landmarks and non-landmarks. To address the challenge of ignoring structure information, a Coordinated Transformer, called CoorTransformer, is proposed, which establishes long-range dependencies under the guidance of landmark coordination information, making the attention more focused on the sparse landmarks while taking advantage of global spatial structure. Furthermore, CoorTransformer can speed up convergence, effectively avoiding the defect that Transformers have difficulty converging in sparse representation learning. Using the advanced CoorTransformer and central loss, we propose a generalized detection model that can handle various scenarios, inherently exploiting the underlying relationship between landmarks and incorporating rich structural knowledge around the target landmarks. We analyzed and evaluated CoorTransformer and central loss on three challenging landmark detection tasks. The experimental results show that our CoorTransformer outperforms state-of-the-art methods, and the central loss significantly improves the performance of the model with p-values< 0.05.

📄 PDF Abstract BibTeX arXiv:2305.11338

Code (0)

등록된 구현이 없습니다.

Tasks

Anatomical Landmark DetectionPositionRepresentation Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Integrating Transit Signal Priority into Multi-Agent Reinforcement Learning based Traffic Signal Control

2024-11-28 · Dickness Kakitahi Kwesiga, Suyash Chandra Vishnoi, Angshuman Guin, Michael Hunter

This study integrates Transit Signal Priority (TSP) into multi-agent reinforcement learning (MARL) based traffic signal control. The first part of the study develops adaptive signal control based on MARL for a pair of co…

Multi-agent Reinforcement LearningTraffic Signal Control

Coordinated Replay Sample Selection for Continual Federated Learning

2023-10-23 · Jack Good, Jimit Majmudar, Christophe Dupuy, Jixuan Wang 외

Continual Federated Learning (CFL) combines Federated Learning (FL), the decentralized learning of a central model on a number of client devices that may not communicate their data, and Continual Learning (CL), the learn…

Continual LearningFederated Learning

Generative Multi-Agent Q-Learning for Policy Optimization: Decentralized Wireless Networks

2025-03-07 · Talha Bozkus, Urbashi Mitra

Q-learning is a widely used reinforcement learning (RL) algorithm for optimizing wireless networks, but faces challenges with large state-spaces. Recently proposed multi-environment mixed Q-learning (MEMQ) algorithm addr…

Q-LearningReinforcement Learning (RL)

Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance

2026-01-28 · Chenliang Zhou, Fangcheng Zhong, Weihao Xia, Albert Miao 외 arxiv

We introduce the Quartet of Diffusions, a structure-aware point cloud generation framework that explicitly models part composition and symmetry. Unlike prior methods that treat shape generation as a holistic process or o…

Point Cloud Generation

Paris: A Decentralized Trained Open-Weight Diffusion Model

2025-10-03 · Zhiying Jiang, Raihan Seraj, Marcos Villagra, Bidhan Roy arxiv

We present Paris, the first publicly released diffusion model pre-trained entirely through decentralized computation. Paris demonstrates that high-quality text-to-image generation can be achieved without centrally coordi…

Text-to-Image Generation