UniCell: Universal Cell Nucleus Classification via Prompt Learning
The recognition of multi-class cell nuclei can significantly facilitate the process of histopathological diagnosis. Numerous pathological datasets are currently available, but their annotations are inconsistent. Most existing methods require individual training on each dataset to deduce the relevant labels and lack the use of common knowledge across datasets, consequently restricting the quality of recognition. In this paper, we propose a universal cell nucleus classification framework (UniCell), which employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains. In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets. Moreover, we develop a Dynamic Prompt Module (DPM) that exploits the properties of multiple datasets to enhance features. The DPM first integrates the embeddings of datasets and semantic categories, and then employs the integrated prompts to refine image representations, efficiently harvesting the shared knowledge among the related cell types and data sources. Experimental results demonstrate that the proposed method effectively achieves the state-of-the-art results on four nucleus detection and classification benchmarks. Code and models are available at https://github.com/lhaof/UniCell
Code (1)
Tasks
ClassificationPrompt LearningSimilar Papers 제목 키워드 기반
Genome hybridization: A universal way for the origin and diversification of organelles as well as the origin and speciation of eukaryotes
The origin of organelles (mitochondrion, chloroplast and nucleus) remains enigmatic. The endosymbiotic hypothesis that chloroplasts, mitochondria and nuclei descend from the endosymbiotic cyanobacterium, bacterium and ar…
Prompt-based Grouping Transformer for Nucleus Detection and Classification
Automatic nuclei detection and classification can produce effective information for disease diagnosis. Most existing methods classify nuclei independently or do not make full use of the semantic similarity between nuclei…
ClassificationSemantic SimilaritySemantic Textual SimilaritySecond-order Phase Transition in Phytoplankton Trait Dynamics
Key traits of unicellular species, like cell size, often follow scale-free or self-similar distributions, hinting at the possibility of an underlying critical process. However, linking such empirical scaling laws to the …
Easy-GT: Open-Source Software to Facilitate Making the Ground Truth for White Blood Cells Nucleus
The nucleus of white blood cells (WBCs) plays a significant role in their detection and classification. Appropriate feature extraction of the nucleus is necessary to fit a suitable artificial intelligence model to classi…
Metabolic Allometric Scaling of Unicellular Organisms as a Product of Selection Guided by Optimization of Nutrients Distribution in Food Chains
One of the major characteristics of living organisms is metabolic rate, which is the amount of energy produced per unit of time. When the mass of organisms increases, the metabolic rate also increases (usually as a power…