Attentive Representation Learning with Adversarial Training for Short Text Clustering
Short text clustering has far-reaching effects on semantic analysis, showing its importance for multiple applications such as corpus summarization and information retrieval. However, it inevitably encounters the severe sparsity of short text representations, making the previous clustering approaches still far from satisfactory. In this paper, we present a novel attentive representation learning model for shot text clustering, wherein cluster-level attention is proposed to capture the correlations between text representations and cluster representations. Relying on this, the representation learning and clustering for short texts are seamlessly integrated into a unified model. To further ensure robust model training for short texts, we apply adversarial training to the unsupervised clustering setting, by injecting perturbations into the cluster representations. The model parameters and perturbations are optimized alternately through a minimax game. Extensive experiments on four real-world short text datasets demonstrate the superiority of the proposed model over several strong competitors, verifying that robust adversarial training yields substantial performance gains.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringInformation RetrievalRepresentation LearningRetrievalShort Text ClusteringText ClusteringSimilar Papers 제목 키워드 기반
Quaternion-Based Self-Attentive Long Short-Term User Preference Encoding for Recommendation
Quaternion space has brought several benefits over the traditional Euclidean space: Quaternions (i) consist of a real and three imaginary components, encouraging richer representations; (ii) utilize Hamilton product whic…
Recommendation SystemsPhoneme-aware and Channel-wise Attentive Learning for Text DependentSpeaker Verification
This paper proposes a multi-task learning network with phoneme-aware and channel-wise attentive learning strategies for text-dependent Speaker Verification (SV). In the proposed structure, the frame-level multi-task lear…
Multi-Task LearningSpeaker VerificationText-Dependent Speaker VerificationAttentive Tree-structured Network for Monotonicity Reasoning
Many state-of-art neural models designed for monotonicity reasoning perform poorly on downward inference. To address this shortcoming, we developed an attentive tree-structured neural network. It consists of a tree-based…
Natural Language InferenceSentenceAttentive Pooling with Learnable Norms for Text Representation
Pooling is an important technique for learning text representations in many neural NLP models. In conventional pooling methods such as average, max and attentive pooling, text representations are weighted summations of t…
A Pairwise DomMix Attentive Adversarial Network for Unsupervised Domain Adaptive Object Detection
Unsupervised Domain Adaptive Object Detection (DAOD) could adapt a model trained on a source domain to an unlabeled target domain for object detection. Existing unsupervised DAOD methods usually perform feature alignment…
object-detectionObject Detection