paper-with-me

Papers

Unsupervised Belief Representation Learning with Information-Theoretic Variational Graph Auto-Encoders

2021-10-01 · Jinning Li, Huajie Shao, Dachun Sun, Ruijie Wang, Yuchen Yan, Jinyang Li, Shengzhong Liu, Hanghang Tong, Tarek Abdelzaher

This paper develops a novel unsupervised algorithm for belief representation learning in polarized networks that (i) uncovers the latent dimensions of the underlying belief space and (ii) jointly embeds users and content items (that they interact with) into that space in a manner that facilitates a number of downstream tasks, such as stance detection, stance prediction, and ideology mapping. Inspired by total correlation in information theory, we propose the Information-Theoretic Variational Graph Auto-Encoder (InfoVGAE) that learns to project both users and content items (e.g., posts that represent user views) into an appropriate disentangled latent space. To better disentangle latent variables in that space, we develop a total correlation regularization module, a Proportional-Integral (PI) control module, and adopt rectified Gaussian distribution to ensure the orthogonality. The latent representation of users and content can then be used to quantify their ideological leaning and detect/predict their stances on issues. We evaluate the performance of the proposed InfoVGAE on three real-world datasets, of which two are collected from Twitter and one from U.S. Congress voting records. The evaluation results show that our model outperforms state-of-the-art unsupervised models by reducing 10.5% user clustering errors and achieving 12.1% higher F1 scores for stance separation of content items. In addition, InfoVGAE produces a comparable result with supervised models. We also discuss its performance on stance prediction and user ranking within ideological groups.

📄 PDF Abstract BibTeX arXiv:2110.00210

Code (1)

jinningli/infovgae 공식 구현 pytorch

Tasks

Representation LearningStance Detection

Similar Papers 제목 키워드 기반

Auto-Encoding Total Correlation Explanation

2018-02-16 · Shuyang Gao, Rob Brekelmans, Greg Ver Steeg, Aram Galstyan

Advances in unsupervised learning enable reconstruction and generation of samples from complex distributions, but this success is marred by the inscrutability of the representations learned. We propose an information-the…

DisentanglementRepresentation Learning

Variational approach to unsupervised learning

2019-04-24 · Swapnil Nitin Shah

Deep belief networks are used extensively for unsupervised stochastic learning on large datasets. Compared to other deep learning approaches their layer-by-layer learning makes them highly scalable. Unfortunately, the pr…

Generalized Information-theoretic Multi-view Clustering

2023-09-21 · NeurIPS 2023 11

In an era of more diverse data modalities, multi-view clustering has become a fundamental tool for comprehensive data analysis and exploration. However, existing multi-view unsupervised learning methods often rely on str…

INFORMATION MAXIMIZATION AUTO-ENCODING

2019-05-01 · ICLR 2019 5 · Dejiao Zhang, Tianchen Zhao, Laura Balzano

We propose the Information Maximization Autoencoder (IMAE), an information theoretic approach to simultaneously learn continuous and discrete representations in an unsupervised setting. Unlike the Variational Autoencoder…

DecoderDisentanglementInformativenessvalid

Learning Representations by Maximizing Mutual Information in Variational Autoencoders

2019-12-21 · Ali Lotfi Rezaabad, Sriram Vishwanath

Variational autoencoders (VAEs) have ushered in a new era of unsupervised learning methods for complex distributions. Although these techniques are elegant in their approach, they are typically not useful for representat…

Representation Learning