paper-with-me

홈 › Papers

Latent Space Model for Multi-Modal Social Data

2015-10-18 · Yoon-Sik Cho, Greg Ver Steeg, Emilio Ferrara, Aram Galstyan

With the emergence of social networking services, researchers enjoy the increasing availability of large-scale heterogenous datasets capturing online user interactions and behaviors. Traditional analysis of techno-social systems data has focused mainly on describing either the dynamics of social interactions, or the attributes and behaviors of the users. However, overwhelming empirical evidence suggests that the two dimensions affect one another, and therefore they should be jointly modeled and analyzed in a multi-modal framework. The benefits of such an approach include the ability to build better predictive models, leveraging social network information as well as user behavioral signals. To this purpose, here we propose the Constrained Latent Space Model (CLSM), a generalized framework that combines Mixed Membership Stochastic Blockmodels (MMSB) and Latent Dirichlet Allocation (LDA) incorporating a constraint that forces the latent space to concurrently describe the multiple data modalities. We derive an efficient inference algorithm based on Variational Expectation Maximization that has a computational cost linear in the size of the network, thus making it feasible to analyze massive social datasets. We validate the proposed framework on two problems: prediction of social interactions from user attributes and behaviors, and behavior prediction exploiting network information. We perform experiments with a variety of multi-modal social systems, spanning location-based social networks (Gowalla), social media services (Instagram, Orkut), e-commerce and review sites (Amazon, Ciao), and finally citation networks (Cora). The results indicate significant improvement in prediction accuracy over state of the art methods, and demonstrate the flexibility of the proposed approach for addressing a variety of different learning problems commonly occurring with multi-modal social data.

📄 PDF Abstract BibTeX arXiv:1510.05318

Code (0)

등록된 구현이 없습니다.

Tasks

model

Similar Papers 제목 키워드 기반

Trajectory Prediction with Latent Belief Energy-Based Model

2021-04-07 · CVPR 2021 1 · Bo Pang, Tianyang Zhao, Xu Xie, Ying Nian Wu

Human trajectory prediction is critical for autonomous platforms like self-driving cars or social robots. We present a latent belief energy-based model (LB-EBM) for diverse human trajectory forecast. LB-EBM is a probabil…

modelPredictionSelf-Driving CarsTrajectory Prediction

Multi-Modal Bayesian Embeddings for Learning Social Knowledge Graphs

2015-08-04 · Zhilin Yang, Jie Tang, William Cohen

We study the extent to which online social networks can be connected to open knowledge bases. The problem is referred to as learning social knowledge graphs. We propose a multi-modal Bayesian embedding model, GenVector, …

Knowledge Graphs

N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space

2024-03-18 · William Theisen, Walter Scheirer

The social media landscape of conflict dynamics has grown increasingly multi-modal. Recent advancements in model architectures such as CLIP have enabled researchers to begin studying the interplay between the modalities …

Certainly Bot Or Not? Trustworthy Social Bot Detection via Robust Multi-Modal Neural Processes

2025-03-11 · Qi Wu, Yingguang Yang, Hao liu, Hao Peng 외

Social bot detection is crucial for mitigating misinformation, online manipulation, and coordinated inauthentic behavior. While existing neural network-based detectors perform well on benchmarks, they struggle with gener…

Misinformation

Composite Correlation Quantization for Efficient Multimodal Retrieval

2016-05-22 · Long Mingsheng, Cao Yue, Wang Jianmin, Yu Philip S.

Efficient similarity retrieval from large-scale multimodal database is pervasive in modern search engines and social networks. To support queries across content modalities, the system should enable cross-modal correlatio…

Cross-Modal RetrievalQuantizationRetrieval