paper-with-me

Papers

USTAR: Online Multimodal Embedding for Modeling User-Guided Spatiotemporal Activity

2019-10-23 · Amila Silva, Shanika Karunasekera, Christopher Leckie, Ling Luo

Building spatiotemporal activity models for people's activities in urban spaces is important for understanding the ever-increasing complexity of urban dynamics. With the emergence of Geo-Tagged Social Media (GTSM) records, previous studies demonstrate the potential of GTSM records for spatiotemporal activity modeling. State-of-the-art methods for this task embed different modalities (location, time, and text) of GTSM records into a single embedding space. However, they ignore Non-GeoTagged Social Media (NGTSM) records, which generally account for the majority of posts (e.g., more than 95\% in Twitter), and could represent a great source of information to alleviate the sparsity of GTSM records. Furthermore, in the current spatiotemporal embedding techniques, less focus has been given to the users, who exhibit spatially motivated behaviors. To bridge this research gap, this work proposes USTAR, a novel online learning method for User-guided SpatioTemporal Activity Representation, which (1) embeds locations, time, and text along with users into the same embedding space to capture their correlations; (2) uses a novel collaborative filtering approach based on two different empirically studied user behaviors to incorporate both NGTSM and GTSM records in learning; and (3) introduces a novel sampling technique to learn spatiotemporal representations in an online fashion to accommodate recent information into the embedding space, while avoiding overfitting to recent records and frequently appearing units in social media streams. Our results show that USTAR substantially improves the state-of-the-art for region retrieval and keyword retrieval and its potential to be applied to other downstream applications such as local event detection.

📄 PDF Abstract BibTeX arXiv:1910.10335

Code (0)

등록된 구현이 없습니다.

Tasks

Collaborative FilteringEvent DetectionRetrieval

Similar Papers 제목 키워드 기반

Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)

2019-06-05 · Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas, Roger Zimmermann 외

Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has be…

Sarcasm Detection

Towards Multimodal Sarcasm Detection (An \_Obviously\_ Perfect Paper)

2019-07-01 · ACL 2019 7 · Santiago Castro, Devamanyu Hazarika, Ver{\'o}nica P{\'e}rez-Rosas, Roger Zimmermann 외

Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the recent work in sarcasm detection has be…

Sarcasm Detection

An Emoji-aware Multitask Framework for Multimodal Sarcasm Detection

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Sarcasm is a case of implicit emotion and needs additional information like context and multimodality for its better detection. But sometimes this additional information also fails to help in sarcasm detection. For examp…

Sarcasm Detection

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

2023-12-27 · Zhiqiang Guo, Jianjun Li, GuoHui Li, Chaoyang Wang 외

The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchas…

Graph EmbeddingGraph Learninghypergraph embeddingMultimodal Recommendation

Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detection

2023-09-29 · Swapnil Bhosale, Abhra Chaudhuri, Alex Lee Robert Williams, Divyank Tiwari 외

The introduction of the MUStARD dataset, and its emotion recognition extension MUStARD++, have identified sarcasm to be a multi-modal phenomenon -- expressed not only in natural language text, but also through manners of…

BenchmarkingDiversityEmotion RecognitionSarcasm Detection