paper-with-me

홈 › Papers

GSE: Evaluating Sticker Visual Semantic Similarity via a General Sticker Encoder

2025-11-07 · Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma, Min Zhang arxiv

Stickers have become a popular form of visual communication, yet understanding their semantic relationships remains challenging due to their highly diverse and symbolic content. In this work, we formally {define the Sticker Semantic Similarity task} and introduce {Triple-S}, the first benchmark for this task, consisting of 905 human-annotated positive and negative sticker pairs. Through extensive evaluation, we show that existing pretrained vision and multimodal models struggle to capture nuanced sticker semantics. To address this, we propose the {General Sticker Encoder (GSE)}, a lightweight and versatile model that learns robust sticker embeddings using both Triple-S and additional datasets. GSE achieves superior performance on unseen stickers, and demonstrates strong results on downstream tasks such as emotion classification and sticker-to-sticker retrieval. By releasing both Triple-S and GSE, we provide standardized evaluation tools and robust embeddings, enabling future research in sticker understanding, retrieval, and multimodal content generation. The Triple-S benchmark and GSE have been publicly released and are available here.

📄 PDF Abstract BibTeX arXiv:2511.04977

Code (0)

등록된 구현이 없습니다.

Tasks

Emotion ClassificationSemantic Similarity

Similar Papers 제목 키워드 기반

Small Stickers, Big Meanings: A Multilingual Sticker Semantic Understanding Dataset with a Gamified Approach

2025-06-02 · Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma 외

Stickers, though small, are a highly condensed form of visual expression, ubiquitous across messaging platforms and embraced by diverse cultures, genders, and age groups. Despite their popularity, sticker retrieval remai…

Retrieval

MGHFT: Multi-Granularity Hierarchical Fusion Transformer for Cross-Modal Sticker Emotion Recognition

2025-07-25 · Jian Chen, Yuxuan Hu, Haifeng Lu, Wei Wang 외 arxiv

Although pre-trained visual models with text have demonstrated strong capabilities in visual feature extraction, sticker emotion understanding remains challenging due to its reliance on multi-view information, such as ba…

Contrastive LearningEmotion Recognition

PerSRV: Personalized Sticker Retrieval with Vision-Language Model

2024-10-29 · Heng Er Metilda Chee, Jiayin Wang, Zhiqiang Guo, Weizhi Ma 외

Instant Messaging is a popular means for daily communication, allowing users to send text and stickers. As the saying goes, "a picture is worth a thousand words", so developing an effective sticker retrieval technique is…

Language ModelingLanguage ModellingmodelRetrieval

SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset

2026-04-29 · Changhyun Roh, Yonghyun Jeong, Jonghyun Lee, Chanho Eom 외 arxiv

Synthesizing a target concept from a single reference image is challenging in diffusion-based personalized text-to-image generation, particularly for sticker personalization where prompts often require explicit attribute…

Text-to-Image GenerationTest-time Adaptation

Sticker820K: Empowering Interactive Retrieval with Stickers

2023-06-12 · Sijie Zhao, Yixiao Ge, Zhongang Qi, Lin Song 외

Stickers have become a ubiquitous part of modern-day communication, conveying complex emotions through visual imagery. To facilitate the development of more powerful algorithms for analyzing stickers, we propose a large-…

Image RetrievalRetrieval