paper-with-me

홈 › Papers

Hierarchical Vision-Language Retrieval of Educational Metaverse Content in Agriculture

2025-08-19 · Ali Abdari, Alex Falcon, Giuseppe Serra arxiv

Every day, a large amount of educational content is uploaded online across different areas, including agriculture and gardening. When these videos or materials are grouped meaningfully, they can make learning easier and more effective. One promising way to organize and enrich such content is through the Metaverse, which allows users to explore educational experiences in an interactive and immersive environment. However, searching for relevant Metaverse scenarios and finding those matching users' interests remains a challenging task. A first step in this direction has been done recently, but existing datasets are small and not sufficient for training advanced models. In this work, we make two main contributions: first, we introduce a new dataset containing 457 agricultural-themed virtual museums (AgriMuseums), each enriched with textual descriptions; and second, we propose a hierarchical vision-language model to represent and retrieve relevant AgriMuseums using natural language queries. In our experimental setting, the proposed method achieves up to about 62\% R@1 and 78\% MRR, confirming its effectiveness, and it also leads to improvements on existing benchmarks by up to 6\% R@1 and 11\% MRR. Moreover, an extensive evaluation validates our design choices. Code and dataset are available at https://github.com/aliabdari/Agricultural_Metaverse_Retrieval .

📄 PDF Abstract BibTeX arXiv:2508.13713

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language Queries

Similar Papers 제목 키워드 기반

A Language-based solution to enable Metaverse Retrieval

2023-12-22 · Ali Abdari, Alex Falcon, Giuseppe Serra

Recently, the Metaverse is becoming increasingly attractive, with millions of users accessing the many available virtual worlds. However, how do users find the one Metaverse which best fits their current interests? So fa…

Contrastive LearningRetrieval

Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos

2023-01-01 · ICCV 2023 1 · Dong Won Lee, Chaitanya Ahuja, Paul Pu Liang, Sanika Natu 외

Many educational videos use slide presentations, a sequence of visual pages that contain text and figures accompanied by spoken language, which are constructed and presented carefully in order to optimally transfer k…

AttributeRetrievalText Retrieval

Adversarial Attacks and Defenses for Semantic Communication in Vehicular Metaverses

2023-06-06 · Jiawen Kang, Jiayi He, Hongyang Du, Zehui Xiong 외

For vehicular metaverses, one of the ultimate user-centric goals is to optimize the immersive experience and Quality of Service (QoS) for users on board. Semantic Communication (SemCom) has been introduced as a revolutio…

Semantic Communication

Information Need in Metaverse Recordings - A Field Study

2024-11-13 · Patrick Steinert, Jan Mischkies, Stefan Wagenpfeil, Ingo Frommholz 외

Metaverse Recordings (MVRs) represent an emerging and underexplored media type within the field of Multimedia Information Retrieval (MMIR). This paper presents findings from a field study aimed at understanding the users…

Information RetrievalRetrieval

Uni-Retrieval: A Multi-Style Retrieval Framework for STEM's Education

2025-02-09 · Yanhao Jia, Xinyi Wu, Hao Li, Qinglin Zhang 외

In AI-facilitated teaching, leveraging various query styles to interpret abstract text descriptions is crucial for ensuring high-quality teaching. However, current retrieval models primarily focus on natural text-image r…

Image RetrievalLanguage ModelingLanguage ModellingRetrieval