paper-with-me

Papers

CMAG: Concept-Scaffolded Retrieval for Marketplace Avatar Generation

2026-05-18 · Rajeev Goel, Jason Ding, Phani Harish Wajjala, Pavan Turaga, Tejaswi Gowda, Krishna C. Garikipati arxiv

Metaverse platforms rely on creator-driven marketplaces where avatars are assembled from discrete, taxonomy-labeled 3D assets (e.g., tops, bottoms, shoes, accessories) under strict category and topology constraints. While users increasingly expect free-form text control, text-only retrieval is brittle: natural language is ambiguous with respect to platform taxonomies, metadata is often noisy or informal, and independently retrieved components can be stylistically inconsistent or geometrically incompatible. We propose \textbf{CMAG}, a concept-scaffolded retrieval and verified composition framework for marketplace avatar generation. Given a prompt, CMAG first synthesizes an intermediate 3D concept scaffold that disambiguates intent beyond text by providing global spatial and stylistic context. In parallel, a view-aware part discovery module extracts localized visual evidence via prompt decomposition and text-grounded segmentation. A prompt-conditioned taxonomy router enforces category coverage and resolves semantic-to-taxonomic mismatch, after which a hybrid category-wise retriever combines part-based fusion with a concept-residual fallback using feature suppression. Finally, an agentic vision--language model filters and re-ranks candidates across categories and drives an iterative verification loop to assemble prompt-faithful, topologically consistent avatars from catalog assets. We evaluate CMAG on diverse compositional prompts and demonstrate improved retrieval robustness and compositional correctness compared to strong baselines, highlighting the importance of 3D concept scaffolding under prompt ambiguity.

📄 PDF Abstract BibTeX arXiv:2605.18680

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Enter: Graduated Realism: A Pedagogical Framework for AI-Powered Avatars in Virtual Reality Teacher Training

2025-06-13 · Judson Leroy Dean Haynes IV

Virtual Reality simulators offer a powerful tool for teacher training, yet the integration of AI-powered student avatars presents a critical challenge: determining the optimal level of avatar realism for effective pedago…

Retrieval-augmented Generation

Learning How To Learn NLP: Developing Introductory Concepts Through Scaffolded Discovery

2021-06-01 · NAACL (TeachingNLP) 2021 6 · Alexandra Schofield, Richard Wicentowski, Julie Medero

We present a scaffolded discovery learning approach to introducing concepts in a Natural Language Processing course aimed at computer science students at liberal arts institutions. We describe some of the objectives of t…

LLM Constitutional Multi-Agent Governance

2026-03-13 · J. de Curtò, I. de Zarzà arxiv

Large Language Models (LLMs) can generate persuasive influence strategies that shift cooperative behavior in multi-agent populations, but a critical question remains: does the resulting cooperation reflect genuine prosoc…

Avatar Concept Slider: Manipulate Concepts In Your Human Avatar With Fine-grained Control

2024-08-26 · Yixuan He, Lin Geng Foo, Ajmal Saeed Mian, Hossein Rahmani 외

Language based editing of 3D human avatars to precisely match user requirements is challenging due to the inherent ambiguity and limited expressiveness of natural language. To overcome this, we propose the Avatar Concept…

Attribute

Que2Engage: Embedding-based Retrieval for Relevant and Engaging Products at Facebook Marketplace

2023-02-21 · Yunzhong He, Yuxin Tian, Mengjiao Wang, Feier Chen 외

Embedding-based Retrieval (EBR) in e-commerce search is a powerful search retrieval technique to address semantic matches between search queries and products. However, commercial search engines like Facebook Marketplace …

Retrieval