paper-with-me

Papers

LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoning

2026-03-12 · Haiying Xu, Zihan Wang, Song Dai, Zhengxuan Zhang, Kairan Dou, Xuming Hu arxiv

Despite recent advances in multimodal reasoning, representing auxiliary geometric constructions remains a fundamental challenge for multimodal large language models (MLLMs). Such constructions are absent from the original diagram and must be introduced before theorems apply. Existing approaches predominantly rely on explicit construction paradigms, including text-based geometric specification, visual-token interleaving during reasoning, and tool-augmented geometric execution. However, these methods either fail to faithfully represent complex spatial relationships, incur representation mismatch between discrete symbols and continuous geometric structures, or rely on external capabilities that hinder end-to-end optimization. To address these limitations, we propose LatentGeo, a framework that learns continuous latent visual representations to internalize auxiliary geometric constructions without pixel-level rendering or external executors. We design a three-stage curriculum that progressively aligns and internalizes these latent representations through auxiliary visual supervision, followed by LaGDPO, a latent-aware reinforcement learning procedure that stabilizes latent representations during policy optimization while improving end-task correctness. To systematically evaluate construction-centric representation quality, we introduce GeoAux, a new benchmark targeting visually dependent geometry problems, and conduct experiments on GeoAux and MathVerse. Results show that LatentGeo achieves substantial gains on geometric reasoning tasks, particularly those requiring auxiliary constructions. Extensive analyses and ablation studies further validate the effectiveness of each component in our framework.

📄 PDF Abstract BibTeX arXiv:2603.12166

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningMultimodal Reasoning

Similar Papers 제목 키워드 기반

Dueling Decoders: Regularizing Variational Autoencoder Latent Spaces

2019-05-17 · Bryan Seybold, Emily Fertig, Alex Alemi, Ian Fischer

Variational autoencoders learn unsupervised data representations, but these models frequently converge to minima that fail to preserve meaningful semantic information. For example, variational autoencoders with autoregre…

Decoder

Latent Process Generator Matching

2026-05-19 · Lukas Billera, Hedwig Nora Nordlinder, Ben Murrell arxiv

Many recent flow-matching and diffusion-style generative models rely on auxiliary stochastic dynamics during training: a richer process is simulated to define conditional targets, but the auxiliary state is either intrac…

Improving Deep Representation Learning via Auxiliary Learnable Target Coding

2023-05-30 · KangJun Liu, Ke Chen, Kui Jia, YaoWei Wang

Deep representation learning is a subfield of machine learning that focuses on learning meaningful and useful representations of data through deep neural networks. However, existing methods for semantic classification ty…

Representation LearningRetrievalTriplet

Inverse Problem Sampling in Latent Space Using Sequential Monte Carlo

2025-02-09 · Idan Achituve, Hai Victor Habi, Amir Rosenfeld, Arnon Netzer 외

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generativ…

Decoder

Frequency-Forcing: From Scaling-as-Time to Soft Frequency Guidance

2026-04-21 · Weitao Du arxiv

While standard flow-matching models transport noise to data uniformly, incorporating an explicit generation order - specifically, establishing coarse, low-frequency structure before fine detail - has proven highly effect…