paper-with-me

홈 › Papers

DODO: Discrete OCR Diffusion Models

2026-02-18 · Sean Man, Gilad Deutch, Roy Ganz, Roi Ronen, Shahar Tsiper, Shai Mazor, Niv Nayman arxiv

Optical Character Recognition (OCR) is a fundamental task for digitizing information, serving as a critical bridge between visual data and textual understanding. While modern Vision-Language Models (VLM) have achieved high accuracy in this domain, they predominantly rely on autoregressive decoding, which becomes computationally expensive and slow for long documents as it requires a sequential forward pass for every generated token. We identify a key opportunity to overcome this bottleneck: unlike open-ended generation, OCR is a highly deterministic task where the visual input strictly dictates a unique output sequence, theoretically enabling efficient, parallel decoding via diffusion models. However, we show that existing masked diffusion models fail to harness this potential; those introduce structural instabilities that are benign in flexible tasks, like captioning, but catastrophic for the rigid, exact-match requirements of OCR. To bridge this gap, we introduce DODO, the first VLM to utilize block discrete diffusion and unlock its speedup potential for OCR. By decomposing generation into blocks, DODO mitigates the synchronization errors of global diffusion. Empirically, our method achieves near state-of-the-art accuracy while enabling up to 5x faster inference compared to autoregressive baselines.

📄 PDF Abstract BibTeX arXiv:2602.16872

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Differentiable Phylogenetics via Hyperbolic Embeddings with Dodonaphy

2023-09-21 · Matthew Macaulay, Mathieu Fourment

Motivation: Navigating the high dimensional space of discrete trees for phylogenetics presents a challenging problem for tree optimisation. To address this, hyperbolic embeddings of trees offer a promising approach to en…

Decoder

Dodo: Dynamic Contextual Compression for Decoder-only LMs

2023-10-03 · Guanghui Qin, Corby Rosset, Ethan C. Chau, Nikhil Rao 외

Transformer-based language models (LMs) are inefficient in long contexts. We propose Dodo, a solution for context compression. Instead of one vector per token in a standard transformer model, Dodo represents text with a …

DecoderLanguage ModelingLanguage ModellingQuestion Answering

DODO: Causal Structure Learning with Budgeted Interventions

2025-10-09 · Matteo Gregorini, Chiara Boldrini, Lorenzo Valerio arxiv

Artificial Intelligence has achieved remarkable advancements in recent years, yet much of its progress relies on identifying increasingly complex correlations. Enabling causality awareness in AI has the potential to enha…

Causal Inference

Universal Policies for Software-Defined MDPs

2020-12-21 · Daniel Selsam, Jesse Michael Han, Leonardo de Moura, Patrice Godefroid

We introduce a new programming paradigm called oracle-guided decision programming in which a program specifies a Markov Decision Process (MDP) and the language provides a universal policy. We prototype a new programming …

Heuristic SearchMeta-Learning

Do's and Don'ts: Learning Desirable Skills with Instruction Videos

2024-06-01 · Hyunseung Kim, Byungkun Lee, Hojoon Lee, Dongyoon Hwang 외

Unsupervised skill discovery is a learning paradigm that aims to acquire diverse behaviors without explicit rewards. However, it faces challenges in learning complex behaviors and often leads to learning unsafe or undesi…

continuous-controlContinuous ControlNavigate