paper-with-me

홈 › Papers

The Inference-Compute Frontier and a Latency-Efficient Architecture for Limit Order Book Prediction

2026-06-24 · C. Evans Hedges arxiv

We study whether a scaling-law-style inference-compute frontier appears in limit order book prediction. Using FI-2010 and a suite of models ranging from small decision trees to neural LOB architectures, we find that the realized empirical frontier of predictive loss versus structural forward work is well summarized by a power law. In particular, with MLPLOB held out as an architecture family, a power-law fit to the low- and mid-compute non-MLPLOB frontier extrapolates across multiple orders of magnitude and attains $R^2=0.941$ on the excluded high-compute MLPLOB target frontier. A similar exercise in latency space gives substantially weaker results, showing that latency is not merely noisy compute. We use this gap to motivate FastBiNLOB, a dense axis-separable LOB mixer built from hardware-friendly temporal and feature mixing operations. In a five-seed experiment, FastBiNLOB exceeds the published $y_{10}$ and $y_{100}$ macro-F1 targets at notably lower latency than existing published SOTA architectures.

📄 PDF Abstract BibTeX arXiv:2606.25986

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AI Inference as Relocatable Electricity Demand: A Latency-Constrained Energy-Geography Framework

2026-04-30 · Xubin Luo, Cheng Yang arxiv

AI inference is becoming a persistent and geographically distributed source of electricity demand. Unlike many traditional electrical loads, inference workloads can sometimes be executed away from the user-facing service…

Tiered Pruning for Efficient Differentialble Inference-Aware Neural Architecture Search

2022-09-23 · Sławomir Kierat, Mateusz Sieniawski, Denys Fridman, Chen-Han Yu 외

We propose three novel pruning techniques to improve the cost and results of inference-aware Differentiable Neural Architecture Search (DNAS). First, we introduce Prunode, a stochastic bi-path building block for DNAS, wh…

image-classificationImage ClassificationNeural Architecture Searchobject-detection+1

Efficient Neural Compression with Inference-time Decoding

2024-06-10 · C. Metz, O. Bichler, A. Dupret

This paper explores the combination of neural network quantization and entropy coding for memory footprint minimization. Edge deployment of quantized models is hampered by the harsh Pareto frontier of the accuracy-to-bit…

DecoderQuantization

Frontier: Simulating the Next Generation of LLM Inference Systems

2025-08-05 · Yicheng Feng, Xin Tan, Kin Hang Sew, Yimin Jiang 외 arxiv

Large Language Model (LLM) inference is growing increasingly complex with the rise of Mixture-of-Experts (MoE) models and disaggregated architectures that decouple components like prefill/decode (PD) or attention/FFN (AF…

Scaling Inference-Efficient Language Models

2025-01-30 · Song Bian, Minghao Yan, Shivaram Venkataraman

Scaling laws are powerful tools to predict the performance of large language models. However, current scaling laws fall short of accounting for inference costs. In this work, we first show that model architecture affects…

Model SelectionMORPH