paper-with-me

Papers

Probabilistic Lexical Manifold Construction in Large Language Models via Hierarchical Vector Field Interpolation

2025-02-14 · Clive Pendleton, Ewan Harrington, Giles Fairbrother, Jasper Arkwright, Nigel Fenwick, Richard Katrix

Hierarchical vector field interpolation introduces a structured probabilistic framework for lexical representation, ensuring that word embeddings transition smoothly across a continuous manifold rather than being constrained to discrete token mappings. The proposed methodology constructs a probabilistic function space where word representations adhere to topological consistency, mitigating representational discontinuities commonly observed in transformer-based embeddings. Empirical evaluations reveal that probabilistic constraints enhance lexical coherence by refining contextual relationships, leading to improvements in semantic stability across multiple linguistic distributions. The application of divergence minimization techniques ensures that interpolated embeddings maintain probabilistic consistency while preserving computational feasibility for large-scale implementations. Experimental findings demonstrate that interpolated lexical manifolds improve representation density alignment, reducing anisotropic distortions in contextual embedding distributions. Comparative analyses with standard transformer-based models highlight that structured interpolation yields more stable representations, particularly in tasks requiring fine-grained semantic differentiation. The statistical evaluation of embedding divergence confirms that probabilistic lexical manifolds reduce representational inconsistencies while maintaining coherence across varying scales of contextual abstraction. An assessment of computational efficiency reveals that while interpolation introduces minor processing overhead, the structured representation learning approach remains scalable for practical deployment.

📄 PDF Abstract BibTeX arXiv:2502.10013

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyRepresentation LearningWord Embeddings

Similar Papers 제목 키워드 기반

Lexicalization of Probabilistic Linear Context-free Rewriting Systems

2020-07-01 · WS 2020 7 · Richard M{\"o}rbitz, Thomas Ruprecht

In the field of constituent parsing, probabilistic grammar formalisms have been studied to model the syntactic structure of natural language. More recently, approaches utilizing neural models gained lots of traction in t…

An Infinitesimal Probabilistic Model for Principal Component Analysis of Manifold Valued Data

2018-01-31 · Stefan Sommer

We provide a probabilistic and infinitesimal view of how the principal component analysis procedure (PCA) can be generalized to analysis of nonlinear manifold valued data. Starting with the probabilistic PCA interpretati…

Meaning-infused grammar: Gradient Acceptability Shapes the Geometric Representations of Constructions in LLMs

2025-07-29 · Supantho Rakshit, Adele Goldberg arxiv

The usage-based constructionist (UCx) approach to language posits that language comprises a network of learned form-meaning pairings (constructions) whose use is largely determined by their meanings or functions, requiri…

Inferring Manifolds From Noisy Data Using Gaussian Processes

2021-10-14 · David B Dunson, Nan Wu

In analyzing complex datasets, it is often of interest to infer lower dimensional structure underlying the higher dimensional observations. As a flexible class of nonlinear structures, it is common to focus on Riemannian…

Gaussian Processes

3D Morphology Prediction of Progressive Spinal Deformities from Probabilistic Modeling of Discriminant Manifolds

2017-01-17 · Samuel Kadoury, William Mandel, Marjolaine Roy-Beaudry, Marie-Lyne Nault 외

We introduce a novel approach for predicting the progression of adolescent idiopathic scoliosis from 3D spine models reconstructed from biplanar X-ray images. Recent progress in machine learning have allowed to improve c…

General ClassificationPrognosis