paper-with-me

홈 › Papers

GeoReg: Weight-Constrained Few-Shot Regression for Socio-Economic Estimation using LLM

2025-07-17 · Kyeongjin Ahn, Sungwon Han, Seungeon Lee, Donghyun Ahn, Hyoshin Kim, Jungwon Kim, Jihee Kim, Sangyoon Park, Meeyoung Cha

Socio-economic indicators like regional GDP, population, and education levels, are crucial to shaping policy decisions and fostering sustainable development. This research introduces GeoReg a regression model that integrates diverse data sources, including satellite imagery and web-based geospatial information, to estimate these indicators even for data-scarce regions such as developing countries. Our approach leverages the prior knowledge of large language model (LLM) to address the scarcity of labeled data, with the LLM functioning as a data engineer by extracting informative features to enable effective estimation in few-shot settings. Specifically, our model obtains contextual relationships between data features and the target indicator, categorizing their correlations as positive, negative, mixed, or irrelevant. These features are then fed into the linear estimator with tailored weight constraints for each category. To capture nonlinear patterns, the model also identifies meaningful feature interactions and integrates them, along with nonlinear transformations. Experiments across three countries at different stages of development demonstrate that our model outperforms baselines in estimating socio-economic indicators, even for low-income countries with limited data availability.

📄 PDF Abstract BibTeX arXiv:2507.13323

Code (0)

등록된 구현이 없습니다.

Tasks

Large Language Model

Similar Papers 제목 키워드 기반

ROS georegistration: Aerial Multi-spectral Image Simulator for the Robot Operating System

2022-01-19 · Andrew R. Willis, Kevin Brink, Kathleen Dipple

This article describes a software package called ROS georegistration intended for use with the Robot Operating System (ROS) and the Gazebo 3D simulation environment. ROSgeoregistration provides tools for the simulation, …

House Price Valuation Model Based on Geographically Neural Network Weighted Regression: The Case Study of Shenzhen, China

2022-02-09 · Zimo Wang, Yicheng Wang, Sensen Wu

Confronted with the spatial heterogeneity of real estate market, some traditional research utilized Geographically Weighted Regression (GWR) to estimate the house price. However, its kernel function is non-linear, elusiv…

regression

Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning

2026-02-19 · Hien Dang, Pratik Patil, Alessandro Rinaldo arxiv

Self-distillation (SD) is the process of retraining a student on a mixture of ground-truth labels and the teacher's own predictions using the same architecture and training data. Although SD has been empirically shown to…

One-shot Distributed Ridge Regression in High Dimensions

2020-01-01 · ICML 2020 1 · Yue Sheng, Edgar Dobriban

To scale up data analysis, distributed and parallel computing approaches are increasingly needed. Here we study a fundamental problem in this area: How to do ridge regression in a distributed computing environment? We st…

Distributed ComputingregressionUnityVocal Bursts Intensity Prediction

A cost-sensitive constrained Lasso

2024-01-31 · Rafael Blanquero, Emilio Carrizosa, Pepa Ramírez-Cobo, M. Remedios Sillero-Denamiel

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full cont…

Prediction