SplitWise Regression: Stepwise Modeling with Adaptive Dummy Encoding
Capturing nonlinear relationships without sacrificing interpretability remains a persistent challenge in regression modeling. We introduce SplitWise, a novel framework that enhances stepwise regression. It adaptively transforms numeric predictors into threshold-based binary features using shallow decision trees, but only when such transformations improve model fit, as assessed by the Akaike Information Criterion (AIC) or Bayesian Information Criterion (BIC). This approach preserves the transparency of linear models while flexibly capturing nonlinear effects. Implemented as a user-friendly R package, SplitWise is evaluated on both synthetic and real-world datasets. The results show that it consistently produces more parsimonious and generalizable models than traditional stepwise and penalized regression techniques.
Code (1)
Tasks
regressionSimilar Papers 제목 키워드 기반
Adaptive Batching for Gaussian Process Surrogates with Application in Noisy Level Set Estimation
We develop adaptive replicated designs for Gaussian process metamodels of stochastic experiments. Adaptive batching is a natural extension of sequential design heuristics with the benefit of replication growing as respon…
Splitwise: Collaborative Edge-Cloud Inference for LLMs via Lyapunov-Assisted DRL
Deploying large language models (LLMs) on edge devices is challenging due to their limited memory and power resources. Cloud-only inference reduces device burden but introduces high latency and cost. Static edge-cloud pa…
Reinforcement LearningSplitwiser: Efficient LM inference with constrained resources
Efficient inference of LLMs remains a crucial challenge, with two main phases: a compute-intensive prompt computation and a memory-intensive token generation. Despite existing batching and scheduling techniques, token ge…
GPUSchedulingEfficient Autoregressive Video Diffusion with Dummy Head
The autoregressive video diffusion model has recently gained considerable research interest due to its causal modeling and iterative denoising. In this work, we identify that the multi-head self-attention in these models…
Video GenerationA Work Zone Simulation Model for Travel Time Prediction in a Connected Vehicle Environment
A work zone bottleneck in a roadway network can cause traffic delays, emissions and safety issues. Accurate measurement and prediction of work zone travel time can help travelers make better routing decisions and therefo…
Model SelectionregressionTravel Time Estimation