Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
Combinatorial optimization problems with parameters to be predicted from side information are commonly seen in a variety of problems during the paradigm shift from reactive decision making to proactive decision making. Due to the misalignment between the continuous prediction results and the discrete decisions in optimization problems, it is hard to achieve a satisfactory prediction result with the ordinary $l_2$ loss in the prediction phase. To properly connect the prediction loss with the optimization goal, in this paper we propose a total group preorder (TGP) loss and its differential version called approximated total group preorder (ATGP) loss for predict-then-optimize (PTO) problems with strong ranking property. These new losses are provably more robust than the usual $l_2$ loss in a linear regression setting and have great potential to extend to other settings. We also propose an automatic searching algorithm that adapts the ATGP loss to PTO problems with different combinatorial structures. Extensive experiments on the ranking problem, the knapsack problem, and the shortest path problem have demonstrated that our proposed method can achieve a significant performance compared to the other methods designed for PTO problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Combinatorial OptimizationDecision MakingPredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AutoLoss-GMS: Searching Generalized Margin-Based Softmax Loss Function for Person Re-Identification
Person re-identification is a hot topic in computer vision, and the loss function plays a vital role in improving the discrimination of the learned features. However, most existing models utilize the hand-crafted los…
Person Re-IdentificationLoss Function Search for Face Recognition
In face recognition, designing margin-based (e.g., angular, additive, additive angular margins) softmax loss functions plays an important role in learning discriminative features. However, these hand-crafted heuristic me…
AutoMLFace RecognitionSearching Parameterized AP Loss for Object Detection
Loss functions play an important role in training deep-network-based object detectors. The most widely used evaluation metric for object detection is Average Precision (AP), which captures the performance of localization…
Objectobject-detectionObject DetectionLoss-Controlling Calibration for Predictive Models
We propose a learning framework for calibrating predictive models to make loss-controlling prediction for exchangeable data, which extends our recently proposed conformal loss-controlling prediction for more general case…
PredictionWeather ForecastingSparseMask: Differentiable Connectivity Learning for Dense Image Prediction
In this paper, we aim at automatically searching an efficient network architecture for dense image prediction. Particularly, we follow the encoder-decoder style and focus on designing a connectivity structure for the dec…
DecoderPrediction