Learning the Travelling Salesperson Problem Requires Rethinking Generalization
End-to-end training of neural network solvers for graph combinatorial optimization problems such as the Travelling Salesperson Problem (TSP) have seen a surge of interest recently, but remain intractable and inefficient beyond graphs with few hundreds of nodes. While state-of-the-art learning-driven approaches for TSP perform closely to classical solvers when trained on trivially small sizes, they are unable to generalize the learnt policy to larger instances at practical scales. This work presents an end-to-end neural combinatorial optimization pipeline that unifies several recent papers in order to identify the inductive biases, model architectures and learning algorithms that promote generalization to instances larger than those seen in training. Our controlled experiments provide the first principled investigation into such zero-shot generalization, revealing that extrapolating beyond training data requires rethinking the neural combinatorial optimization pipeline, from network layers and learning paradigms to evaluation protocols. Additionally, we analyze recent advances in deep learning for routing problems through the lens of our pipeline and provide new directions to stimulate future research.
Code (4)
Tasks
Combinatorial OptimizationTransfer LearningZero-shot GeneralizationSimilar Papers 제목 키워드 기반
Web-Based Implementation of Travelling Salesperson Problem Using Genetic Algorithm
The world is connected through the Internet. As the abundance of Internet users connected into the Web and the popularity of cloud computing research, the need of Artificial Intelligence (AI) is demanding. In this resear…
Cloud ComputingSchedulingInsights from Multi-tasking the EAX Algorithm for the Travelling Salesperson Problem
Evolutionary multitasking allows several related problems to be solved in a single run of an algorithm. In this paper, we investigate integrating evolutionary multitasking with Edge Assembly Crossover (MT-EAX) to solve t…
Evolving Diverse Sets of Tours for the Travelling Salesperson Problem
Evolving diverse sets of high quality solutions has gained increasing interest in the evolutionary computation literature in recent years. With this paper, we contribute to this area of research by examining evolutionary…
DiversityEvolutionary AlgorithmsPareto Frontier Approximation Network (PA-Net) to Solve Bi-objective TSP
The travelling salesperson problem (TSP) is a classic resource allocation problem used to find an optimal order of doing a set of tasks while minimizing (or maximizing) an associated objective function. It is widely used…
Reinforcement Learning (RL)SchedulingRecent Advances in Deep Learning for Routing Problems
Developing neural network-driven solvers for combinatorial optimization problems such as the Travelling Salesperson Problem have seen a surge of academic interest recently. This blogpost presents a Neural Combinatorial O…
Combinatorial OptimizationDeep Learning