paper-with-me

홈 › Papers

Tensorized Ant Colony Optimization for GPU Acceleration

2024-04-07 · Luming Yang, Tao Jiang, Ran Cheng

Ant Colony Optimization (ACO) is renowned for its effectiveness in solving Traveling Salesman Problems, yet it faces computational challenges in CPU-based environments, particularly with large-scale instances. In response, we introduce a Tensorized Ant Colony Optimization (TensorACO) to utilize the advancements of GPU acceleration. As the core, TensorACO fully transforms ant system and ant path into tensor forms, a process we refer to as tensorization. For the tensorization of ant system, we propose a preprocessing method to reduce the computational overhead by calculating the probability transition matrix. In the tensorization of ant path, we propose an index mapping method to accelerate the update of pheromone matrix by replacing the mechanism of sequential path update with parallel matrix operations. Additionally, we introduce an Adaptive Independent Roulette (AdaIR) method to overcome the challenges of parallelizing ACO's selection mechanism on GPUs. Comprehensive experiments demonstrate the superior performance of TensorACO achieving up to 1921$\times$ speedup over standard ACO. Moreover, the AdaIR method further improves TensorACO's convergence speed by 80% and solution quality by 2%. Source codes are available at https://github.com/EMI-Group/tensoraco.

📄 PDF Abstract BibTeX arXiv:2404.04895

Code (1)

emi-group/tensoraco 공식 구현 jax

Tasks

CPUGPU

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

GPU-accelerated Evolutionary Multiobjective Optimization Using Tensorized RVEA

2024-04-01 · Zhenyu Liang, Tao Jiang, Kebin Sun, Ran Cheng

Evolutionary multiobjective optimization has witnessed remarkable progress during the past decades. However, existing algorithms often encounter computational challenges in large-scale scenarios, primarily attributed to …

GPUMultiobjective Optimization

GPU-accelerated Evolutionary Many-objective Optimization Using Tensorized NSGA-III

2025-04-08 · Hao Li, Zhenyu Liang, Ran Cheng

NSGA-III is one of the most widely adopted algorithms for tackling many-objective optimization problems. However, its CPU-based design severely limits scalability and computational efficiency. To address the limitations,…

Computational EfficiencyCPUEvolutionary AlgorithmsGPU

Bridging Evolutionary Multiobjective Optimization and GPU Acceleration via Tensorization

2025-03-26 · Zhenyu Liang, Hao Li, Naiwei Yu, Kebin Sun 외

Evolutionary multiobjective optimization (EMO) has made significant strides over the past two decades. However, as problem scales and complexities increase, traditional EMO algorithms face substantial performance limitat…

CPUGPUMultiobjective Optimization

TensorIR: An Abstraction for Automatic Tensorized Program Optimization

2022-07-09 · Siyuan Feng, Bohan Hou, Hongyi Jin, Wuwei Lin 외

Deploying deep learning models on various devices has become an important topic. The wave of hardware specialization brings a diverse set of acceleration primitives for multi-dimensional tensor computations. These new ac…

BIG-bench Machine LearningDeep Learning

Tensorized NeuroEvolution of Augmenting Topologies for GPU Acceleration

2024-04-02 · Lishuang Wang, Mengfei Zhao, Enyu Liu, Kebin Sun 외

The NeuroEvolution of Augmenting Topologies (NEAT) algorithm has received considerable recognition in the field of neuroevolution. Its effectiveness is derived from initiating with simple networks and incrementally evolv…

Computational EfficiencyGPU