Single-GPU GNN Systems: Traps and Pitfalls
The current graph neural network (GNN) systems have established a clear trend of not showing training accuracy results, and directly or indirectly relying on smaller datasets for evaluations majorly. Our in-depth analysis shows that it leads to a chain of pitfalls in the system design and evaluation process, questioning the practicality of many of the proposed system optimizations, and affecting conclusions and lessons learned. We analyze many single-GPU systems and show the fundamental impact of these pitfalls. We further develop hypotheses, recommendations, and evaluation methodologies, and provide future directions. Finally, a new reference system is developed to establish a new line of optimizations rooted in solving the system-design pitfalls efficiently and practically. The proposed design can productively be integrated into prior works, thereby truly advancing the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
GPUGraph Neural NetworkMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Jungle of Generative Drug Discovery: Traps, Treasures, and Ways Out
"How to evaluate de novo designs proposed by a generative model?" Despite the transformative potential of generative deep learning in drug discovery, this seemingly simple question has no clear answer. The absence of sta…
BenchmarkingDeep LearningDrug DiscoveryNavigateOnline ML Self-adaptation in Face of Traps
Online machine learning (ML) is often used in self-adaptive systems to strengthen the adaptation mechanism and improve the system utility. Despite such benefits, applying online ML for self-adaptation can be challenging,…
Protein atom traps as seeing by neutron scattering
The expression for the higher temperature dependence of the mean squared displacement in proteins is obtained. The quantum multi-well model explains the dynamic transitions of the proteins and minimizes the amount of par…
Artificial intelligence and the transformation of higher education institutions
Artificial intelligence (AI) advances and the rapid adoption of generative AI tools like ChatGPT present new opportunities and challenges for higher education. While substantial literature discusses AI in higher educatio…
Sequence Information Channel Concatenation for Improving Camera Trap Image Burst Classification
Camera Traps are extensively used to observe wildlife in their natural habitat without disturbing the ecosystem. This could help in the early detection of natural or human threats to animals, and help towards ecological …
General Classificationimage-classificationImage Classification