Handling Class Imbalance in Link Prediction using Learning to Rank Techniques
We consider the link prediction problem in a partially observed network, where the objective is to make predictions in the unobserved portion of the network. Many existing methods reduce link prediction to binary classification problem. However, the dominance of absent links in real world networks makes misclassification error a poor performance metric. Instead, researchers have argued for using ranking performance measures, like AUC, AP and NDCG, for evaluation. Our main contribution is to recast the link prediction problem as a learning to rank problem and use effective learning to rank techniques directly during training. This is in contrast to existing work that uses ranking measures only during evaluation. Our approach is able to deal with the class imbalance problem by using effective, scalable learning to rank techniques during training. Furthermore, our approach allows us to combine network topology and node features. As a demonstration of our general approach, we develop a link prediction method by optimizing the cross-entropy surrogate, originally used in the popular ListNet ranking algorithm. We conduct extensive experiments on publicly available co-authorship, citation and metabolic networks to demonstrate the merits of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationLearning-To-RankLink PredictionPredictionSimilar Papers 제목 키워드 기반
Attribute-Enhanced Similarity Ranking for Sparse Link Prediction
Link prediction is a fundamental problem in graph data. In its most realistic setting, the problem consists of predicting missing or future links between random pairs of nodes from the set of disconnected pairs. Graph Ne…
AttributeBinary ClassificationGraph Learninggraph partitioning+2A Linkage-based Doubly Imbalanced Graph Learning Framework for Face Clustering
In recent years, benefiting from the expressive power of Graph Convolutional Networks (GCNs), significant breakthroughs have been made in face clustering area. However, rare attention has been paid to GCN-based clusterin…
ClusteringFace ClusteringGraph Learningimage-classification+1Structural Imbalance Aware Graph Augmentation Learning
Graph machine learning (GML) has made great progress in node classification, link prediction, graph classification and so on. However, graphs in reality are often structurally imbalanced, that is, only a few hub nodes ha…
Graph ClassificationLink PredictionNode ClassificationSequential Binary Classification for Intrusion Detection
Network Intrusion Detection Systems (IDS) have become increasingly important as networks become more vulnerable to new and sophisticated attacks. Machine Learning (ML)-based IDS are increasingly seen as the most effectiv…
Binary ClassificationClassificationIntrusion DetectionMulti-class Classification+1Handling Extreme Class Imbalance in Technical Logbook Datasets
Technical logbooks are a challenging and under-explored text type in automated event identification. These texts are typically short and written in non-standard yet technical language, posing challenges to off-the-shelf …