Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization
Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However, recent deep learning models have moved forward from independent and identically distributed data to graph-structured data, such as social networks, e-commerce user-item graphs, and knowledge graphs. This evolution has led to the emergence of Graph Neural Networks (GNNs) that go beyond the models existing data selection methods are designed for. Therefore, we present Grain, an efficient framework that opens up a new perspective through connecting data selection in GNNs with social influence maximization. By exploiting the common patterns of GNNs, Grain introduces a novel feature propagation concept, a diversified influence maximization objective with novel influence and diversity functions, and a greedy algorithm with an approximation guarantee into a unified framework. Empirical studies on public datasets demonstrate that Grain significantly improves both the performance and efficiency of data selection (including active learning and core-set selection) for GNNs. To the best of our knowledge, this is the first attempt to bridge two largely parallel threads of research, data selection, and social influence maximization, in the setting of GNNs, paving new ways for improving data efficiency.
Code (1)
Tasks
Active LearningKnowledge GraphsSimilar Papers 제목 키워드 기반
Diversified and Adaptive Negative Sampling on Knowledge Graphs
In knowledge graph embedding, aside from positive triplets (ie: facts in the knowledge graph), the negative triplets used for training also have a direct influence on the model performance. In reality, since knowledge gr…
Graph EmbeddingInformativenessKnowledge Graph EmbeddingKnowledge Graphs+1Robust Diversified Graph Contrastive Network for Incomplete Multi-view Clustering
Incomplete multi-view clustering is a challenging task which aims to partition the unlabeled incomplete multi-view data into several clusters. The existing incomplete multi-view clustering methods neglect to utilize the …
ClusteringContrastive LearningIncomplete multi-view clusteringRepresentation LearningDeep Graph Representation Learning and Optimization for Influence Maximization
Influence maximization (IM) is formulated as selecting a set of initial users from a social network to maximize the expected number of influenced users. Researchers have made great progress in designing various tradition…
Graph Representation LearningRepresentation LearningAdapting ELM to Time Series Classification: A Novel Diversified Top-k Shapelets Extraction Method
ELM (Extreme Learning Machine) is a single hidden layer feed-forward network, where the weights between input and hidden layer are initialized randomly. ELM is efficient due to its utilization of the analytical approach …
DiversityGeneral ClassificationTime SeriesTime Series Analysis+1Fine-Grained Urban Flow Inference with Multi-scale Representation Learning
Fine-grained urban flow inference (FUFI) is a crucial transportation service aimed at improving traffic efficiency and safety. FUFI can infer fine-grained urban traffic flows based solely on observed coarse-grained data.…
Contrastive LearningFine-Grained Urban Flow InferenceRepresentation Learning