WindTunnel -- A Framework for Community Aware Sampling of Large Corpora
Conducting comprehensive information retrieval experiments, such as in search or retrieval augmented generation, often comes with high computational costs. This is because evaluating a retrieval algorithm requires indexing the entire corpus, which is significantly larger than the set of (query, result) pairs under evaluation. This issue is especially pronounced in big data and neural retrieval, where indexing becomes increasingly time-consuming and complex. In this paper, we present WindTunnel, a novel framework developed at Yext to generate representative samples of large corpora, enabling efficient end-to-end information retrieval experiments. By preserving the community structure of the dataset, WindTunnel overcomes limitations in current sampling methods, providing more accurate evaluations.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalRetrievalRetrieval-augmented GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Breaking Structural Isolation: Scalable Graph Clustering via Community-Aware Sampling and Structural Entropy
Unsupervised graph clustering is a fundamental technique for uncovering underlying semantic patterns in large-scale networks. Although Graph Contrastive Learning has demonstrated promising performance, existing methods o…
Contrastive LearningGraph ClusteringMemory-aware framework for fast and scalable second-order random walk over billion-edge natural graphs
Second-order random walk is an important technique for graph analysis. Many applications including graph embedding, proximity measure and community detection use it to capture higher-order patterns in the graph, thus imp…
Community DetectionGraph EmbeddingCommunity-Aware Graph Signal Processing
The emerging field of graph signal processing (GSP) allows to transpose classical signal processing operations (e.g., filtering) to signals on graphs. The GSP framework is generally built upon the graph Laplacian, which …
Community DetectionDenoisingLearnable Skeleton-Aware 3D Point Cloud Sampling
Point cloud sampling is crucial for efficient large-scale point cloud analysis, where learning-to-sample methods have recently received increasing attention from the community for jointly training with downstream tas…
ObjectPoint Cloud ClassificationRetrievalCommunity-Aware Temporal Walks: Parameter-Free Representation Learning on Continuous-Time Dynamic Graphs
Dynamic graph representation learning plays a crucial role in understanding evolving behaviors. However, existing methods often struggle with flexibility, adaptability, and the preservation of temporal and structural dyn…
Graph Representation LearningLink PredictionRepresentation Learning