Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learning
This paper introduces a task- and model-aware framework for measuring similarity between wireless datasets, enabling applications such as dataset selection/augmentation, simulation-to-real (sim2real) comparison, task-specific synthetic data generation, and informing decisions on model training/adaptation to new deployments. We evaluate candidate dataset distance metrics by how well they predict cross-dataset transferability: if two datasets have a small distance, a model trained on one should perform well on the other. We apply the framework on an unsupervised task, channel state information (CSI) compression, using autoencoders. Using metrics based on UMAP embeddings, combined with Wasserstein and Euclidean distances, we achieve Pearson correlations exceeding 0.85 between dataset distances and train-on-one/test-on-another task performance. We also apply the framework to a supervised beam prediction in the downlink using convolutional neural networks. For this task, we derive a label-aware distance by integrating supervised UMAP and penalties for dataset imbalance. Across both tasks, the resulting distances outperform traditional baselines and consistently exhibit stronger correlations with model transferability, supporting task-relevant comparisons between wireless datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Synthetic Data GenerationBeam PredictionSimilar Papers 제목 키워드 기반
A Dataset Similarity Evaluation Framework for Wireless Communications and Sensing
This paper introduces a task-specific, model-agnostic framework for evaluating dataset similarity, providing a means to assess and compare dataset realism and quality. Such a framework is crucial for augmenting real-worl…
BenchmarkingDimensionality ReductionThe Historical Significance of Textual Distances
Measuring similarity is a basic task in information retrieval, and now often a building-block for more complex arguments about cultural change. But do measures of textual similarity and distance really correspond to evid…
Information RetrievalRetrievalLearning Non-Metric Visual Similarity for Image Retrieval
Measuring visual similarity between two or more instances within a data distribution is a fundamental task in image retrieval. Theoretically, non-metric distances are able to generate a more complex and accurate similari…
Content-Based Image RetrievalImage RetrievalInstance SearchRetrievalQuantifying the Echo Chamber Effect: An Embedding Distance-based Approach
The rise of social media platforms has facilitated the formation of echo chambers, which are online spaces where users predominantly encounter viewpoints that reinforce their existing beliefs while excluding dissenting p…
Distance and Similarity Measures Effect on the Performance of K-Nearest Neighbor Classifier -- A Review
The K-nearest neighbor (KNN) classifier is one of the simplest and most common classifiers, yet its performance competes with the most complex classifiers in the literature. The core of this classifier depends mainly on …