paper-with-me

홈 › Papers

RK-core: An Established Methodology for Exploring the Hierarchical Structure within Datasets

2023-10-10 · Yao Lu, Yutian Huang, Jiaqi Nie, Zuohui Chen, Qi Xuan

Recently, the field of machine learning has undergone a transition from model-centric to data-centric. The advancements in diverse learning tasks have been propelled by the accumulation of more extensive datasets, subsequently facilitating the training of larger models on these datasets. However, these datasets remain relatively under-explored. To this end, we introduce a pioneering approach known as RK-core, to empower gaining a deeper understanding of the intricate hierarchical structure within datasets. Across several benchmark datasets, we find that samples with low coreness values appear less representative of their respective categories, and conversely, those with high coreness values exhibit greater representativeness. Correspondingly, samples with high coreness values make a more substantial contribution to the performance in comparison to those with low coreness values. Building upon this, we further employ RK-core to analyze the hierarchical structure of samples with different coreset selection methods. Remarkably, we find that a high-quality coreset should exhibit hierarchical diversity instead of solely opting for representative samples. The code is available at https://github.com/yaolu-zjut/Kcore.

📄 PDF Abstract BibTeX arXiv:2310.12168

Code (1)

yaolu-zjut/kcore 공식 구현 pytorch

Tasks

Diversity

Similar Papers 제목 키워드 기반

Exploring the hierarchical structure of human plans via program generation

2023-11-30 · Carlos G. Correa, Sophia Sanborn, Mark K. Ho, Frederick Callaway 외

Human behavior is often assumed to be hierarchically structured, made up of abstract actions that can be decomposed into concrete actions. However, behavior is typically measured as a sequence of actions, which makes it …

A methodology for analyzing financial needs hierarchy from social discussions using LLM

2026-02-06 · Abhishek Jangra, Sachin Thukral, Arnab Chatterjee, Jayasree Raveendran arxiv

This study examines the hierarchical structure of financial needs as articulated in social media discourse, employing generative AI techniques to analyze large-scale textual data. While human needs encompass a broad spec…

Reducing the dimensionality and granularity in hierarchical categorical variables

2024-03-06 · Paul Wilsens, Katrien Antonio, Gerda Claeskens

Hierarchical categorical variables often exhibit many levels (high granularity) and many classes within each level (high dimensionality). This may cause overfitting and estimation issues when including such covariates in…

Linguistics and Human Brain: A Perspective of Computational Neuroscience

2026-02-09 · Fudong Zhang, Bo Chai, Yujie Wu, Wai Ting Siok 외 arxiv

Elucidating the language-brain relationship requires bridging the methodological gap between the abstract theoretical frameworks of linguistics and the empirical neural data of neuroscience. Serving as an interdisciplina…

Exploring ordered patterns in the adjacency matrix for improving machine learning on complex networks

2023-01-20 · Mariane B. Neiva, Odemir M. Bruno

The use of complex networks as a modern approach to understanding the world and its dynamics is well-established in literature. The adjacency matrix, which provides a one-to-one representation of a complex network, can a…