S-index: Towards Better Metrics for Quantifying Research Impact
The ongoing growth in the volume of scientific literature available today precludes researchers from efficiently discerning the relevant from irrelevant content. Researchers are constantly interested in impactful papers, authors and venues in their respective fields. Moreover, they are interested in the so-called recent "rising stars" of these contexts which may lead to attractive directions for future work, collaborations or impactful publication venues. In this work, we address the problem of quantifying research impact in each of these contexts, in order to better direct attention of researchers and streamline the processes of comparison, ranking and evaluation of contribution. Specifically, we begin by outlining intuitive underlying assumptions that impact quantification methods should obey and evaluate when current state-of-the-art methods fail to satisfy these properties. To this end, we introduce the s-index metric which quantifies research impact through influence propagation over a heterogeneous citation network. s-index is tailored from these intuitive assumptions and offers a number of desirable qualities including robustness, natural temporality and straightforward extensibility from the paper impact to broader author and venue impact contexts. We evaluate its effectiveness on the publicly available Microsoft Academic Search citation graph with over 119 million papers and 1 billion citation edges with 103 million and 21 thousand associated authors and venues respectively.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
How are journals cited? characterizing journal citations by type of citation
Evaluation of journals for quality is one of the dominant themes of bibliometrics since journals are the primary venue of vetting and distribution of scholarship. There are many criticisms of quantifying journal impact w…
Information RetrievalRetrievalVocal Bursts Type PredictionDeep forecasting of translational impact in medical research
The value of biomedical research--a $1.7 trillion annual investment--is ultimately determined by its downstream, real-world impact. Current objective predictors of impact rest on proxy, reductive metrics of dissemination…
TranslationQuantifying the Effects of the 2008 Recession using the Zillow Dataset
This report explores the use of Zillow's housing metrics dataset to investigate the effects of the 2008 US subprime mortgage crisis on various US locales. We begin by exploring the causes of the recession and the metrics…
ClusteringModified-Emergency Index (MEI): A Criticality Metric for Autonomous Driving in Lateral Conflict
Effective, reliable, and efficient evaluation of autonomous driving safety is essential to demonstrate its trustworthiness. Criticality metrics provide an objective means of assessing safety. However, as existing metrics…
Autonomous DrivingQuantifying Grid-Forming Behavior: Bridging Device-level Dynamics and System-Level Stability
Grid-Forming (GFM) technology is considered a promising solution to build power electronics-dominated power systems. However, the impact of GFM converters on the system stability is still unquantified, creating a gap bet…