paper-with-me

홈 › Papers

Venue Analytics: A Simple Alternative to Citation-Based Metrics

2019-04-29 · Leonid Keselman

We present a method for automatically organizing and evaluating the quality of different publishing venues in Computer Science. Since this method only requires paper publication data as its input, we can demonstrate our method on a large portion of the DBLP dataset, spanning 50 years, with millions of authors and thousands of publishing venues. By formulating venue authorship as a regression problem and targeting metrics of interest, we obtain venue scores for every conference and journal in our dataset. The obtained scores can also provide a per-year model of conference quality, showing how fields develop and change over time. Additionally, these venue scores can be used to evaluate individual academic authors and academic institutions. We show that using venue scores to evaluate both authors and institutions produces quantitative measures that are comparable to approaches using citations or peer assessment. In contrast to many other existing evaluation metrics, our use of large-scale, openly available data enables this approach to be repeatable and transparent. To help others build upon this work, all of our code and data is available at https://github.com/leonidk/venue_scores

📄 PDF Abstract BibTeX arXiv:1904.12573

Code (1)

leonidk/venue_scores 공식 구현

Similar Papers 제목 키워드 기반

Editorial for the First Workshop on Mining Scientific Papers: Computational Linguistics and Bibliometrics

2015-06-17 · Iana Atanassova, Marc Bertin, Philipp Mayr

The workshop "Mining Scientific Papers: Computational Linguistics and Bibliometrics" (CLBib 2015), co-located with the 15th International Society of Scientometrics and Informetrics Conference (ISSI 2015), brought togethe…

Geographic Citation Gaps in NLP Research

2022-10-26 · Mukund Rungta, Janvijay Singh, Saif M. Mohammad, Diyi Yang

In a fair world, people have equitable opportunities to education, to conduct scientific research, to publish, and to get credit for their work, regardless of where they live. However, it is common knowledge among resear…

How are journals cited? characterizing journal citations by type of citation

2021-02-22 · Domenic Rosati

Evaluation of journals for quality is one of the dominant themes of bibliometrics since journals are the primary venue of vetting and distribution of scholarship. There are many criticisms of quantifying journal impact w…

Information RetrievalRetrievalVocal Bursts Type Prediction

Supervised Machine Learning for Eliciting Individual Demand

2019-04-30 · John A. Clithero, Jae Joon Lee, Joshua Tasoff

Direct elicitation, guided by theory, is the standard method for eliciting latent preferences. The canonical direct-elicitation approach for measuring individuals' valuations for goods is the Becker-DeGroot-Marschak proc…

BIG-bench Machine Learning

LLM-Metrics: Measuring Research Impact Through Large Language Model Memory

2026-05-21 · Si Shen, Wenhua Zhao, Danhao Zhu arxiv

Citation counts remain the dominant metric for assessing research impact, yet they suffer from well-documented limitations: temporal lag, disciplinary bias, and Matthew effects. Here we propose LLM-Metrics, a research-im…