NoveltyRank: A Retrieval-Augmented Framework for Conceptual Novelty Estimation in AI Research
The accelerating pace of scientific publication makes it difficult to identify truly original research among incremental work. We propose a framework for estimating the conceptual novelty of research papers by combining semantic representation learning with retrieval-based comparison against prior literature. We model novelty as both a binary classification task (novel vs. non-novel) and a pairwise ranking task (comparative novelty), enabling absolute and relative assessments. Experiments benchmark three model scales, ranging from compact domain-specific encoders to a zero-shot frontier model. Results show that fine-tuned lightweight models outperform larger zero-shot models despite their smaller parameter count, indicating that task-specific supervision matters more than scale for conceptual novelty estimation. We further deploy the best-performing model as an online system for public interaction and real-time novelty scoring.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningBinary ClassificationSimilar Papers 제목 키워드 기반
Navigating Ideation Space: Decomposed Conceptual Representations for Positioning Scientific Ideas
Scientific discovery is a cumulative process and requires new ideas to be situated within an ever-expanding landscape of existing knowledge. An emerging and critical challenge is how to identify conceptually relevant pri…
Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning
Paraphrase generation is a fundamental and long-standing task in natural language processing. In this paper, we concentrate on two contributions to the task: (1) we propose Retrieval Augmented Prompt Tuning (RAPT) as a p…
Paraphrase GenerationRetrievalRGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering
Medical question answering requires extensive access to specialized conceptual knowledge. The current paradigm, Retrieval-Augmented Generation (RAG), acquires expertise medical knowledge through large-scale corpus retrie…
Decision MakingLanguage ModelingLanguage ModellingLarge Language Model+5SocialCredit+
SocialCredit+ is AI powered credit scoring system that leverages publicly available social media data to augment traditional credit evaluation. It uses a conversational banking assistant to gather user consent and fetch …
Credit scoreEthicsRetrieval-augmented GenerationDeep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System
This paper presents a computational model for conceptual shifts, based on a novelty metric applied to a vector representation generated through deep learning. This model is integrated into a co-creative design system, wh…
AI Agent