paper-with-me

홈 › Papers

Patent Citation Dynamics Modeling via Multi-Attention Recurrent Networks

2019-05-22 · Taoran Ji, Zhiqian Chen, Nathan Self, Kaiqun Fu, Chang-Tien Lu, Naren Ramakrishnan

Modeling and forecasting forward citations to a patent is a central task for the discovery of emerging technologies and for measuring the pulse of inventive progress. Conventional methods for forecasting these forward citations cast the problem as analysis of temporal point processes which rely on the conditional intensity of previously received citations. Recent approaches model the conditional intensity as a chain of recurrent neural networks to capture memory dependency in hopes of reducing the restrictions of the parametric form of the intensity function. For the problem of patent citations, we observe that forecasting a patent's chain of citations benefits from not only the patent's history itself but also from the historical citations of assignees and inventors associated with that patent. In this paper, we propose a sequence-to-sequence model which employs an attention-of-attention mechanism to capture the dependencies of these multiple time sequences. Furthermore, the proposed model is able to forecast both the timestamp and the category of a patent's next citation. Extensive experiments on a large patent citation dataset collected from USPTO demonstrate that the proposed model outperforms state-of-the-art models at forward citation forecasting.

📄 PDF Abstract BibTeX arXiv:1905.10022

Code (1)

TaoranJ/PC-RNN 공식 구현 pytorch

Tasks

Citation PredictionPoint Processes

Similar Papers 제목 키워드 기반

PatSTEG: Modeling Formation Dynamics of Patent Citation Networks via The Semantic-Topological Evolutionary Graph

2024-02-03 · Ran Miao, Xueyu Chen, Liang Hu, Zhifei Zhang 외

Patent documents in the patent database (PatDB) are crucial for research, development, and innovation as they contain valuable technical information. However, PatDB presents a multifaceted challenge compared to publicly …

Graph Learning

Early identification of important patents through network centrality

2017-10-25 · Mariani Manuel Sebastian, Medo Matus, Lafond François

One of the most challenging problems in technological forecasting is to identify as early as possible those technologies that have the potential to lead to radical changes in our society. In this paper, we use the US pat…

Research on feature fusion and multimodal patent text based on graph attention network

2025-05-26 · Zhenzhen Song, Ziwei Liu, Hongji Li

Aiming at the problems of cross-modal feature fusion, low efficiency of long text modeling and lack of hierarchical semantic coherence in patent text semantic mining, this study proposes HGM-Net, a deep learning framewor…

Computational EfficiencyGraph AttentionPatent classificationSentence

Heterogeneous Dependency Graph-Guided Attentionfor Patent Representation Learning

2026-05-11 · Yongmin Yoo, Qiongkai Xu, Zhangkai Wu, Longbing Cao arxiv

Pre-trained language models advance patent classification and retrieval by encoding claims as flat token sequences, but they overlook the dependency hierarchy among claims. Incorporating this hierarchy into self-attentio…

Representation Learning

Dynamic Structures of Knowledge Production: Citation Rates in Hydrogen Technologies

2025-02-02 · David Dekker, Dimitirs Christopoulos, Heather McGregor

We explore a dynamic patent citation network model to explain the established link between network structure and technological improvement rate. This model, a type of survival model, posits that the *dynamic* network str…