Universal Language Model Fine-tuning for Patent Classification
This paper describes the methods used for the 2018 ALTA Shared Task. The task this year was to automatically classify Australian patents into their main International Patent Classification section. Our final submission used a Support Vector Machine (SVM) and Universal Language Model with Fine-tuning (ULMFiT). Our system achieved the best results in the student category.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationLanguage ModelingLanguage ModellingmodelPatent classificationText ClassificationSimilar Papers 제목 키워드 기반
PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT Model
In this work we focus on fine-tuning a pre-trained BERT model and applying it to patent classification. When applied to large datasets of over two millions patents, our approach outperforms the state of the art by an app…
ClassificationGeneral ClassificationMulti-Label Text ClassificationPatent classificationMeasuring Patent Claim Generation by Span Relevancy
Our goal of patent claim generation is to realize "augmented inventing" for inventors by leveraging latest Deep Learning techniques. We envision the possibility of building an "auto-complete" function for inventors to co…
Language ModellingNatural Language InferenceText GenerationPatent Figure Classification using Large Vision-language Models
Patent figure classification facilitates faceted search in patent retrieval systems, enabling efficient prior art search. Existing approaches have explored patent figure classification for only a single aspect and for as…
ClassificationFew-Shot LearningMultiple-choiceQuestion Answering+2Improving Patent Mining and Relevance Classification using Transformers
Patent analysis and mining are time-consuming and costly processes for companies, but nevertheless essential if they are willing to remain competitive. To face the overload induced by numerous patents, the idea is to aut…
ClassificationGeneral ClassificationPatent classificationPatent Claim Generation by Fine-Tuning OpenAI GPT-2
In this work, we focus on fine-tuning an OpenAI GPT-2 pre-trained model for generating patent claims. GPT-2 has demonstrated impressive efficacy of pre-trained language models on various tasks, particularly coherent text…
Text Generation