Deep Learning for Technical Document Classification
In large technology companies, the requirements for managing and organizing technical documents created by engineers and managers have increased dramatically in recent years, which has led to a higher demand for more scalable, accurate, and automated document classification. Prior studies have only focused on processing text for classification, whereas technical documents often contain multimodal information. To leverage multimodal information for document classification to improve the model performance, this paper presents a novel multimodal deep learning architecture, TechDoc, which utilizes three types of information, including natural language texts and descriptive images within documents and the associations among the documents. The architecture synthesizes the convolutional neural network, recurrent neural network, and graph neural network through an integrated training process. We applied the architecture to a large multimodal technical document database and trained the model for classifying documents based on the hierarchical International Patent Classification system. Our results show that TechDoc presents a greater classification accuracy than the unimodal methods and other state-of-the-art benchmarks. The trained model can potentially be scaled to millions of real-world multimodal technical documents, which is useful for data and knowledge management in large technology companies and organizations.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDecision MakingDeep LearningDescriptiveDocument ClassificationGraph Neural NetworkManagementMultimodal Deep LearningPatent classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VersionRAG: Version-Aware Retrieval-Augmented Generation for Evolving Documents
Retrieval-Augmented Generation (RAG) systems fail when documents evolve through versioning-a ubiquitous characteristic of technical documentation. Existing approaches achieve only 58-64% accuracy on version-sensitive que…
Intent ClassificationChange DetectionObservations on Building RAG Systems for Technical Documents
Retrieval augmented generation (RAG) for technical documents creates challenges as embeddings do not often capture domain information. We review prior art for important factors affecting RAG and perform experiments to hi…
RAGRetrievalRetrieval-augmented GenerationUnsupervised document zone identification using probabilistic graphical models
Document zone identification aims to automatically classify sequences of text-spans (e.g. sentences) within a document into predefined zone categories. Current approaches to document zone identification mostly rely on su…
Enhancing Technical Documents Retrieval for RAG
In this paper, we introduce Technical-Embeddings, a novel framework designed to optimize semantic retrieval in technical documentation, with applications in both hardware and software development. Our approach addresses …
Semantic RetrievalA Graph Convolution Network-based System for Technical Domain Identification
This paper presents the IITKGP contribution at the Technical DOmain Identification (TechDOfication) shared task at ICON 2020. In the preprocessing stage, we applied part-of-speech (PoS) taggers and dependency parsers to …
Classificationdomain classificationPOSTAG