Representing text as abstract images enables image classifiers to also simultaneously classify text
We introduce a novel method for converting text data into abstract image representations, which allows image-based processing techniques (e.g. image classification networks) to be applied to text-based comparison problems. We apply the technique to entity disambiguation of inventor names in US patents. The method involves converting text from each pairwise comparison between two inventor name records into a 2D RGB (stacked) image representation. We then train an image classification neural network to discriminate between such pairwise comparison images, and use the trained network to label each pair of records as either matched (same inventor) or non-matched (different inventors), obtaining highly accurate results. Our new text-to-image representation method could also be used more broadly for other NLP comparison problems, such as disambiguation of academic publications, or for problems that require simultaneous classification of both text and image datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationEntity DisambiguationGeneral Classificationimage-classificationImage ClassificationText ClassificationSimilar Papers 제목 키워드 기반
Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art
Artificial intelligence can classify artistic styles and synthesize images, but it still lacks a model of the visual language that gives art meaning. Abstract painting minimizes object semantics and foregrounds structura…
Text-to-Image GenerationCross-Modal RetrievalBongard-RWR+: Real-World Representations of Fine-Grained Concepts in Bongard Problems
Bongard Problems (BPs) provide a challenging testbed for abstract visual reasoning (AVR), requiring models to identify visual concepts fromjust a few examples and describe them in natural language. Early BP benchmarks fe…
Answer GenerationVisual ReasoningA Formalisation of Abstract Argumentation in Higher-Order Logic
We present an approach for representing abstract argumentation frameworks based on an encoding into classical higher-order logic. This provides a uniform framework for computer-assisted assessment of abstract argumentati…
Abstract ArgumentationCamera Obscurer: Generative Art for Design Inspiration
We investigate using generated decorative art as a source of inspiration for design tasks. Using a visual similarity search for image retrieval, the \emph{Camera Obscurer} app enables rapid searching of tens of thousands…
Image RetrievalRetrievalControlling Geometric Abstraction and Texture for Artistic Images
We present a novel method for the interactive control of geometric abstraction and texture in artistic images. Previous example-based stylization methods often entangle shape, texture, and color, while generative methods…
Image GenerationImage StylizationParameter PredictionStyle Transfer+1