Identifying the Units of Measurement in Tabular Data
We consider the problem of identifying the units of measurement in a data column that contains both numeric values and unit symbols in each row, e.g., "5.2 l", "7 pints". In this case we seek to identify the dimension of the column (e.g. volume) and relate the unit symbols to valid units (e.g. litre, pint) obtained from a knowledge graph. Below we present PUC, a Probabilistic Unit Canonicalizer that can accurately identify the units of measurement, extract semantic descriptions of quantitative data columns and canonicalize their entries. We present the first messy real-world tabular datasets annotated for units of measurement, which can enable and accelerate the research in this area. Our experiments on these datasets show that PUC achieves better results than existing solutions.
Code (1)
Tasks
validSimilar Papers 제목 키워드 기반
GraphPMU: Event Clustering via Graph Representation Learning Using Locationally-Scarce Distribution-Level Fundamental and Harmonic PMU Measurements
This paper is concerned with the complex task of identifying the type and cause of the events that are captured by distribution-level phasor measurement units (D-PMUs) in order to enhance situational awareness in power d…
Graph Representation LearningRepresentation LearningCONNER: A Cascade Count and Measurement Extraction Tool for Scientific Discourse
This paper presents our wining contribution to SemEval 2021 Task 8: MeasEval. The purpose of this task is identifying the counts and measurements from clinical scientific discourse, including quantities, entities, proper…
Joint Entity and Relation ExtractionRelation ExtractionBenchmarking Machine Learning Architectures for Antimicrobial Stewardship in Pediatric ICUs
Antimicrobial stewardship (AMS) is critical in pediatric intensive care units (PICUs), where diagnostic uncertainty often drives broad-spectrum antibiotic use, increasing antimicrobial resistance and potential long-term …
Multi-Task LearningNUMCoT: Numerals and Units of Measurement in Chain-of-Thought Reasoning using Large Language Models
Numeral systems and units of measurement are two conjoined topics in activities of human beings and have mutual effects with the languages expressing them. Currently, the evaluation of Large Language Models (LLMs) often …
MathMathematical ReasoningData-driven Identification of Nonlinear Power System Dynamics Using Output-only Measurements
In this paper, we propose a novel approach for the data-driven characterization of power system dynamics. The developed method of Extended Subspace Identification (ESI) is suitable for systems with output measurements wh…