The eIdentity Text Exploration Workbench
We work on tools to explore text contents and metadata of newspaper articles as provided by news archives. Our tool components are being integrated into an {`}Exploration Workbench{''} for Digital Humanities researchers. Next to the conversion of different data formats and character encodings, a prominent feature of our design is its {}Wizard{''} function for corpus building: Researchers import raw data and define patterns to extract text contents and metadata. The Workbench also comprises different tools for data cleaning. These include filtering of off-topic articles, duplicates and near-duplicates, corrupted and empty articles. We currently work on ca. 860.000 newspaper articles from different media archives, provided in different data formats. We index the data with state-of-the-art systems to allow for large scale information retrieval. We extract metadata on publishing dates, author names, newspaper sections, etc., and split articles into segments such as headlines, subtitles, paragraphs, etc. After cleaning the data and compiling a thematically homogeneous corpus, the sample can be used for quantitative analyses which are not affected by noise. Users can retrieve sets of articles on different topics, issues or otherwise defined research questions ({}subcorpora{''}) and investigate quantitatively their media attention on the timeline ({`}Issue Cycles{''}).
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesInformation RetrievalNamed Entity Recognition (NER)RetrievalSimilar Papers 제목 키워드 기반
StableIdentity: Inserting Anybody into Anywhere at First Sight
Recent advances in large pretrained text-to-image models have shown unprecedented capabilities for high-quality human-centric generation, however, customizing face identity is still an intractable problem. Existing metho…
3D GenerationToward a Scientific Discovery Engine for Weather and Climate Data: A Visual Analytics Workbench for Embedding-Based Exploration
Earth system science is producing increasingly large, high-dimensional datasets from physics based Earth system models to AI-based weather and climate models. Embedding-based representations can make these data searchabl…
NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools
NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-…
Entity LinkingRelation ExtractionSemantic ParsingSentiment AnalysisWorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting
We introduce WorkBench: a benchmark dataset for evaluating agents' ability to execute tasks in a workplace setting. WorkBench contains a sandbox environment with five databases, 26 tools, and 690 tasks. These tasks repre…
Scheduling