paper-with-me

홈 › Papers

Building Inspection Toolkit: Unified Evaluation and Strong Baselines for Damage Recognition

2022-02-14 · Johannes Flotzinger, Philipp J. Rösch, Norbert Oswald, Thomas Braml

In recent years, several companies and researchers have started to tackle the problem of damage recognition within the scope of automated inspection of built structures. While companies are neither willing to publish associated data nor models, researchers are facing the problem of data shortage on one hand and inconsistent dataset splitting with the absence of consistent metrics on the other hand. This leads to incomparable results. Therefore, we introduce the building inspection toolkit -- bikit -- which acts as a simple to use data hub containing relevant open-source datasets in the field of damage recognition. The datasets are enriched with evaluation splits and predefined metrics, suiting the specific task and their data distribution. For the sake of compatibility and to motivate researchers in this domain, we also provide a leaderboard and the possibility to share model weights with the community. As starting point we provide strong baselines for multi-target classification tasks utilizing extensive hyperparameter search using three transfer learning approaches for state-of-the-art algorithms. The toolkit and the leaderboard are available online.

📄 PDF Abstract BibTeX arXiv:2202.07012

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation

2025-12-09 · Sergio Burdisso, Séverin Baroudi, Yanis Labrak, David Grunert 외 arxiv

We present SDialog, an MIT-licensed open-source Python toolkit that unifies dialog generation, evaluation and mechanistic interpretability into a single end-to-end framework for building and analyzing LLM-based conversat…

Audio Generation

CRSLab: An Open-Source Toolkit for Building Conversational Recommender System

2021-01-04 · ACL 2021 5 · Kun Zhou, Xiaolei Wang, Yuanhang Zhou, Chenzhan Shang 외

In recent years, conversational recommender system (CRS) has received much attention in the research community. However, existing studies on CRS vary in scenarios, goals and techniques, lacking unified, standardized impl…

Graph Neural NetworkRecommendation Systems

ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format

2022-11-30 · Qi Zhu, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk 외

Task-oriented dialogue (TOD) systems function as digital assistants, guiding users through various tasks such as booking flights or finding restaurants. Existing toolkits for building TOD systems often fall short of in d…

Reinforcement Learning (RL)Transfer Learning

Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality

2025-05-05 · Xueguang Ma, Luyu Gao, Shengyao Zhuang, Jiaqi Samantha Zhan 외

Recent advancements in large language models (LLMs) have driven interest in billion-scale retrieval models with strong generalization across retrieval tasks and languages. Additionally, progress in large vision-language …

Retrieval

In-IDE Toolkit for Developers of AI-Based Features

2026-05-14 · Yaroslav Sokolov, Yury Khudyakov, Lenar Sharipov, Andrei Gasparian 외 arxiv

AI-enabled features built on LLMs and agentic workflows are difficult to test, debug, and reproduce, especially for product-focused software engineers without a machine learning background. We present the AI Toolkit plug…