paper-with-me

홈 › Papers

Leveraging universality of jet taggers through transfer learning

2022-03-11 · Frédéric A. Dreyer, Radosław Grabarczyk, Pier Francesco Monni

A significant challenge in the tagging of boosted objects via machine-learning technology is the prohibitive computational cost associated with training sophisticated models. Nevertheless, the universality of QCD suggests that a large amount of the information learnt in the training is common to different physical signals and experimental setups. In this article, we explore the use of transfer learning techniques to develop fast and data-efficient jet taggers that leverage such universality. We consider the graph neural networks LundNet and ParticleNet, and introduce two prescriptions to transfer an existing tagger into a new signal based either on fine-tuning all the weights of a model or alternatively on freezing a fraction of them. In the case of $W$-boson and top-quark tagging, we find that one can obtain reliable taggers using an order of magnitude less data with a corresponding speed-up of the training process. Moreover, while keeping the size of the training data set fixed, we observe a speed-up of the training by up to a factor of three. This offers a promising avenue to facilitate the use of such tools in collider physics experiments.

📄 PDF Abstract BibTeX arXiv:2203.06210

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

Weakly Supervised POS Taggers Perform Poorly on Truly Low-Resource Languages

2020-04-28 · Katharina Kann, Ophélie Lacroix, Anders Søgaard

Part-of-speech (POS) taggers for low-resource languages which are exclusively based on various forms of weak supervision - e.g., cross-lingual transfer, type-level supervision, or a combination thereof - have been report…

Cross-Lingual TransferPOSPOS Tagging

Leveraging Pre-Trained Embeddings for Welsh Taggers

2019-08-01 · WS 2019 8 · Ignatius Ezeani, Scott Piao, Steven Neale, Paul Rayson 외

While the application of word embedding models to downstream Natural Language Processing (NLP) tasks has been shown to be successful, the benefits for low-resource languages is somewhat limited due to lack of adequate da…

Optimization of Module Transferability in Single Image Super-Resolution: Universality Assessment and Cycle Residual Blocks

2025-05-06 · Haotong Cheng, Zhiqi Zhang, Hao Li, Xinshang Zhang

Deep learning has substantially advanced the Single Image Super-Resolution (SISR). However, existing researches have predominantly focused on raw performance gains, with little attention paid to quantifying the transfera…

Image Super-ResolutionSuper-Resolution

Enhancing the Self-Universality for Transferable Targeted Attacks

2022-09-08 · CVPR 2023 1 · Zhipeng Wei, Jingjing Chen, Zuxuan Wu, Yu-Gang Jiang

In this paper, we propose a novel transfer-based targeted attack method that optimizes the adversarial perturbations without any extra training efforts for auxiliary networks on training data. Our new attack method is pr…

From Traditional Taggers to LLMs: A Comparative Study of POS Tagging for Medieval Romance Languages

2026-05-09 · Matthias Schöffel, Esteban Garces Arias arxiv

Part-of-speech (POS) tagging for Medieval Romance languages remains challenging due to orthographic variation, morphological complexity, and limited annotated resources. This paper presents a systematic empirical evaluat…

Cross-Lingual TransferPOS Tagging