paper-with-me

Papers

LTRL: Boosting Long-tail Recognition via Reflective Learning

2024-07-17 · QiHao Zhao, Yalun Dai, Shen Lin, Wei Hu, Fan Zhang, Jun Liu

In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting errors. Motivated by this learning process, we propose a novel learning paradigm, called reflecting learning, in handling long-tail recognition. Our method integrates three processes for reviewing past predictions during training, summarizing and leveraging the feature relation across classes, and correcting gradient conflict for loss functions. These designs are lightweight enough to plug and play with existing long-tail learning methods, achieving state-of-the-art performance in popular long-tail visual benchmarks. The experimental results highlight the great potential of reflecting learning in dealing with long-tail recognition.

📄 PDF Abstract BibTeX arXiv:2407.12568

Code (1)

fistyee/LTRL 공식 구현 pytorch

Tasks

Long-tail Learning

Similar Papers 제목 키워드 기반

SememeASR: Boosting Performance of End-to-End Speech Recognition against Domain and Long-Tailed Data Shift with Sememe Semantic Knowledge

2023-09-04 · Jiaxu Zhu, Changhe Song, Zhiyong Wu, Helen Meng

Recently, excellent progress has been made in speech recognition. However, pure data-driven approaches have struggled to solve the problem in domain-mismatch and long-tailed data. Considering that knowledge-driven approa…

Domain Generalizationspeech-recognitionSpeech Recognition

MM-HELIX: Boosting Multimodal Long-Chain Reflective Reasoning with Holistic Platform and Adaptive Hybrid Policy Optimization

2025-10-09 · Xiangyu Zhao, Junming Lin, Tianhao Liang, Yifan Zhou 외 arxiv

While current Multimodal Large Language Models (MLLMs) have demonstrated proficiency in reasoning tasks such as mathematics and logic, their capacity for long-chain reflective reasoning, a prerequisite for solving comple…

Reinforcement LearningResponse Generation

Memory Augmented Lookup Dictionary based Language Modeling for Automatic Speech Recognition

2022-12-30 · Yukun Feng, Ming Tu, Rui Xia, Chuanzeng Huang 외

Recent studies have shown that using an external Language Model (LM) benefits the end-to-end Automatic Speech Recognition (ASR). However, predicting tokens that appear less frequently in the training set is still quite c…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+2

Towards Personalization of CTC Speech Recognition Models with Contextual Adapters and Adaptive Boosting

2022-10-18 · Saket Dingliwal, Monica Sunkara, Sravan Bodapati, Srikanth Ronanki 외

End-to-end speech recognition models trained using joint Connectionist Temporal Classification (CTC)-Attention loss have gained popularity recently. In these models, a non-autoregressive CTC decoder is often used at infe…

Decoderspeech-recognitionSpeech Recognition

Technology Readiness Levels for Machine Learning Systems

2021-01-11 · Alexander Lavin, Ciarán M. Gilligan-Lee, Alessya Visnjic, Siddha Ganju 외

The development and deployment of machine learning (ML) systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope c…

BIG-bench Machine Learning