Amulet: Aggregating Multi-level Convolutional Features for Salient Object Detection
Fully convolutional neural networks (FCNs) have shown outstanding performance in many dense labeling problems. One key pillar of these successes is mining relevant information from features in convolutional layers. However, how to better aggregate multi-level convolutional feature maps for salient object detection is underexplored. In this work, we present Amulet, a generic aggregating multi-level convolutional feature framework for salient object detection. Our framework first integrates multi-level feature maps into multiple resolutions, which simultaneously incorporate coarse semantics and fine details. Then it adaptively learns to combine these feature maps at each resolution and predict saliency maps with the combined features. Finally, the predicted results are efficiently fused to generate the final saliency map. In addition, to achieve accurate boundary inference and semantic enhancement, edge-aware feature maps in low-level layers and the predicted results of low resolution features are recursively embedded into the learning framework. By aggregating multi-level convolutional features in this efficient and flexible manner, the proposed saliency model provides accurate salient object labeling. Comprehensive experiments demonstrate that our method performs favorably against state-of-the art approaches in terms of near all compared evaluation metrics.
Code (1)
Tasks
Objectobject-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
Agile Amulet: Real-Time Salient Object Detection with Contextual Attention
This paper proposes an Agile Aggregating Multi-Level feaTure framework (Agile Amulet) for salient object detection. The Agile Amulet builds on previous works to predict saliency maps using multi-level convolutional featu…
object-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionAMULET: Adaptive Matrix-Multiplication-Like Tasks
Many useful tasks in data science and machine learning applications can be written as simple variations of matrix multiplication. However, users have difficulty performing such tasks as existing matrix/vector libraries s…
Compiler OptimizationAmulet: a Python Library for Assessing Interactions Among ML Defenses and Risks
Machine learning (ML) models are susceptible to various risks to security, privacy, and fairness. Most defenses are designed to protect against each risk individually (intended interactions) but can inadvertently affect …
Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries
Today, large language models are widely used as judges to evaluate responses from other language models. Hence, it is imperative to benchmark and improve these LLM-judges on real-world language model usage: a typical hum…
Amulet: ReAlignment During Test Time for Personalized Preference Adaptation of LLMs
How to align large language models (LLMs) with user preferences from a static general dataset has been frequently studied. However, user preferences are usually personalized, changing, and diverse regarding culture, valu…
Computational Efficiency