Exploring the Role of the Bottleneck in Slot-Based Models Through Covariance Regularization
In this project we attempt to make slot-based models with an image reconstruction objective competitive with those that use a feature reconstruction objective on real world datasets. We propose a loss-based approach to constricting the bottleneck of slot-based models, allowing larger-capacity encoder networks to be used with Slot Attention without producing degenerate stripe-shaped masks. We find that our proposed method offers an improvement over the baseline Slot Attention model but does not reach the performance of \dinosaur on the COCO2017 dataset. Throughout this project, we confirm the superiority of a feature reconstruction objective over an image reconstruction objective and explore the role of the architectural bottleneck in slot-based models.
Code (1)
Tasks
Image ReconstructionSimilar Papers 제목 키워드 기반
Exploring Named Entity Recognition As an Auxiliary Task for Slot Filling in Conversational Language Understanding
Slot filling is a crucial task in the Natural Language Understanding (NLU) component of a dialogue system. Most approaches for this task rely solely on the domain-specific datasets for training. We propose a joint model …
Domain AdaptationMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+6Automatic Intent-Slot Induction for Dialogue Systems
Automatically and accurately identifying user intents and filling the associated slots from their spoken language are critical to the success of dialogue systems. Traditional methods require manually defining the DOMAIN-…
Intent Detectionslot-fillingSlot FillingReusable Slotwise Mechanisms
Agents with the ability to comprehend and reason about the dynamics of objects would be expected to exhibit improved robustness and generalization in novel scenarios. However, achieving this capability necessitates not o…
Future predictionObjectOut-of-Distribution GeneralizationQuestion Answering+1On Connecting Deep Trigonometric Networks with Deep Gaussian Processes: Covariance, Expressivity, and Neural Tangent Kernel
Deep Gaussian Process (DGP) as a model prior in Bayesian learning intuitively exploits the expressive power in function composition. DGPs also offer diverse modeling capabilities, but inference is challenging because mar…
Gaussian ProcessesChronicals: A High-Performance Framework for LLM Fine-Tuning with 3.51x Speedup over Unsloth
Large language model fine-tuning is bottlenecked by memory: a 7B parameter model requires 84GB--14GB for weights, 14GB for gradients, and 56GB for FP32 optimizer states--exceeding even A100-40GB capacity. We present Chro…