Exploring Implicit Image Statistics for Visual Representativeness Modeling
In this paper, we propose a computational model of visual representativeness by integrating cognitive theories of representativeness heuristics with computer vision and machine learning techniques. Unlike previous models that build their representativeness measure based on the visible data, our model takes the initial inputs as explicit positive reference and extend the measure by exploring the implicit negatives. Given a group of images that contains obvious visual concepts, we create a customized image ontology consisting of both positive and negative instances by mining the most related and confusable neighbors of the positive concept in ontological semantic knowledge bases. The representativeness of a new item is then determined by its likelihoods for both the positive and negative references. To ensure the effectiveness of probability inference as well as the cognitive plausibility, we discover the potential prototypes and treat them as an intermediate representation of semantic concepts. In the experiment, we evaluate the performance of representativeness models based on both human judgements and user-click logs of commercial image search engine. Experimental results on both ImageNet and image sets of general concepts demonstrate the superior performance of our model against the state-of-the-arts.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalSimilar Papers 제목 키워드 기반
Using Word Familiarities and Word Associations to Measure Corpus Representativeness
The definition of corpus representativeness used here assumes that a representative corpus should reflect as well as possible the average language use a native speaker encounters in everyday life over a longer period of …
Language AcquisitionVROAV: Using Iconicity to Visually Represent Abstract Verbs
For a long time, philosophers, linguists and scientists have been keen on finding an answer to the mind-bending question {``}what does abstract language look like?{''}, which has also sprung from the phenomenon of mental…
Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability
This paper addresses the critical challenge of assessing the representativeness of news thumbnail images, which often serve as the first visual engagement for readers when an article is disseminated on social media. We f…
Contrastive LearningcounterfactualTesting a Bayesian Measure of Representativeness Using a Large Image Database
How do people determine which elements of a set are most representative of that set? We extend an existing Bayesian measure of representativeness, which indicates the representativeness of a sample from a distribution, t…
BIG-bench Machine LearningExploring UMAP in hybrid models of entropy-based and representativeness sampling for active learning in biomedical segmentation
In this work, we study various hybrid models of entropy-based and representativeness sampling techniques in the context of active learning in medical segmentation, in particular examining the role of UMAP (Uniform Manifo…
Active LearningDimensionality ReductionSegmentation