DISCount: Counting in Large Image Collections with Detector-Based Importance Sampling
Many modern applications use computer vision to detect and count objects in massive image collections. However, when the detection task is very difficult or in the presence of domain shifts, the counts may be inaccurate even with significant investments in training data and model development. We propose DISCount -- a detector-based importance sampling framework for counting in large image collections that integrates an imperfect detector with human-in-the-loop screening to produce unbiased estimates of counts. We propose techniques for solving counting problems over multiple spatial or temporal regions using a small number of screened samples and estimate confidence intervals. This enables end-users to stop screening when estimates are sufficiently accurate, which is often the goal in a scientific study. On the technical side we develop variance reduction techniques based on control variates and prove the (conditional) unbiasedness of the estimators. DISCount leads to a 9-12x reduction in the labeling costs over naive screening for tasks we consider, such as counting birds in radar imagery or estimating damaged buildings in satellite imagery, and also surpasses alternative covariate-based screening approaches in efficiency.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
\$1 Today or \$2 Tomorrow? The Answer is in Your Facebook Likes
In economics and psychology, delay discounting is often used to characterize how individuals choose between a smaller immediate reward and a larger delayed reward. People with higher delay discounting rate (DDR) often ch…
Decision MakingConservative, Proportional and Optimistic Contextual Discounting in the Belief Functions Theory
Information discounting plays an important role in the theory of belief functions and, generally, in information fusion. Nevertheless, neither classical uniform discounting nor contextual cannot model certain use cases, …
Non-Linear Discounting and Default Compensation: Valuation of Non-Replicable Value and Damage: When the Social Discount Rate may become Negative
In this paper, we introduce a model that adds a non-linearity to discounting: the discounting factor may depend on the notional (i.e., discounted values are no longer linear in the notional). In the first part of the pap…
UGAE: A Novel Approach to Non-exponential Discounting
The discounting mechanism in Reinforcement Learning determines the relative importance of future and present rewards. While exponential discounting is widely used in practice, non-exponential discounting methods that ali…
A Deeper Look at Discounting Mismatch in Actor-Critic Algorithms
We investigate the discounting mismatch in actor-critic algorithm implementations from a representation learning perspective. Theoretically, actor-critic algorithms usually have discounting for both actor and critic, i.e…
Representation Learning