Tree bark re-identification using a deep-learning feature descriptor
The ability to visually re-identify objects is a fundamental capability in vision systems. Oftentimes, it relies on collections of visual signatures based on descriptors, such as SIFT or SURF. However, these traditional descriptors were designed for a certain domain of surface appearances and geometries (limited relief). Consequently, highly-textured surfaces such as tree bark pose a challenge to them. In turn, this makes it more difficult to use trees as identifiable landmarks for navigational purposes (robotics) or to track felled lumber along a supply chain (logistics). We thus propose to use data-driven descriptors trained on bark images for tree surface re-identification. To this effect, we collected a large dataset containing 2,400 bark images with strong illumination changes, annotated by surface and with the ability to pixel-align them. We used this dataset to sample from more than 2 million 64x64 pixel patches to train our novel local descriptors DeepBark and SqueezeBark. Our DeepBark method has shown a clear advantage against the hand-crafted descriptors SIFT and SURF. For instance, we demonstrated that DeepBark can reach a mAP of 87.2% when retrieving 11 relevant bark images, i.e. corresponding to the same physical surface, to a bark query against 7,900 images. Our work thus suggests that re-identifying tree surfaces in a challenging illuminations context is possible. We also make public our dataset, which can be used to benchmark surface re-identification techniques.
Code (1)
Tasks
Deep LearningSimilar Papers 제목 키워드 기반
Tree Species Identification from Bark Images Using Convolutional Neural Networks
Tree species identification using bark images is a challenging problem that could prove useful for many forestry related tasks. However, while the recent progress in deep learning showed impressive results on standard vi…
Deep LearningAutomated Identification of Tree Species by Bark Texture Classification Using Convolutional Neural Networks
Identification of tree species plays a key role in forestry related tasks like forest conservation, disease diagnosis and plant production. There had been a debate regarding the part of the tree to be used for differenti…
Texture ClassificationTransfer LearningAutomated Feature-Specific Tree Species Identification from Natural Images using Deep Semi-Supervised Learning
Prior work on plant species classification predominantly focuses on building models from isolated plant attributes. Hence, there is a need for tools that can assist in species identification in the natural world. We pres…
GPUBARK: A Fully Bayesian Tree Kernel for Black-box Optimization
We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and …
Bayesian OptimizationGaussian Processesglobal-optimizationUncertainty QuantificationExplaining excitable population dynamics in bark beetles: From life history to large, episodic outbreaks
Bark beetles are significant forest pests, with some species capable of causing widespread tree mortality. Among these, the mountain pine beetle (MPB) stands out for its exceptionally destructive outbreak in the 2000s. W…