paper-with-me

홈 › Papers

AI-Driven Relocation Tracking in Dynamic Kitchen Environments

2025-03-03 · Arash Nasr Esfahani, Hamed Hosseini, Mehdi Tale Masouleh, Ahmad Kalhor, Hedieh Sajedi

As smart homes become more prevalent in daily life, the ability to understand dynamic environments is essential which is increasingly dependent on AI systems. This study focuses on developing an intelligent algorithm which can navigate a robot through a kitchen, recognizing objects, and tracking their relocation. The kitchen was chosen as the testing ground due to its dynamic nature as objects are frequently moved, rearranged and replaced. Various techniques, such as SLAM feature-based tracking and deep learning-based object detection (e.g., Faster R-CNN), are commonly used for object tracking. Additionally, methods such as optical flow analysis and 3D reconstruction have also been used to track the relocation of objects. These approaches often face challenges when it comes to problems such as lighting variations and partial occlusions, where parts of the object are hidden in some frames but visible in others. The proposed method in this study leverages the YOLOv5 architecture, initialized with pre-trained weights and subsequently fine-tuned on a custom dataset. A novel method was developed, introducing a frame-scoring algorithm which calculates a score for each object based on its location and features within all frames. This scoring approach helps to identify changes by determining the best-associated frame for each object and comparing the results in each scene, overcoming limitations seen in other methods while maintaining simplicity in design. The experimental results demonstrate an accuracy of 97.72%, a precision of 95.83% and a recall of 96.84% for this algorithm, which highlights the efficacy of the model in detecting spatial changes.

📄 PDF Abstract BibTeX arXiv:2503.01547

Code (1)

ArashNasrEsfahani/Object-Rearrangement-in-Dynamic-Environments 공식 구현 pytorch

Tasks

2D Object Detection3D ReconstructionIndoor LocalizationNavigateObjectObject TrackingOptical Flow Estimation

Similar Papers 제목 키워드 기반

SAMJAM: Zero-Shot Video Scene Graph Generation for Egocentric Kitchen Videos

2025-04-10 · Joshua Li, Fernando Jose Pena Cantu, Emily Yu, Alexander Wong 외

Video Scene Graph Generation (VidSGG) is an important topic in understanding dynamic kitchen environments. Current models for VidSGG require extensive training to produce scene graphs. Recently, Vision Language Models (V…

Graph GenerationObjectScene Graph GenerationVideo scene graph generation

Incremental RANSAC for Online Relocation in Large Dynamic Environments

2015-06-24 · Kanji Tanaka, Eiji Kondo

Vehicle relocation is the problem in which a mobile robot has to estimate the self-position with respect to an a priori map of landmarks using the perception and the motion measurements without using any knowledge of the…

Position

Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation

2021-03-18 · Mayank Mittal, David Hoeller, Farbod Farshidian, Marco Hutter 외

A kitchen assistant needs to operate human-scale objects, such as cabinets and ovens, in unmapped environments with dynamic obstacles. Autonomous interactions in such environments require integrating dexterous manipulati…

Object

MANER: Multi-Agent Neural Rearrangement Planning of Objects in Cluttered Environments

2023-06-10 · Vivek Gupta, Praphpreet Dhir, Jeegn Dani, Ahmed H. Qureshi

Object rearrangement is a fundamental problem in robotics with various practical applications ranging from managing warehouses to cleaning and organizing home kitchens. While existing research has primarily focused on si…

Object Rearrangement

Beyond the Remembered World: Predictive 4D Belief for Persistent Navigation in Evolving Worlds

2026-09-30 · Mingjian Gao, Zhaocheng Li, Haoyang Huang, Wenqiao Zhang 외 arxiv

Persistent spatial memory enables embodied agents to navigate familiar environments across repeated visits. However, targets may move while unobserved, including during navigation, making remembered locations unreliable …