Dynamic Interactive Relation Capturing via Scene Graph Learning for Robotic Surgical Report Generation
For robot-assisted surgery, an accurate surgical report reflects clinical operations during surgery and helps document entry tasks, post-operative analysis and follow-up treatment. It is a challenging task due to many complex and diverse interactions between instruments and tissues in the surgical scene. Although existing surgical report generation methods based on deep learning have achieved large success, they often ignore the interactive relation between tissues and instrumental tools, thereby degrading the report generation performance. This paper presents a neural network to boost surgical report generation by explicitly exploring the interactive relation between tissues and surgical instruments. We validate the effectiveness of our method on a widely-used robotic surgery benchmark dataset, and experimental results show that our network can significantly outperform existing state-of-the-art surgical report generation methods (e.g., 7.48% and 5.43% higher for BLEU-1 and ROUGE).
Code (0)
등록된 구현이 없습니다.
Tasks
Graph LearningRelationSimilar Papers 제목 키워드 기반
Unbiased Scene Graph Generation by Type-Aware Message Passing on Heterogeneous and Dual Graphs
Although great progress has been made in the research of unbiased scene graph generation, issues still hinder improving the predictive performance of both head and tail classes. An unbiased scene graph generation (TA-HDG…
graph constructionGraph GenerationScene Graph GenerationUnbiased Scene Graph GenerationExploiting Long-Term Dependencies for Generating Dynamic Scene Graphs
Dynamic scene graph generation from a video is challenging due to the temporal dynamics of the scene and the inherent temporal fluctuations of predictions. We hypothesize that capturing long-term temporal dependencies is…
Graph GenerationObjectScene Graph DetectionScene Graph Generation+1Spatial-Temporal Interactive Dynamic Graph Convolution Network for Traffic Forecasting
Accurate traffic forecasting is essential for smart cities to achieve traffic control, route planning, and flow detection. Although many spatial-temporal methods are currently proposed, these methods are deficient in cap…
Traffic PredictionCommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion
Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in…
DiversityObjectScene GenerationFloCoDe: Unbiased Dynamic Scene Graph Generation with Temporal Consistency and Correlation Debiasing
Dynamic scene graph generation (SGG) from videos requires not only a comprehensive understanding of objects across scenes but also a method to capture the temporal motions and interactions with different objects. Moreove…
Graph GenerationScene Graph GenerationUnbiased Scene Graph Generation