An Open Source Computer Vision and Machine Learning Framework for Affordable Life Science Robotic Automation
We present an open-source robotic framework that integrates computer vision and machine learning based inverse kinematics to enable low-cost laboratory automation tasks such as colony picking and liquid handling. The system uses a custom trained U-net model for semantic segmentation of microbial cultures, combined with Mixture Density Network for predicating joint angles of a simple 5-DOF robot arm. We evaluated the framework using a modified robot arm, upgraded with a custom liquid handling end-effector. Experimental results demonstrate the framework's feasibility for precise, repeatable operations, with mean positional error below 1 mm and joint angle prediction errors below 4 degrees and colony detection capabilities with IoU score of 0.537 and Dice coefficient of 0.596.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic SegmentationSimilar Papers 제목 키워드 기반
ZPY: Open Source Synthetic Data for Computer Vision
Synthetic data presents a unique solution to the huge data requirements of computer vision with deep learning. In this work, we present zpy, an open source framework for creating synthetic data in Python. Built on top of…
FairnessSynthetic Data GenerationVision-based inspection system employing computer vision & neural networks for detection of fractures in manufactured components
We are proceeding towards the age of automation and robotic integration of our production lines [5]. Effective quality-control systems have to be put in place to maintain the quality of manufactured components. Among dif…
BIG-bench Machine LearningComposing Complex and Hybrid AI Solutions
Progress in several areas of computer science has been enabled by comfortable and efficient means of experimentation, clear interfaces, and interchangable components, for example using OpenCV for computer vision or ROS f…
Kornia: an Open Source Differentiable Computer Vision Library for PyTorch
This work presents Kornia -- an open source computer vision library which consists of a set of differentiable routines and modules to solve generic computer vision problems. The package uses PyTorch as its main backend b…
Camera CalibrationData AugmentationEdge DetectionImage Augmentation+9YMIR: A Rapid Data-centric Development Platform for Vision Applications
This paper introduces an open source platform to support the rapid development of computer vision applications at scale. The platform puts the efficient data development at the center of the machine learning development …
Active Learning