Object Detection and Collaboration in Heterogeneous Multi-Robot Systems
Loading...
Authors
Jiang, Song
Issue Date
2022
Type
Thesis
Language
Keywords
MRS , Multi-Robot Systems , Robot Collaboration , Robotics
Alternative Title
Abstract
With the development of novel technologies, robots are becoming more widely used in everyday applications. Compared with a single robot, Multi-Robot Systems (MRS) are more powerful and cost effective. This thesis will introduce a complete heterogeneous distributed MRS which contains an autonomous mobile robot (Pioneer 3-DX) and a stationary humanoid robot (Baxter), which are able to jointly perform a task that involves navigation and object manipulation. The contributions of this thesis are: 1) we developed an object detection system, locating the pose of objects with a depthcamera through OpenCV and the HSV color model; 2) we optimized a path planning and control system which would enable the Pioneer 3-DX to map its surrounding environment and navigate to target poses, as well as allow the Baxter to grasp, lift and drop the target objects using the MoveIt framework accurately and successfully; 3) we developed a distributed communication system so as to allow two different functional robots to communicate with each other through ROS 2. These contributions are validated with a heterogeneous robot team, including an autonomous mobile robot and a humanoid robot, completing tasks collaboratively.