➔ Page 1431 ‘Multi-UAV-based stereo vision system without GPS for ground obstacle mapping to assist path planning of UGV’, Jin Hyo Kim, Ji-Wook Kwon and Jiwon Seo

Coordination of mixed air and ground unmanned vehicle teams using low-cost cameras and without GPS

robotic explorers

much larger than the separation of the cameras, and when the cameras are both mounted on the same UAV, that distance limit is obviously very small. In the work by the team from Yonsei’s School of Integrated Technology and the Yonsei Institute of Convergence Technology, this limitation is addressed by using single cameras on two UAVs, providing much greater separation, and control of that separation. The initial motivation of the work was polar exploration, but there are many applications that could benefit from the approach, as team member Prof. Jiwon Seo explained: “We are also working on precise farming applications according to a research request from a Korean company. The role of UAVs in this case is not just limited to obstacle detection. UAVs equipped with multispectral imaging sensors can collect useful information on crops over a large farming area. Based on this information, unmanned tractors could operate more efficiently. As a longer-term development, the system can be applied to emergency patient transport and military applications.”

Cooperative future A system to allow air- and ground-based robot vehicles to work together, without GPS signals or expensive sensor devices, is being developed by a team at Yonsei University in Korea. This could be used by unmanned vehicle teams to explore environments, ranging from farms here on earth to the surfaces of other worlds.

No man’s land Unmanned ground vehicles (UGVs) are already used for a number of “3D jobs” (dangerous, dirty or difficult), including bomb disposal and exploring the surface of Mars, and the range of applications for UGVs is expanding to include reconnaissance, transport, border control, disaster area exploration and agriculture. UGV operation can be impeded by a reliance on line-of-sight sensing, as their on-board sensors cannot see what is beyond obstacles around them. This can significantly slow down exploration applications. Unmanned aerial vehicles (UAVs), on the other hand, can quickly obtain an overview of large areas, but cannot match UGVs for endurance, load carrying or up-close investigation of the surface, such as collecting soil samples. There are clear advantages to combining the use of both types of vehicle in a UGV/UAV cooperative system, an example of a heterogeneous multi-agent system. Creating such a system requires solutions to three main challenges: sensor technology to robustly detect and identify all the agents (UGVs and UAVs); precise relative positioning between the agents even where GPS is not available or reliable; and efficient communication between the agents.

TOP: The agents of the prototype UGV/UAV cooperative system in the motion analysis laboratory at Yonsei University. The laboratory’s nine camera motion capture system was used to provide a real-time ground truth against which the stereo-vision based system could be checked BOTTOM: The D-Board, the general sensor/ processor platform developed for the prototype system. Incorporating microprocessor, motor drivers, multiple sensor types and Bluetooth communication capability the D-board is finding applications in various other projects at Yonsei

For UGV path planning, one of the most important things UAVs can provide is an obstacle map of the area of operation. Previous UAV approaches to obtaining depth information of ground objects have used relatively expensive sensors such as LIDAR, RADAR, and SONAR, but the work reported in this issue of Electronics Letters uses much less expensive visual sensors, i.e. cameras. It also uses those same cameras to address the identification, positioning and GPS reliance challenges.

Eyes in the sky The system uses stereo-vision depth sensing to provide the obstacle map, and other image processing techniques to identify and track all the agents in the system, relative to each other and the environment, so GPS information is not needed. Stereo-vision-based depth sensing is of course well known, but its performance degrades if the distance from the observed objects becomes

1406 ELECTRONICS LETTERS 25th September 2014 Vol.50 No.20

While the team is now working to demonstrate the system outside the laboratory environment, the control, image processing and hardware developments made in developing the prototype system are already benefitting other work at Yonsei. An example of this is the ‘D-board’, which is the name the team have given to the small, lightweight, low-power sensor/processor board they developed to handle control and communication between the agents in the system. Within a 25 × 25 mm area, it incorporates a microprocessor, motor drivers, necessary sensors such as an accelerometer, a gyroscope, and a barometer, and Bluetooth communication capability. Seo says that it has already proved useful for other applications, including “intelligent robots, IoT devices, and media art applications”. This other work includes the team’s wider interests in heterogeneous multi-agent systems, and UGV/UAV cooperative systems. The Yonsei researchers believe there are many other potential benefits to be found in using such systems over single agent and homogeneous multi-agent systems, as the different agents, with different strengths and weaknesses, can complement each other. “The multi-UAV stereo-vision system is just a single example of potential collaborations between UGVs and UAVs,” said Seo. “We think that it is a quite natural path for robotics research to move in this direction over the next decade. We expect many novel real-world applications, beyond the polar exploration robots and precise farming that we are currently working on, which can expand the horizon of robotics and provide real benefits to our society.”

doi: 10.1049/el.2014.3309

Coordination of mixed air and ground unmanned ... - IEEE Xplore

Sep 25, 2014 - The system uses stereo-vision depth sensing to provide the obstacle map, and other image pro- cessing techniques to identify and track all the.

274KB Sizes 1 Downloads 52 Views

Recommend Documents

Adaptive Air-to-Ground Secure Communication System ... - IEEE Xplore
May 12, 2016 - technology has been conceived to be an unauthenticated and unencrypted signal ... of ADS-B signal suffers from the following security vulnera-.

Control Design for Unmanned Sea Surface Vehicles ... - IEEE Xplore
Nov 2, 2007 - the USSV, and the actual hardware and software components used for control of ... the control design problem was developed in our previous.

Tight Mixed Integer Linear Programming Formulations ... - IEEE Xplore
Page 1 ... mizes system-wide operational costs of power generators by providing an optimal ... generator so that the demand for electricity is met. Genera-.

I iJl! - IEEE Xplore
Email: [email protected] Abstract: A ... consumptions are 8.3mA and 1.lmA for WCDMA mode .... 8.3mA from a 1.5V supply under WCDMA mode and.

PDF Intelligent Unmanned Ground Vehicles
Computer Science) Download Online ... Carnegie Mellon (The Springer International Series in Engineering and Computer Science), Read Best Book Intelligent ..... Vehicles shows the progress that was achieved during this program, from brittle.

Device Ensembles - IEEE Xplore
Dec 2, 2004 - Device. Ensembles. Notebook computers, cell phones, PDAs, digital cameras, music players, handheld games, set-top boxes, camcorders, and.

striegel layout - IEEE Xplore
tant events can occur: group dynamics, network dynamics ... network topology due to link/node failures/addi- ... article we examine various issues and solutions.

Pseudosaturation and Negative Differential ... - IEEE Xplore
Feb 20, 2013 - IEEE TRANSACTIONS ON ELECTRON DEVICES, VOL. 60, NO. 3, MARCH 2013. 985. Pseudosaturation and Negative Differential.