Dynamic Threshold and Contour Detection: A more Robust Visual Centroid Recognition♦ A. Soria♣, W. Ortmann *, P. Wiederhold & R. Garrido.

Departamento de Control Automático. Centro de Investigación y Estudios Avanzados del IPN. México D.F., México. *Faculty of Mathematics and Informatics, Friedrich Schiller University, Jena, Germany Abstract: We present a robust centroid detection algorithm based on contour shape properties. This algorithm is applied to a gray level image under different illumination conditions in a visual servoing control architecture. Experimental results using a 2dof planar robot are presented. 1. Introduction In most of the Visual Servoing published works (cf. [HASHIMOTO], [HUTCHINSON], [CORKE], [KELLY]) centroid estimation is performed using fixed binarization thresholding for centroid calculation. In this case, the environment and/or the robot itself are built to allow a high contrast between the background and the robot end effector. Using binarization, two extreme gray levels for the foreground and the background are obtained. The end effector centroid is calculated using all the foreground pixels. In this case, there is no way to distinguish if a pixel in the foreground corresponds to the end effector. This approach heavily depends on the illumination conditions and the binarization threshold (cf. [CORKE]).

for visual servoing of robot manipulators evolving in more realistic illumination conditions where it is not always possible to manipulate the environment. In this paper we propose the use of a dynamic binary thresholding in conjunction with a contour extraction method to select the pixels that will be used in the determination of the end effector position in a 2dof robot, using centroid calculation in a visual servoing control framework. The paper is organized as follows, Section 2 describes the proposed dynamic binary thresholding and the contour extraction and selection. Section 3 presents the PD visual servoing control algorithm. In section 4 we show some experimental results on a 2dof planar robot. The paper ends with some concluding remarks.

This lack of robustness against illumination changes hampers the application of visual servoing techniques inside industry. It is then natural to ask for more robust centroid detection algorithms

♦ ♣

Work supported by joint Mexican-German project CONACYT-DLR N° ALE 107-A99 and CINVESTAV JIRA’2001/02. Corresponding author: [email protected]

1

2. Dynamic Binarization Thresholding, Contour Extraction and Selection. From the histogram of the gray level image, a binarization threshold t is determined by the well known method of [OTSU]. Beginning with an appropriate contour starting point, the contour is determined by a classical contour following algorithm (cf. [VOSS/SUESSE]). Once a contour is found, the properties length, area and form factor (area/length) are calculated. These properties are then used to select the contour that matches the 2dof robot end effector characteristics. A contour is selected if the values of length, area, form factor are within manually determined intervals. These intervals will allow the selection of a contour that approaches the end effector characteristics. With the selected contour, the centroid is then calculated using the moments m00, m01 and m10 : m pq = ∑∑ X pY q I ( x, y )

(1)

R

Here, I ( X , Y ) is 0 or 1, taking all the pixels within the contour, centroid is given by:

Xc =

m10 m00

Yc =

m01 m00

(2)

It is worth remarking that the robot end effector is attached with a black circle. 3. PD Visual Servoing Control A PD visual servoing control was used with an image-based look-and-move (cf. [WEISS]), then a 2dof robot (cf. [GARRIDO]) is controlled using both visual and joint information. The robot set-up was tested using the algorithm proposed in (cf. [KELLY]). The control law is:

τ = J T ( q) R(θ ) K p ~x − Kd q& + g (θ )

(3)

where J(q) is the robot Jacobian matrix, R(θ) is the camera rotation matrix, Kp and Kd the proportional and derivative gains, ~x = xd − x , the error in the image plane, xd and x the desired and actual

position vectors in the image plane, q the vector of joint derivatives and g(θ) the gravity compensation. Visual feedback is used for the proportional part and damping is added using joint measurements as well for the calculation the robot Jacobian matrix. 4. Experimental Results Image acquisition and processing is performed using a Pentium based computer running at 1 Mhz under Windows NT 4.0. For image acquisition we use a Dalsa digital camera CA-1D-128A. This camera is connected to the vision computer trough a National Instruments PCI 1422 interface card. Image processing was done using C++ language and is based on the image processing library ICE and DIAS environment developed by the Image Processing Group of the Faculty of Mathematics and Informatics, Friedrich Schiller University, Jena Germany. Figure 1 shows the result of applying Otsu’s method and then finding the contours. We used three illumination conditions: low, intermediate and high. The contours are marked over the gray level image so that the illumination level can be noticed at the same time as the contour detection. The contour that corresponds to the 2dof robot end effector is marked darker than the other contours found. Figure 2 shows the control results for the three illumination conditions corresponding to illumination conditions a), b) and c) of figure 1. The initial large change in the end effector coordinates X and Y, is due to the fact that the visual position determination is used from the beginning of the control at time 0. The X position is very similar in the three illumination conditions. For the Y position, it can be noted in figure 2 that b) and c) are very similar and a) slightly different. This difference is due to the use of large matching characteristic intervals for the area, length and form factor. However, if these intervals are excessively narrow, some centroids will be missed, so we tolerate some noise rather that missing a

centroid that will cause the robot to go out of control. It is interesting to note that the initial control in figure 2 a) and b) is different from c) because the configuration that the robot takes in a) and b) is an “elbow up” and in c) is an “elbow” down. 5. Conclusions In this paper we presented de use of Otsu’s dynamic binarization thresholding method for robust centroid detection for visual servoing. We employ a contour following method to select the pixels for centroid calculation. Further work will aim to propose a method to achieve a closer and automated matching of end effector characteristics with the contours found that may result in reducing low illumination centroid detection noise. References [CASTILLO] CASTILLO, P.- Plataforma de control visual para servomecanismos. M. Sc. Thesis. México : Departamento de Control Automático CINVESTAV-IPN, 2000. [CORKE] CORKE, P.- High Performance Visual Servoing. Taunton Somerset England: Research Studies Press, 1996. [GARRIDO] GARRIDO, R.; SORIA, A.; CASTILLO, P. & VÁZQUEZ, I.- “A Visual Servoing Architecture for Controlling Electromechanical Systems. [Proc.] of the 2001 IEEE International Conference on Control Applications (September 5-7, Mexico). New York: IEEE, 2001. [HASIMOTO] HASIMOTO, K. & KIMULRA, H. - “LQR Optimal and Non-Linear Approaches to Visual Servoing”. In HASHIMOTO, K. (Ed.).- Visual Servoing. Singapore: World Scientific, 1993. [HUTCHINSON] HUTCHINSON, S.; HAGER, G. & CORKE, P. - “A Tutorial on Visual Servo Control”.- IEEE Trans. On Robotics and Automation. Vol. 12, Nº 5. October, 1996. pp. 651-670.

[KELLY] KELLY, R.“Robust Asymptotically Stable Visual Servoing of Planar Robots”.- IEEE Transactions on Robotics and Automation. Vol. 12, N° 5. October, 1996. pp. 759-766. [Otsu] OTSU, N.- “A Threshold Selection Method from Gray-Level Histograms”. IEEE Transaction on Systems, Man and Cybernetics. Vol. SMC-9, Nº 1. 1995. pp.6266. [VOSS] VOSS, K. & SUESSE, H.- Praktische Bildverarbeitung. Aachen, Germany: Hanser Verlag, 1991. [WEISS] WEISS, L. & SANDERSON, A.“ Image-Based Visual Servo Control Using Relational Graph Error Signals”. Proc. IEEE. 1980. pp.1077-1980.

X and Y Position in Pixels

50

Low Illuminatio n - Control Results - Gray Level Image

0

X Y X Y -50

0

5

10 time (secs)

po sition Positio n S et Po int Set P oint

15

20

a)

a) Low Illumination

X and Y Position in Pixels

intermediate Illumination - Contro l Results - Gray Level Image 50

0

X Y X Y -50

0

5

10 time (secs)

po sition Positio n S et Po int Set P oint

15

20

b)

b) Intermediate Illumination

X and Y Position in Pixels

50

H igh Illumination - Co ntrol Results - Gray Level Image

0

X Y X Y -50

0

5

10 time (secs)

po sition Positio n S et Po int Set P oint

15

20

c)

c) High Illumination Figure 1. Centroid detection using contours on a gray level image with three different illumination conditions.

Figure 2. Control results with three different illumination conditions.

1 Dynamic Threshold and Contour Detection: A more ...

Dalsa digital camera CA-1D-128A. This camera is connected to the vision computer trough a National Instruments PCI 1422 interface card. Image processing was done using C++ language and is based on the image processing library ICE and DIAS environment developed by the Image. Processing Group of the Faculty of.

197KB Sizes 0 Downloads 310 Views

Recommend Documents

An Active Contour Model for Spectrogram Track Detection
Oct 26, 2009 - Department of Computer Science, University of York, Heslington, .... for Q = UT Vx(t)y(t) − µ where µ and Σ the mean and standard deviation of.

Active Contour Detection of Linear Patterns in ...
tour algorithm for the detection of linear patterns within remote sensing and vibration data. The proposed technique uses an alternative energy force, overcom-.

An Active Contour Model for Spectrogram Track Detection
Oct 26, 2009 - feature detection and an analysis of the algorithm's complexity. 2.1. The Active ..... Vol. 57 of. Advances in Intelligent and Soft Computing.

Subpixel Contour Matching Using Continuous Dynamic ...
ing the discretization problems which commonly oc- cur when matching polygonal contours, as illustrated in Figure 1. The main drawbacks of previous research on sub- pixel matching, either using correlation measures 11] or geometric reasoning 3], are

Back-Gated CMOS On SOIAS For Dynamic Threshold ...
options and various degrees in which the buried layer or layers can be rendered ..... B.S. degree in electrical engineering and computer science from the Univer-.

Sharp Threshold Detection Based on Sup-norm Error ...
May 3, 2015 - E (X1(τ)X1(τ) ) denote the population covariance matrix of the covariates. ... 1 ≤ s ≤ 2m, a positive number c0 and some set S ⊂ R, the following condition holds wpa1 κ(s, c0,S) = min ..... package of Friedman et al. (2010).

Back-Gated CMOS On SOIAS For Dynamic Threshold ...
[4] M. Srivastava, A. P. Chandrakasan, and R. W. Brodersen, “Predictive system shutdown and ... tomized program analysis tools,” Tech. Rep., 1994. ... Communications Society 1993 Best Tutorial Paper Award for the IEEE. Communications ...

A More Secure Approach to Dynamic Web Threats ...
Network Security. “Partnering with clients to create innovative growth strategies” ... virus signatures are no longer effective in stopping Web-borne threats. A new ...

A More Secure Approach to Dynamic Web Threats ...
Solving the Content Filtering Challenge With On-Demand Services. 5 ... one that can respond to dynamic threats in real-time, is needed to secure this vital.

HOW DYNAMIC ARE DYNAMIC CAPABILITIES? 1 Abstract ...
Mar 11, 2012 - superior performance. The leading hypothesis on performance is deemed to be that of sustainable competitive advantage, (Barney 1997).

1 more 1 less 10 more 10 less.pdf
Then, erase the. numbers and repeat, or call another student over to work with. (Note: The. super, thin Page Protectors erase best.) You or the student picks a number from the box below and puts it in the red. box located in the middle. The student w

Dynamic Circuits, Part 1
Energy stored in a capacitor, W, can be found from the definition of electric power: ..... All analysis method (KVL, KCL, circuit reduction, node-voltage and mesh ...

Economic growth and quality of life" a threshold ... - ScienceDirect.com
there is an increasing environmental degradation up to a point, after which environmental quality im- proves" [as quoted in Arrow et al. (1995) article] seem to be merely anecdotes that don't make history. What I mean is that although anecdotes can b

towards a threshold of understanding
Online Meditation Courses and Support since 1997. • Meditation .... consistent teaching, enable the Dhamma to address individuals at different stages of spiritual .... Throughout Buddhist history, the great spiritual masters of the. Dhamma have ...

Image contour extraction
Apr 6, 2009 - Based on intensity difference with neighbor pixels. • Convert pixels to “directed” points. – Each pixel has an angle associated with it (direction.

Dynamic Demand and Dynamic Supply in a Storable ...
In many markets, demand and/or supply dynamics are important and both firms and consumers are forward-looking. ... 1Alternative techniques for estimating dynamic games have been proposed by (Pesendorfer and Schmidt-. 3 ... Our estimation technique us

dynamic centroid detection in outdoor/indoor scenes ...
email: [email protected]. ABSTRACT. Centroid .... The lowest score indicates the best segmentation quality, while the .... and Automation. Vol. 12, N ˚ 5.

Dynamic Cache Contention Detection in Multi-threaded Applications
Mar 9, 2011 - marily a function of the cache line size and application behavior. Using memory shadowing and dynamic instrumentation, we im- plemented a ...

Dynamic Cache Contention Detection in Multi-threaded Applications
Mar 9, 2011 - marily a function of the cache line size and application behavior. ... is the development of a memory hierarchy: the use of multiple lev-.

Enhanced Dynamic Detection of Code Injection Attack in OS ... - IJRIT
At runtime, a monitor compares the behavior of the variants at certain ... The global decision is made by a data fusion center, ... complete solution. Modern static ...

Environmental Contour Lines: A Method for Estimating ...
In practice, the fitting process is started by fitting a log- normal distribution to ..... must be somewhere on the sphere in the u-space with a radius. 5.4. = β . By now ...

A TASOM-based algorithm for active contour modeling
Active contour modeling is a powerful technique for modeling object boundaries. Various methods .... close to the input data, the learning parameters of. TASOM ...

Prevention Prevention and Detection Detection ...
IJRIT International Journal of Research in Information Technology, Volume 2, Issue 4, April 2014, Pg: 365- 373 ..... Packet passport uses a light weight message authentication code (MAC) such as hash-based message ... IP Spoofing”, International Jo

Dynamic-1.pdf
HEAVY METALS CHELATING AGENTS. [email protected] 12. Most drugs act ... itself has no other function. Page 3 of 8. Dynamic-1.pdf. Dynamic-1.pdf.