(IJEECS) International Journal of Electrical, Electronics and Computer Systems. Vol: 5 Issue:1, 2011

Neural Network Based Microcontroller Operated Intelligent Vehicle System A.S.M. Bakibillah, Asim Abdulkhaleq Department of Computer Science, Electrical Engineering and Information Technology, University of Stuttgart 70569 Stuttgart, Germany 1 [email protected] 2 [email protected] Abstract— Today a fast real-time and robust automatic vehicle system is required to increase driving safety as the manned driving is getting extremely numbered, so are those of traffic jams, bad, dangerous and rough drivers and more importantly, accidents. Automatic recognition of traffic signs is also important for automated intelligent driving vehicle or driver assistance systems. This paper presents a new technique for object recognition and control the vehicle thereby. A combination of image processing and artificial neural network has been used for extraction and recognition of the boundaries in captured noisy images. A car is chosen to move towards some defined directions. Direction of the car in a certain moment is a subject of sensing. This sensing is fed to the car to implement image processing techniques and some matching principles by means of artificial neural network. The microcontroller operating the car receives the data via serial port and drives it by analyzing the data. Experimental results demonstrating the performance of the proposed technique are also presented. Performance analysis shows that the applied technique is able to execute well on a low performance CPU without requiring significant additional CPU resources.

vehicle system with the advanced feature to decide on moving directions according to traffic signs. The implementation is essentially divided into two specific phases [4]. The first step is the extraction of traffic signs from a video or image sequence using image processing. The other one is the recognition of these detected signs which deals with the interest of performance in artificial neural network. This paper is organized as follows. In Section 2, the required hardware configuration and protocols are discussed. In Section 3, the image processing technique to bring out necessary information is described. In Section 4, artificial neural network analysis for recognition of traffic sign patterns is discussed. Section 5 details the implementation technique to control the vehicle, while Section 6 shows the experimental results and performance analysis. Section 7 points to scopes of future development of the task under consideration. Lastly, Section 8 points out the conclusion inferred from this work.

II. HARDWARE REQUIREMENTS Implementation of artificial intelligence in vehicle control Keywords— Intelligent vehicle, Automatic control, Image involves a number of essential hardware parts, as listed: processing, Artificial neural network, Microcontroller  Availability of a USART interface in the car circuit. I. INTRODUCTION  External crystal connection facility for high baud rate. In the past few years, implementing intelligence has  Bi-directional motor drive circuitry. become a very important tool in the history of development of robot and automated system [1]. Artificial intelligence has To implement the idea, a microcontroller PIC16F628A is found its application in vehicles including road transportation, used. The microcontroller is equipped with necessary ports aircraft and spaceship. Should some automated intelligence which are used as control logic output and for interfacing be applied to the vehicle, driving safety can be achieved with USART. beyond the error of any human being. Conventional traffic signs on the road provide a driver valuable information for A. Configuring the Microcontroller Various device configurations are programmed using safe and efficient navigation. Automatic recognition of these signs is therefore important for automated intelligence ‘0’and ‘1’ bits. Memory map location of these bits starts from driving vehicle or driving assistance systems. Artificial 2007h. For example, crystal clock configuration bits are Neural Network represents a precise technology that is used FOSC2:FOSC1:FOSC0=010 which are available in this to recognize traffic sign patterns and have showed promising mapped area [5]-[6]. result [2]. B. Asynchronous Data Transfer Mode The difficulties of traffic sign detection and recognition are The USART uses eight or nine data bits along with one involved with the performance of system in real time [3]. Start bit and one Stop bit in a standard non-return to zero There are three major sources of error while tracking a moving object using a video camera. Firstly, error is inherent (NRZ) format [7]. An 8-bit baud rate generator generates in the finite resolution of the captured image. Secondly, the baud rate frequencies from the oscillator [6]. Though the scale of the corresponding image processing algorithm results transmitter and the receiver function independently, they use in error. The last one is the inherent noise due to visibility the same data format and baud rate. conditions. These errors result in uncertain measurements. III. IMAGE PROCESSING Consequently, the designed system needs to be robust to Image processing encompasses a broad range of hardware, allow for some uncertainty while still processing in real-time. So high efficient algorithms and powerful performance software and theoretical underpinnings. Fig. 1 summarizes hardware is required in the system [3]. This paper proposes a ©IJEECS

(IJEECS) International Journal of Electrical, Electronics and Computer Systems. Vol: 5, Issue:1, 2011 the process of producing the result from the problem domain by means of image processing.

Pre-processing

Representation and Description

Knowledge Base

Recognition And Interpretation

Image Acquisition

Result

Problem domain

Segmentation

Fig. 1 Block diagram of implemented image processing technique

A. Canny Edge Detection Algorithm The best tool known for optimal edge detection is the Canny edge detection algorithm which is used in this experiment [8]-[ 9]. The algorithm concentrates on fulfilling three objectives.  The first and the most crucial one is to obtain a low error rate. Ideally, only the edges should respond to the algorithm.  Secondly, the edge points should be well localized. In other words, the detected positions should be as close to the actual edges as possible.  Thirdly, the response should keep one-one correspondence to the edges. In other words, there should be only one response to a single edge. At the very beginning of implementing the algorithm, any noise present in the image is filtered out with a Gaussian filter [10]. The filter implements a simple mask. After calculating the mask, standard convolution process performs the filtering [11]. The more the width of the mask, the less is the detector’s sensitivity to the noise, hence the more smoothing of the noise. The edge is enhanced by taking the image gradient. A popular 2-D spatial gradient measurement filter is the Sobel operator [10]-[12], shown in Fig. 2, which is a pair of 3×3 convolution masks, estimating the gradient in the horizontal and the vertical direction respectively.

As soon as the edge direction is known; it can be related to a direction that is traceable in an image. Then the algorithm traces along the edge in the edge direction, and suppresses any pixel value by setting it equal to 0 that is not at maximum, hence not considered to be an edge. This process is known as non-maximum suppression. It leaves a thin line in the output image [14]. The gradient array is further reduced by hysteresis. Hysteresis is used to track along the remaining pixels that have not been suppressed [15]. Hysteresis implements two thresholds to suppress fluctuating above or below any threshold due to noise. Any pixel with a value below the lower threshold is set to zero, thus marking it as a non-edge. If a pixel has a value above the higher threshold, it is presumed to be an edge, and is immediately marked as such. Also, any pixel with value between the two thresholds that is connected to another edge pixel is also selected as an edge pixel. B. Image Boundary Boundaries are linked edges that characterize the shape of an object. They are useful in computation of geometry features such as size or orientation. Conceptually, boundaries can be found by tracing the connected edges [16]-[17]. On a rectangular grid a pixel is said to be four- or eight-connected when it has the same properties as one of its nearest four or eight neighbours, respectively. Contour following algorithm trace boundaries by ordering successive edge points [18]. By using this algorithm, open or closed boundary can be traced. In this work, closed boundary tracing was used. Coarse contour was implemented with some pixels appearing twice. A certain pixel ‘P’ can have eight adjacent pixels which are named according to their directions with respect to ‘P’, as demonstrated in Fig. 3

Fig. 2 Horizontal and vertical Sobel operators

Fig. 3 Different adjacent pixels

The following formula then approximates the edge strength, or the magnitude, of the gradient vector:

C. Boundary Tracing Algorithm P0 : is a starting pixel of the region border dir : stores the direction of the previous move along the border from the previous border element to the current border element using 3×3 neighborhood P : set of pixels forming the boundary Step 1 Start from a pixel P0 Step 2 Number and define 8 connectivity v = […..] Step 3 Search 3×3 neighborhood anti-clockwise Step 4 If pixel found with the same value as the current pixel P= [P0, P1, …]. Otherwise, update dir using Step 3

The gradients in the x and y directions are used to compute the direction of the gradient vector. This indicates the edge direction, measured as the angle of the gradient vector with respect to the x direction [13]. The measurement of this parameter is trivial when Gx=0

©IJEECS

(IJEECS) International Journal of Electrical, Electronics and Computer Systems. Vol: 5, Issue:1, 2011 Step 5 If the current boundary element Pn is equal to the second border element P1, and the previous border element P(n-1) is equal to P0, stop IV. MATHEMATICAL MODEL OF THE NEURAL NETWORK An artificial neural network (ANN) is a system which models the operation of a biological neural network. Several basic components of importance should be considered while designing a functional model of the biological neuron [19]. Fig. 4 displays the model along with these components.  First, the synapses of the neuron are characterized as weights indicating the strength of the connection. Excitatory and inhibitory connections correspond to positive and negative weights respectively.  Second, the weighted sum of all the inputs characterizes the interval activity of the neuron. This activity is referred to as linear combination [20].  Finally, the amplitude of the output of the neuron is modeled as an activation function. The amplitude is normalized from 0 to 1, or alternatively, from –1 to1.

V. IMPLEMENTATION TECHNIQUE The output data from neural network are sent to car microcontroller via serial port. Car microcontroller takes decision on moving direction of the car based on the data sent. Two push-pull configurations are used in the motor drive circuit, as demonstrated in Fig. 6, to drive the car both in clockwise and anticlockwise directions. Inverting buffers are used to drive the bases of motor drive transistor. Fig. 7 displays the power distribution circuit used for distributing voltage and current to various circuit units.

Fig. 6 Motor drive circuit

According to this model, the interval activity of the neuron is given by:

The output of the neuron, yk, is therefore the outcome of some activation function of vk. The output of the proposed network id given in Fig. 5

Fig. 7 Power distribution circuit

Fig. 8 represents the whole processing of the vehicle control system. Several steps are involved from acquisition of image to decision on different movement.

Fig. 4 Mathematical model of the neuron

Fig. 8 Entire processing phase at a glance

Fig. 5 Working model of the neuron

VI. RESULT AND PERFORMANCE ANALYSIS Several trials of experiment were run to analyse performance of the proposed vehicle control system. Noise was added to the captured images due to visibility conditions. It is obvious that addition of noise will increase the response time of the algorithm. Thus the inverse of the response time ©IJEECS

(IJEECS) International Journal of Electrical, Electronics and Computer Systems. Vol: 5, Issue:1, 2011 can be taken as a measure of performance. Table 1 shows the results of adding different levels of noise. TABLE I

System performance vs. noise %Noise

%Performance

0

100

10

70

30

60

50

45

The outcomes from experiments can be plotted to obtain a performance profile which is a function of response time of the device, as shown in Fig. 9. The curve enables us to calculate noise to performance ratio at any point.

results are presented. The effect of noisy environment on the performance of the system is also presented. Serial port is used instead of USB port to reduce cost. Also, the availability of a portable computer, e.g., a laptop, has been exploited to avoid a high-performance high-cost microcontroller, hence cut-off the budget substantially. A complete vision system has to recognize all important elements in an environment. This implementation proposed in this work involves processing huge amount of image data using a computer, because the microcontroller used to drive the car is not so powerful to do such kind of task. This controller can be replaced by a powerful commercial digital signal processing microcontroller which will eliminate the need of a computer. An extra RAM can be attached to the microcontroller to hold such huge data at processing time. A USB webcam can be attached to the microcontroller to capture image. A generalized boundary tracing algorithm is used for finding image position. This can also be done using morphological operations. Perception approach is used to match images; but back-propagation is likely to give better results. ACKNOWLEDGMENT Authors would like to thank Institut für Automatisierungsund Softwaretechnik at University of Stuttgart for providing experiment facility. REFERENCES [1] [2] [3]

Fig. 9 Performance vs. noise curve

Results showing network performance during training period of artificial neural network are displayed in Fig. 10. Different results were obtained by varying number of epochs.

[4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]

Fig. 10 Network performance vs noise curve

VII. CONCLUSIONS AND FUTURE WORK In this work, a technique for automatic detection of roadside traffic signs, in videos or images captured by a vehicle is presented. The work concentrates on recognition of traffic signs to decide on automatic moving direction. A solution combining the algorithms of edge detection and boundary extraction and the operation of artificial neural network is developed. Experiments are run and numerical

[16] [17] [18] [19]

©IJEECS

S. M. Metev and V. P. Veiko, Laser Assisted Microtechnology, 2nd ed., R. M. Osgood, Jr., Ed. Berlin, Germany: Springer-Verlag, 1998. J. Breckling, Ed., The Analysis of Directional Time Series: Applications to Wind Speed and Direction, ser. Lecture Notes in Statistics. Berlin, Germany: Springer, 1989, vol. 61. S. Zhang, C. Zhu, J. K. O. Sin, and P. K. T. Mok, “A novel ultrathin elevated channel low-temperature poly-Si TFT,” IEEE Electron Device Lett., vol. 20, pp. 569–571, Nov. 1999. M. Wegmuller, J. P. von der Weid, P. Oberson, and N. Gisin, “High resolution fiber distributed measurements with coherent OFDR,” in Proc. ECOC’00, 2000, paper 11.3.4, p. 109. R. E. Sorace, V. S. Reinhardt, and S. A. Vaughn, “High-speed digital-to-RF converter,” U.S. Patent 5 668 842, Sept. 16, 1997. (2002) The IEEE website. [Online]. Available: http://www.ieee.org/ M. Shell. (2002) IEEEtran homepage on CTAN. [Online]. Available: http://www.ctan.org/texarchive/macros/latex/contrib/supported/IEEEtran/ FLEXChip Signal Processor (MC68175/D), Motorola, 1996. “PDCA12-70 data sheet,” Opto Speed SA, Mezzovico, Switzerland. A. Karnik, “Performance of TCP congestion control with rate feedback: TCP/ABR and rate adaptive TCP/IP,” M. Eng. thesis, Indian Institute of Science, Bangalore, India, Jan. 1999. J. Padhye, V. Firoiu, and D. Towsley, “A stochastic model of TCP Reno congestion avoidance and control,” Univ. of Massachusetts, Amherst, MA, CMPSCI Tech. Rep. 99-02, 1999. Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specification, IEEE Std. 802.11, 1997. Dong, J.: Image Filtering. Serenade Training Session (2004) Web Ezine. http://web-ezine.com/shopping/iris-recognition-usingneural-networks Accessed 28 December 2009 Bechor, I.: Eye Detection (2005). http://www.cs.bgu.ac.il/~icbv071/StudentProjects/ICBV052/ICBV2005-2-Bechor-Itai/Project%20Report.doc Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval: an experimental comparison. Inf. Retr. 11(2): 77–107 (2008) Edge Detection & Boundary Tracing. http://www.ece.iastate.edu/~namrata/EE528/EdgeDetection_Bounda ryTracing.pdf Shahrokni, A., Drummond, T., Fua, P.: Texture Boundary Detection for Real-Time Tracking. In: European Conference on Computer Vision, Vol II, pp. 566–577. Prague, Czech Republic (2004) Beale, R., Jackson, T.: Neural Computing - An Introduction, IOP

(IJEECS) International Journal of Electrical, Electronics and Computer Systems. Vol: 5, Issue:1, 2011 Publishing Limited (1990) [20] Artificial Neural Networks - A neural network tutorial. http://www.learnartificialneuralnetworks.com Accessed 27 December 2009

©IJEECS

IJEECS Paper Template

accidents. Automatic recognition of traffic signs is also important for automated intelligent driving vehicle or driver assistance systems. This paper presents a new ...

240KB Sizes 0 Downloads 253 Views

Recommend Documents

IJEECS Paper Template
virtual OS for users by using unified resource. Hypervisor is a software which enables several OSs to be executed in a host computer at the same time. Hypervisor also can map the virtualized, logical resource onto physical resource. Hypervisor is som

IJEECS Paper Template
Department of Computer Science & Engineering ... The code to implement mean filter in java language is as,. //smoothing ... getPixel(r,c); //get current pixel.

IJEECS Paper Template
thin client Windows computing) are delivered via a screen- sharing technology ... System administrators. Fig. 1 Cloud Computing. IDS is an effective technique to protect Cloud Computing systems. Misused-based intrusion detection is used to detect ...

IJEECS Paper Template
Department of Computer Science & Engineering. Dr. B R Ambedkar .... To compute the value that express the degree to which the fuzzy derivative in a ..... Now she is working as a Associate Professor in Computer Science &. Engineering ...

IJEECS Paper Template
Increasing the number of voltage levels in the inverter without requiring higher rating on individual devices can increase power rating. The unique structure of multilevel voltage source inverter's allows them to reach high voltages with low harmonic

IJEECS Paper Template
not for the big or complex surface item. The example based deformation methods ... its size as it moves through the limb. Transition from each joint, the ellipsoid ...

IJEECS Paper Template
number of power semiconductor switches needed. Although lower voltage rated switches can be utilized in a multilevel converter, each switch requires a related gate drive circuit. This may cause the overall system to be more expensive and complex. Som

IJEECS Paper Template
rise to many type of security threats or attacks. Adversary can ... data transmission. The message is sent ... in realizing security services like: authenticity, integrity,.

IJEECS Paper Template
B. M. Alargani and J. S. Dahele, “Feed Reactance of. Rectangular Microstrip Patch Antenna with Probe. Feed,” Electron letters, Vol.36, pp.388-390, 2000. [6].

Transactions Template - IJEECS
trol flow. There are two types of slicing namely static and dynamic slicing [7] .A static program slice comprises of those program statements that affects the value of a variable at some program point of interest which is referred as 'slicing cri- te

Transactions Template - IJEECS
The face space is defined by the “eigen-faces”, which are the eigen vectors of the set of faces. The block .... eigenvector and eigenvalue of WTW respective- ly,.

Transactions Template - IJEECS
Abstract—The resonant modes and characteristics of an equilateral triangular microstrip patch antenna with a variable air gap are theoretically and experimentally examined. Effect of varying parameters like dielectric constant of substrate, size of

Transactions Template - IJEECS
ISSN: 2221-7258(Print) ISSN: 2221-7266 (Online) www.ijeecs.org. Modified ..... vanced Information Networking and Applications Workshops. (AINAW 07), vol. 2.

Transactions Template - IJEECS
client server model doesn't support the slicing over the object oriented programs on ... slicing, Slice, Distributed System, Finite State Machine, Java Programming.

Transactions Template - IJEECS
INTERNATIONAL JOURNAL OF ELECTRICAL, ELECTRONICS AND COMPUTER SYSTEMS (IJEECS),. Volume ... ployed to validate the present theory for various .... Journal of Radio and Space Physics, vol. 35, pp. 293-. 296, 2006.(Journal).

Transactions Template - IJEECS
Dr. Harsh K Verma, Head, Department of Computer Science and Engi- neering,NIT jalandhar, E-mail: [email protected]. • Vaibhaw Dixit with the National Institute of Technology, Jalandhar,. Jalandhar, 144011. E-mail: [email protected]. The face

Paper Template - SAS Support
of the most popular procedures in SAS/STAT software that fit mixed models. Most of the questions ..... 10 in group 2 as shown with the following observations of the printed data set: Obs. Y ..... names are trademarks of their respective companies.

PMC2000 Paper Template - CiteSeerX
Dept. of Civil and Environmental Eng., Stanford University, Stanford, CA ... accurately follow the observed behavior of a large California ground motion database. .... rate of phase change, conditional on the amplitude level, to have a normal ...

Paper Template - SAS Support
Available support.sas.com/rnd/scalability/grid/gridfunc.html. Tran, A., and R. Williams, 2002. “Implementing Site Policies for SAS Scheduling with Platform JobScheduler.” Available support.sas.com/documentation/whitepaper/technical/JobScheduler.p

Paper Template - SAS Support
SAS® Simulation Studio, a component of SAS/OR® software, provides an interactive ... movement by shipping companies, and claims processing by government ..... service engineers spent approximately 10% of their time making service calls ...

CiC Paper Template
From Echocardiographic Image Sequence In Long-Axis View. Anastasia Bobkova, Sergey Porshnev, Vasiliy Zuzin. Institute of radio engineering, Ural Federal University of the First President of Russia B.N. Yeltsin. Ekaterinburg, Russia. ABSTRACT. In this

PMC2000 Paper Template
accurately follow the observed behavior of a large California ground motion database. ..... over a (coarse) grid, and various methods have been investigated to ...

IEEE Paper Template in A4 (V1) - icact
the SE-EE trade-off in multi-user interference-limited wireless networks ... International Conference on Advanced Communications Technology(ICACT).

I/ITSEC Author's Paper Template
MIST and INSPYRED are both free software available under GPL license and can ..... from this work, the implementation is offered under General Public License that allows ... Population - The Reference Model Runs with MIST Over the Cloud!