Generating Arabic Text from Interlingua Khaled Shaalan

Azza Abdel Monem

Institute of Informatics The British University in Dubai P O Box 502216, Dubai,UAE

Faculty of Engineering and Natural Sciences Central Lab. For Agricultural Expert Systems (CLAES) Argicuture Research Center P O Box: 100 Dokki, Giza, Egypt

Honorary Fellow, School of Informatics, University of Edinburgh, UK [email protected]

[email protected]

Ahmed Rafea

Hoda Baraka

Computer Science Dept., American University in Cairo 113, Sharia Kasr El-Aini, P.O. Box 2511, 11511, Cairo, Egypt [email protected]

Faculty of Engineering Cairo University Dokki, Giza, Egypt [email protected]

1 Introduction

Abstract

Arabic is the fourth most widely spoken language in the world (Nwesri et al., 2005). It is a morphologically and syntactically rich language. Arabic morphological and syntactic analyses have gained the focus of Arabic natural language processing research for a long time in order to achieve the automated understanding of Arabic. On the other hand, Arabic generation has received little attention although the generation problems are as sophisticated as those of the analysis. With the recent technological advances in multilingual machine translations, Arabic natural language generation has received attentions in order to automate Arabic translations. For machine translation systems that support a large number of languages, interlingua approach is particularly attractive (Levin et al., 2003): 1) it requires fewer components in order to relate each source language to each target language, 2) it takes fewer components to add a new language, 3) It supports paraphrase of the input in the original language, and 4) both the analyzers and generators can be written by mono-lingual system developers. In this paper, we describe a grammar-based generation approach for task-oriented interlinguabased spoken dialogue that transforms a shallow

In this paper, we describe a grammarbased generation approach for taskoriented interlingua-based spoken dialogue that transforms a shallow semantic interlingua representation called Interchange Format (IF) into Arabic Text that corresponds to the intentions underlying the speakers' utterances. The generation approach is developed primarily within the framework of the NESPOLE! (NEgotiating through SPOken Language in Ecommerce) multilingual speech-to-speech MT project. The IF-to-Arabic generator is implemented in SICStus Prolog. We conducted an evaluation experiment using the output from the English analyzer provided by Carnegie Mellon University (CMU). The results of this experiment were promising and assured the ability of the generation approach in generating Arabic text form the interlingua taken from the travel and tourism domain.

137

semantic interlingua representation called Interchange Format (IF) into Arabic text. The advantages of the approach used in this research are that it is easy to incorporate domain knowledge as well as heuristic rules into the linguistic knowledge which provide highly accurate generations for each semantic segment. The Arabic generator is compatible with the NESPOLE! interlingua specification.1 It translates simple conversations between a traveler (customer) speaking American English and a travel agent speaking Arabic. The Arabic generator uses the interlingua in Carnegie Mellon University (CMU) machine translation.2 The result will be automated computer translation of spoken English into Arabic. This research advances the state of the art in interlingua-based Arabic machine translation by discovering and formalizing the relationship between the deep semantic structures of sentences in the travel planning domain represented in an interlingua called Interchange Format (IF) and surface structure of an Arabic sentence. The Arabic generator follows a grammar-based approach in generating Arabic sentences which is based on solid linguistic knowledge. The first part of the generation is relatively domain-specific and concerns issues in interlingua-based machine translation for transferring an interlingua representation that does not contain any syntactic information into a feature structure that reflects the syntactic structure of the target Arabic sentence. The second part is linguistic-based and includes two main components: Arabic morphological generator and Arabic syntactic generator. The Arabic morphological generator concerns issues in the synthesis of inflected noun, verb, and particle. The Arabic syntactic generator concerns issues in the realization of the target Arabic sentence such as ensuring the agreement among constituents of the sentence and heuristically inserting missing fragments such as prepositions. The rest of the paper is organized as follows. Description of the interlingua representation is summarized in Section 2. This is followed by introducing the interlingua-to-Arabic generator in Section 3. Next, in Section 4, we discuss the set of important issues that we encountered during the

design and implementation of the system. In Section 5, we present the results of the experiment for evaluating the system. Section 6 discusses the related work. Finally, a conclusion and recommendations for further enhancements are given in Section 7.

1

2.

2 The Description of Interlingua The NESPOLE! translation system (Metze et al., 2005) is designed to provide human-to-human speech-to-speech machine translation using an interlingua-based approach similar to that used in the JANUS system (Levin et al., 2000). The general goal of the system is to provide translation over the Internet to facilitate communication for Ecommerce and e-service applications between common users in real-world settings. The domain addressed in NESPOLE! is the Travel & Tourism, a task-oriented domain. The NESPOLE machine translation project uses an interlingua representation which is based on speaker intention rather than literal meaning. The IF is a task-based representation of the semantics of a unit of speech. Since the system translates spoken dialogue, these units are called Spoken Dialogue Units (SDUs), and they range in length from a single word (“hello”) up to a full sentence (“I'd like to reserve a room”). An IF is based on a set of domain actions (DA) with parametric arguments. Each DA has up to four components: a speaker tag, a speech act, the concepts, and the arguments. Plus sign separate speech acts from the concepts and concepts from each other. Arguments are represented as an argument name followed by the “=” symbol followed by a value and/or subargument(s). In general, each DA has a speaker tag and at least one speech act optionally followed by string of concepts and optionally, a string of arguments. DAs can be roughly characterized as follows (Levin et al., 2003): Speaker: speech act +concept* arguments*

Several examples of utterances, with corresponding IF representations, are shown below: 1.

See interlingua specification for NESPOLE project, http://www.is.cs.cmu.edu/nespole/db/specification.html 2 See Carnegie Mellon University (CMU) web site for NESPOLE, http://www.is.cs.cmu.edu/nespole

138

a: Good morning a:greeting (greeting= good_morning)  

c: I'm planning a vacation this summer in Egypt c:give-information+plan+trip (who=i, visit-spec=( identifiability=no, vacation,

3.

4.

x

time=(season=(identifiability=non-distant, summer)),location=name-egypt))           c: How much does a double room with full board accommodation cost? c:request-information+price +accommodation (price=question, room-spec=(double_room, identifiability=no), include= (accommodation-board=full_board)) *$%&     !" # c: Tell me about sightseeing and transportations c:request-action+inform+object ( object-spec=(operator=conjunct, [(sightseeing, identifiability=,yes), (transportation, quantity=,plural, identifiability=yes)])) /0560$ 78 #!9 ;< > 

Lexical Mapping. Performing lexical lookup for the lexical entries in order to associate lexemes with semantic IF concepts and values. Interlingua Lexical Mapping Rules Structure Mapping Rules

Mapping Lexicon

3 The Interlingua-to-Arabic Generator

Lexical Mapper

Structural Mapper

In interlingua-based machine translation, the second half of the translation process is generation. This section describes a proposed rule-based grammar approach for Arabic natural language generation from the interlingua representation used in NESPOLE! Our approach introduces how to generate grammatically correct Arabic sentence from Interlingua. In this context, we address some issues in generating Arabic from interlingua such as agreement in number which cannot be transferred exactly from the IF of an input sentence, e.g. English sentence. The basic architecture of the proposed Arabic generation system is shown in Figure 1. It involves two main components a mapper for converting intelingua representation into an Arabic sentence structure (feature-structure representation) and a generator for generating the target Arabic sentence. 3.1

Preprocessor

ontology

Feature Structure

Arabic Morphology Rules

Morphological Generator

Arabic Grammar Rules

Sentence Generator

Arabic Lexicon

Arabic

Figure 1. Architecture of the generation component

The Mapper

x

The Arabic mapper module produces feature structure (FS) for Arabic from IF representation, using ontology, a set of mapping rules, and a mapping lexicon (Shaalan et al., 2006b). To explain how the mapper maps the input IF into a feature structure, we provide an illustrative example in Figure 2. The mapping process involves three main stages: x Preprocessing. It is mainly based on the domain ontology and performs three tasks: transforms an IF representation into a prolog term, associates the arguments to their concepts, and checks the IF for correctness.

139

Structure Mapping. Determining the syntactic structure. It performs two tasks: o Use the Speech Act to determine the sentence mood. There are four sentence moods that can be derived from the IF representation: statement, command (imperative), interrogative (question), and fragment (word or phrase) o Use the sentence mood and the rest of the IF to: ƒ Group the words to construct the constituents.

There are five constituents that: coordinates sentences, occurs as subject, occurs as verb, occurs as interrogative, and occurs as complement of a sentence. The latter cover syntactic forms that come after a verb such as object and quasi-sentence. ƒ Order the constituents to form the syntactic structure of the Arabic sentence. The structural mapping rules follow the transformation grammar formalism to order the recognized constituents and construct the Arabic FS that reflects the syntactic structure of the target Arabic sentence. They are processed in order and use the pattern shown in Table 1 to construct the Arabic FS. The sequence of the feature-value pairs in the FS corresponds to the syntactic structure that will be used to generate the Arabic sentence. 3.2

I'm planning a vacation this summer in Egypt c:give-information+plan+trip(who=i, visit-spec=(identifiability=no,vacation, time=(season=(identifiability=non-distant, summer)),location=name-egypt))

['c:',['give-information',[]],['+plan',[]], ['+trip',['who=',i, 'visit-spec=',[vacation, 'identifiability=',no,'location=',name-egypt, 'time=',['season=',[summer,'identifiability=', 'non-distant']]]]]]

['c:',['give-information',[]], [map_concept('+plan','',verb),[]], ['+trip',['who=',map_value(i,pronoun,''), 'visit-spec=',[map_value(vacation, noun,''), 'identifiability=',no,'location=', map_value(name-egypt,noun,' '), 'time=', ['season=',[map_value(summer,noun,'  '), 'identifiability=', map_value('non-distant',noun, )]]]]]]

[speaker: 'c:', sentence_mood: statement, subject: ['who=',map_value(i,pronoun,'')], verb: [map_concept('+plan','',verb)], complement: ['visit-spec=',map_value(vacation,noun,''), 'identifiability=',no,'location=', map_value(nameegypt,noun,' '),'season=', map_value(summer,noun,'  '), 'identifiability=', map_value('non-distant',noun, )]

The Arabic Generator

The Arabic generator produces the target Arabic sentence, using an Arabic lexicon, Arabic morphological generator and Arabic syntactic generator. The lexicon stores the Arabic lexical knowledge for nouns, verbs, and particles. The Arabic morphological generator is relatively new and has been published elsewhere (shaalan et al., 2006a). Syntactic generation rules encode the rules for constructing grammatically correct Arabic sentences. They can be classified into rules that are responsible for: x ensuring agreements between constituents such as verb-subject, noun-adjective, demonstrated noun-substitute, and numbercounted noun, x Handling the end case of dual and plural forms according to the case markings, and x Inserting missing fragments for producing the target Arabic surface structure in its right form such as prepositions. In the following, we will present an example of each of these categories.

]

Figure 2. An illustrative example of mapping an IF to feature structure for a statement

Table 1 Syntactic structure of the target Arabic sentence Sentence Mood statement

Syntactic structure [Coord] S V C [Coord] V C [Coord] S V1 V2 C [Coord] NP C

command question

fragment

140

[Coord] V S C [Coord] Q V S C [Coord] Q V S [Coord] Q V C [Coord] Q C [Coord] C

Example of Target Arabic sentence ‫ﺃﻧﺎ ﺃﺭﻏﺐ ﻓﻲ ﺣﺠﺰ ﻏﺮﻓﺔ‬ ‫ﻳﻮﺟﺪ ﻓﻘﻂ ﻏﺮﻑ ﻣﺰﺩﻭﺟﺔ ﻓﻲ ﺍﻷﺳﺒﻮﻉ‬ ‫ﺍﻟﺜﺎﻧﻲ ﻋﺸﺮ‬ ‫ﻧﺤﻦ ﻧﺮﻏﺐ ﻓﻲ ﺃﻥ ﻧﺴﺒﺢ ﻓﻲ ﺍﻟﻔﻨﺪﻕ‬ ‫ﺃﺟﺎﺯﺗﻲ ﻣﻦ ﺍﻟﻌﺎﺷﺮ ﻣﻦ ﻳﻮﻟﻴﻮ ﺇﻟﻲ ﺍﻟﺜﺎﻧﻲ‬ ‫ﻋﺸﺮ ﻣﻦ ﺃﻏﺴﻄﺲ‬ ‫ﺃﺣﺠﺰ ﻟﻨﺎ ﺃﺭﺑﻊ ﻏﺮﻑ ﻣﻦ ﻓﻀﻠﻚ‬ ‫ﻫﻞ ﺗﻘﺒﻞ ﺷﻴﻜﺎﺕ ﺳﻴﺎﺣﻴﺔ ؟‬ ‫ﻣﺎﺫﺍ ﺃﻛﻠﺖ ؟‬ ‫ﻫﻞ ﺃﺳﺘﻄﻴﻊ ﺗﺄﺟﻴﻞ ﺣﺠﺰ ﺍﻟﺒﺮﻧﺎﻣﺞ؟‬ ‫ﺃﻳﻦ ﺍﻟﻔﻨﺪﻕ ؟‬ ‫ﻓﻲ ﺍﻟﻔﻨﺪﻕ‬

Rules for verb-subject agreement. In Arabic, verb and subject agree in number and gender. Table 2 shows examples of applying verb-subject agreement. These examples show that in case of a statement the subject is usually a first person nominative pronoun. While, in case of an interrogative the subject is usually a second person nominative pronoun.

Rules for filling missing prepositions. Prepositions are heuristically generated according to certain verbs, nouns, or arguments. For example, the argument for-whom= generates the preposition ‘‫’ﻝ‬ (for) and the argument pair origin= and destination= generates both the prepositions ‘‫( ’ﻣﻦ‬from) and ‘‫( ’ﺇﻟﻲ‬to), respectively. Table 4 shows examples of prepositions generated by certain pair of arguments. The Arabic syntactic generator is responsible for producing grammatical correct Arabic sentence. It recursively iterates over the current FS and applies the sentence generation rules to generate the target sentence structure.

Table 2. Examples of verb-subject agreement Verb ‫ﻭﺻﻞ‬ ‫ﻭﺟﺪ‬ ‫ﺃﺭﻏﺐ‬ ‫ﺃﻧﻮﻱ‬ ‫ﺃﺳﺘﻄﻴﻊ ﺃﻥ ﺃﻣﺸﻲ‬ ‫ﺳﺄﺻﻞ‬ ‫ﺳﺄﺣﺘﺎﺟﻬﺎ‬ ‫ﺳﺄﺣﺎﻭﻝ ﺃﻥ ﺃﺭﺳﻞ‬

Tense Perfect Perfect Imperfect Imperfect Imperfect imperfect Future Future Future imperfect

Subject ‫ﻧﺤﻦ‬ ‫ﺃﻧﺎ‬ ‫ﺃﺳﺮﺗﻲ ﻭﺃﻧﺎ‬ ‫ﺃﻧﺖ‬ ‫ﺃﻧﺖ‬

Agreement ‫ﻭﺻﻠﻨﺎ‬ ‫ﻭﺟﺪﺕ‬ ‫ﻧﺮﻏﺐ‬ ‫ﺗﻨﻮﻱ‬ ‫ﺗﺴﺘﻄﻴﻊ ﺃﻥ ﺗﻤﺸﻲ‬

‫ﺃﻧﺎ ﻭﺯﻭﺟﺘﻲ‬ ‫ﻧﺤﻦ‬ ‫ﻧﺤﻦ‬

‫ﺳﻨﺼﻞ‬ ‫ﺳﻨﺤﺘﺎﺟﻬﺎ‬ ‫ﺳﻨﺤﺎﻭﻝ ﺃﻥ ﻧﺮﺳﻞ‬

4 Issues and Problems The following discusses major problems encountered during the syntactic generation of Arabic text, and presents how we have handled them.

Rules for handling duals forms. In the specification of IF, the argument quantity= indicates a number feature and its value determines the number (dual or plural) of the target inflected Arabic word. This information can only be used to generate the dual or plural in nominative case (e.g. ‘‫—’ﻟﻴﻠﺘﺎﻥ‬two nights). The final generation of either dual or sound plural forms requires that their case markings are known. This can only be handled during the syntactic generation of the Arabic sentence. Examples of synthesizing the final dual forms are shown in Table 3.

4.1

In order to comply with Arabic grammar rules, our Arabic generator overrides the specification of the negated past tense verb in the interlingua with a present tense form that is preceded by (“the apocopative particle Lam— ‘‫)’ﺣﺮﻑ ﺍﻟﺠﺰﻡ ﻟﻢ‬. In Arabic, this particle is used for negating a present tense verb form and turns it to indicate the negated past form. For example: I did not understand the last sentence c:give-information+negation+understand +information-object(e-time=previous, polarity=negative, …)  9C #D # 

Table 3 Examples of synthesizing dual forms Noun ‫ﺑﺮﻧﺎﻣﺞ ﺻﻴﻔﻲ‬ ‫ﻏﺮﻓﺔ ﻣﺰﺩﻭﺟﺔ‬ ‫ﺷﺨﺺ‬ ‫ﺃﺳﺒﻮﻉ‬ ‫ﻃﻔﻞ‬ ‫ﻣﺮﺓ‬ ‫ﺷﻬﺮ‬ ‫ﺳﺮﻳﺮ ﻣﺰﺩﻭﺝ‬

Case Nominative Accusative/Genitive Accusative/Genitive Accusative/Genitive Nominative Accusative/Genitive Accusative/Genitive Accusative/Genitive

Dual ‫ﺑﺮﻧﺎﻣﺠﺎﻥ ﺻﻴﻔﻴﺎﻥ‬ ‫ﻏﺮﻓﺘﻴﻦ ﻣﺰﺩﻭﺟﺘﻴﻦ‬ ‫ﺷﺨﺼﻴﻦ‬ ‫ﺃﺳﺒﻮﻋﻴﻦ‬ ‫ﻃﻔﻼﻥ‬ ‫ﻣﺮﺗﻴﻦ‬ ‫ﺷﻬﺮﻳﻦ‬ ‫ﺳﺮﻳﺮﻳﻦ ﻣﺰﺩﻭﺟﻴﻦ‬

4.2

Second Arg. location= object-topic= specifier= destination= month= location= destination=

Prep.  ;<  @ +; + ;+@

Effect of Argument-subargument Mapping and Generation

in

In general, the value of arguments in IF is mapped into Arabic lexemes. However, there are some values that their mapping depend on their arguments to resolve lexical ambiguity. Moreover, there are certain argument-subargument combinations that map to implicit values. Our Arabic generator applies special handling for these cases during mapping and generation. For example, the following input interlingua, the “age=(quantity=8)” is mapped by our system into three values “age, 8, and year”. The former is an implicit value and the latter is a missed value indicating the counted

Table 4. Examples of prepositions generated by certain pair of arguments First Arg. attraction-spec= info-object= location= address= md= month= origin=

Tense of Verb in Negation

Position of Prep. Bet. args Bet. args Before args Before args Before each arg Before each arg Before each arg

141

name of the given number. Additionally, another further handling is done during the Arabic syntactic generation to add the third person pronoun suffix to the implicit value “age”. Ultimately, our system will produce “‫ ”ﺃﺑﻨﻲ ﻋﻤﺮﻩ ﺛﻤﺎﻧﻲ ﺳﻨﻮﺍﺕ‬rather than “‫”ﺃﺑﻨﻲ ﺛﻤﺎﻧﻴﺔ‬. For example:

indicate correct or wrong, under each evaluation criterion: both syntactically and semantically correct, semantically correct, and syntactically correct. The summary of this evaluation results is shown in Table 5. The first column shows the evaluation criteria involved. The second and third columns show the results of the human judgments of the machine translation (system output).

My son is eight c:give-information+personal-data (experiencer= (offspring,sex=male,whose=i), age=(quantity=8)) /KL" 9N O9< LQ

4.3

Table 5. Summary of human evaluation results Correct Incorrect Total % Total % syntactically & 266 89 34 11 semantically semantically 267 89 33 11 Syntactically 285 95 15 5

Filling Missing Prepositions

Using IF as intermediate representation in a multilingual machine translation led to dropping language specific details for constructing the target surface structure. In our system, we have handled this by heuristic rules that insert the missing fragments. The important missing fragments are prepositions. For example, the following IF generates a sentence that requires five prepositions in order to get the target Arabic sentence. It shows a verb that is followed by a preposition, a date range specified by two prepositions, and a start-date and end-date expressions specified by two prepositions. For example:

We analyzed the incorrect system output marked by English-to-Arabic translator specialist and observed the following classifications: x Errors in morphological generation. Table 6 shows these erroneous sentences. They are all due to generating a separate pronoun instead of generating a suffix pronoun connected to a particle. This error is not solved in the current system. However, the solution is simple and could be done by adding a morphological rule that handles this case.

I’m looking for a tour from November twelfth to December twelfth. c: give-information+search+tour (who=i, tour-spec=(tour,identifiability=no,time= (start-time=(md=12,month=11),end-time= (md=12, month=12)))) X @  9K ; Y< X ; 7" K ;< VWQ   98Z% ; Y<

Table 6. Errors in morphological generation of a suffix pronoun 1.

But I'll try ‫ﻟﻜﻨﻨﻲ ﺳﺄﺣﺎﻭﻝ‬ ‫ﻟﻜﻦ ﺃﻧﺎ ﺳﺄﺣﺎﻭﻝ‬

2.

But I'm sure

3.

‫ﻟﻜﻨﻨﻲ ﻣﺘﺄﻛﺪ‬ ‫ﻟﻜﻦ ﺃﻧﺎ ﻣﺘﺄﻛﺪ‬ But I think there is a problem ‫ﻟﻜﻨﻨﻲ ﺃﻇﻦ ﺃﻧﻪ ﻳﻮﺟﺪ ﻣﺸﻜﻠﺔ‬ ‫ﻟﻜﻦ ﺃﻧﺎ ﺃﻇﻦ ﺃﻧﻪ ﻳﻮﺟﺪ ﻣﺸﻜﻠﺔ‬

5 Evaluation A set of real 300 SDUs with their corresponding interlingua representations has been used as a test set. This set is randomly chosen from the NESPOLE! Travel & Tourism database that was provided by Carnegie Mellon University (CMU). The interlingua representations of the English source translation set is fed into the IF-to-Arabic generator to produce their Arabic translations. The output is evaluated by a human evaluation method. In the human evaluation, an English-to-Arabic translator specialist was involved in making judgments on the translated Arabic sentences. We gave him a form that contains 300 items. Each of which consists of a sentence from the English source set followed by its system output translation. Then, we asked the evaluator to put a tick, to subjectively

x

x

142

Source translation Correct translation System output Source translation Correct translation System output Source translation Correct translation System output

Errors in word sense. Table 7 shows examples of these semantically incorrect sentences. They are all due to variations in word senses. These errors are difficult to solve because the semantic value in the IF that were produced by the English-to-interlingua analyzer does not capture the same meaning of the source English sentence. Errors in verb-subject agreement. Table 8 shows examples of these erroneous sentences. They are all due to errors in verb-subject agreement. In particular, when the subject is

feminine the masculine verb prefix form "‫"ﻳـ‬ (Yeh) is generated instead of the feminine prefix form "‫( "ﺗـ‬Teh). However, the solution is simple and could be done by adding such an agreement rule that handles this case.

implemented using MORPHE (Leavitt, 1994) and Genkit (Tomita and Nyberg, 1988) tools that compile the morphological and grammatical rules into morphological and sentence generator programs, respectively. The problems with these tools are that they are not easily adaptable to generate the proper Arabic script and syntax. That is why the generator has dealt with restricted forms of Arabic verbs and nouns. Waible et al. (2003) described a prototype for a two-way speech-to-speech translation system that runs on a conventional PDA computer. It can translate from English to Arabic and Arabic to English in the medical domain. The system is limited in order to do speech processing on PDA platform. The interlingua-to-Arabic generator was supposed to be implemented using the advantage of the interlingua approach, but due to network overhead, a statistical-based machine translation mechanism is used.

Table 7. Errors in word sense. 1.

We are planning to get around by car c:give-information+ disposition+trip (disposition= (intention, who=we), locomotion=car) ‫ﻧﺤﻦ ﻧﺨﻄﻂ ﻟﻠﺤﺼﻮﻝ ﻋﻠﻰ ﺳﻴﺎﺭﺓ‬ ‫ﻧﺤﻦ ﻧﻨﻮﻯ ﻋﻠﻰ ﺗﺄﺟﻴﺮ ﺳﻴﺎﺭﺓ‬ There is everything you need a:give-information+existence +object (object-spec= (everything, modifier= necessary)) ‫ﻳﻮﺟﺪ ﻛﻞ ﺷﻴﺊ ﺗﺤﺘﺎﺟﻪ‬ ‫ﻳﻮﺟﺪ ﻛﻞ ﺷﻴﺊ ﺿﺮﻭﺭﻱ‬ and there is two people c: give-information+party (conjunction=discourse, how-many=2) ‫ﻭ ﺷﺨﺼﺎﻥ‬ ‫ﻭ ﻋﺪﺩﻧﺎ ﺃﺛﻨﺎﻥ‬

2.

3.

Source translation Interligua representation

Correct translation System output Source translation Correct translation

Interligua representation System output Source translation Interligua representation

7 Conclusions and Future Work Correct translation System output

In this paper, we described the development of a novel Arabic generator. The Arabic generator follows the rule-based grammar approach. We have discussed the problems encountered in the generation of Arabic text from the interlingua representation used in NESPOLE! For these problems we have described how we handled them. The paper shows how relatively easy it is to add a new language into an interlingua MT project. A set of real 300 SDUs with their corresponding interlingua representations has been used for evaluating the approach and the correctness of the Arabic generator. The system output is evaluated by a human evaluation method. The evaluation shows 89% of the system output was “syntactically and semantically” correct, 89% of the system output was “semantically” correct, and 95% of the system output was “syntactically” correct. The problems found were classified, explained, and possible suggestions for solutions were presented. As Arabic has received very little computational research and in particular, on the level of deep semantic or interlingua, we believe that our contribution might encourage some computational linguistics and researchers to put more efforts in this complex area of natural language generation. Future work will include integrating the Arabic generator with the Carnegie Mellon University (CMU)’s English analyzer in order to automate the

Table 8. Errors in verb-subject agreement of feminine subject. 1.

2.

3.

There are many castles. ‫ﺗﻮﺟﺪ ﻗﻼﻉ ﻛﺜﻴﺮﺓ‬ ‫ﻳﻮﺟﺪ ﻗﻼﻉ ﻛﺜﻴﺮﺓ‬ Are there good places for seven persons? ‫ﻫﻞ ﺗﻮﺟﺪ ﺃﻣﺎﻛﻦ ﺟﻴﺪﺓ ﻟﺴﺒﻌﺔ ﺃﺷﺨﺎﺹ؟‬ ‫ﻫﻞ ﻳﻮﺟﺪ ﺃﻣﺎﻛﻦ ﺟﻴﺪﺓ ﻟﺴﺒﻌﺔ ﺃﺷﺨﺎﺹ؟‬ In august we have both single rooms and double rooms available. ‫ﺗﺘﻮﻓﺮ ﻋﻨﺪﻧﺎ ﻏﺮﻑ ﻣﻔﺮﺩﺓ ﻭﻏﺮﻑ‬ ‫ﻣﺰﺩﻭﺟﺔ ﻓﻲ ﺃﻏﺴﻄﺲ‬ ‫ﻳﺘﻮﻓﺮ ﻋﻨﺪﻧﺎ ﻏﺮﻑ ﻣﻔﺮﺩﺓ ﻭﻏﺮﻑ‬ ‫ﻣﺰﺩﻭﺟﺔ ﻓﻲ ﺃﻏﺴﻄﺲ‬

Source translation Correct translation System output Source translation Correct translation System output Source translation

Correct translation System output

6 Related Work Research on translations of Arabic using the interlingua approach is beginning to emerge. Abul seoud (2005) developed a prototype for transferring an Arabic parse tree, which is obtained from a DCG parser, into KANT-like Interlingua (Mitamura and Nyberg, 1992). A set of structural transformation and mapping rules has been described. Cavalli-Sforza et al. (2000) and Soudi et al. (2002) developed a template-based Arabic realizer which is based on KANT (Mitamura and Nyberg, 1992). It focused on the problems related to the Arabic morphology generation. The Arabic generator is

143

organised by the British Computer Society, 23 October, London, UK. Lori Levin, Alon Lavie, Monika Woszczyna, Donna Gates,Marsal Gavalda, Detlef Koll, and Alex Waibel. 2000. The Janus III Translation System: Speech-toSpeech Translation in Multiple Domains, Machine Translation, 15(1-2), PP. 3-25.

translation of spoken English into Arabic. Moreover, this integration will be extended to include the other languages supported by NESPOLE! Another interesting challenge would be to enhance the Arabic generator by automating the diacritization or vowelization of the generated Arabic sentence. This is particularly critical for Arabic Text-toSpeech (TTS) system where an Arabic TTS system might mispronounce one word due to incorrect vowelizations.

Lori Levin, Donna Gates, Dorcas Wallace, Kay Peterson, Emanuele Pianta, and Nadia Mana. 2003. The NESPOLE! Interchange Format, Project Deliverable D13. Masaru Tomita and Eric H. Nyberg 1988. Generation Kit and Transformation Kit, Version 3.2, User's, Manual, Technical Report, Carnegie Mellon-Center for Machine Translation.

References Abdelhadi Soudi,, Violetta Cavalli-Sforza, and Abderrahim Jamari, A. 2002. A Prototype Englishto-Arabic Interlingua-based MT System, In the Proceedings of the Workshop on Arabic Language Resources and Evaluation - Status and Prospects, The 3rd International Conference on Language Resources and Evaluation (LREC 2002), Las Palmas de Gran Canaria, Spain.

Rania Abul seoud. 2005. Generating Interlingua from Arabic Parsing Tree, M. Sc., Faculty of Engineering, Cairo University, Egypt. Teruko Mitamura and Eric Nyberg. 1992. Hierarchical Lexical Structure and Interpretive Mapping in Machine Translation, In the Proceedings of COLING92.

Abdusalam F.A. Nwesri, S.M.M.Tahaghoghi, and Falk Scholer. 2005. String Processing and Information Retrieval: 12th International Conference, SPIRE 2005, Buenos Aires, Argentina, LNCS, Springer Berlin / Heidelberg, PP. 206 – 217.

Violetta Cavalli-Sforza, Abdelhadi Soudi, and Teruko Mitamura, 2000. Arabic Morphology Generation Using a Concatenative Strategy, In the Proceedings of the 1st Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL 2000), Seattle, PP. 86-93.

Alex Waibel , Ahmed Badran, Alan W Black , Robert Frederking, Donna Gates, Alon Lavie, Lori Levin, Kevin Lenzo, Laura Mayfield Tomokiyo, Jürgen Reichert, Tanja Schultz, Dorcas Wallace, Monika Woszczyna, Jing Zhang. 2003. Speechalator:two-way speech-to-speech translation on a consumer PDA, In the Proceedings of EUROSPEECH 2003, GENEVA. PP.369-372. Florian Metze, John McDonough, Hagen Soltau, Alon Lavie, Lori Levin, Chad Langley, Tanja Schultz, Alex Waibel, Roldano Cattoni, Gianni Lazzari, Nadia Mana, Fabio Pianesi, and Emanuelle Pianta. 2002. Enhancing the Usability and Performance of NESPOLE! - a Real-World Speech-to-Speech Translation System. In Proceedings of HLT-2002 Human Language Technology Conference, San Diego, CA. John R. Leavitt. 1994. MORPHE: A Morphological Rule Compiler. Technical Report, CMU-CMT-94MEMO. Khaeld Shaalan, Azza Abdel Monem, Ahmed Rafea. 2006a, Arabic Morphological Generation from Interlingua, 4th International Conference on Intelligent Information Processing (ICIIP), 20-23 September, Adelaide Australia. Khaled Shaalan, Azza Abdel Monem, Ahmed Rafea, Hoda Baraka 2006b. Mapping Interlingua Representations to Feature Structures of Arabic Sentences, The Challenge of Arabic for NLP/MT Conference,

144

Generating Arabic Text from Interlingua - Semantic Scholar

intention rather than literal meaning. The IF is a task-based representation ..... In order to comply with Arabic grammar rules, our. Arabic generator overrides the ...

129KB Sizes 1 Downloads 322 Views

Recommend Documents

Generating Arabic Text from Interlingua - Semantic Scholar
Computer Science Dept.,. Faculty of ... will be automated computer translation of spoken. English into .... such as verb-subject, noun-adjective, dem- onstrated ...

Extracting Collocations from Text Corpora - Semantic Scholar
1992) used word collocations as features to auto- matically discover similar nouns of a ..... training 0.07, work 0.07, standard 0.06, ban 0.06, restriction 0.06, ...

Generating Semantic Graphs from Image ...
semantic parser generates a unique semantic graph. G representing the descriptions of .... pseudo-code 1, shows that if Gcomb is empty then Gnext,. i.e. the next ...

Improved Video Categorization from Text Metadata ... - Semantic Scholar
Jul 28, 2011 - mance improves when we add features from a noisy data source, the viewers' comments. We analyse the results and suggest reasons for why ...

A Proposed Approach for Generating Arabic from ...
(ana arghabu fi hagzi ghurfatun fardiyah). A major problem ... allows for a flexible integration of software modules for languages that differ in their realization of ...

METER: MEasuring TExt Reuse - Semantic Scholar
Department of Computer Science. University of ... them verbatim or with varying degrees of mod- ification. ... fined °700 and banned for two years yes- terday.

Syntactic Generation of Arabic in Interlingua-based ...
Faculty of Computer & Information Sciences Ain ... Computer Science Dept., American University in. Cairo, Egypt ..... Dissertation, University of Manchester, UK.

Generating Sentences from Semantic Vector Space ...
We depart from this formulation by learning a joint synthesis-decomposition function that is capable of generating ... hidden vector hn ∈ Rd of the same dimension as the word vectors. Unlike in constituency. 1Recently .... issues for less common re

Arabic Named Entity Recognition from Diverse Text ... - Springer Link
NER system is a significant tool in NLP research since it allows identification of ... For training and testing purposes, we have compiled corpora containing texts which ... 2 Treebank Corpus reference: http://www.ircs.upenn.edu/arabic/.

Learning Articulation from Cepstral Coefficients - Semantic Scholar
Parallel and Distributed Processing Laboratory, Department of Applied Informatics,. University ... training set), namely the fsew0 speaker data from the MOCHA.

Learning Articulation from Cepstral Coefficients - Semantic Scholar
2-3cm posterior from the tongue blade sensor), and soft palate. Two channels for every sensor ... (ν−SVR), Principal Component Analysis (PCA) and Indepen-.

TEXTLINE INFORMATION EXTRACTION FROM ... - Semantic Scholar
Camera-Captured Document Image Segmentation. 1. INTRODUCTION. Digital cameras are low priced, portable, long-ranged and non-contact imaging devices as compared to scanners. These features make cameras suitable for versatile OCR related ap- plications

Learning from weak representations using ... - Semantic Scholar
how to define a good optimization argument, and the problem, like clustering, is an ... function space F · G. This search is often intractable, leading to high .... Linear projections- Learning a linear projection A is equivalent to learning a low r

INFERRING LEARNERS' KNOWLEDGE FROM ... - Semantic Scholar
In Experiment 1, we validate the model by directly comparing its inferences to participants' stated beliefs. ...... Journal of Statistical Software, 25(14), 1–14. Razzaq, L., Feng, M., ... Learning analytics via sparse factor analysis. In Personali

TEXTLINE INFORMATION EXTRACTION FROM ... - Semantic Scholar
because of the assumption that more characters lie on baseline than on x-line. After each deformation iter- ation, the distances between each pair of snakes are adjusted and made equal to average distance. Based on the above defined features of snake

Affective Modeling from Multichannel Physiology - Semantic Scholar
1 School of Electrical and Information Engineering, University of Sydney, Australia ..... Andre, E.: Emotion Recognition Based on Physiological Changes in Music.

No Negative Semantic Priming From Unconscious ... - Semantic Scholar
Libre de Bruxelles, Brussels, Belgium, and National Fund for Scientific. Research–Belgium ..... ripheral energy masking, whereas both meanings of the polysemous prime words ... This alternative interpretation is more consonant with Tipper's.

Persistent structural priming from language ... - Semantic Scholar
b NTT Communication Science Laboratories, 2-4 Hikari-dai, Seika-cho, ... c Department of Psychology, McGill University, Montreal, Quebec, Canada, H3A 1B1.

Mutation Rate Inferred From Synonymous ... - Semantic Scholar
Aug 1, 2011 - 1999). Both methods have limitations. The former requires knowledge of the ... Supporting information is available online at http://www.g3journal.org/lookup/ · suppl/doi:10.1534/g3.111.000406/-/DC1 .... mated point-mutation rates for th

INFERRING LEARNERS' KNOWLEDGE FROM ... - Semantic Scholar
We use a variation of inverse reinforcement learning to infer these beliefs. ...... Twenty-Second International Joint Conference on Artificial Intelligence (IJCAI) (p.

Extracting Protein-Protein Interactions from ... - Semantic Scholar
Existing statistical approaches to this problem include sliding-window methods (Bakiri and Dietterich, 2002), hidden Markov models (Rabiner, 1989), maximum ..... MAP estimation methods investigated in speech recognition experiments (Iyer et al.,. 199

Tree detection from aerial imagery - Semantic Scholar
Nov 6, 2009 - automatic model and training data selection to minimize the manual work and .... of ground-truth tree masks, we introduce methods for auto-.