A probabilistic approach to language structure Annarita Felici and Paul Pal Royal Holloway, University of London Helsinki 2 -4 June 2008 A. Felici@rhul. ac. uk 2 -4 June 2008 P. Pal@rhul. ac. uk QITL 3
Outline Field of investigation Research goals Data Probabilistic analysis Information Theory Entropy results 2 -4 June 2008 QITL 3
Field of investigation Repetitive language structure in multilingual legal text EU normative statements in translation Languages of investigation Ø English, French, German and Italian 2 -4 June 2008 QITL 3
Field of investigation: legal norms Ø Deontic norms (from the Greek deon = duty). obligations, prohibitions, permissions and authorizations Ø Constitutive performatives The uttering of a performative is, or is part of, the doing of a certain kind of action or speech acts (Austin 1962) Uttering a sentence = doing things 2 -4 June 2008 QITL 3
Other norm types Ø Logical necessity necessary requirements or competences Ø Non-binding norms guidelines, correct procedure 2 -4 June 2008 QITL 3
Research goals 1. To evaluate the degree of prescriptive standardization in French, German and Italian with reference to English 2. To predict translation equivalents in French, German and Italian 2 -4 June 2008 QITL 3
under the conditions that: English legal drafting is highly standardized The EU and the main English drafting suggest modal verbs for prescriptive norms (Coode 1843, Driedger 1976, Dickerson 1975, Thornton 1996) Text types under investigation are repetitive and reusable Text types under investigation can be more or less binding 2 -4 June 2008 QITL 3
Data Multilingual parallel corpus Origin: Corpus size: Text type: Type of docs: EU 1. 404. 723 words normative Secondary Legislation (Regulations, Decisions, Directives, Recommendations) 2001 -04 Languages: English, French, German, Italian Years: 2 -4 June 2008 QITL 3
Probabilistic Analysis Information Theory To measure the amount of linguistic alternatives when translating a repetitive normative statement from English into French, German and Italian = Quantifying information by reducing uncertainty ü more alternatives = more uncertainty (high entropy) ü less alternatives = more standardization, certainty (low entropy) 2 -4 June 2008 QITL 3
Probabilistic Variables Categories of expressions Linguistic forms English modals Entry point for parallel retrieval shall, must, may, can, should 2 -4 June 2008 QITL 3
Categories of expression Constitutive norms and performatives Logical necessity Permissions and authorizations Capability Non-binding norms 2 -4 June 2008 QITL 3
Linguistic forms Indicative (pres. ) Modal verbs (mv) Verbal periphrasis (vp) Lexicalized modal expressions (le) Ellipses (0 - correspondence) 2 -4 June 2008 QITL 3
Linguistic forms Linguistic equivalents used in constitutive and performative norms 2 -4 June 2008 QITL 3
Linguistic forms Linguistic equivalents used to convey permissions and authorizations 2 -4 June 2008 QITL 3
Given the English system of modality, which is the relative probability of choosing an equivalent modal verb in the translation of may or must and a different linguistic form as the equivalent of shall? Is the probability of a choice in a system affected by a choice in another? 2 -4 June 2008 QITL 3
Information Theory the information value or content h(p) is dependent on the probability of occurrence (p) of an event (Shannon 1949) h(p) = - log (p) = log (1/p) Entropy degree of uncertainty (= shortage of information due to the large number of alternatives) 2 -4 June 2008 QITL 3
Probabilistic analysis The frequency of occurrence (ni) of each linguistic form is associated with a category A probability variable (pi) is derived from the estimated proportion of a particular linguistic form 2 -4 June 2008 QITL 3
Probabilistic analysis âIn English P 1 = p mv→ shall = n shall / n; p 2 = pmv → must = nmust / n; p 3 = pmv →should = nshould / n; p 4 = pmv → can = ncan / n; p 5 = pmv → may = nmay / n âIn French, German and Italian p 1 = pindicative + pmv + pvp + pme + pellipses; p 2 = pindicative + pmv + pvp + pme + pellipses and so on. 2 -4 June 2008 QITL 3
Linguistic forms and frequencies of occurrences in the EU Regulation for the selected categories of 1) constitutive norms and 2) permissions and authorization 2 -4 June 2008 QITL 3
Probabilistic approach The sum of these probabilities produces different information values The expected information content of a system is the sum of the information contents weighted by the probabilities for each possible outcome 2 -4 June 2008 QITL 3
Entropy : extrema Variations in the language-specific p(i) values of linguistic forms produce distribution profiles reflecting the characteristics of the corresponding language. Mathematically it can be shown that If all the p(i) values are equal (equi-probable situation), the profile is a uniform distribution and results in maximum entropy. If only one probability p(i) is maximum and the remaining p(i) values are zero, the entropy is minimum (e. g. English). All other distributions lie between these two limits (e. g. French, German and Italian) 2 -4 June 2008 QITL 3
A concrete example Regulation document in English, French, German and Italian + a fictitious language. One category of expression: e. g. the constitutive norms. 5 linguistic forms for this category. Total number of modal verbs and alternatives: 2075. 2 -4 June 2008 QITL 3
Constitutive norm Frequency of occurrences of expression modes in 4 real languages and one fictitious language English French German Italian Fictitious mv 1382 58 94 81 276 ind 0 1223 1125 1192 276 vp 0 8 71 6 276 me 0 43 46 51 276 el 0 50 46 52 276 2 -4 June 2008 QITL 3
Histogram of 5 modes of expression 2 -4 June 2008 QITL 3
Comparison based on Entropy Computed Entropy of Constitutive norm EN FR GE IT FI 2 -4 June 2008 H H H = 0 + Hmv + 0 + = Hind + Hmv + Hvp QITL 3 0 + + Hme Hme + + = 0. 405 Hme =0. 857 Hme =1. 08 Hme =0. 88 Hme =2. 32
Computed Entropy of constitutive norms (English, French, German, Italian and Fictitious) 2 -4 June 2008 QITL 3
Entropy results 1. In the EU Regulation according to the 5 categories of expression (1. Constitutive and performative norms, 2. Logical necessity, 3. Permissions and authorizations, 4. Capability, 5. Non-binding norms) 2. In the EU Secondary Legislation overall according to the 4 types of documents (Regulations, Decisions, Directives, Recommendations) 2 -4 June 2008 QITL 3
Entropy in the EU Regulation 2 -4 June 2008 QITL 3
Entropy results EU Regulation Logical necessity, permissions and authorizations and capability (< entropy) Ø quite standardized in the 4 languages = almost equivalent translations Constitutive performative norms (> entropy) Ø translation is more difficult to predict Ø Definitions, const. statements, obligations Ø FR: < entropy than IT Ø DE: > entropy (VP sein/haben…zu) 2 -4 June 2008 QITL 3
Entropy results EU Regulation Non -binding norms Ø fairly amount of variation among the 4 languages Ø FR/IT: >entropy Ø DE: < entropy (should is most likely translated with sollen- Soll-Vorschriften) 2 -4 June 2008 QITL 3
Entropy overall the 4 EU documents 2 -4 June 2008 QITL 3
Entropy results EU Secondary Legislation Regulations and Decisions (< entropy) Ø Direct applicability of the norms = more precision and standardization Ø FR looks more standardized than IT and DE Directives (> entropy than Reg. and Dec. ) Ø Binding only as to the result to be achieved Recommendations (> entropy) Ø Not-binding: more freedom Ø DE : sollen 2 -4 June 2008 QITL 3
Conclusions Given certain conditions, it is possible to predict with some certainty the occurrence of a particular factor If applied to repetitive texts, entropy analysis can enhance research in langauge testing, evaluation and in the development of automated translation’s tools 2 -4 June 2008 QITL 3
References Austin, J. L. 1962. How to do things with words. Oxford: Oxford University Press. Coode, G. 1843. Legislative Expressions. Appendix to the Report of the Poor Law Commissioners on Local Taxation. Published separately 1845, 2 nd Ed. 1852. Driedger, E. A. 1976. The Composition of legislation. Legislative forms and precedents (2 nd Ed. ). Ottawa: The Department of Justice Shannon, Cand W. Weaver. 1963 (1949) The mathematical theory of communication. Urbana: University of Illinois Press. USA. Thornton G. C. 1996. Legislative Drafting (4 th Ed. ). Butterworths, London. http: //publications. europa. eu/code/en/en-6000000. htm 2 -4 June 2008 QITL 3
Скачать презентацию A probabilistic approach to language structure Annarita Felici
14af95a79461152fea7f32028b226741.ppt