scieee Open visual document viewer

High Quality Syntactic Annotated Corpus of Lithuanian – VILSINTEKS

Daiva Šveikauskienė

Full text

252 Ac a Linguis ica Li huanica LXXIII DAIVA ŠVEIKAUSKIENĖ Ins i u e o Li huanian Language Fields o esea ch: compu a ional linguis ics, eebanking, laye s o anno a ion. HIGH QUALITY SYNTACTIC ANNOTATED CORPUS OF LITHUANIAN – VILSINTEKS Aukš os kokybės sin aksiškai ano uo as lie u ių kalbos eks ynas VILSINTEKS ANNOTATION This pape p esen s a wo old anno a ion, which is used o he high quali y anno a ion o he Li huanian co pus. Comp ehensi e in o ma ion abou a sen ence is gi en in a able and he syn ac ic s uc u e o a sen ence is p esen ed in a pic u e. The expe ience o o he languages is being used, and speci ic ea u es o he Li huanian language a e aken in o accoun . The insu iciency o he ee- ep esen a ion o he syn ac ic s uc u e o Li hua- nian sen ences is shown h ough he s a is ically anno a ed examples. The goal o he c e- a ion o he anno a ed co pus bea ing exhaus i e in o ma ion is also clea ly emphasized. The examples o he anno a ed sen ences a e gi en, which e lec he speci ic ea u es o he Li huanian language. KEYWORDS: syn ac ic anno a ed co pus; g aph ep esen a ion o he syn ac ic s uc u e; laye s o anno a ion in he Li huanian co pus; insu i- ciency o ee- ep esen a ion o Li huanian sen ences; goal o he syn ac ic anno a ed co pus. ANOTACIJA S aipsnyje ap a iamas d iem lygmenimis a liekamas ano a imas, naudojamas aukš os kokybės ano uo am lie u ių kalbos eks ynui suku i. Išsami in o macija apie sakinį nu o- doma len elėje, o sin aksinė sakinio s uk ū a nub aižoma g a iškai. Naudojamasi ki ų kalbų pa i imi, a siž elgian į speci inius lie u ių kalbos b uožus. Medžio nepakanka- mumas aizduojan lie u ių kalbos sakinių sin aksinę s uk ū ą pa odomas s a is iniu S aipsniai / A icles 253 High Quali y Syn ac ic Anno a ed Co pus o Li huanian – VILSINTEKS me odu ano uo ų sakinių pa yzdžiais. S aipsnyje aip pa aiškiai pab ėžiamas ano uo o eks yno, ku iame bus sukaup a išsami in o macija, kū imo ikslas. Pa eikiami ano uo ų sakinių pa yzdžiai, a spindin ys speci inius lie u ių kalbos b uožus. ESMINIAI ŽODŽIAI: sin aksiškai ano uo as eks ynas, sakinio s uk ū os aizda imas g a u, eks yno ano a imo lygmenys, medžio nepakankamumas aizduojan lie u ių kalbos sakinius, eks yno kū imo ikslas. 1. INTRODUCTION The i s anno a ion o co po a was a pa o speech agging POST [Chu ch 1988: 136]. Such anno a ion is ound in he Penn T eebank. La e , o he sen- ences, ca ying he syn ac ic in o ma ion, we e in oduced. They we e ep e- sen ed by using a ious schemes [A well e al. 2000: 12]. In 2012 Köhle men- ioned he ollowing: “... he e is no gene al s anda d as o how co po a should be s uc u ed and no a ed” [Köhle 2012: 32]. The e o e, he Li huanian co pus VILSINTEKS is anno a ed, bea ing in mind he speci ic ea u es o he Li hua- nian language – a la ge amoun o in lexion and a ee wo d o de in a sen ence. O he wo leading ypes o syn ac ic s uc u e ep esen a ion, which a e he ph ase s uc u e g amma and dependency g amma , he la e was chosen o Li huanian because “...dependency g amma has appealed mos o s uden s o languages wi h ela i ely ee wo d o de …” [Kay, Gaw on and No ig 1994: 55]. The mos common ep esen a ion o he syn ac ic s uc u e is a ee [Allen 1987: 41]. The name o he syn ac ically anno a ed co pus – eebank – is ela ed o his e m. The name o he Li huanian eebank does no con ain he wo d ‘ ee’, because he syn ac ic s uc u e o some Li huanian sen ences is ep esen - ed by a g aph wi h a cycle, ha is, i does no mee he condi ions es ablished by he de ini ion o a ee, as a ee is a connec ed acyclic g aph [Swamy, Thu- lasi aman 1984: 33]. The ac onym VILSINTEKS means VILniaus SIN aksinis TEKS ynas – Vilnius syn ac ic co pus. 2. ANNOTATION OF THE LITHUANIAN CORPUS Recen ly, much has been said and w i en abou he low deg ee o compu - e iza ion o he Li huanian language. Acco ding o he da a o he META-NET DAIVA ŠVEIKAUSKIENĖ 254 Ac a Linguis ica Li huanica LXXIII p ojec , Li huanian belongs o he g oup o he leas compu e ized Eu opean languages [Vaišnienė, Zaba skai ė 2012: 35]. The so wa e c ea ed o o he lan- guages does no p oduce sa is ac o y esul s when i is applied o he Li huani- an language. I is high ime o speak no abou he low compu e iza ion o he Li huanian language bu abou he quali y o i s compu e iza ion. Thus, i is wo h looking back a he Li huanian language and ying o c ea e one’s own so wa e o he compu e iza ion o he Li huanian language so as o p oduce high quali y compu e iza ion o he Li huanian language. The i s endea o s in he syn ac ic anno a ion o he Li huanian co pus we e made in 2013. The syn ac ic anno a ed co pus VILSINTEKS was c ea ed a he Ins i u e o he Li huanian Language in Vilnius. We aim a p o iding as much da a as possible ega ding a sen ence, especially i hey happen o be he da a which a e needed du ing he p ocess o ansla ion. Exhaus i e in o ma- ion is gi en in he P ague Dependency T eebank, which has a h ee-le el an- no a ion [Hajič 2000: 103]. Mo e le els o anno a ion in one pic u e could no FIGURE 1. Example o he syn ac ic s uc u e o he Li huanian sen ence Jie gali bū i ki okie – They can be di e en S aipsniai / A icles 255 High Quali y Syn ac ic Anno a ed Co pus o Li huanian – VILSINTEKS FIGURE 2. S a is ically pa sed sen ence Kas ne izikuoja, as nege ia šampano, be g audžiai i ne e kia (Who does no isk, ha does no d ink champagne bu does no c y ea ully ei he ) [Kapočiū ė, Ni e, K upa ičius 2013: 15] FIGURE 3. S a is ically pa sed sen ence Be š ai p o medį, ku iame sėdėjau, p aslinko didelis šešėlis (Bu he e h ough he ee in which I sa passed a small shadow) [Kapočiū ė, Ni e, K upa ičius 2013: 15] be achie ed so we decided o di ide he ep esen a ion o in o ma ion in o wo pa s when we deal wi h Li huanian sen ences: a able, which con ains he mo - phological, syn ac ic and seman ic in o ma ion, while he syn ac ic s uc u e should be p esen ed in a pic u e. A g aph wi h cycles is used o Li huanian sen ences because a ee is no able o e lec he en i e syn ac ic in o ma ion which he Li huanian sen ence con ains. The p edica i e a ibu e depends on wo pa s o he sen ence: on he subjec o he objec , and on he p edica e. These ela ionships a e exp essed o mally and could no be igno ed ( o mo e de ails, see Š eikauskienė 2005: 412). Figu e 1 shows he syn ac ic s uc u e o a i le sen ence. I con ains a p e- dica i e, which has o mally exp essed ela ionships wi h he subjec and he p edica e, and bo h ela ionships mus be ep esen ed by anno a ing he co pus. DAIVA ŠVEIKAUSKIENĖ 256 Ac a Linguis ica Li huanica LXXIII The p edica i e mus ha e he ending ag eeing wi h he subjec and a he same ime i is adjoined o he p edica e; ha is, i is no an a ibu e o he subjec . The i s a emp s o syn ac ically anno a e he Li huanian co pus demon- s a ed ha he so wa e c a ed o o he languages did no p oduce good esul s in he Li huanian language. Some 1500 sen ences we e anno a ed s a is ically a Kaunas Uni e si y o Technology [Kapočiū ė, Ni e, K upa ičius 2013: 12]. The p esen ed esul s showed he insu iciency o he in o ma ion hidden in he FIGURE 4. VILSINTEKS pa sed sen ence Kas ne izikuoja, as nege ia šampano, be g audžiai i ne e kia S aipsniai / A icles 257 High Quali y Syn ac ic Anno a ed Co pus o Li huanian – VILSINTEKS FIGURE 5. VILSINTEKS pa sed sen ence Be š ai p o medį, ku iame sėdėjau, p aslinko nedidelis šešėlis DAIVA ŠVEIKAUSKIENĖ 258 Ac a Linguis ica Li huanica LXXIII s uc u e o sen ences. The wo igu es illus a e wo pa sed sen ences, bo h lacking e y impo an in o ma ion. The i s sen ence lacks he a ow be ween he p edica e nege ia and subjec as (Figu e 2). In he second sen ence he ag eemen ela ionship is no shown be ween wo wo ds medį and ku iame, which ha e ag eeing endings (Figu e 3) when he au- ho s in he same a icle w o e: “an adjec i e modi ying a noun has o ag ee in GENDER, NUMBER and CASE”. The wo ds medį and ku iame ha e o ag ee in gende and numbe , and his in o ma ion is absen in he s uc u e o he sen ence. I is di icul o ag ee ha he ela ions be ween he wo ds ku iame sėdėjau - in which I sa and p o medį - h ough he ee a e o he same ype. These sen ences anno a ed acco ding he me hod used in VILSINTEKS a e shown in Figu e 4 and Figu e 5 espec i ely. 3. LAYERS OF ANNOTATION IN THE TABLE The in o ma ion in he able has h ee ypes: • In o ma ion abou he whole sen ence, • In o ma ion abou he wo ds in he sen ence, • Non-g amma ical in o ma ion abou he wo ds and he sen ence. 3.1. In o ma ion abou he Whole Sen ence In o ma ion ega ding he whole sen ence consis s o i s code, ha is, i s po- si ion in he co pus, i s ype, and i s ea u es. The ea u e o he sen ence is i s cha ac e is ic aking in o accoun i s unc ion in he ex , ha is, whe he i is a i le, an au ho , a sub i le o a ex sen ence. The ype o he sen ence indi- ca es communica i e in o ma ion, ha is whe he i is decla a i e, impe a i e, in e oga i e, e c., and s uc u al in o ma ion: pe sonal, impe sonal, ellip ical, simple, composi e sen ence, e c. [Amb azas 1997: 573]. 3.2. In o ma ion abou he Wo ds in he Sen ence Each wo d is p o ided wi h he da a abou i s numbe in he sen ence, mo - phological da a ( ense, case, gende , e c.), lemma, da a on i s lexical seman ics, S aipsniai / A icles 259 High Quali y Syn ac ic Anno a ed Co pus o Li huanian – VILSINTEKS syn ac ic unc ion, di ec syn ac ic ela ionships wi h o he wo ds in he sen- ence, and deep cases. Since he wo d o de in he Li huanian language usually does no ha e any syn ac ic in o ma ion, he ea u es o lexical seman ics a e e y impo an o iden i ying i s syn ac ic unc ion. The noun in he accusa i e case wi h he ea- u e o ime is an ad e bial modi ie and wi hou i – an objec . I wo nouns in he accusa i e case appea in he sen ence he ea u e o he lexical seman ics is some imes he only c i e ion, which allows one o decide he syn ac ic unc ion. 3.3. Non-g amma ical In o ma ion abou he Wo ds and he Sen ence The s ylis ic in o ma ion abou he wo d is gi en in he able. I helps o choose he igh equi alen in he o he language when ansla ing he wo d. The an eceden o he p onoun is necessa y. Mille, Wanne and Bu ga [2012: 5] desc ibe co e e en ial s uc u e, which links he p onoun wi h i s an eceden in one sen ence. The Li huanian eebank p o ides he in o ma ion abou he an eceden o he p onoun i i is ou side he sen ence oo. I is e y impo an o ansla ion because he gende o he noun (o p onoun acco dingly) may di e in a ious languages. Fo example, he Li huanian sen ence Ji bu o g aži has h ee ansla ions in o Ge man. I i is “a gi l”, he igh ansla ion is Es wa schön. I i is “a ca ” he igh ansla ion is Sie wa schön, and i i is “a day”, he igh ansla ion is E wa schön. All h ee p onouns in Li huanian a e em- inine because all h ee nouns a e eminine, whe eas in he case o he Ge man language his p onoun has h ee di e en equi alen s aking in o conside a ion he noun i eplaces. The able con ains he missing wo ds in ellip ical sen ences and he omi - ed subjec , which is exp essed by a pe sonal p onoun. I is e y o en he case in he Li huanian language. We can guess i om he ending o he e b. The copula o he p edica e in he p esen ense is usually omi ed oo, so he able con ains hese missing wo ds. Ac onyms a e ep esen ed in ull wo ds in he able. The numbe s a e addi ionally ep esen ed in he able by nume als and nu- me als by numbe s because he lexical exp ession o numbe s in a ious lan- guages may di e . DAIVA ŠVEIKAUSKIENĖ 260 Ac a Linguis ica Li huanica LXXIII 4. TYPES OF INFORMATION IN THE SYNTACTIC STRUCTURE In he syn ac ic s uc u e he sen ence is di ided a he i s s age in o a noun g oup, a e b g oup and he sen ence-end cha ac e . The Li huanian lan- guage has a ee wo d o de and some imes he sen ence-end cha ac e is he only means by which o de e mine he ype o he sen ence, i.e. whe he i is a decla a i e o in e oga i e sen ence, o example, Tu šiandien laimėjai p izą. – You ha e won a p ize oday. and Tu šiandien laimėjai p izą? – Ha e you won a p ize oday?. Figu e 6 shows he syn ac ic s uc u e o he in e oga i e sen ence. The ansla ion o he sen ence is chosen acco ding o he sen ence-end cha ac e . Fu he mo e, he s uc u e o he sen ence is ep esen ed using dependency g amma . The head o he subjec g oup is he subjec and below a e depic ed he wo ds ha expand i , and he head o he p edica e g oup is he p edica e wi h he subo dina ed wo ds loca ed below. O he wo ields, which a e e y impo an o anno a ing he Li huanian co pus, a e he ype o he syn ac ic ela ions be ween he wo ds and seman i- cally i esol able wo d g oups. FIGURE 6. Syn ac ic s uc u e o he in e oga i e sen ence Tu šiandien laimėjai p izą? – Ha e you won a p ize oday? S aipsniai / A icles 267 High Quali y Syn ac ic Anno a ed Co pus o Li huanian – VILSINTEKS Aukš os kokybės sin aksiškai ano uo as lie u ių kalbos eks ynas VILSINTEKS SANTRAUKA Pas a uoju me u labai daug kalbama i ašoma apie ai, kad lie u ių kalba mažai kompiu- e izuo a. Pe kama ki oms kalboms suku a p og aminė į anga, ku i lie u ių kalbos a eju dažniausiai neduoda pa enkinamų ezul a ų. Jau a ėjo me as, kai eikia p adė i ap a i lie- u ių kalbos kompiu e iza imo kokybę, užuo kalbėjus apie menką jos kompiu e iza imą. S aipsnyje ap ašomas aukš os kokybės sin aksiškai ano uo as lie u ių kalbos eks y- nas, ku iame pa eik a pa ikima in o macija. Ano a imas a liekamas d iem lygmenimis: išsami in o macija apie sakinį nu odoma len elėje i sin aksinė s uk ū a nub aižoma g a- iškai. Ano uojan didelis dėmesys ski iamas sin aksinių yšių aizda imui. Jie pa odomi ski ingų spal ų i ipų linijomis. S aipsnyje ap ašomi neskaidomi žodžių junginiai – ai žodžių g upės, ku ios ik ka u gali išplės i ki ą žodį, i ik isą g upę gali pažymė i ją iš- plečian is žodis. Ki ų sakinio žodžių yšys su ienu iš neskaidomo junginio dėmenų ne u i p asmės. S uk ū oje neskaidomi junginiai sudedami į ieną bloką pa odan idinius sin- aksinius yšius. S aipsnyje pa eikiami sin aksiškai ano uo ų sakinių pa yzdžiai. Sakinio s uk ū ai aizduo i naudojamas g a as, nes medis, ku is sėkmingai aikomas anglų kalbos sakinių s uk ū ai, negali a spindė i isos sin aksinės in o macijos, esančios lie u iškame sakinyje. Tai labai ge ai ma y i s a is iniu me odu ano uo ų sakinių pa yzdžiuose, ku ie pa eikiami šiame s aipsnyje. Pa odomos d iejų sakinių s uk ū os, ku iose ūks a labai s a bios in o macijos: ienoje nepa ody as sin aksinis yšys a p eiksnio i a inio, ki oje nė a yšio a p žodžių, ku ie de inami skaičiumi i gimine. Palyginimui s aipsnyje pa ei- kiami šie sakiniai, ano uo i i VILSINTEKS naudojamu me odu. P adė o ku i eks yno ikslas – sukaup i išsamią i pa ikimą in o maciją apie lie u ių kalbos g ama iką, a liekan sakinio analizę be klaidų, . y. kai kompiu e io da bo ezul a- us da pe žiū i žmogus. Ano uo as eks ynas bus iešai p ieinamas in e ne e. Kaip daba iš VDU eks yno galima gau i pa eik o žodžio pa a ojimo pa yzdžius, aip VILSINTEKS inklapyje bus galima gau i sin aksinių s uk ū ų, ku ios u i am ik ų požymių – pa yz- džiui, ien isinių sakinių, ku iuose eiksniu eina į a dis i pan., – pa yzdžių. Ano uojan naudojamos Excel len elės, nes jos leidžia aizdžiai pa eik i sakinio s uk- ū ą i leng ai pe a ky i in o maciją į XML o ma ą, ku is plačiai aikomas paieškai. Taigi ano uo ą eks yną bus galima panaudo i s a is iniams lie u ių kalbos y imams, aip pa in o macijai apie lie u ių kalbos g ama iką išgau i i k . Į eik a 2013 m. spalio 28 d. DAIVA ŠVEIKAUSKIENĖ Lie u ių kalbos ins i u as Pe o Vileišio g. 5-216, LT-10308 Vilnius, Lie u a dai a. m @gmail.com