BOBO/SJ$8$8$8//tX /t` M/Z -(PX7PX7PX7PXACL-2007-Poster.cwk.0].cwkNHp(Commented-Fragments3-7.cwkNHp(CommRob-concepts.cwk-7.cwkN<0X(CommRobModel.cwk.cwk-7.cwkNHp(Discourse-details.cwk7.cwkNHp(Discourse-issues-sample.cwkNHp(Discourse-issue0PXH(.PX\DdPX^\Hp(d-_ster.cwk.0].cwkNHp(Commented-Fragments3-7.cwkNHp(CommRob-conepts.cwk-7.:XHp(:0XCommRobModel.cwk.cwk-7.cwkNHp(Discourse-details.cwk7.cwkNHp(Discourse-issues-sample.cwkN(PXdHelmut HoracekjFLOM!`XxHH 6+e{HH(d'h  R/<::` 8/8//8H\  /)bN DSET LL////// /p // LAv/<  zZ( /  / /t /\ /  1/P  h & F>G>H>Y>f>z )G)Z))))))))OO"O#);Mj?)MMR?)MMMPM!%:;;;;;;; %+&?m+HHF\+HH MTMvOwOx$H?.AMH.HH -H zM {M | ) F ) M Y.  E   az z ? M M > *' 6j GH ZH M H M F H M M M [ . NH \H H   3L3Qc`M)`eM`M`M$`KMp`Q>M)M'`c)uMMydqqJc))))'dMzSzf))1z2>%?+H+*++B)M+l 4E4FBHBX YBfBz/ Y(00VSR"#V:5;TjDV5TRDV5T,/ 12<= J   C7%8&Dm78\78- TuvSxZ_6\-DbA6L\M-bbbb @  @ + y- zW |n  V  v  N  t V  v T Yb v b b   u x u x u    aU P D  T A (B *X 5k 6| 9 E| G- Z- T - ~ - T   T W  - .6 M K N a P T- [ a \- G I L]Leimm66 Kg)e$KphsABWV v oT'cVt vuT^^!f,1fAdp&!'4!5?!@J YimV V'{MSefV5V5V012<> C?7G8978BVL5M8llX@xpxp $xpxp @xpxpP//"/Q/ / /{/8/ Justifying Corpus-Based Choices in Referring Expression Generation Helmut Horacek DFKI GmbH & Saarland University Recent Advances in Natural Language Processing (RANLP) - 2013 Hissar, Bulgaria, 7.-13.9.2013 CHOICES IN REFERRING EXPRESSION GENERATION Corpus 1 Interpretation of corpora Corpus 2  Learned human preferences Learned human preferences Procedure Attribute selection How does the corpus relate? ?? What to do in another domain? MOTIVATION Approaches in the 1990s Emphasis on algorithmic/computational issues Instantiation and use of essential control parameters left unspecified Approaches from 2000 on Corpora generated through controled experiments Selection procedures based on learning algorithms that interpret a partial corpus Excellent results, but restricted to domain/specificities of the corpus addressed Goal Adopting empirical insights about human proferences Abstracting from idiosyncracies of individual corpora Expressing preferences in task oriented categories, widely domain-independent, cognitive meaningful terms CONTENT Motivation Previous work The basic idea Abtracted properties Corpus used Results Discussion Conclusion PREVIOUS WORK Algorithmic perspective Settled in favor of the incremental algorithm [Dale and Reiter 1995] Building corpora to mimick human preferences by learning procedures TUNA corpus [van Deemter et al. 2012], intensibely used for challenges [Gatt and Belz 2010] GRE3D3 and GRE3D7 [Viethen and Dale 2008, 2011] - situationanl 3D Examinations of principles underlying attribute selection choices " Expressed in terms of rules [Jordan and Walker 2005] Role of visual context [Viethen et al. 2010] Adapting previous references rather than constructing a new expression [Viethen, Dale and Guhe 2011] THE BASIC IDEA Method Expressing relations between situations and expressions chosen Established between properties of situations and compenents of expressions Aggregated over similar situations Assumptions People's choices can be characerized in terms of components of expressions Choices depend on salience of properQties and on their contribution to identification Novelty The task of identification plays a crucial role Simple or difficult cases, good or bad contribution of salient properties CATEGORIES OF ATTRIBUTES Obligatory elements Attributes that must be chosen in some sort of situation (human almost always do) Exclusive alternatives Two attributes where one of them but not the other must be chosen in some sort of situation (human almost always choise exactly one of them) Optional elements Attributes that may be chosen in some sort of situation (human sometimes do) Contextual factors Leading to preferences in choosing among exclusive alternatives or distinguishing situations from others where optional elements are chosen or not Test through aggregation over sets of situations (similar in the indentification task)  APPLICATION CORPUS USED TUNA corpus Organization 3x5 square grid 1 intended referent, approximately four distractors Domains Furniture category, color, size, orientation Scientists beardedness, wearing glasses, age, hair(color), tie, CATEGORIES TESTED Subcategorization of attributes 1. the type 2. most salient attributes (color, beardedness, wearing glasses) 3. location 4. remaining attributes Contribution to identification an attribute 1. allows the identification by itself 2. does it together with the type attribute 3. does it together with the type attribute and a most salient attribute 4. neither of these RESULTS Situations Regularity furniture domain obligatory (color) distinguishing alternatives (type+color+orientation) (position, orientation) distinguishing alternatives (type+color+size) (position, size) ap{plicable optional (beardedness) (beardedness) distinguishing obligatory (beardedness) (beardedness) distinguishing alternatives (hair color) (hair color, position) DISCUSSION Granularity and precision rules are More concrete than principles tested on the basis of controled experiments Less specific than results obtained by learning methods Domain-dependency The role of identification contribution and relation between salient attribute: color obligatory in entire furniture domain (as opposed to hair color) the role of beardedness and wearning glasses depend on role in identification Towards transferring to other domains assumptions People behave similarly in similar situations (easy or difficult identification task) People behave similarly in comparable perception circumstances (attribute salience) Salience can be reasonably generalized across situations and domains THE VISION Corpus 1 Interpretation of corpora Corpus 2  Abstraction Abstraction  Abstracted preferences (salience and task categories) Procedure How do the corpora relate? What to do in another domain? They are abstracted into Attribute selection Abstract attributes in salience some principles categories (to be elaborated) CONCLUSION Approach Finding out relations between task-relevant properties and attributes chosen Application to the TUNA corpus Results Some principled rules extracted from the corpus Some discrepancies regarding domains and the role of salient attributes found Extensions Application to other corpora Towards automation of choosing and testing aggregations of situation More fine-grained descriptions of regularities ZN DSET2H0/wonslwv/"aor/"6*    "0'5<8CC=HUNZb]isls    ( 0;4A K DR^W ep ipDSET2H0ZDwonslwvZ<"aorZL"6*    "0'5<8CC=HUNZb]isls    ( 0;4A K DR^W ep ipDSET2H0/wonslwv/"aor/"6*    "0'5<8CC=HUNZb]isls    ( 0;4A K DR^W ep ipDSET 2H/ p- Y&o& /  /u`&AbZ&o&AqH&Afh&6* p-    "0'5<8CC=HUNZb]isls    ( 0;4A K DR^W ep ipDSET'2H/-'2=HS  ^  i&t1<G R ] h &   1 <! !G, ,R  7  7 ]  B  B h'M Ms2X X~ =c c Hn n Sy y ^  i 6*p-DSET2Hm(L/S-&X*S-& -& & & & & & & & & &! &#P&%PDSETT.. g///&/&rrgH p q r  h/hHelmut Horacek Justifying Corpus-Based Choices in Referring Expression Generation DSET2H nU.U/M-& X*M-&&&&&&&&&& &"&$&&DSETT==@ o///&/P&$   p/p Recent Advances in Natural Language Processing (RANLP) - 2013 Hissar, Bulgaria, 7.-13.9.2013DSUM'Helmut HoracekHDNISTYLXJSTYL//D///$/,/4/</@5&                       ! % 2) "+ &, '/'1! (2%)5)+7+ -8+- : .!; /"<:0#=;1$> 2 %? 3&A> 'B>(C% ))D?5 *O <+V) +,Q D-eQ . [/ \0\1RO ?2O?93M = 4TMB5SO?6WMB7Y\'8H _)9H5:F 7;F]<* %=9*,>sQ? M@n AMBBr `CrDrE F G aH4 $I> J !K|L|M N# cO \PQ R( S0T"U& V-H5WJX$ YZ$ Z_$[ \6 -]\-^. _b.6 `z av)+bUzCc@H5 d Ie :f:gNF]htF]iE #juE4k~H 5l' *mk'Hnj Eo|jKpj KqX'Hr[ @s` Aty Qu Sv[ w[;x`]yy6z4{zC| }I ~LK-aH5  G83 9]3g`]h`]c ;ic 'mc'^MBfy6oMB q Fq:pq:q: zxE4y.6-fq:    ) +) + nnH 5. 6 n P? 5V?5z Cd >{d LHASH#*#*;#*@++*+*]+*+*+*;\+*<+*@3*3*=3*@3*;)#8] B]D]\ "\ڷ**0wXp x*(* *C2'D'T)Pg)Bw*&,*(>)U*=-x*F J+x*-#..5..*7..%W.KI.r*E.y*..*.*.*Q.*$.*M.*4*04*4*4*S4*'4**4*4*X4*r5 )l:.)O:../:.):.,H:..:.)R:..&:.)N:#*2:+*:3*Z:3*w:i*G:)m:)q@*L@*K@#..1@+.)@3.)Y@3..vEe%jϙm#..6oc) q*`q*q*dq*|q*q*iq*us'*s/*s7*gt*3t*8t*%t)nt*:t*st)t*^t*tt*t)"u w#*{w#*bw#*;w+*w+*w+*w+*@ew+29w3*~w3*w3*;}w;*jw;*y'* ay/*z#*Az#*z#*4z#*<z+*z+*9z+* cz+*;kz+*@z,*oz,*;pz3*z3* z3*hz3*xz;*_z;*z;* z;*:z;*;zK*z*z*ffQf l+l& l&-l.,l.nl"l%l ll&lMl1m^/$ KSEN/8HASHl,LKUP EFG| P [QMOTNXUlR<V^SH\= !"#$%c&'()i:8}W~3g*,154b+6q7Yr]Zs_-nmwB>hja}t`okduvwpxye./0f2z{;9CADI?@JKL $NAMEStandard Standard TK Kopfzeile HaupttextFuzeileFunote Funote IndexdDFNTMTimesGeneva Lucida Grande Lucida Grande HelveticaMCROMCROoBlNMARKMRKS MOBJWMBTSNAP  HH HHLA/h@wwsswo{swsswo{kZsw{wo{w{so{w{so{kZw {w{kZwkZwsw{o{sw{sw{o{wo{w kZV^ZVs^Z^NsV^#sRcZcNsNskZg9ZZc^cZNsVg9g9kZNsZZg9kZc^ZVc^ZNscZRZ ^ckZZNs^ZR^s{w{w{m{o{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{so{so{so{so{sso{sso{sso{sso{sso{sso{so{sso{so{sso{sso{sso{ssw1o{BkZkZo{kZg9JRBRBo{ZBkZkZwo{{s9F1VkZskZo{kZskZskZwR9Vo{skZskZwZVB99Rs 5g9kZwkZwkZBco{w?JRkZBB5g95ZR==-k^JRF1Z9{kZVkZZBF1F1RF15NsJRVB^o{=5BJRR=BF1F1Vo{RRVV=JRNsZ)JV-kNs5VRR^3JRF1cB59^-kJRBJR5^JR==Ns=so{=9Ns9JRNso{=NsF1B9NscJR9F1F19=B=Ns=RB=BBF1=F1 9R99JRNsBBV#kZkZg9Z^JRg9^Cs^Vww^{Rw^VwZ^Vg9skZcJRF1RRF15RJRBJR=5cF1ZR^Ns5NsJR9JRNsNsF1RNsBV91g9BRRcsJRVF1NsRJRR^F1V5F1Rc1NsJRF1VJRwwF19F159NsB-kBwBs=Z9=^Z{F111F1#=BkZ=)J=-kJRBR9F1=V{9=JR=-kBBNs!RcJRBV-kR95RBg9}kZo{wo{wo{wwkZo{{o{skZV!Zo{%kZV={o{o{wo{wskZ{o{so{w{o{{wwo{kZ{ss{so{wso{wsskZ#o{NscVsNsNsJR/o{=-kV!5=!1F1B1-kF1==59R(wsswswsw{ww{ww+JRNs=V5cF1{Nsg9F1cF1F15s-NsVF1wF1BJRNsNs-k5JRF1VRZBg9){s{{o{{o{{w{7RR^^cNsJRcRc=o{^R^NsZV^NsZF1Zs7o{V9BJRcBJR=JRNs{ZVF1VNsRNskZF1JRR{ sE{w{{w{wss{wss{{2^1kZcg9c^JRkZRkZ5^^g9g9cZg9NsVF1R^Rc^Z^JR=wg9Zc^ZckZZ^5B^g9^c^Zg9V{kZ9VBs9cJRo{%)ZkZ99=sJRMg9JRJRRcVF1B^JRVRV5JRJR^F1Ns{JR=sg9c5RVB^1RJRVNs==F1=BJR9JRNsg9^NsRRVRBF1Ns)J{kZNsR^RkZ^Nsccg9s^VRNsg9g9ws{o{kZ=VVkZNs^R sc^V{ZcckZRwcGNs==9V=JR!-k95B5-k1{kZg9NswB^JRkZB=BsJRIo{kZg9kZg9kZ{g9sg9cR^kZo{cg9kZ{{kZo{skZwg9o{o{kZkZ{mwsso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{sso{{/cR^VNso{VVNs^^VwRkZVJR^ZZkZZc^VVRkZVZ^VV^ZwNs^ZJRg9Zg9{kZRo{ZcR^V^o{R^RZ^co{skZkZcg9cVg9g9~{w{{w{wswwsw{ws^sg9kZ{{w{wwsg9ssww{sw{ww{{{w^s{w{wTNAM760C29536132AA1D4331AE7CBC2AA2CPRT.s com.apple.print.PrintSettings.PMColorMode com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMColorMode 3 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PrintSettings.PMCopies com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMCopies 1 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PrintSettings.PMDestinationType com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMDestinationType 2 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PrintSettings.PMFirstPage com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMFirstPage 1 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PrintSettings.PMLastPage com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMLastPage 9999 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PrintSettings.PMPageRange com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PrintSettings.PMPageRange 1 32000 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.ticket.APIVersion 00.20 com.apple.print.ticket.privateLock com.apple.print.ticket.type com.apple.print.PrintSettingsTicket < com.apple.print.PageFormat.PMHorizontalRes com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMHorizontalRes 72 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PageFormat.PMOrientation com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMOrientation 2 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PageFormat.PMScaling com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMScaling 1 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PageFormat.PMVerticalRes com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMVerticalRes 72 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PageFormat.PMVerticalScaling com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMVerticalScaling 1 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.subTicket.paper_info_ticket com.apple.print.PageFormat.PMAdjustedPageRect com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMAdjustedPageRect 0.0 0.0 538 781 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PageFormat.PMAdjustedPaperRect com.apple.print.ticket.creator com.apple.printingmanager com.apple.print.ticket.itemArray com.apple.print.PageFormat.PMAdjustedPaperRect -29 -31 566 811 com.apple.print.ticket.client com.apple.printingmanager com.apple.print.ticket.modDate 2008-03-14T16:45:34Z com.apple.print.ticket.stateFlag 0 com.apple.print.PaperInfo.PMConstrainedPaper com.apple.print.ticket.creator CUPS_CPL com.apple.print.ticket.itemArray com.apple.print.PaperInfo.PMConstrainedPaper com.apple.print.ticket.client CUPS_CPL com.apple.print.ticket.modDate 2008-03-14T11:34:25Z com.apple.print.ticket.stateFlag 1 com.apple.print.PaperInfo.PMPaperName com.apple.print.ticket.creator CUPS_CPL com.apple.print.ticket.itemArray com.apple.print.PaperInfo.PMPaperName A4 (Klein) com.apple.print.ticket.client CUPS_CPL com.apple.print.ticket.modDate 2008-03-14T11:34:25Z com.apple.print.ticket.stateFlag 1 com.apple.print.PaperInfo.PMUnadjustedPageRect com.apple.print.ticket.creator CUPS_CPL com.apple.print.ticket.itemArray com.apple.print.PaperInfo.PMUnadjustedPageRect 0.0 0.0 781 538 com.apple.print.ticket.client CUPS_CPL com.apple.print.ticket.modDate 2008-03-14T11:34:25Z com.apple.print.ticket.stateFlag 1 com.apple.print.PaperInfo.PMUnadjustedPaperRect com.apple.print.ticket.creator CUPS_CPL com.apple.print.ticket.itemArray com.apple.print.PaperInfo.PMUnadjustedPaperRect -31 -28 811 567 com.apple.print.ticket.client CUPS_CPL com.apple.print.ticket.modDate 2008-03-14T11:34:25Z com.apple.print.ticket.stateFlag 1 com.apple.print.PaperInfo.ppd.PMPaperName com.apple.print.ticket.creator CUPS_CPL com.apple.print.ticket.itemArray com.apple.print.PaperInfo.ppd.PMPaperName A4Small com.apple.print.ticket.client CUPS_CPL com.apple.print.ticket.modDate 2008-03-14T11:34:25Z com.apple.print.ticket.stateFlag 1 com.apple.print.ticket.APIVersion 00.20 com.apple.print.ticket.privateLock com.apple.print.ticket.type com.apple.print.PaperInfoTicket com.apple.print.ticket.APIVersion 00.20 com.apple.print.ticket.privateLock com.apple.print.ticket.type com.apple.print.PageFormatTicket ETBLhDSUM[LHDNI[{STYL[MCROoBlNMARKWMBTSNAPTNAMCPRT ETBLg