Modeling Discourse Cohesion for Discourse Parsing via Memory Network Yanyan Jia, Yuan Ye, Yansong Feng, Yuxuan Lai, Rui Yan and Dongyan Zhao Institute of Computer Science and Technology, Peking University
Discourse Dependency Parsing EDU means Element Discourse Unit EDU 1 : President Bush insists Root EDU 2 : it would be a great tool Root EDU 3 : for curbing the budget deficit EDU 33 Background Attribution EDU 4 : and slicing the lard out of government programs. EDU 2 EDU 32 EDU 5 : He wants it now . Attribution Elaboration ··· EDU 3 EDU 1 EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· ···
Discourse Dependency Parsing EDU 1 : President Bush insists Root EDU 2 : it would be a great tool Root EDU 3 : for curbing the budget deficit EDU 33 Background Attribution EDU 4 : and slicing the lard out of government programs. EDU 2 EDU 32 EDU 5 : He wants it now . Attribution Elaboration ··· EDU 3 EDU 1 EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· ···
Motivation • Identifying long-span dependencies between element discourse units – Discourse structure • Morris and Hirst, 1991 extracts features to characterize discourse structures – Discourse cohesion • Joty et al., 2013 uses lexical chain features to model discourse cohesion
Motivation • Identifying long-span dependencies between element discourse units – Discourse structure • Morris and Hirst, 1991 extracts features to characterize discourse structures – Discourse cohesion • Joty et al., 2013 uses lexical chain feature to model discourse cohesion Our Work : Use Memory network to implicitly capture discourse cohesion
How Does Memory Network Work? EDU 1 : I feel hungry after wake up, EDU 2 : I rush into the kitchen and make my breakfast. EDU 3 : My breakfast is hamburger. EDU 4 : It is eight o’clock when I leave home. EDU 5 : So late! EDU 6 : I drive into the highway, EDU 7 : but meet a traffic jam. EDU 8 : Oh, I finally arrive at the company. EDU 9 : It is nine o’clock. EDU 10 : Thank God, I am not late for work. EDU 11 : But the hamburger is cold, EDU 12 : order some take-away food is better, maybe.
How Does Memory Network Work? EDU 1 : I feel hungry after wake up, EDU 2 : I rush into the kitchen and make my breakfast. EDU 3 : My breakfast is hamburger. EDU 4 : It is eight o’clock when I leave home. EDU 5 : So late! EDU 6 : I drive into the highway, Food EDU 7 : but meet a traffic jam. EDU 8 : Oh, I finally arrive at the company. EDU 9 : It is nine o’clock. EDU 10 : Thank God, I am not late for work. EDU 11 : But the hamburger is cold, EDU 12 : order some take-away food is better, maybe.
How Does Memory Network Work? EDU 1 : I feel hungry after wake up, EDU 2 : I rush into the kitchen and make my breakfast. EDU 3 : My breakfast is hamburger. EDU 4 : It is eight o’clock when I leave home. EDU 5 : So late! EDU 6 : I drive into the highway, Time EDU 7 : but meet a traffic jam. EDU 8 : Oh, I finally arrive at the company. EDU 9 : It is nine o’clock. EDU 10 : Thank God, I am not late for work. EDU 11 : But the hamburger is cold, EDU 12 : order some take-away food is better, maybe.
How Does Memory Network Work? EDU 1 : I feel hungry after wake up, EDU 2 : I rush into the kitchen and make my breakfast. EDU 3 : My breakfast is hamburger. EDU 4 : It is eight o’clock when I leave home. EDU 5 : So late! EDU 6 : I drive into the highway, Traffic EDU 7 : but meet a traffic jam. EDU 8 : Oh, I finally arrive at the company. EDU 9 : It is nine o’clock. EDU 10 : Thank God, I am not late for work. EDU 11 : But the hamburger is cold, EDU 12 : order some take-away food is better, maybe.
How Does Memory Network Work? Memory Network EDU 1 : I feel hungry after wake up, EDU 2 : I rush into the kitchen and make my breakfast. Slot 1 EDU 3 : My breakfast is hamburger. Slot 2 EDU 4 : It is eight o’clock when I leave home. EDU 5 : So late! Slot 3 EDU 6 : I drive into the highway, ··· EDU 7 : but meet a traffic jam. EDU 8 : Oh, I finally arrive at the company. Slot n-2 EDU 9 : It is nine o’clock. EDU 10 : Thank God, I am not late for work. Slot n-1 EDU 11 : But the hamburger is cold, Slot n EDU 12 : order some take-away food is better, maybe.
Framework Transition-based dependency parsing Arc-eager algorithm (Nivre): Stack, Buffer, Arcs set Left-Arc(LA) Right-Arc(RA) Shift Reduce
Framework Transition-based dependency parsing Arc-eager algorithm (Nivre): Stack, Buffer, Arcs set Left-Arc(LA) Right-Arc(RA) Shift Reduce
Framework Transition-based dependency parsing Arc-eager algorithm (Nivre): Stack, Buffer, Arcs set Left-Arc(LA) Right-Arc(RA) Shift Reduce
Framework Transition-based dependency parsing Arc-eager algorithm (Nivre): Stack, Buffer, Arcs set Left-Arc(LA) Right-Arc(RA) Shift Reduce
Framework Transition-based dependency parsing Arc-eager algorithm (Nivre): Stack, Buffer, Arcs set Left-Arc(LA) Right-Arc(RA) Shift Reduce
Arc-eager EDU 1 : President Bush insists EDU 2 : it would be a great tool EDU 3 : for curbing the budget deficit EDU 4 : and slicing the lard out of government programs. EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ···
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists EDU 2 : it would be a great tool EDU 3 : for curbing the budget deficit EDU 4 : and slicing the lard out of government programs. EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool EDU 3 : for curbing the budget deficit EDU 4 : and slicing the lard out of government programs. EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool LA( Attribution ) [] [E 2 , E 3 , E 4 , ···] EDU 3 : for curbing the budget deficit EDU 4 : and slicing the lard out of government programs. EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· Attribution ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool LA( Attribution ) [] [E 2 , E 3 , E 4 , ···] EDU 3 : for curbing the budget deficit SH [E 2 ] [E 3 , E 4 , ···] EDU 4 : and slicing the lard out of government programs. EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· Attribution ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool LA( Attribution ) [] [E 2 , E 3 , E 4 , ···] EDU 3 : for curbing the budget deficit SH [E 2 ] [E 3 , E 4 , ···] EDU 4 : and slicing the lard out of government programs. RA( Elaboration ) [E 2 , E 3 ] [E 4 , ···] EDU 5 : He wants it now . ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· Attribution Elaboration ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool LA( Attribution ) [] [E 2 , E 3 , E 4 , ···] EDU 3 : for curbing the budget deficit SH [E 2 ] [E 3 , E 4 , ···] EDU 4 : and slicing the lard out of government programs. RA( Elaboration ) [E 2 , E 3 ] [E 4 , ···] EDU 5 : He wants it now . RA( Joint ) [E 2 , E 3 , E 4 ] [···] ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· Attribution Elaboration Joint ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Arc-eager Transition Stack Buffer [] [E 1 , E 2 , E 3 , E 4 , ···] EDU 1 : President Bush insists Shift [E 1 ] [E 2 , E 3 , E 4 , ···] EDU 2 : it would be a great tool LA( Attribution ) [] [E 2 , E 3 , E 4 , ···] EDU 3 : for curbing the budget deficit SH [E 2 ] [E 3 , E 4 , ···] EDU 4 : and slicing the lard out of government programs. RA( Elaboration ) [E 2 , E 3 ] [E 4 , ···] EDU 5 : He wants it now . RA( Joint ) [E 2 , E 3 , E 4 ] [···] ··· ··· ··· ··· EDU 32 : Mr. Bush is considering simply declaring EDU 33 : that the Constitution gives him the power ··· Attribution Elaboration Joint ··· ··· E 1 E 1 E 2 E 2 E 3 E 3 E 4 E 4
Recommend
More recommend
