Model-Based Story Summary: Patrick Henry Winston
Model-Based Story Summary: Patrick Henry Winston
Model-Based Story Summary: Patrick Henry Winston
Abstract
A story summarizer benefits greatly from a reader model because a reader model enables the story
summarizer to focus on delivering useful knowledge in minimal time with minimal effort. Such a
summarizer can, in particular, eliminate disconnected story elements, deliver only story elements
connected to conceptual content, focus on particular concepts of interest, such as revenge, and
make use of our human tendency to see causal connection in adjacent sentences. Experiments
with a summarizer, built on the Genesis story understanding system, demonstrate considerable
compression of an 85-element précis of the plot of Shakespeare’s Macbeth, reducing it, for example,
to the 14 elements that make it a concise summary about Pyrrhic victory. Refocusing the
summarizer on regicide reduces the element count to 7, or 8% of the original.
Keywords and phrases story telling and summarization, story understanding, cognitive modeling
1 Vision
Suppose you want a program to summarize a story. How should your program decide what
to include and what to leave out? I suggest that people read summaries mainly to acquire
useful knowledge in minimal time with minimal effort. Thus, a summary program should
focus on knowledge useful as precedent, exclude obvious inferences, but include reflective
inferences that help the reader understand how the key elements are connected. Accordingly,
a summary program should adhere to several principles reminiscent of the maxims of Grice
[5], and in so adhering, a summary program must have an understanding of human story
understanding in general and of the summary reader in particular. My students and I have
built such an understanding into our Genesis story-understanding system, and we can adjust
Genesis to model the knowledge and interests of particular summary readers.
One such simple Genesis-readable story is the following précis, which is based loosely
on Shakespeare’s play, Macbeth. It is itself a summary, but it is also an anvil on which to
hammer out principles that enable further compression and clarification.
Macbeth précis
Scotland and England are countries. Dunsinane is a castle and Birnam Wood is a forest.
Macbeth, Macduff, Malcolm, Donalbain, Lady Macbeth, Lady Macduff, Cawdor, and
Duncan are persons. Lady Macbeth is Macbeth’s wife. Lady Macduff is Macduff’s
wife. Lady Macbeth is evil and greedy. Duncan is the king, and Macbeth is Duncan’s
successor. Duncan is an enemy of Cawdor. Macbeth is brave. Macbeth defeats
Cawdor. Duncan becomes happy because Macbeth defeats Cawdor. The witches are
weird. The witches meet at night. The witches danced and chanted. Macbeth tells
witches to speak. Macbeth talks with the witches. Birnam Wood is a forest. Witches
predict that Birnam Wood will go to Dunsinane. The witches predict that Macbeth
will become Thane of Cawdor. The witches predict that Macbeth will become king.
The witches astonish Macbeth. Duncan executes Cawdor. Macbeth becomes Thane of
Cawdor. Duncan rewarded Macbeth because Duncan became happy. Lady Macbeth
wants Macbeth to become king. Macbeth is weak and vulnerable. Lady Macbeth
persuades Macbeth to want to become the king because Lady Macbeth is greedy.
Macbeth loves Lady Macbeth. Macbeth wants to please lady Macbeth. Macbeth
wants to become king because Lady Macbeth persuaded Macbeth to want to become
the king. Lady Macbeth plots to murder the king with Macbeth. Macbeth invites
Duncan to dinner. Duncan compliments Macbeth. Duncan goes to bed. Duncan’s
guards become drunk and sleep. In order to murder Duncan, Macbeth murders the
guards, Macbeth enters the king’s bedroom, and Macbeth stabs Duncan. Macbeth
becomes king. Malcolm and Donalbain become afraid. Malcolm and Donalbain flee.
Macbeth’s murdering Duncan leads to Macduff’s fleeing to England. In order to
flee to England, Macduff rides to the coast and Macduff sails on a ship. Macduff’s
fleeing to England leads to Macbeth’s murdering Lady Macduff. Macbeth hallucinates
at a dinner. Lady Macbeth says he hallucinates often. Everyone leaves because
Lady Macbeth tells everyone to leave. Macbeth’s murdering Duncan leads to Lady
Macbeth’s becoming distraught. Lady Macbeth has bad dreams. Lady Macbeth
thinks she has blood on her hands. Lady Macbeth tries to wash her hands. Lady
Macbeth kills herself. Birnam Wood goes to Dunsinane. Macduff’s army attacks
Dunsinane. Macduff curses Macbeth. Macbeth refuses to surrender. Macduff kills
Macbeth.
Given the Macbeth précis, Genesis notes and infers several kinds of causal connections.
Connections noted are those signaled by the word because, the words leads to, and the
words in order to in stories. Because signals a direct cause between story elements (Duncan
becomes happy because Macbeth defeated Cawdor); leads to indicates there is a chain
of unstated causes connecting two story elements (Macbeth’s murdering Duncan leads to
Macduff’s fleeing to England); in order to explains how something is done (In order to murder
Duncan, Macbeth murders the guards, Macbeth enters the king’s bedroom, and Macbeth
stabs Duncan).
Random Unabridged Connected Concept centered Dominant concept centered Unresolved questions Table
Duncan is a king.
Macbeth is Duncan's
successor.
P. H. Winston 159
Lady Macduff is Macduff's wife.
Macbeth
Inspector Summary
||| Pop Views Controls Start viewer Experts Elaboration graph Inspector Sources Results Summary Retelling
Macbeth
Rules: 42 Lady Macbeth Macduff is Lady Macbeth Duncan Duncan Cawdor Duncan Duncan Lady Macbeth
persuades that
Macbeth Macbeth Macbeth Duncan Lady Macbeth Macbeth Macbeth
is Macbeth's Macduff's defeats becomes executes becomes harms rewards Macbeth wants
murders murders becomes becomes becomes becomes harms
wife. relation. Cawdor. happy. Cawdor. dead. Cawdor. Macbeth. guards. Duncan. king. dead. queen. happy. Duncan.
to become king.
Inferences: 54
Explicit elements: 71
Macbeth is Lady Macbeth
Macbeth's stabs
Inferred elements: 31 relation. Duncan.
Macduff is Lady
Macduff's
husband.
Lady
Macbeth is
greedy.
Duncan
is a king.
Macbeth is
Duncan's
successor.
Lady Macbeth
tells everyone
to the leave.
Macbeth Macbeth Macbeth Macduff Macbeth Everyone Lady Macbeth Lady Macbeth Macbeth Lady Macbeth Macduff
Macduff flees Lady Macbeth Lady Macbeth Macduff kills
murders Lady harms Lady harms becomes angers becomes harms becomes angers harms
to England.
Macduff. Macduff. Macduff. unhappy. Macduff. leaves. distraught.
kills herself. harms herself.
Macbeth. unhappy. Macbeth.
Macbeth.
Macbeth.
Macduff sails
on ship.
England is Dunsinane Birnam Duncan is Cawdor is Lady Malcolm is Macduff is Macbeth is Lady Duncan is Macbeth Witches
Scotland is a Lady Macduff Donalbain is
Wood is a Macbeth is a Macbeth is Cawdor's
a country. country. is a castle. a person. a person. is a person. a person. a person. a person. a person. is brave. are weird.
forest. person. evil. enemy.
Witches meet
Witches Witches Macbeth tells Macbeth Witches predict
that Birnam
Witches predict Witches predict Witches Macbeth Lady Macbeth Macbeth is Macbeth Macbeth Macbeth wants
Lady Macbeth
plots to murder
witches to the talks with that Macbeth that Macbeth astonish becomes wants Macbeth loves Lady to please Lady
at night. dance. chant. speak. witches.
Wood goes to
Dunsinane.
becomes thane. becomes king. Macbeth. thane. to become king. vulnerable. is weak. Macbeth. Macbeth.
king with
Macbeth.
Macduff Macbeth
curses refuses to
Macbeth. surrender.
Analysis
Revenge
Figure 1 Elaboration graph generated by the Macbeth précis. Connections are color coded:
Pyrrhic victory Pyrrhic victory Mistake because har... Mistake because har... Mistake because unh... Suicide Success Regicide Answered prayer Revenge
Elaboration graph
deduction rules and explicit because connections produce black lines; explicit leads to connections 100%
produce blue lines; explanation rules produce orange connections. You can expand the diagram if
you are using a PDF viewer.
presumption rules. Deduction rules, such as If x kills y, then y becomes dead, make connections
whenever all their antecedents are in a story. Abduction rules make connections between
elements and presumed antecedents. For example, Genesis’s reader model may include the
abduction rule If x kills y, then x must be insane. Explanation rules make connections only
when there is no other known way to explain an element. For example, Macduff kills Macbeth
is explained by the explanation rule If x angers y, then y may kill x and the previously
inferred element Macbeth angers Macduff. Presumption rules, like abduction rules, make
connections between elements and presumed antecedents, but only when there is no other
known way to explain an element. Presumption rules, unlike explanation rules, do not require
antecedents to be already in place. Abduction rules, explanation rules, and presumption
rules are ranked, so that the highest ranking rule dominates in the event multiple rules are
available for explaining an unexplained event. We intend to develop a more sophisticated,
context-sensitive process.
The noted and inferred causal connections constitute the elaboration graph of causally
connected elements as shown in Figure 1.
CMN’15
13:25:25 EST 01-Mar-2015
Macbeth
murders Lady Macbeth Macbeth Macduff Macduff
harms angers kills harms
Macduff leads Macduff. Macduff. Macbeth. Macbeth.
to Macduff kills
Figure 2 The instantiated revenge concept pattern found in the Macbeth précis.
Macbeth.
I note that revenge, for example, is just a single such sequence described by x’s harming y leads to y’s
harming x. An instantiated revenge pattern is shown in Figure 2.
murder and Remarkably, the elaboration graph, augmented by discovered concept patterns, provides
Results Inspector
the substrate for developing models of many kinds of story understanding and telling,
||| Pop Views Controls including
Start viewer Experts question answering,
Elaboration graph Inspector cultural bias in
Sources Results interpretation,
Summary Retelling instructional telling with a
learner model, persuasive telling with a listener model, precedent-based prediction, and as
described here, summary. Macbeth/revenge
Macbeth is Lady Macbeth's Cawdor Macbeth Duncan
Lady Macbeth is Macbeth's wife. Macbeth defeats Cawdor. Duncan becomes happy. Duncan executes Cawdor. Lady Macbeth becomes queen. Duncan rewards Macbeth. Macbeth murders guards. Macbeth murders Duncan. Guards become dead. Macbeth becomes happy. Macbeth harms Duncan.
relation.
becomes dead. becomes thane. becomes dead.
husband.
Lady Macbeth is Macbeth's
relation.
Duncan harms Cawdor. Macbeth wants to become king. Macbeth enters bedroom.
Macbeth
becomes king.
Concepts: 15
My students and I provide Genesis with common-sense rules, concept patterns, and stories;
Lady Macbeth is greedy.
Discoveries: 11 Duncan is a
all rules, patterns, and stories are provided in English as indicated in the examples. Our
king.
Explicit elements: 70
Macbeth is Duncan's successor.
purpose is to establish, by telling, what Genesis needs to know to exhibit a kind of humanlike
Inferred elements: 33
understanding.
Total elements: 103 Everyone Macduff kills
We think it reasonable, at this stage, to tell Genesis what it needs to know. One reason is
Macduff flees to England. Macbeth murders Lady Macduff. Macbeth harms Lady Macduff. Macbeth harms Macduff. Macduff becomes unhappy. Macbeth angers Macduff. Lady Macbeth becomes distraught. Lady Macbeth kills herself. Lady Macbeth harms herself. Lady Macbeth harms Macbeth. Macbeth becomes unhappy. Lady Macbeth angers Macbeth. Macduff harms Macbeth.
leaves. Macbeth.
that much of what we know we learn by being told. Few would have the concept of Pyrrhic
Macduff sails
on ship.
in experimenting with one story finds use in other stories. Revenge, for example, is revenge
Dunsinane is a castle. Birnam Wood is a forest. Lady Macduff is a person. Lady Macbeth is a person. Donalbain is a person.
eastern. machiavellian. noble. country. person. person. person. person. person. thane. thane.
not only in Macbeth, but also in fairy tales and international conflicts. Yet another reason is
Duncan goes to bed. Guards become drunk.
Guards
sleep.
Malcolm
becomes afraid.
Donalbain
becomes afraid.
Malcolm
flees.
Donalbain
flees.
Macbeth hallucinates at dinner. Lady Macbeth has bad dreams. Birnam Wood goes to Dunsinane. Birham wood is a forest. Burnham wood goes to Dunsinane.
Army attacks
Dunsinane.
that we have done research on learning concept patterns from ensembles of stories [2, 7], and
Macduff curses Macbeth. Macbeth refuses surrendering.
Analysis we are engaged in research on learning common sense by mining various textual sources.
Revenge Revenge Pyrrhic vi... Pyrrhic vi... Mistake ... Mistake ... Mistake ... Suicide Success Regicide Answere...
Elaboration graph
The Macbeth précis contains 55 sentences, which, when understood by Genesis, expand
to 85 explicit story elements, with the expansion caused by separately counting elements
that are embedded in compound sentences and explicit causal connections and by adding
one to the element count for each explicit causal connection. In what follows, I compare the
number of summary elements with the number of explicit story elements for various versions
of the Genesis summarizer.
Many of the explicit elements are not involved in causal connections of any kind, explicit
or inferred, and thus offer little or nothing by way of constraining precedent. Keeping only
those explicit elements that are causal connections and explicit elements that are embedded
in Genesis’s inferred causal connections produces the following summary in which the START
system produces the English, with occasional awkwardness, from Genesis’s inner language of
relations and events:
Thus, the principle of connection allows the Genesis summarizer to reduce the number of
summary elements to 34, 40% of the 85 explicit story elements.
CMN’15
162 Model-based Story Summary
Now the summary contains only 30 of the 85 explicit story elements or 35%. Excluded are
elements such as Duncan becomes happy because Macbeth succeeded, and Duncan rewarded
Macbeth because Duncan becomes happy. None of the elements involved leads to an element
in an instantiated concept.
The elements that deal with Lady Macbeth’s suicide drop out; the number of summary
elements is 25, 29% of the explicit story elements.
P. H. Winston 163
Memorable elements, incidentally, are readily captured in simple concept patterns that
may involve no leads to elements, such as this Memorable event pattern: a woman becomes
the bishop. Of course, what constitutes a memorable event may not be so memorable at a
different time or place.
With means deleted, the number of summary elements is further reduced to 18, 21% of
the explicit story elements.
3.6 Compression using the post hoc ergo propter hoc assumption
Good summaries refrain from making natural inferences explicit because making them explicit
is unnatural and annoying. Accordingly, the Genesis story summarizer supposes the reader
will instinctively find plausible causal connections between adjacent events.
After this does not mean because of this in logic, but we use it nevertheless in telling
stories smoothly, dropping explicit cause when proximity makes the cause apparent:
CMN’15
164 Model-based Story Summary
Lady Macbeth is greedy. Macbeth wants to become king. Macbeth murders Duncan,
probably because Duncan is a king, and Macbeth is Duncan’s successor. Macduff
flees to England. Macbeth murders Lady Macduff. Macduff kills Macbeth, probably
because Macbeth angers Macduff. Macduff.
Processing with post hoc ergo propter hoc transforms Macduff’s fleeing to England leads
to Macbeth murders Lady Macduff to Macbeth murders Lady Macduff. With post hoc ergo
propter hoc in play, the number of summary elements is 15, 18% of the explicit story elements.
4 Experiments
Using Genesis to summarize Shakespearian play summaries and cyberwar summaries produced
the following percentages of summary elements relative to total elements. The Connected
column reports the fraction of the explicit story elements that are reported when reporting
all and only the elements in the story that are causally connected; the All-methods column
reports the fraction of the explicit story elements reported when all of the principles here
described are engaged.
The compression numbers are not dramatic because the test stories are already summaries.
The numbers generally drop when limiting the summary to elements that lead eventually
to one or more instantiated concept patterns. One exception is Estonia vs. Russia. In this
summary, one concept pattern is Aggression of a bully, a concept pattern that looks for
which side the reader is friendly with: x is my friend. x’s angering y leads to y’s harming x.
Instantiating that concept pattern brings in I am Estonia’s friend, a disconnected element,
but an element that corresponds to an element in the concept pattern. If the reader happens
to be Russia’s friend, the concept pattern triggered is Teaching a lesson and I am Russia’s
friend is included.
5 Contributions
Work on the Genesis story understanding and telling system has been inspired, in part, by
the pioneering work of Roger Shank and his students [8, 9, 10, 11]. Work on Genesis has
also been inspired, in part, by paleoanthropologist Ian Tattersall’s reflections on what makes
us human [12, 13], which led me to the conclusion that story understanding and story telling
plays a major role. I have focused here on principles of story summary and shown how those
principles are reflected the Genesis story summarizer. In particular, I have:
Argued that a reader model is a necessary foundation for good story summary
Identified the principles of connection, concept focus, dominant concept focus, and
interpretation transparency.
Suggested means compression and introduced post hoc ergo propter hoc processing.
Exhibited an implemented, principle-based summarizer at work on a representative story
from the Genesis library, a précis of Macbeth, showing a compression of 84%.
P. H. Winston 165
References
1 David Ferrucci, Eric Brown, Jennifer Chu-Carroll, James Fan, David Gondek, Aditya
Kalyanpur, Adam Lally, J. William Murdock, Eric Nyberg, John Prager, Nico Schlaefer,
and Chris Welty. The AI behind watson—the technical article. AI Magazine, 2010.
2 Mark A. Finlayson. Learning Narrative Structure from Annotated Folktales. PhD thesis,
Electrical Engineering and Computer Science Department, MIT, Cambridge, MA, 2012.
3 Mark A. Finlayson and Patrick Henry Winston. Intermediate features and informational-
level constraint on analogical retrieval. In Proceedings of the 27th Annual Meeting of the
Cognitive Science Society, pages 666–671, 2005.
4 Dedre Gentner and Arthur B Markman. Structure mapping in analogy and similarity.
American Psychologist, 52(1):45–56, 1997.
5 H. Paul Grice. Studies in the Way of Words. Harvard University Press, Cambridge, MA,
1989.
6 Boris Katz, Gary Borchardt, and Sue Felshin. Syntactic and semantic decomposition strate-
gies for question answering from multiple resources. In Proceedings of the AAAI 2005
Workshop on Inference for Textual Question Answering, 2005.
7 Caryn Krakauer and Patrick Henry Winston. Story retrieval and comparison using concept
patterns. In Mark Alan Finlayson, Pablo Gervas, Deniz Yuret, and Floris Bex, editors, Pro-
ceedings of the 3rd Workshop on Computational Models of Narrative (CMN’12), volume 3,
pages 119–124. European Language Resources Association (ELRA), 2012.
8 Wendy Lehnert. Plot units and narrative summarization. Cognitive Science, 5(4):293–331,
1981.
9 Roger C. Schank. Conceptual dependency: A theory of natural language understanding.
Cognitive Psychology, 3(4):552–631, 1972.
10 Roger C. Schank and Robert P. Abelson. Scripts, Plans, Goals, and Understanding: An
Inquiry into Human Knowledge Structures. Lawrence Erlbaum Associates, Mahwah, NJ,
1977.
11 Roger C. Schank and Christopher K. Riesbeck. Inside Computer Understanding: Five
Programs Plus Miniatures. Lawrence Erlbaum Associates, Mahwah, NJ, 1981.
12 Ian Tattersall. Becoming Human. Harcourt, Orlando, FL, 1998.
13 Ian Tattersall. Human evolution and cognition. Theory in Biosciences, 123(4):371–379,
2010.
14 Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. Show and tell: A neu-
ral image caption generator. Cornell University Library digital repository, arXiv:1411.4555
[cs.CV], 2014.
15 Patrick Henry Winston. The strong story hypothesis and the directed perception hypothesis.
In Pat Langley, editor, Technical Report FS-11-01, Papers from the AAAI Fall Symposium,
pages 345–352, Menlo Park, CA, 2011. AAAI Press.
16 Patrick Henry Winston. The next 50 years: a personal view. Biologically Inspired Cognitive
Architectures, 1:92–99, 2012.
17 Patrick Henry Winston. The right way. Advances in Cognitive Systems, 1:23–36, 2012.
CMN’15