Brutus Part I An Architecture for Automatic Story

Brutus Part I: An Architecture for Automatic Story Generation Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Overview 4 Automatic Story Generators: What makes a good one. 4 Previous Architectures 4 The Brutus Architecture 4 Conceptual Introduction to FLEX 4 The Knowledge Level 4 The Process Level Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Interesting Story? 4 Story: A Natural Language description of objects (agents), their attributes, relationships, beliefs, behaviors, motivations and interactions. 4 Need not have a message or theme but interesting ones typically do. – And they have themes that are typically interesting 4 Need not have a particular structure but interesting ones typically do. – Lots of effective ways to tell a story. 4 Need not even have a plot but interesting ones typically do. – Plot may vary dramatically. Huge space of possibilities but typical highlevel structures are also typical. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Story Generators: What Makes a Good One? 4 Interesting Stories – Arises from theme, structure and language 4 Creative Distance – “Distance” between input and output – Print statement of canned story would be bad – Turn a collection of assertions about people, places, things, themes and story structures into interesting prose would be good. 4 Wide Variability – Produces the same story every time with names changed would be bad – Produces different plots, scenes, character behaviors over the same theme would be good. – Architectural Differentiation enables control over variability Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

A Story Dave loves the university of Rome. He loves its studious youth, ivy covered clock-towers and its sturdy brick. Dave wanted to graduate. Prof. Hart told Dave, “I will sign your thesis at your defense. ” Prof. Hart actually intends to thwart Dave’s plans to graduate. After Dave completed his defense and the Charmin of Dave's committee asked Prof. Hart to sign Dave’s thesis, Prof. Hart refused to sign. Dave was crushed. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Component Configuration Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Component Configuration 4 Deconstruct an existing story 4 Store canned text chunks 4 Assemble according to a Story “Flow-Chart” 4 No explicit representation of Plot, Theme, Characters, Action etc. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Plot Generation Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Plot Generation 4 Planning Engines 4 Classic AI approach 4 Agents, Goals, Rules, Forward Chaining 4 Simulation generates series of actions 4 Actions mapped to natural language 4 Interestingness was assumed to arise from simulation 4 But interestingness comes from interesting themes and good story telling (“literature”). 4 Complex series of events describing osmotic interactions between amoebae just doesn’t cut it. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Story Structure Expansion Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Sample Story Grammar Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Story Structure Expansion 4 Iterative Expansion of a Story Grammar 4 Builds increasing detailed outlines. 4 Plot representations and literary variations are hard to capture 4 Characters and their behaviors are not explicitly represented 4 Themes are not explicitly represented 4 Hard to manipulate anything but story structure. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Brutus: A Theme-Based Composite Architecture 4 Anchored in an explicit representation of theme for interestingness – We know what themes interest humans -- observe from classic literature – Build this knowledge into system in a way that is independent of • Plot • Story Structure • Literary devices – Manipulate these independently 4 Plot Generation through simulation to vary plot 4 Story Structure Expansion to capturing story telling form 4 Language generation for text 4 Explicit representation of literary devices to draw reader Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Brutus Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Knowledge and Process 4 The Knowledge Level – Declarative representation of different types of knowledge used in story generation. 4 The Process Level – Computational approach to story generation – Procedures that uses knowledge to construct a story. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Knowledge and Process Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

The Process Level Intro 4 Thematic Concept Instantiation – In Brutus the story is anchored on a theme. – The theme is represented in a way that is independent of plot, story structure and other elements – – – of the story. This enables architectural differentiation and control over variability. Interesting themes are not generated they are presumed to exist and are represented formally in the system as part of the knowledge-base Output is The Stage - Set or characters, places, things and initial events 4 Plot Generation – Input is the Stage – Extends the stage through time by executing actions associate with characters goals. – Generates The Scenario - a sequence of the detailed events of a plot derived from the cast of characters and initial events identified in the stage 4 Story Structure Expansion – Given a story structure, selects series of paragraph types drilling down to sentence types 4 Language Generation – Sentences are instantiated with selected elements from the scenario. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

The Knowledge Level 4 Domain Knowledge 4 Linguistic Knowledge 4 Literary Knowledge 4 Usage in Story Generation Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Domain Knowledge 4 Not the story itself (no natural language, no story structure, etc. ) 4 Representation of: – Objects and Attributes -- People, Places, Things – Agents and Events – Agent Beliefs and Behaviors 4 About which a story may be written Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Linguistic Knowledge 4 Language structures at vary levels of aggregation – Discourse, – Paragraph, – Sentence, – Phrase, – Word 4 Rules for their valid formation -- e. g. , grammars at every level 4 Discourse Level – Lengthy natural language expression -- discussion, story. . . – Describes combinations of lower level elements to form a “valid” discourse – In Brutus: A Story Grammar Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Words 4 Word – Smallest independent unit that can be assigned descriptive meaning – Can be further decomposed into prefixes, roots, suffixes, letters • Word Formation morphology (morphemes) – May be influenced by semantic properties - number, gender, case, tense • Derivational morphology – May taken on different forms based an agreement with other words in more aggregate structures - e. g. , number of noun influences form of verb • Inflectional morphology 4 Lexicon = Set of Words and morphemes (word parts - e. g. , -ed) 4 Lexicon + Morphological Rules Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Sentences 4 A sentence in a natural language, L, is a string of words taken for L’s lexicon. 4 A natural language grammar for L is a computational device that distinguishes the grammatical from the ungrammatical sequences of words. – It defines the valid (grammatically correct) sentences of L. 4 NL Understanding – Robust systems require a full grammar for L to recognize valid sentence. – For most NLs this is non-trivial 4 In NL Generation (We have it easy) – Can generate over subset of defined grammatically correct sentence types. – These are defined with generative sentence grammars. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Sentence Grammar 4 Different Generation Procedures can fix different variables 4 Other variables in Grammar are generated randomly 4 Examples Fixing Setting = university – The university has its ancient and sturdy brick, its sun-splashed greens, and its eager youth. – The university as its lush green ivy. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Literary Knowledge 4 Different ways to use words and phrases to evoke particular responses in the mind of the reader. – Generate Imagery – Produce a landscape of psychological consciousness – Producing moods: positive/secure, negative or anxious… 4 Types of Literary Knowledge in Brutus 1 – Literary Associations – Literary Augmented Grammars (LAGs) – Imagistic Expertise Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Literary Associations 4 Iconic Features – Typical associations found in a literary setting partitioned in psychological positive and negative associations 4 Literary Modifiers – Typical associations between modifiers and the objects they modify partitioned in positive and negative associations 4 Literary Analogs – Metaphors – Objects and an analog used to represent it to affect the mind of the reader. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Iconic Features 4 Typical associations found in a literary setting • ivy and clock towers are iconic features of a university 4 Positive – brick, ivy, youth, knowledge are positive iconic features of a university. 4 Negative – tests, competition, ‘intellectual snobbery’, cheating are negative iconic features of a university Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Literary Modifiers 4 Typical associations between modifiers and the objects they modify partitioned in positive and negative associations – poisonous, lush modify ivy in a university setting 4 Positive – spreading, green, lush are classified as positive modifiers of ivy 4 Negative – poisonous, tangled are classified as negative modifiers of ivy Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Literary Analogs 4 Identify Metaphorical associations between objects – Sun is an analog for an eye – Her eyes were gleaming suns leading the way toward victory 4 Produce images – warmth – trust – power Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Literary Augmented Grammars 4 Literary Knowledge is embedded in generative procedures to influence the selection of words and phrased to achieve literary results. 4 Literary knowledge is embedded as constraints on terminals in sentence grammars that make reference to literary knowledge structures Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

The Bizarro World 4 Bizzaro Modifiers are special modifier-object associations that create a sense of the bizarre. – “bleeding” bizarrely modifies sun, plants, eggs etc. – Shelly’s eyes were like big bleeding suns 4 Use bizzaro modifiers in LAGs Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Architectural Overview Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Thematic Relation 4 Captures the necessary ingredients for a story about theme of betrayal 4 Used to scour the knowledge base and assemble the stage for a betrayal story. 4 May be many solutions -- many plots, many characters, may stories depends on contents of KB. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Stage 4 Betrayer: Professor Hart 4 Betrayed: Dave Striver 4 Betrayal_Location: University of Rome 4 Betrayed’s goal: To Graduate (Acquire thesis committee’s approval and signatures) 4 Betrayer’s Lie (Promise): Approve and sign betrayed’s thesis. 4 Betrayer’s Evil Action: Refuse to sign thesis Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Scenario 4 Plot generation takes initial state of stage and runs characters behavioral rules (forward chaining) 4 Actions take place 4 New events including utterances (dialog) occur 4 This events are used as input to expand the story structure and generate natural language sentences. – Prof. Hart lies to Dave. The utterance is “…” – The Chair request to Prof. Hart: sign Dave’s Thesis – Prof. Hart refuses the chairs request. – Prof. Hart says “…. ” – and so on. . . Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Story Structure Expansion 4 1. Story Setting + Goals-and-plans + Betrayers-evil-action + Betrayed's-state 4 2. Goals-and-plans Betrayed's-goal + Betrayer’s-promise + Betrayer’s-goal 4 3. Setting setting-description(betrayal-location, pov, betrayed) 4 4. Betrayed's-goal personal-goal-sentence(betrayed) 4 5. Betrayed's-goal personal-goal-sentence(betrayer) 4 6. Betrayers-promise promise-description(betrayer, betrayed) 4 7. Betrayers-evil-action narrate-action(betrayers-evil-action) 4 ========================= 4 setting-description(Loc, pov, Persion) : – pc_of(Person, Loc) + parallel_dscrp(Loc, pov, Person) Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

A Story 4 Dave loves the university of Rome. 4 He loves its studious youth, ivy covered clock-towers and its sturdy brick. 4 Dave wanted to graduate. 4 Prof. Hart told Dave, “I will sign your thesis at your defense. ” 4 Prof. Hart actually intends to thwart Dave’s plans to graduate. 4 Dave completed his defense and the Charmin of Dave's committee asked Prof. Hart to sign Dave’s thesis, Prof. Hart refused to sign. 4 Dave was crushed. Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

FLEX Exercises Learn the Basics Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Conceptual Introduction to FLEX 4 Frames and “isa” 4 Instances 4 Relations 4 Production Rules Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes

Brutus Part II: Micro Brutus 1: An Implementation of the Brutus Story Generation Architecture Dr. David A Ferrucci -- Logic Programming and AI Lecture Notes