Scene Maker Automatic Visualisation of Screenplays Eva Hanser

Scene. Maker: Automatic Visualisation of Screenplays Eva Hanser Prof. Paul Mc Kevitt Dr. Tom Lunney Dr. Joan Condell School of Computing & Intelligent Systems Faculty of Computing & Engineering University of Ulster, Magee, Northern Ireland hanser-e@email. ulster. ac. uk, {p. mckevitt, tf. lunney, j. condell}@ulster. ac. uk

SCENEMAKER OVERVIEW • Automatically generate animated scenes from screenplays

: AIMS & OBJECTIVES AIMS Input: Screenplay Scene. Maker System Output: Animation • Realistic visualisation of emotional aspects • Well-designed representation through 3 D animation, speech, audio and cinematography • Enhance believability of virtual actors and scene presentation

: AIMS & OBJECTIVES • Inferencing emotions and semantic information within story context • Common sense, affective and cinematic knowledge reflecting human cognitive reasoning • Automatic genre recognition from text • Design, implementation and evaluation of Scene. Maker

: RELATED PROJECTS SEMANTIC TEXT PROCESSING INT. M. I. T. HALLWAY -- NIGHT Lambeau and Tom come around a corner. His P. O. V. reveals a figure in silhouette blazing through the proof on the chalkboard. There is a mop and a bucket beside him. As Lambeau draws closer, reveal that the figure is Will, in his janitor's uniform. There is a look of intense concentration in his eyes. LAMBEAU Excuse me! WILL Oh, I'm sorry. LAMBEAU What're you doing? WILL (walking away) I'm sorry. Screenplay Extract from ‘Good Will Hunting (1997)’ • Standardized format and language of screenplays • Automatic access to information on location, timing, props, actors, events, manners, dialogue and camera direction (Jhala 2008)

: RELATED PROJECTS MODELLING EMOTIONAL BEHAVIOUR • Reflecting emotions in automatic physical transformation of 3 D models • Manner influences intensity, scale, force, fluency and timing of an action Greta (Pelachaud 2005) Personality & Emotion Engine (Su et al. 2007)

: RELATED PROJECTS VISUALISING 3 D SCENES • Words. Eye – Scene composition (Coyne & Sproat 2001) • Script. Viz – Screenplay visualisation (Liu & Leung 2006) • CONFUCIUS – Action & speech animation (Ma 2006) • CAMEO – Cinematic and genre visualisation (Shim & Kang 2008) Words. Eye Script. Viz CONFUCIUS CAMEO

: DESIGN AND IMPLEMENTATION ARCHITECTURE OF SCENEMAKER Screenplay Script Editor Animation Player Text & Language Processing Context Interpretation Genre } Emotion Action } Multimedia Generation

: DESIGN AND IMPLEMENTATION GENRE IDENTIFICATION Film Script. txt Gate Tokenizer Sentence Splitter Word. Net Training corpora Light key-phrases KEA Key-phrase Extractor Controlled Indexing Free Indexing Emotion Module Word. Net. Affect . xml Concept Net Part-Of-Speech Gazetteer Training corpora Location key-phrases Script Element Ontology Tagged Film Script Motion Content Dialogue Length Genre Location Ontology Genre Light Ontology Film Pace Genre Relevant Locations Most Dominant Emotions Genre Relevant Lighting Theme Director. Notation (Film Ontology) Genre

: DESIGN AND IMPLEMENTATION EVALUATION OF SCENEMAKER Aspect Evaluation Correctness of screenplay interpretation Hand-animating scenes Effectiveness of output scenes Existing feature film scenes Suitability for genre type Unknown scripts categorised by readers Functionality of interface Testing with drama students and directors

SUMMARY Scene. Maker • Heightens expressiveness, naturalness and artistic quality of computer generated animations • Assists crew on set – directors, actors, camera men, . . . – drama students, script writers and advertising agencies • Mobile user interface for immediate use on set or anywhere • Animations manually editable

Thank you. QUESTIONS OR COMMENTS?