Verbmobil from a Software Engineering point of view

Verbmobil from a Software Engineering point of view System Design and Software Integration Andreas Klüter sonicson Gmb. H, Kaiserslautern, Germany Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Many partners delivered software. . . Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Software Technology Challenges The goal • Build an integrated system The situation • Researchers do research • Using different programming languages • Researchers don’t want to be bothered with technical details The solution • Introducing: the System Group • Introducing: the Testbed Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

The Graphical User Interface Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Visualization and Debug Tools … . . and much more Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Service Modules: Convenient development, integration, testing, . . . Synchronization Module Visualization Manager Testbed Manager Automatic Test Module Andreas Klüter Arbitration of Concurrent Modules GUI User Command Mapper NLP System Software Engineering Chennai, 17. /18. Feb 04

The Testbed: Integration Framework for NLP-Systems Testbed Manager GUI Blackboard X Blackboard Y Module A Blackboard Z Module C Module B 5 - Testbed Chennai, 17. /18. Feb 04

PCA - Pool Communication Architecture Verbmobil II Multi-Agent Architecture Multi-Blackboard Architecture M 1 M 3 M 2 M 4 M 5 M 6 M 2 Modules know all communication partners Direct communication between modules Reconfiguration difficult Software: ICE and ICE Master Basic Platform: PVM Andreas Klüter BB 1 BB 2 BB 3 M 4 M 5 M 6 Blackboards (= „Pools“) Modules know their I/O data pools No direct communication between modules 198 blackboards vs. 2380 direct comm. paths Reconfiguration easy Several instances of one module/functionality Software: PCA and Module Manager Basic Platform: PVM NLP System Software Engineering Chennai, 17. /18. Feb 04

Sample Pool Structure Command Recognizer Channel/Speaker Adaptation Audio Data Spontaneous Speech Recognizer Prosodic Analysis Statistical Parser Chunk Parser Dialog Act Recognition Semantic Construction Robust Dialog Semantics Andreas Klüter Word Hypotheses Graph with Prosodic Labels VITs Underspecified Discourse Representations NLP System Software Engineering HPSG Parser Semantic Transfer Generation Chennai, 17. /18. Feb 04

Distributed Execution Supports Distributed Development server 2 controlling terminal server 1 Pool Communication Architecture User 1 User 2 Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

The Testbed has already been reused: • • Philips Catholic University of Nijmegen Smart. Kom Comic Thank you for your interest! Andreas Klüter sonicson Gmb. H, Kaiserslautern, Germany Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Audio Processing („fast“) and Phonetic Fuzzy Match(„fil Kollins“) combined Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Genre Classification („pop“), Audio Processing („slow“) and Access to Meta Data („ 80 s“) Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Automatic Classification („lovesongs“) Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Music Simliarity and Recommendations … Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

… Plus Constraints („not madonna“) Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

… Even More Constraints („only english songs“) … We Leed the Users to What He‘s Looking For ! Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04

Installation Example: Phonetic Fuzzy Match at musicline. de Andreas Klüter NLP System Software Engineering Chennai, 17. /18. Feb 04