Web engineering meets natural language processing a vocal

Web engineering meets natural language processing: a vocal interface generation practice 2006/12/11 江文成

Reference n n n Hendrik Macedo, Jacques Robin, Roberto Barros Proceedings of the 11 th Brazilian Symposium on Multimedia and the web Web. Media '05 ACM , December, 2005

Introduction n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

Voice. XML(example)

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

Voice Portals n TTS Text-To-Speech: 文字轉語音 ASR ■ n Automatic Speech Recognition: 自動語音識別 Voice Portal application architecture

Voice Portals

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

Voice-Driven interface n PBTG mediator ■ ■ ■ n a artificial intelligence system To connect a Web application and a Voice Portal consist of a MPC and a COLEC MPC Message Production Component ■ n COLEC Content Organization and Linquistic Expression Component COLEC pipeline (10 stages) ■ ■

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

PBTG mediator

MPC n Recommendation Message “The system recommends Matrix Reloaded to you? ” Feature Message Matrix Reloaded stars Keanu Reeves? Matrix Reloaded is a science-fiction moive? Feature Asking Message Would you like more information about this movie? ■ n ■

COLEC ( pipeline )

COLEC ( pipeline ) - CLTT n n Coganate. Lexicalized. Thematic. Tree(CLTT) Example: Matrix Reloaded is a science-fiction movie?

COLEC ( pipeline ) - FLST n n Fully. Lexicalized. Syntactic. Tree(FLST) Input source : form CLTT ( output of the last step) Matrix Reloaded is a sciencefiction movie?

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

Related Work n DCIE proxy-based interactive service browse dynamically generated audio renditions of both e-mail and WWW documents In April, 1997 WIRE voice browser for car radio to access e-mail and WWW in Octobeer , 1998 ■ ■ ■ n ■ ■ ■

n n n Overview Voice. XML Voice Portals ● TTS ● ASR Voice-Driven interface ● PBTG mediator ● MPC ● COLEC Related work Conclusions

Conclusions Thanks!!