COLLEGE OF ART SCIENCE UNIVERSITI UTARA MALAYSIA STIW

COLLEGE OF ART & SCIENCE UNIVERSITI UTARA MALAYSIA STIW 5023 ADVANCED PROGRAMMING Lecturer : Mazen S. H. Elsayed PROPOSAL : The Use of Voice Command in Operating Personal Computer By : Group Name : VINISKAZU Group Members : Virakwan A/P Hai Kelian (800355) Anis Eliani Binti Abd. Rahman (802329) Kamal Harmoni Kamal Ariff (801584) Mohd Fazudli Bin Saad (804213)

: : Abstract • This study aims to develop an application that can execute command in operating system to allow user operate the personal computer through voice. • It will provide a proved of concept on how user will be able to operate the personal computer using voice. • This application will receive, analyzes, searches and matches an input voice with the set of grammar which is stored in the database and returns matching results to users. • It is another solution for users to easy work with personal computer instead of using a graphical input device.

: : Introduction • Application that will be developing in this study is the voice input command that use to operate the personal computer. • According to Austin. J, (__), all communication with personal computers will someday be by voice alone. This means that keyboards will be obsolete. Therefore this study will provide a proved of concept how user able to operate the personal computer using voice. • Java platform classes and compatible with Sphinx 4. 0 will design to work in Windows and Linux operating system. • According to (Meir and Zamir, 2007), Sphinx 4. 0 able to greatly improve the speech recognition capabilities and Sphinx 4. 0 platform proved very to be reliable, relatively easy to use and highly portable.

: : Problem Statement • Users facing problem to interact with personal computer due to the inability of using hands or eyes and also handicap persons. • New users facing problem to remember the command line that used to execute the application on personal computer. • To provide a convenient and ability to use the personal computer, application that can execute command in operating system to allow user operate the personal computer through voice is to develop.

: : Objectives • Main objective • The aim of this study is to produce three (3) commands that able to understand by Windows and Linux operating system. • Sub objective • To understand how to use Sphinx 4. 0. • To develop a Java class that can be interact with Sphinx 4. 0 classes. • To make the developed class able to convert voice command into command line.

: : Scope • Java classes that able to use in Windows and Linux operating system by using Sphinx 4. 0. • Classes will be use to convert voice into command line. • Only three (3) commands will introduce into this studies. • The three (3) command that want personal computer execute in this studies are Run Paint, Run Calculator and List File command.

: : System Specification

: : Voice. Command Package // OVERVIEW : This package run the voice recognition application built using Sphinx 4. 0 // Uses the Sphinx 4. 0 and contains of two (2) main classes that will receive, // analyzes, searches and matches an input voice with the set of dictionary and // grammar. // which is stored in the database and returns matching results to users by run and // display the application on the personal computer screen monitor. // REQUIRES : Convert. Voice. To. Text class to identify, analyze voice input and convert it //into text. // Run. Command class to execute input and display application on the screen // monitor. // EFFECTS : If voice input is valid, will execute the command. // If not valid, will wait until the valid input entered. // Else allow user to terminate the application.

: : Convert. Voice. To. Text Class // OVERVIEW : This class provides a number of procedures that are // useful for voice recognition and convert it into text. // REQUIRES : Valid voice input, dictionary and grammar. // Voice input that matches with the set of dictionary and grammar // database. // EFFECTS : If voice input is valid, will convert it into text. // Otherwise wait until the valid input entered or allow user to // terminate the application.

: : Run. Command Class // OVERVIEW : This class provides procedures for execute String // input and display application on the screen monitor according the // types of Operating System either Windows or Linux. // REQUIRES : String to execute the command. // Example command : Run Paint, to run on Windows platform. // EFFECTS : Execute command to display on the screen based on // types of Operating System.

: : Methodology : :

: : Context Diagram Voice Signal 0. 0 User Display Application Voice. Command

: : Flow Diagram

: : Use Case of the System

: : Class Diagram of the System User voice instruction Recording sphinx /send speech record Voice Recognizer /search and match Convert voice to text Feature Execution Feature Classification

: : Sequence Diagram

: : Group Structure Leader Virakwan A/P Hai Kelian Task Responsibilities Tasks assignment for each members Specify system requirements Produce system specification Team members Kamal Harmoni Bin Kamal Ariff Task Responsibilities Develop Coding Mohd Fazudli Bin Saad -Develop Voice. Command class Expending acoustic model -Dictionary class -Grammar class Anis Eliani Binti Abd. Rahman Develop Coding -Develop Run. Command class

: : Conclusion • Using the Sphinx 4. 0 integrate with Java platform will able to develop the application that provide function for human to interact with personal computer via voice. • In order to implement an application that can execute at least three (3) commands on Windows or Linux operating system, we identify two (2) main classes that will develop in this study which are Convert. Voice. To. Text class and Run. Command class. • These two (2) classes proposed to identify the voice input from user and finally execute the command to run the application on the screen.

: : References Austin. J, (__). The Computer Listens Up. Atariarchives. org. Retrieved : Mac 2, 2010, from : http: //www. atariarchives. org/deli/computer_listens. php Meir, D. , & Zamir, Y. (2007). Mini Project : Saya Speech Recognition. Ben. Gurion University : Department of Computer Science. Sphinx Technologies Inc. (2009). Sphinx. Retrieved : Mac 2, 2010, from : http: //www. sphinxsearch. com/about. html

. . thank you