Voice Recognition Robotics Olesya Derkach Valerii Dychok Doga

Voice Recognition Robotics Olesya Derkach, Valerii Dychok, Doga Demirel, Byungkyu Kang Donnie Turner, Erica Sheff, Sachiko Oshio, Byungkyu Kang, Clifford Tawiah Faculty Mentor: Dr. Sun University of Central Arkansas Department of Computer Science Abstract Equipment Methods/Final Results Robot Navigation with audio or speech sensors is an emerging area of research in various fields of robotic exploration and artificial intelligence. Robots have great importance and future in our daily life. Albeit to a lesser extent, speech controlled are capable of serving multiple purposes across a wide variety of application domains. The work presented in our paper describes a robot which can recognize voice commands, attempt to understand the command by inferring the intent of the command responding as programmed. In order to further the research and show robot’s capabilities, more complicated commands such as dance and square were implemented. Also, several melodies were coded, so that sound can be incorporated with robot’s movements as the experiment progresses. Equipment: •  DFRobot. Shop Rover Kit – an Arduino based, track design robot. •  VRbot Speech Recognition Module – this processes the speech and identifies the commands. •  Xbee RF Communication Module (2 x) – this creates a wireless link between the speech recognition engine and the robot. •  Arduino Uno – this controls the speech recognition module. •  IO Expansion Shield – this allows the Xbee module to be connected to the DFRobot. Shop Rover. •  Xbee Shield – this allows the Xbee module to be connected to the Arduino Uno. •  Male Headers – this is required to facilitate the connection between the Xbee Shield and the Arduino Uno. •  Barrel Jack to 9 V Adaptor – this allows the Arduino Uno to be powered through a 9 V battery. •  Speaker with hook-up wires – is used to play a melody. Methods •  Voice controlled communication requires two IDEs to be installed: Ø Easy. VR Commander - is required to work with Easy. VR Voice Recognition module Ø Arduino IDE - to code robot’s moves and melodies Following table demonstrates the full cycle of execution of command “Right”: Introduction During the Fall 2013 semester Multimedia class students started to work on implementing voice recognition function on Arduino robot. The Arduino platform consists of a single-board microcontroller that aims to make using electronics in multidisciplinary projects more accessible. As a speech input device that would recognize voice commands, VRbot Speech Recognition Module was used. The project was focused solely on enabling speech recognition in a robot by using wireless communication. This semester goals include implementing more complicated movements like dancing and enabling robot to play melodies. All equipment, methods, and results will be further discussed in the following sections. Step # Procedure 1 Say “Right” to the microphone 2 Recognize the command under index 1 3 4 5 6 Find corresponding set of movements Send characters “d” and “f” to DFRobot Receive characters Move right, then stop The initial command set along with the additional commands programmed into the VRbot speech recognition module will be covered below •  Coding for the melodies is done in Arduino IDE, and requires some knowledge about how to play notes and timing issues. Before coding melodies, need a header file with list of notes definitions, for example #define NOTE_B 0 31 #define NOTE_C 1 33 Next, iterate over the notes of the melody, calculating the note duration. Function note() will produce a sound by receiving corresponding pin number, note and duration. To quit playing melody, function no. Tone() is used. Final Results •   Initial Command Set 1.   RIGHT – made the rover turn right. 2.   LEFT – made the rover turn left. 3.   FORWARD – made the rover move forward. 4.   BACKWARD – made the rover move left. •   Additional Commands 1.  STOP – made the rover cease all movement. 2.  SPIN – made the rover continuously perform a spin movement. 3.  SQUARE – made the rover perform a set of movements that mimicked the shape of a square. 5.  ANCE – made the rover perform a predefined set of movements that mimicked a dance performance. Social Implications Voice control over devices is useful in various situations. • it can be used by disabled people to control tools or machines which they have to use • voice control can make people’s lives easier since it does not require any extra work like pushing buttons to make machines move • therefore, voice controlled interaction is a promising field to do research in Many elderly have difficulties with mobility that limit their ability to get around. They are forced to rely on canes or walkers that tends to be clumsy and difficult to store. The results from our research will assist the elderly or physically challenged to easily navigate to anywhere they wish using voice commands. This resolves the mobility problems of people who are immobile. Future Work Ø One of the future extensions of this project will be a merge with another autonomous robot control projects which seeks to focus on using robot navigation exploration to aid the elderly or physically challenged. Ø The next step is by implementing the sound, enable robot to respond to the commands, thus, enabling the people controlling the robot to have communication with it. Ø Among improvements, is enhancements to speech recognition system, in order to enable to recognize not only one person voice Ø Finally, we would include wireless communication systems to transmit voice commands wirelessly through the internet to the rover ACKNOWLEDGEMENTS Ø The authors would like to acknowledge previous semester group work on this project as well as Dr. Sun, for providing all the guidance and advising us during our work and research. ØThis project was partially supported by NASA EPSCo. R 2012 Award # NNX 13 AD 32 A