Mobile application generalization An authoring tool for Sign
+ Mobile application generalization: An authoring tool for Sign. Support
+ Research question How can we generalize Sign. Support for any given limited domain conversation scenario and also accommodate different signed languages, and multiple mobile platforms?
+ Rational n The current Sign. Support version focuses on the pharmacy setting only, in South African Sign Language (SASL), on Android. n Sign. Support needs to accommodate multiple limited domain communication scenarios, e. g. post office and police station. n Sign. Support should also support multiple signed languages for illiterate Deaf users in developing regions, i. e. video content to be easily swapped out. n Sign. Support also needs to be platform independent to work on a variety of mobile devices.
+ Deaf community and communication challenges adapted from [10]
+ Sign. Support background n Doctor to Deaf patient (v 1) n n n Doctor to Deaf patient (v 2) n n n Help a Deaf patient to communicate symptoms to a doctor [10]. Computer based mock up. Ported to a Symbian mobile phone application [13]. Scenario deemed to be too wide to fully capture and store the conversation flow. Pharmacy to Deaf patient (v 3) n n n Help a Deaf patient understand medical instructions from a pharmacist. A limited domain conversation flow was possible to contain on a phone. An Android application; Samsung smart phone [6, 12 ]
+ Current development of authoring tools for Sign. Support n ELearning authoring tool produces XML output (George) n XML parser for the mobile app to render the user interface (Marshalan) n Generalized authoring tool to produce XML (Sifiso)
+ Literature review n Authoring tools n Multi-platform solutions n Language independence n Design for All
+ Authoring tools n Types of authoring tools [8] n Wireframing n n UI Pilot [17] n Microsoft Visio [19] Software frameworks n Phone. Gap [1] n Titanium Mobile [18]
+ Multi platform solutions n n Generic ui parts [3] n Controls n Window n Menu bar n Interaction API's [7] n n Drag and Drop XML [7] n XML Dom
+ Language independence n n Icons n Text-free icons[11] n Universal icons and signs[2] Manipulation n More direct manipulation[2]
+ Design for all n User sensitive inclusive design n n Community based co-design n n Designing products that accommodates the minority e. g. people with disability [13] Product design methodology where end users play the steer role in the design process. E. g. Sign. Support mobile application development process [c, co] ethnographic methodology n Engaging with the community members during the project design process [5]
+ Anticipated design
+ Expected user interface for the conversation designer
+ Incremental design methodology adapted from [16]
+ Testing methods n Unit test Integration test n Usability test n
+ Unit testing n Create a driver program for each unit. n Test independent methods or classes with sample inputs. n Compare the output against the expected results. n If the output do not match the expected results, we trace the error and fix it, otherwise conclude that the functions work correctly
+ Integration test n We divide the system into different subsystems namely Screen builder , assets upload and XML output. n Test each sub-system individually and observe the results. n If the output do not match the expected results, n n n we trace the error/bug and fix it We then do regression test We then test the whole system for correctness
+ Usability testing n Testing it out with a couple scenarios with domain experts n Pharmacy n n some other scenario determined by the Deaf community Testing it out with the app renderer (Marshalan's work)
+ Resources required n Software assets n n n Hardware n n n Icons Sign language videos Computer Mobile phones Programming languages n n XML [4] Javascript [15] HTML 5 [15] CSS 3 [9]
+ Year 2014 Project plan Timeline Term 1 Tasks User requirements gathering Research problem definition Proposal preparation Term 2 Presenting the proposal to the Department Submiting 5 pages article about improved pattern passcode to SATNAC Refining my user requirements Submiting 2 pages article on WIP of my masters project to SATNAC Start developing a prototype Term 3 Start developing a prototype Term 4 Finish developing a prototype Test the prototype with the stakeholders Analyze feedback from stakeholders Modify the prototype based on the feedback from stakeholder
+ Year 2015 Project plan Timeline Task Term 1 Verify the modified prototype with domain specialists Obtain feedback from domain specialists Term 2 Analyze feedback from domain specialists Make final changes of the prototype Make final testing with domain specialists Term 3 Analyze the feedback from domain specialists Start writing my thesis Term 4 Finish writing my thesis Submit my thesis
+ References [1] Allen, S. , Graupera, V. , & Lundrigan, L. (2012). Phone. Gap. In Pro Smartphone Cross_Platform Development (pp. 131 -152). Apress [2] Benbasat, I. , & Todd, P. (1993). An experimental investigation of interface design alternatives: icon vs. text and direct manipulation vs. menus. International Journal of Man-Machine Studies, 38(3), 369 -402. [3] Bishop, J. (2006, May). Multi-platform user interface construction: a challenge for software engineering-in-the-small. In Proceedings of the 28 th international conference on Software engineering (pp. 751 -760). ACM. [4] Bourret, R. (1999). XML and Databases. [5] Chamberlain, A. , Crabtree, A. , & Davies, M. (2013, June). Community engagement for research: contextual design in rural CSCW system development. In Proceedings of the 6 th International Conference on Communities and Technologies (pp. 131 -139). ACM. [6] Chininthorn, P. , Glaser, M. , Freudenthal, A. , & Tucker, W. D. (2012). Mobile communication tools for a South African Deaf patient in a pharmacy context. Information Society Technologies-Africa (IST-Africa). Dar es Salaam, Tanzania: IIMC International Information Management Corporation. [7] Coninx, K. , Luyten, K. , Vandervelpen, C. , Van den Bergh, J. , & Creemers, B. (2003). Dygimes: Dynamically generating interfaces for mobile computing devices and embedded systems. In Human-Computer Interaction with Mobile Devices and Services (pp. 256 -270). Springer Berlin Heidelberg. [8] Harris, J. (2002). An introduction to authoring tools. Learning Circuits. [9]Hogan, B. P. (2011). HTML 5 and CSS 3: Develop with Tomorrow's Standards Today. Pragmatic Bookshelf. [10] Looijesteijn, K. (2009). The design of a Deaf-to-hearing communication aid for South Africans. Unpublished MSc thesis, Delft University of Technology, Delft, Netherlands. [11]Marcus, A. (2003). Icons, symbols, and signs: visible languages to facilitate communication, interactions, v. 10 n. 3. May+ June.
+ References (Cont. ) [12] Motlhabi, M. B. , Tucker, W. D. , Parker, M. , & Glaser, M. (2013). Improving Usability and Correctness of a Mobile Tool to help a Deaf person with Pharmaceutical Instruction. In 4 th Annual Symposium on Computing for Development (DEV-4) (Article 13, 10 pages). Cape Town, South Africa: New York: ACM Press. [13] Mutemwa, M. , & Tucker, W. D. (2010). A mobile Deaf-to-hearing communication aid for medical diagnosis. In Southern African Telecommunication Networks and Applications Conference (SATNAC) (pp. 379 -384). [14] Newell, A. F. , & Gregor, P. (2000, November). “User sensitive inclusive design”—in search of a new paradigm. In Proceedings on the 2000 conference on Universal Usability (pp. 39 -44). ACM. [15] Padley, R. (2011). HTML 5–bridging the mobile platform gap: mobile technologies in scholarly communication. Serials: The Journal for the Serials Community, 24, S 32 -S 39. [16] Pressman, R. S. (2005). Software engineering: a practitioner’s approach. Mc. Graw Hill International Edition, 41 -43. [17] Puerta, A. , Micheletti, M. , & Mak, A. (2005, January). The UI pilot: a model-based tool to guide early interface design. In Proceedings of the 10 th international conference on Intelligent user interfaces (pp. 215 -222). ACM. [18] Xanthopoulos, S. , & Xinogalos, S. (2013, September). A comparative analysis of cross-platform development approaches for mobile applications. In Proceedings of the 6 th Balkan Conference in Informatics (pp. 213 -220). ACM. [19] http: //office. microsoft. com/en-us/visio/
- Slides: 23