Generating Content Math ML Markup from Nemeth Braille
Generating Content Math. ML Markup from Nemeth Braille Input Sequences Sam Dooley Pearson Assessment Dan Brown Pearson Assessment Edgar Lozano Pearson Assessment
Braille math is hard! 1 Ø Blind students need to create printed math Ø Back translation is difficult, time-consuming Ø Existing processes are complex, unreliable Ø TVIs are often unfamiliar with math notation Ø Real-time two-way translation is non-existent Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Translating Braille Math 2 Ø Online equation editor software component Ø Real-time translation from braille into math Ø Accessible to both sighted and blind users Ø Nemeth Braille Ø Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Braille Input Demo 3 Ø Numbers Ø Arithmetic Ø Equations Ø Fractions Ø Radicals Ø Exponents Ø Functions Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
W 3 C Math. ML (1998) 4 Ø World Wide Web Consortium (W 3 C) Ø XML element/attribute vocabulary Ø Typical K-12 and higher ed. math Ø Presentation and content markup Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Nemeth Braille (1952) 5 Ø Abraham Nemeth (AFB, APH, BANA) Ø Tactile encoding for print math Ø Math for technical publications Ø Presentational math structures Ø Consistent with content markup Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Presentation v. Content 6 Ø Presentation encodes signs/symbols Ø Content encodes functional structure Ø "x^2+1" v. "1346, 45, 23, 5, 346, 2" Ø "x^2+1" v. (plus (power x 2) 1) Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Equation Editor (2002) 7 Ø WYSIWYG entry for math expressions Ø Keyboard input into Content Math. ML Ø Content Math. ML to Presentation Math. ML Ø Display Math. ML in a browser (Math. Jax) Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Keyboard to Content 8 Ø QWERTY entry for math expressions Ø Key-based XML transformations Ø Minimal sequential dependencies Ø Presentation updated on each key Ø "x + 1" v. (plus x 1) Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Braille to Content 9 Ø Braille entry for math expressions Ø Each braille cell becomes a key event Ø Non-trivial sequential dependencies Ø Presentation updated on each key Ø "1346, 2" v. (plus x 1) Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Input Sequences Ø One QWERTY key effects a transformation Ø Sequences of braille keys must be used Ø Finite state machine tracks input prefixes Ø Transformation updates on each sequence 10 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Contextual Input Ø The meaning of a key can depend on context Ø Return to baseline from within an exponent Ø Degree of a root from within a radical Ø Moving from numerator to denominator Ø Numeric indicator within a vertical fraction 11 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Usability issues Ø Incomplete expressions Ø Input position indicator Ø Input position selection Ø Keyboard navigation 12 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Braille Input Examples Ø Numeric indicator Ø Baseline indicator Ø Type form indicators Ø Shape indicators Ø Negated operators Ø Composed relations 13 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Braille Input Testing Ø Web browser input test page Ø Java. Script equation editor Ø Screen reader device drivers Ø Web accessibility APIs Ø Braille terminal input 14 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Research Studies Ø Two research studies in Fall 2015 (KY/AZ - Sep, TX - Oct) Ø Goal - to collect feedback from multiple populations on EE functionality Ø Populations - blind, low vision, regular print readers, learning disabled Ø Criteria - high school students who had completed Algebra I 15 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Research Outcomes Ø Students had limited knowledge of Nemeth Ø Erasing math content was unpredictable Ø Working with grouping symbols was difficult Ø Entering and closing fractions was unexpected Ø Ending trigonometric expressions was unusual 16 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Applications Ø Web-based translation tools Ø Stand-alone translation tools Ø Online high-stakes assessment Ø Real-time classroom translation 17 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
Further work Ø Address remaining defect fixes Ø Limits, derivatives, integrals Ø Combining text and math content Ø Braille math usability Ø Braille math discoverability 18 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
To Be Continued … Real-time Online Two-way Braille-to-Print Mathematical Communication Sam Dooley, Susan Osterhaus, Dan Brown, Edgar Lozano, Su Park http: //accessibility. pearson. com/mathex-app/ 19 Content Math. ML Markup from Nemeth Braille Input 23 Mar 2016
- Slides: 20