1 / 30

Navigable, Customizable TTS for Algebra

Navigable, Customizable TTS for Algebra. Lois Frankel Educational Testing Service (ETS) Neil Soiffer Design Science, Inc . CSUN March 1, 2013. Presentation Overview. Project Motivation, Goals, and Background Development to date: discussion and demonstration Research Studies Next Steps.

willis
Download Presentation

Navigable, Customizable TTS for Algebra

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Navigable, Customizable TTS for Algebra Lois Frankel Educational Testing Service (ETS) Neil Soiffer Design Science, Inc. CSUN March 1, 2013

  2. Presentation Overview • Project Motivation, Goals, and Background • Development to date: discussion and demonstration • Research Studies • Next Steps

  3. Handouts are available at: www.atia.org/orlanohandouts Project Motivation • Text-to-speech (TTS) vs. Math-to-speech • Limited choice of syntax/semantics • Limited screen-reader support • Limited or no within-expression navigation • Difficult to author • Works in limited environments • ETS Experience

  4. Handouts are available at: www.atia.org/orlandohandouts Project Goals • Focus on instruction, not assessment • High school algebra • Classroom-like synthesized speech “style”: ClearSpeak • Customization features • Interactive navigation • Author in Word • Playback in Word and IE

  5. Handouts are available at: www.atia.org/orlandohandouts Not Part of Project • Braille • Support for other formats • Authoring by people with visual impairment • Solving math problems • Tutoring/Curriculum • Integration with standardized testing

  6. Handouts are available at: www.atia.org/orlandohandouts Behind the Scene: MathML • The language of math on the web • HTML5, eBooks • Browser support & MathJax • Designed for Accessibility • Daisy players • IE + MathPlayer + AT

  7. Handouts are available at: www.atia.org/orlandohandouts What is MathML? <math><mroot><mi>x</mi><mn>3</mn></mroot></math>

  8. Project Software for Math • MathML Tools: • Authoring: MathType+Word • Audio rendering: MathPlayer • Screen reader • Window-Eyes (Word & IE)

  9. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  10. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  11. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  12. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  13. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  14. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  15. Handouts are available at: www.atia.org/orlandohandouts How Math Speech Works • Rules • Preferences • Exact Speech

  16. Handouts are available at: www.atia.org/orlandohandouts ClearSpeak • Many ways to speak math • ClearSpeak design philosophy • Other design philosophies • MathSpeak • SimpleSpeech

  17. Handouts are available at: www.atia.org/orlandohandouts Demonstration • Authoring • Using MathType in Word to enter math and use preferences • Entering exact speech in Word • Playback • Word with Window-Eyes

  18. Handouts are available at: www.atia.org/orlandohandouts Project Goals Recap • ClearSpeak • Author in Word • Allow setting preference and exact speech • Playback in Word and IE • Interactive navigation

  19. Creating Expressions and Questions for Studies • Level • Degree of complexity • Relevance of speech variations • Provide useful data • Test comprehension, not computation • Guide decisions about speech rules, preferences

  20. Handous are available at: www.atia.org/orlandohandouts Feedback Study #1 • Compared ClearSpeak, MathSpeak, SimpleSpeech • Fractions, exponents, parentheses • Focus: was expression understood? • Research/Statistical consultation • 16 HS students: blind or low vision

  21. Handouts are available at: www.atia.org/orlandohandouts Results Summary • ClearSpeak more understandable than Simple Speech or MathSpeak • Students overall preferred ClearSpeak • Students got more answers correct with ClearSpeak than with Simple Speech or MathSpeak

  22. Handouts are available at: www.atia.org/orlandohandouts One Expression’s Results

  23. Familiarity and Understanding

  24. Handouts are available at: www.atia.org/orlandohandouts Feedback Study #2 • Can Prosody help understanding? • Pauses • Pitch • Rate Changes • Volume Changes • Rejected pitch and volume changes • non-speech sounds not an option • Focus on pauses, rate-change vs. start/end

  25. Handouts are available at: www.atia.org/orlandohandouts Feedback #2 Example vs. • With Pauses / rate change • Expression 1 • Expression 2 • With “end root” • Expression 1 • Expression 2

  26. Handouts are available at: www.atia.org/orlandohandouts Feedback #2 Another Example Nested Parentheses: • Uniform Pauses • Non-uniform pauses • Non-uniform pauses and “First Paren”

  27. Handouts are available at: www.atia.org/orlandohandouts Navigation • Simple char by char mode for beginners • Powerful navigation features for experts • Read • Describe • Multiple ways of moving • Tree • Character, Placemarker, Semantic • After tree move: read or describe • 10 Placemarkers, 2 Cursors, Where am I?

  28. Handouts are available at: www.atia.org/orlandohandouts Participation Opportunities • Blind or Visually Impaired Students • Teachers

  29. Handouts are available at: www.atia.org/orlandohandouts Contact Information • Lois Frankel: lfrankel@ets.org • Neil Soiffer: neils@dessci.com • Beth Brownstein: bbrownstein@ets.org • MathPlayer: http://www.dessci.com/en/products/mathplayer/ The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324A110355 to the Educational Testing Service. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

  30. Handouts are available at: www.atia.org/orlandohandouts Thank you for attending this session

More Related