Listen and Spell

Listen and Spell Assim Deodia

Idea

The idea is to develop an application which would help children to learn new words, improve their vocabulary and pronunciation of words. The activity would speak out a randomly selected word from a predefined set of words and the user is expected to spell the word correctly. For voice synthesis activity would be using Speech-Dispatcher and for the list of words it will have a custom dictionary. This activity is an extension of TalknType.

Need

The basic thing needed to learn a language is to learn its building blocks i.e. words and their pronunciation and how they are spelled. Grammar of course had its preference. This project aims to provide an activity which would help children to learn new words, their pronunciation, the way they are spelled and to some extent its meaning also.

Use Case Scenario

A simple use case scenario of the Test Mode is as follows

• User opens the activity and enters the difficulty level of which he/she would like to hear words.
• A random word would be selected and spoken out from the corresponding level:word list. e.g. "Spell Ocean" would be spoken out.
• User is required to spell the word correctly. (Time limit can be optional)
• The activity would speak out each letter as the user types and the whole word as user submit the word.(This will help user to "feel" the difference between his spelling and the correct one.) This option can be disabled in case of group test(explained further).
• There would be an option to repeat the word and also for the hint.
• The hint option will either give user the meaning of the word or its usage in the sentence or image if possible. E.g. for Ocean it can either speak out its usage "The ocean is full of water" or can print its definition on screen i.e. "One of the five large bodies of water separating the continents".
• User can quit or change the level any time during the game.

To make user experience more lively, sounds for different events (Like activity start, Correct answer, Wrong Answer) would be used.

Level Description

Level of a word is decided primarily on the basis of the number of letters in it. Most of the words would be nouns which can be easily understand by children.

• Initial level would include three to four letter words
  • e.g. cat, dog, tree, cup, bear etc

• Medium level would contain five to six letters words
  • e.g. monkey, mouse, earth, plane, toffee etc

• Hard level: Seven or more letters
  • e.g. computer, Mississippi, dictionary etc
• professional level (If included) would have complete sentences.

Proposed features

Following are the proposed features for the activity

1. *Word source:- The word source would be a expandable custom dictionary which would be using word list from Words activity. Words currently support French, German, Italian, Portuguese, and Spanish and of course English. An option would be provided to update dictionary which would search on the network for the dictionary server and update itself.
2. *Implementation of "Hint" :- This would be using http://en.wiktionary.org. I have explained this further in following sections.
3. Speech-dispatcher: - The voicing would be done using speech dispatcher which would eventually be using espeak for synthesis. Espeak supports more than 30 international languages.
4. User defined word list: - This would facilitate users to add their own word list which can help in conducting a small group test. Option to add words through mesh network would be help in large group/class test.
5. Multiplayer game over mesh network: - Users can challenge each other over the network. One XO will then act as a server which would generate the word list for all the clients. All the users would receive same word list with limited retry option for each word after which next word would be given to user. The one who spelled most correct words in limited time wins. Option to speak each letter aloud would be disabled in this case.
6. Memory tool (A possible extension):- A tutor mode in which activity repeats the word again and again until the spelling is absorbed into child's mind.
7. Input Methods :- Input Methods would be exposed externally so that otehr input methods(Like Handwritting and Speech recognization) could be incorporated

Other supportive features

1. Voice configuration: Option to edit voice configuration like volume, pitch, rate, language of the words and voice, gender of the voice etc.
2. Preferences to choose level of “Hint”: i.e. to select from word usage or word definition or images if possible.
3. Option to save the score as well as game also (in Journal) and retrieve later.

Implementation Details

• For the word source an expandable dictionary would be implemented which would initially use the word list from Words activity (http://dev.laptop.org/~cjb/words/Words-2.xo) (Due to rainbow security one activity cannot access data of another activity) it will also contain their definition and usage in an XML format so that it can be accessible through the activity. I am also looking for another open source dictionaries as a possible option. Newer words would be updated manually or through a server on mesh network. This would require one of the laptop to act as a server
• There would be two ways to implement 'Hint' option

1. Hint part would be fetched from the implemented dictionary
2. Using Wiktionary API. These API's provide a direct, high-level access to the data contained in the Media Wiki databases. Using these APIs it would be possible to extract definition or usage of the word easily. These APIs returns the data in many formats like JSON, XML, txt etc. e.g. http://en.wiktionary.org/w/api.php?action=parse&page=ocean&prop=text&format=xml will give information about "ocean" in XML format. It may look like some absurd text but with proper parsing information like translation to other language, meaning can be extracted

• Speech-Dispatcher: Speech-Dispatcher (http://www.freebsoft.org/speechd) is a socket-connection based speech server which provides speech APIs in many languages including Python and C. I had a discussion with OLPC developers where considering the need of speech server in XO they agreed to ship this in XO once its RPM is approved by Fedora Package Maintainers. Its RPM is under review process and should get approved soon. I have already got approval for its dependency Dotconf RPM
• Language of implementation: Python
• GUI: All the GUI part would be done in PyGTK and Glade
• Parser for configuration files and dictionary data: OLPC includes many python modules which also include expat xml parser. This module can be used to parse the data and extract the information required
• To have access over mesh network:- PresenceService DBUS API would be used

Possible extension

One could be a tutorial for learning languages using this activity like 1) The activity would teach basic sounding vowels like a as in cat, e as in bed, air as in hair etc 2) Sounds of consonants like b as in bed, ch as in change, d as in day etc 3) Teaching the sound of the whole word It would be great if children enters the words and get to know how to pronounce

I would really appreciate if you can give some suggestion of feedback on my proposal here (http://wiki.laptop.org/go/Talk:Listen_and_Spell).

Resources

1. TalknType
2. Speech Dispatcher
3. Words Activity
4. Speech Synthesis
5. Screen Reader
6. Speak & Spell