TestPlan 8.2.0: Difference between revisions
m (Fix Etoys spelling) |
|||
(26 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
===OLPC Test Areas/Features for 8.2.0=== |
===OLPC Test Areas/Features for 8.2.0=== |
||
This is a |
This is a draft. |
||
Below is the major test areas/features list that will be used to create test cases: |
Below is the major test areas/features list that will be used to create [[Test cases 8.2.0|8.2.0 test cases]]: |
||
==== |
==== Network Connectivity/Collaboration==== |
||
Connectivity and ability to browse the web from WEP and WPA access points. |
|||
⚫ | |||
⚫ | |||
⚫ | |||
⚫ | |||
Active Antenna (low priority for 8.2) |
|||
In a mixed environment (when various wireless points of contact are present in the area), allow switching between different modes of connectivity. |
In a mixed environment (when various wireless points of contact are present in the area), allow switching between different modes of connectivity. |
||
Please see use cases that describe connectivity testing in more detail: [[Use_Cases]] |
|||
==== School Server Backup Feature==== |
|||
Register and automatically save files to school server |
|||
Restore files from school server to XO. |
|||
====Journal/Datastore ==== |
====Journal/Datastore ==== |
||
Be able to save and retrieve activities and files from the Journal. |
|||
⚫ | |||
⚫ | |||
⚫ | |||
==== Activity Updater ==== |
|||
This is located in the sugar control panel, but is being identified here as it needs to be get specific test cases. |
|||
Be able to upgrade Activities based on the default location of Activites. |
|||
Be able to upgrade Activities based on the G1G1/8.2 version of activities. |
|||
Be able to upgrade Activities based on the Peru version, 8.2. (Lower priority as this needs to work for 8.2.1). |
|||
Filter records of actions by title. |
|||
⚫ | |||
==== Power Management (Power Control & Conservation)==== |
==== Power Management (Power Control & Conservation)==== |
||
Line 36: | Line 59: | ||
Original software must be installable at the factory. It can be upgraded via an USB stick (clean install) or over the network (upgrade). Clean install will result in deleting all previously existed user data. When upgraded over the network, user data collected while running previously installed software must be preserved and appear existed after the upgrade. |
Original software must be installable at the factory. It can be upgraded via an USB stick (clean install) or over the network (upgrade). Clean install will result in deleting all previously existed user data. When upgraded over the network, user data collected while running previously installed software must be preserved and appear existed after the upgrade. |
||
For testing, these are the features that need to be addressed: |
|||
# Start with major release currently in the field; upgrade via olpc-upgrade to new release |
|||
# Start with minor release(s) currently in the field; upgrade via olpc-upgrade to new release |
|||
# Use USB upgrade |
|||
# Use cleaninstall procedure |
|||
In the cases of upgrades (rather than cleaninstall), the data and Journal entries from before the upgrade should remain intact. |
|||
==== Firmware==== |
==== Firmware==== |
||
Line 61: | Line 92: | ||
# The text on the screen renders legibly and is directionally correct (left to right, right to left) |
# The text on the screen renders legibly and is directionally correct (left to right, right to left) |
||
The tests to determine items 2 and 3 only include text that is typed in the Sugar UI, Write and Browse. |
The tests to determine items 2 and 3 only include text that is typed in the Sugar UI, Write and Browse. See the list of keyboards we would like to support from the release notes: [[Release_Notes/8.2.0#New_Keyboard_Support]] |
||
'''Translations''' |
'''Translations''' |
||
Line 74: | Line 105: | ||
==== USB/SD Peripherals==== |
==== USB/SD Peripherals==== |
||
⚫ | |||
USB read, write, mount and unmount must work. |
|||
⚫ | |||
Mouse and keyboard must connect and work. |
|||
Use SD cards for normal operation and be able to boot off of SD. |
|||
⚫ | |||
⚫ | |||
Reliably store user data to and retrieve user data from FAT16/VFAT formatted SD/SDHC devices. |
|||
⚫ | |||
⚫ | |||
====Sugar GUI==== |
====Sugar GUI==== |
||
New Home View |
|||
⚫ | |||
Frame features |
|||
Activity launching |
|||
⚫ | |||
Graphical Sugar Control Panel |
|||
⚫ | |||
Remove network configuration settings |
|||
Interact with one activity or "location" at a time |
|||
⚫ | |||
⚫ | |||
Switch between the current activity and other locations with the view keys or the frame |
|||
Switch between activities with Alt-Tab or the |
Switch between activities with Alt-Tab or with the means provided in the Home view. |
||
Start new activities and stop running ones with the frame, ring, or activity toolbar. |
Start new activities and stop running ones with the frame, ring, or activity toolbar. |
||
Browse must render the |
Browse must render at least the web sites listed at |
||
http://dev.laptop.org/ticket/7421 |
|||
Pippy, Record, and TamTam will be able to play and record sounds. |
Pippy, Record, and TamTam will be able to play and record sounds. |
||
Line 111: | Line 141: | ||
Pippy and Record will be able to take photographs. |
Pippy and Record will be able to take photographs. |
||
Record will be able to record short videos. |
Record will be able to record short videos (but not reliably transfer them between laptops). |
||
Measure will be able to measure signals with or without DC voltage bias. |
Measure will be able to measure signals with or without DC voltage bias. |
||
Line 117: | Line 147: | ||
Volume keys on the keyboard will adjust the speaker volume while Sugar is running. |
Volume keys on the keyboard will adjust the speaker volume while Sugar is running. |
||
Should be able to control audio volume with the volume keys in Sugar. |
|||
Pictures can be composed with text in |
Pictures can be composed with text in the Write. |
||
Fancier multimedia like video, audio, and programs can be manipulated in an environment like [ |
Fancier multimedia like video, audio, and programs can be manipulated in an environment like [[Etoys]]. |
||
Copy-and-paste media clips between activities |
Copy-and-paste media clips between activities. |
||
Download media clips into the Journal |
Download media clips into the Journal. |
||
⚫ | |||
Pictures can be composed with text in a system editor such as Write. (We actually expect [go/Write Write] to do a lot of other things.) |
|||
⚫ | |||
Copy-and-paste media clips between activities |
Copy-and-paste media clips between activities |
||
Line 137: | Line 165: | ||
====Performance/scalability==== |
====Performance/scalability==== |
||
⚫ | |||
Loading activities should take the same time or less than previous release. |
|||
The number of laptops that can share/collaborate should be as many or more than the previous release for each scenario. |
|||
⚫ | |||
⚫ | |||
[[Category:Test plans]] |
|||
⚫ | |||
⚫ |
Latest revision as of 20:46, 9 December 2008
OLPC Test Areas/Features for 8.2.0
This is a draft.
Below is the major test areas/features list that will be used to create 8.2.0 test cases:
Network Connectivity/Collaboration
Connectivity and ability to browse the web from WEP and WPA access points.
Sharing between XOs on a simple mesh.
Between XOs with a school server with an 802.11 b/g access point (with or without WEP and WPA/WPA2 encryption). Access point connectivity is currently a priority.
Active Antenna (low priority for 8.2)
In a mixed environment (when various wireless points of contact are present in the area), allow switching between different modes of connectivity.
Please see use cases that describe connectivity testing in more detail: Use_Cases
School Server Backup Feature
Register and automatically save files to school server
Restore files from school server to XO.
Journal/Datastore
Be able to save and retrieve activities and files from the Journal.
List, search, and filter records of actions on the system by time, title, or type.
Be able to display and edit text (rtf, pdf, x-pdf, doc, html), image (png, jpeg, gif), audio (ogg, x-wav, wav), video (ogg, mpeg, avi) formats.
Activity Updater
This is located in the sugar control panel, but is being identified here as it needs to be get specific test cases.
Be able to upgrade Activities based on the default location of Activites.
Be able to upgrade Activities based on the G1G1/8.2 version of activities.
Be able to upgrade Activities based on the Peru version, 8.2. (Lower priority as this needs to work for 8.2.1).
Power Management (Power Control & Conservation)
When the lid is closed or when the power button is pressed quickly while Sugar is running, suspend the machine in order to conserve power.
Resume from suspend in response to lid opening or quickly pressing the power-button.
Power off a machine by holding the power button for several seconds.
Power off or reset the machine via the Central XO-person's Palette.
Control screen brightness with the brightness keys in Sugar.
Installation/Upgrade
Original software must be installable at the factory. It can be upgraded via an USB stick (clean install) or over the network (upgrade). Clean install will result in deleting all previously existed user data. When upgraded over the network, user data collected while running previously installed software must be preserved and appear existed after the upgrade.
For testing, these are the features that need to be addressed:
- Start with major release currently in the field; upgrade via olpc-upgrade to new release
- Start with minor release(s) currently in the field; upgrade via olpc-upgrade to new release
- Use USB upgrade
- Use cleaninstall procedure
In the cases of upgrades (rather than cleaninstall), the data and Journal entries from before the upgrade should remain intact.
Firmware
Developer key should grant access to OFW.
It should be able to reinstall firmware If needed) without reinstalling the whole build.
It should be possible to rewrite manufacturing data (e.g. language, write-protect tags) from OFW (?).
Security
Laptops should travel through the delivery chain unactivated.
Laptops should not boot until they are activated.
Laptops can be activated locally (via USB) or wirelessly (with a school server) (?).
Localization
Keyboards Must support all keyboards that we developed. "Support" is defined as:
- There is a keyboard silkscreen, approved and able to be produced at Quanta
- The keys on the keyboard map to the appropriate characters on the display
- The text on the screen renders legibly and is directionally correct (left to right, right to left)
The tests to determine items 2 and 3 only include text that is typed in the Sugar UI, Write and Browse. See the list of keyboards we would like to support from the release notes: Release_Notes/8.2.0#New_Keyboard_Support
Translations Translations need to be developed and approved by the country as OLPC does not have language expertise.
User documentation
Inside XO and online (wiki) available
Help Activity for G1G1
USB/SD Peripherals
Store and retrieve user data from FAT16/VFAT formatted USB Mass Storage and SD/SDHC devices.
USB ethernet adapters, keyboards, and mice should function similarly to their normal function in other operating systems.
Use SD cards for normal operation and be able to boot off of SD.
Login via serial consoles. (low priority)
Sugar GUI
New Home View
Frame features
Activity launching
Graphical Sugar Control Panel
Remove network configuration settings
Activities
Installing or removing activities should not affect the ability of the system to run.
Switch between activities with Alt-Tab or with the means provided in the Home view.
Start new activities and stop running ones with the frame, ring, or activity toolbar.
Browse must render at least the web sites listed at
http://dev.laptop.org/ticket/7421
Pippy, Record, and TamTam will be able to play and record sounds.
Pippy and Record will be able to take photographs.
Record will be able to record short videos (but not reliably transfer them between laptops).
Measure will be able to measure signals with or without DC voltage bias.
Volume keys on the keyboard will adjust the speaker volume while Sugar is running.
Should be able to control audio volume with the volume keys in Sugar.
Pictures can be composed with text in the Write.
Fancier multimedia like video, audio, and programs can be manipulated in an environment like Etoys.
Copy-and-paste media clips between activities.
Download media clips into the Journal.
Fancier multimedia like video, audio, and programs can be manipulated in an environment like Etoys.
Copy-and-paste media clips between activities
Download media clips into the Journal
Performance/scalability
TBD.
Hardware
Support robust behavior, ability to operate with internal (touch-pad, keyboard, etc.) and external devices (mouse, etc.)