TestPlan 8.2.0

From OLPC
Revision as of 16:53, 5 August 2008 by Kimquirk (talk | contribs) (OLPC Test Areas/Features for 8.2.0)
Jump to: navigation, search

OLPC Test Areas/Features for 8.2.0

This is a work-in-progress...

Major test areas/features to be covered are:


Collaboration/Connectivity

Between XOs with simple mesh (associate with other XO or Active-Antenna 802.11s meshes).

Between XOs with a school server with an active antenna and an access point (associate with 802.11 b/g access points with or without WEP and WPA1 encryption).

In a mixed environment.

Journal

List, search, and filter records of actions on the system by time

filter records of actions by title

Datastore

Be able to display and edit DOC, ODT, JPEG, PNG, GIF, WAV, OGG, HTML, JS, some SWF, and several other less-well known formats.

We expect NOT to be able to display [go/Restricted_Formats restricted formats] including MP3, MPEG, most AVI, RM, FLV, etc.


Power Management (Power Control & Conservation)

When the lid is closed or when the power button is pressed while Sugar is running, suspend in order to conserve power.

Resume from suspend in response to lid opening or power-button presses

Cut power by holding the power button for several seconds

Power off or reset the machine via the Central XO-person's Palette

Control screen brightness and suspend state from the root command-line

Control screen brightness with the brightness keys in Sugar


Installation/Upgrade

Must be able to cleaninstall from a production image to a laptop. All data is lost. Tests/Boot/Cleaninstall

W/ internet or preparation: install new activities and library content on a raw OS via the internet or via USB keys.

W/ internet: olpc-update to new versions of the operating system via the internet. Data in /home should be PRESERVED.

W/ preparation: olpc-update to new versions of the operating system via USB. Data in /home should be PRESERVED.

Access the root account via the virtual terminals or via the Terminal activity (if present.)


Access to the firmware "ok" prompt w/ developer key, requestable through Browse and installable through the Terminal.

Firmware

Developer keys should grant access to OFW.

Should be able to flash any build from OFW.

Should be able to rewrite manufacturing data (e.g. language, write-protect tags) from OFW (Very low priority, not a public feature)

Should respond to gamepad [go/Cheat_codes Cheat codes]

Security

Laptops should travel through the delivery chain unactivated.

Laptops should not boot until they are activated.

Can be activated wirelessly (with a school server) (not recently tested)

Can be activated via USB.


Performance/scalability

Localization

Keymaps are correct or are very close to correct for US/International, Amharic, Spanish, Portuguese, and Kreyól keyboards.

Translations

User documentation

Inside XO and online (wiki) available

TBD

USB/SD Peripherals

Reliably store user data to and retrieve user data from FAT16/VFAT formatted USB Mass Storage devices.

Reliably store user data to and retrieve user data from FAT16/VFAT formatted SD/SDHC devices.

USB ethernet adapters, keyboards, and mice should function similarly to their normal function on other operating systems.

Login via serial consoles. (very low priority)


Sugar GUI

TBD


Activities

Interact with one activity or "location" at a time

Switch between the current activity and other locations with the view keys or the frame

Switch between activities with Alt-Tab or the activity ring

Start new activities and stop running ones with the frame, ring, or activity toolbar.

Pippy, Record, and TamTam will be able to play and record sounds.

Pippy and Record will be able to take photographs.

Record will be able to record short videos.

Measure will be able to measure signals with or without DC voltage bias.

Volume keys on the keyboard will adjust the speaker volume while Sugar is running.

Control audio volume with the volume keys in sugar

Pictures can be composed with text in a system editor such as Write. (We actually expect [go/Write Write] to do a lot of other things.)

Fancier multimedia like video, audio, and programs can be manipulated in an environment like [go/EToys EToys].

Copy-and-paste media clips between activities

Download media clips into the Journal

Pictures can be composed with text in a system editor such as Write. (We actually expect [go/Write Write] to do a lot of other things.)

Fancier multimedia like video, audio, and programs can be manipulated in an environment like [go/EToys EToys].

Copy-and-paste media clips between activities

Download media clips into the Journal

The section below has to be edited (in progress)… Installing or removing activities should never change the ability of the system to run.

1 - Start activities at the same speed (including but not limited to all

fructose activities)

2 - Boot to home at the same speed.

3 - Cursor control the same, including number of XOs where it moves

without input or moves without correlation to finger on touchpad

3 - Connect to the same APs in the same time and with the same user

feedback. (e.g. blinks then shows white circle).

4 - Connect to active antennas in the same time and with the same user

feedback (e.g. blinks then shows white circle).

5 - Run all the same activities (can require activity upgrade within

documented bounds). Includes allowing activities to mesh the same way.

6 - Connect to mesh with the same number of XOs in the same time with

the same failure rate.

7 - Save and open files for all activities. Fructose activities at a

minimum otherwise all activities per 5 above. Including when journal has

thousands of entries.

8 - Use the same NAND space.

9 - Always boots up, especially when there is no space on NAND

10 - Open and close all activities per 5 above.

11 - Must support all languages and keyboards previously supported.

"support" means all previously translated strings still work in

activities and sugar. All language types work the same (e.g. RTL)

12 - No new cases where the XO crashes and needs hard reboot.

13 - No new cases where the cursor stops responding (AKA hangs) for more

than 30 seconds.

14 - Sound and video recording and playback must record at the same

rate. Must playback all the same kinds of files. Must playback with the

same quality (assuming all other variables constant, e.g. network,

RAN=M, disk space, etc.)

15 - Browse must render the same web sites as before. See also

http://dev.laptop.org/ticket/7421

16 - USB read, write, mount and unmount must work the same and for all

the same devices.

17 - Mouse and keyboard must connect and work the same

18 - Journal has the same capabilities.

19 - Must use the same or less power for the same user interaction

20 - Must have the same security mechanisms and be as secure as previous

releases.

21 - Must be installable in the factory and upgradeable from 656, 703

and 708 via USB or network.


Hardware/Firmware

Robust behavior, ability to operate with user-oriented (touch-pad, keyboard, etc.) and external devices (mouse, etc.)