Testing: Difference between revisions

From OLPC
Jump to navigation Jump to search
No edit summary
No edit summary
 
(113 intermediate revisions by 18 users not shown)
Line 1: Line 1:
{{outdated}}
{{OLPC}}
{{OLPC}}
The community and core team work through a slate of '''test issues''' for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.
The community and core team work through a slate of '''test issues''' for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.


{{Latest Releases | firmware = inline | devel = inline | rc = inline | livecd = inline |server = inline }}
For the latest tests, see [[Update.1 tests]].
== Release info ==
=== Testing for release 11.3.1 ===
Testers are reporting test results on the testing [[Mailing lists|mailing list]] or by [[reporting bugs]].


They are ''not'' using [[Test group release notes]].
== Notes and minutes ==
=== Testing for release 11.2.0 ===
* [[Test meeting Minutes]] - Weekly meetings of interested test people, Mondays 1pm EDT
See [[Test_cases/11.2]] for information about testing the [[11.2.0]] release.
* [[Requirements]]


=== Testing for the 10.1.x releases ===
== General navigation ==
* [[10.1.3/Testing]] for [[:Category:Community testing]] of the [[Release notes/10.1.3|10.1.3 release]]
Many related pages need to be merged:
* [[Smoke_test/10.1.x/1_hour_smoke_test]]
{{Test-nav}}


=== Testing for major release 8.2.0 ===
* [[Release_notes/8.2.0#New_features_in_8.2.0|New features in 8.2.0]], on top of [[XO_Base_Features]] of 8.1.1
* [[TestPlan 8.2.0]]
* [[Test cases 8.2.0]], a set of test cases developed in the wiki
* [[TestResults 8.2.0]]


=== Release info ===
=== Testing for minor releases 8.1.x ===
* Release 8.1.3, [[OLPC SW-ECO 7]], More Amharic support
* Release 8.1.2, [[OLPC SW-ECO 6]], Nand-full, SD card corruption, support of C3 production boards
* Release 8.1.1, [[OLPC SW-ECO 5]], Amharic and Kreyol support
** [[Release_notes/8.1.1|Release notes for 8.1.1]]


=== Testing for release 8.1.0 ===
* August Release 8.2.0, on top of 8.1.1
[[Release notes/8.1.0|Release 8.1.0]] was also known as "Update.1", see [[Update.1 tests]] for tests and [[Testing Update.1 Results]].
** [[TestCases_8.2.0]]
** [[TestResults_8.2.0]]
** [[Release_Notes/8.2.0#New_Features_in_8.2.0|New Features in 8.2.0]]
* [[XO_Base_Features]]
* [http://wiki.laptop.org/go/OLPC_SW-ECO_5 Minor Release 8.1.1]


==Community testing==
==== Older notes ====
People interested in testing should join the [http://lists.laptop.org/listinfo/testing Testing mailing list], which is also mirrored on an external [http://olpc.396210.n2.nabble.com/Testing-f1469263.html forum].
* [[Test process sprint]]- Wed, Oct 17th, 2007


The awesome New Zealand testers use a very simple [[Activity testing template]].
== Links of Interest ==

* [[Systematic testing]]

Test beds:
* [[Creating a testbed]]
* [[Wireless Sparse Testbed]] - Universidade Federal Fluminense, Brazil
* [[Ejabberd resource tests/try_5]] school server jabber testing

''Older'' obsolete community efforts:
* [[Community testing]]
* [[Friends in testing]]
* [[Activity testing project]]
* [[Testing matrix]]
* [[Activity testing template]]

== Links of Interest to Testing ==
* [[Creating new test cases]]
* [[Test Config Notes]] - Links to configuration info that are useful in testing
* [[Test Group Release Notes]] - Quick info/smoke test on the latest builds. Read this before you bother to load a build
* [[Upgrading the XO| Different upgrade paths and which to use]]
** Also see Builds of Interest below
* [[Multi-hop mesh network in MIT campus]]
* [[Multi-hop mesh network in MIT campus]]
* [[Networking scenarios]]
* [[Networking scenarios]]
* [[Simple mesh test (Cerebro)]]
* [[Simple mesh test (Cerebro)]]
* School Server general info: [[XS]]
* [[Schoolserver Testing]]
** [[Schoolserver Testing]]
* [[Test Group Release Notes]] - Quick info/smoke test on the latest builds. Read this before you bother to load a build
** [[Update.1 tests]] - test process for the 8.1.0/Update.1 builds (builds 691...703)
** [[Release Notes/8.1.0]] - release notes for 8.1.0 also known as "Update.1"
** [[Testing_Update.1_Results]] - some test results for Update.1 (in progress...)
** [[OLPC Ship.2 Software Release Notes]] - release notes for Ship2, build 650
* [[Test Config Notes]] - Links to configuration info that are useful in testing
** [[Upgrade Paths| Different upgrade paths and which to use]]
* 100 Laptop Testbed:
* 100 Laptop Testbed:
**[[Collaboration_Network_Testbed]]
** [[Collaboration_Network_Testbed]]
**[[Peabody Setup]] - 100 laptop test setup in Peabody, MA
** [[Peabody Setup]] - 100 laptop test setup in Peabody, MA
* [[Activation and Developer Keys]] - how to activate or get a developer key
* [[Activation and Developer Keys]] - how to activate or get a developer key
* [[Scenario taxonomy]]
* [[Scenario taxonomy]]
* [[Requirements]]
* [[Requirements]] (no longer used)


Equipment specs:
Equipment specs:
* Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
* Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
* Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
* Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
* [[XS_Server_Specification#XSX_Specifications|Server HW Specs]] (Approx. $3000 USD)
* [[XS_Server_Specification#XSX_Specifications|Server HW Specs]]


== Builds of interest==
Check out these new links to test plans and result matrices -- Get involved and help test some activities:
See [[OS images]] for build streams, release candidates, joyride builds, etc.


For latest activities, run Software update in [[Sugar Control Panel]], or download individual [[Activities]].
==Community Testing:==

* [[Friends in testing]]
===Older builds and activities ===
* [[Activity Testing Project]]
* [[Activity Testing Matrix]]
* [[Activity Testing Template]]


== Builds of Interest:==
* [http://download.laptop.org/xo-1/os/official/ Recent stable builds]
* [http://pilgrim.laptop.org/~pilgrim/olpc/streams/update.1/ "Update.1" builds]
* [http://pilgrim.laptop.org/~pilgrim/olpc/streams/update.1/ "Update.1" builds]
* [http://xs-dev.laptop.org/~cscott/olpc/streams/ "Bleeding-edge" builds]
* [http://xs-dev.laptop.org/~cscott/olpc/streams/ship.2 "Ship.2" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/joyride "Joyride" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/faster "Faster" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/meshtest "Meshtest" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/ship.2 "Ship.2" builds]
* [http://pilgrim.laptop.org/~pilgrim/olpc/streams/olpc3/ "OLPC-3" builds]
* [http://download.laptop.org/xo-1/os/candidate/ "Candidate" builds] before they go public


Activities script/latest activities:
Activities script/latest activities for 8.1:
* From a laptop that is connected to the internet, start a Terminal Activity and type: '''wget http://dev.laptop.org/~erikos/sucrose-activities.py'''
* http://dev.laptop.org/~erikos/sucrose-activities.py'''
* [http://dev.laptop.org/~erikos/bundles/0.81.4/ Latest 0.81.4 activities] (July 2008)
* Then type: '''python sucrose-activities.py'''
* [http://dev.laptop.org/~erikos/bundles/0.81.4/ Link to Latest Activities]


== Testing teams ==
== Notes and minutes ==
* [[Testing meetings]] - Weekly meetings of interested test people, usually Thursdays


== General navigation ==
The Activities on the XO have been developed by community members. Many of them are not well documented and there may not be much information on how to use them; so this testing can be described as 'Descriptive Testing', where you are helping to provide and/or correct the wiki pages that describe how an activity works. If you want to help, please refer to the '''[[Community_Testing|Community Testing]]''' page for more details.
[[Test cases 8.2.0]] lists the test cases created for the recent [[Release notes/8.2.0|release 8.2.0]].


Test results are in [[TestResults 8.2.0]]
===Testing at OLPC===


The {{tl|Community testing}} navigation template is shown below:
====Test Plan====
{{Community testing}}


<br clear="all" />
Below is an unformatted (yet) draft. Please excuse its appearance..
The navigation template {{tl|Test-nav}} is shown below, it should be updated and many related pages need to be merged:
{{Test-nav}}


== Test cases and test results ==
Test Plan/Release Criteria for 8.2.0
Mid-2008 users including Femslade, Charlie, and Kimquirk created test cases for [[8.2.0]] that can be created and modified using a form.
This is a work-in-progress...
Testers can also use the same form to add testing results, see [[Reporting test results]].
Major test areas/features to be covered are:
Hardware/Firmware (robust behavior, ability to operate with user-oriented (touch-pad, keyboard, etc.) and external devices (mouse, etc.)
Power Management (Power Control & Conservation)
When the lid is closed or when the power button is pressed while Sugar is running, suspend in order to conserve power.
Resume from suspend in response to lid opening or power-button presses
Cut power by holding the power button for several seconds
Power off or reset the machine via the Central XO-person's Palette
Control screen brightness and suspend state from the root command-line
Control screen brightness with the brightness keys in Sugar


See, e.g. [[Tests/Activity/Write/Public_sharing]] as a sample.
Peripherals
Reliably store user data to and retrieve user data from FAT16/VFAT formatted USB Mass Storage devices.
Reliably store user data to and retrieve user data from FAT16/VFAT formatted SD/SDHC devices.
USB ethernet adapters, keyboards, and mice should function similarly to their normal function on other operating systems.
Login via serial consoles.
We do not have strong expectations about the behavior of other peripherals.
Firmware


All these test cases are in [[:Category:Test cases]] and most are listed by the queries in [[Test cases 8.2.0]].
Developer keys should grant access to OFW.
Should be able to flash any build from OFW.
Should be able to rewrite manufacturing data (e.g. language, write-protect tags) from OFW
Should respond to gamepad Cheat codes
Installation of Software (operating system, Sugar, activities) and firmware. Field upgrades.
W/ internet or preparation: install new activities and library content on a raw OS via the internet or via USB keys.
W/ internet: install new software via 'yum install' or 'rpm -U' on a raw OS via the internet. Data in /home should be PRESERVED.
W/ internet: olpc-update to new versions of the operating system via the internet. Data in /home should be PRESERVED.
W/ preparation: olpc-update to new versions of the operating system via USB. Data in /home should be PRESERVED.
W/ preparation: reflash appropriately signed builds via USB. NO DATA should be preserved.
Access the root account via the virtual terminals or via the Terminal activity (if present.)
Some downstream partners such as Uruguay intend to disable user access to the root account as part of their theft-deterrence plan.
Access to the firmware "ok" prompt w/ developer key, requestable through Browse and installable through the Terminal.
Sugar GUI
TBD
Datastore
Be able to display and edit DOC, ODT, JPEG, PNG, GIF, WAV, OGG, HTML, JS, some SWF, and several other less-well known formats.
We expect NOT to be able to display restricted formats including MP3, MPEG, most AVI, RM, FLV, etc.
Activities
Interact with one activity or "location" at a time
Switch between the current activity and other locations with the view keys or the frame
Switch between activities with Alt-Tab or the activity ring


In 2007 and early 2008, tests were just wiki pages, e.g. [[Tests/Browse]]. Those older test cases are mostly in [[:Category:Test Plans]] and/or [[:Category:Tests]].
Start new activities and stop running ones with the frame, ring, or activity toolbar.
Pippy, Record, and TamTam will be able to play and record sounds.
Pippy and Record will be able to take photographs.


=== Test case management ===
Record will be able to record short videos.


To add test categories to the pull down menu in [[Form:Test case]], modify
Measure will be able to measure signals with or without DC voltage bias.
[[Property:Test category]]


To add stream checkboxes to [[Form:Test case]], modify
Volume keys on the keyboard will adjust the speaker volume while Sugar is running.
[[Property:Build stream]]


To build queries that list test cases, edit [[TestCase Queries]] and copy the <tt><nowiki>{{#ask:&nbsp;...&nbsp;}}</nowiki></tt> markup.
Control audio volume with the volume keys in sugar
For other examples of queries, see [[Testcase Query Examples]]
Pictures can be composed with text in a system editor such as Write. (We actually expect Write to do a lot of other things.)
Fancier multimedia like video, audio, and programs can be manipulated in an environment like EToys.


Comments at [[Semantic MediaWiki#Issues for Test cases]].
Copy-and-paste media clips between activities


== Testing areas ==
Download media clips into the Journal
:''These "User stories" tests date from 2007-2008''
<!--
These are tests for the builds, materials on them, networks, school servers, and any global synchronization. There is a [[Test activity]] being designed to make testing on an XO simple, and independent of the details of the backend that tracks test results.


Any volunteer who is willing to test should be directed to one single portal: [[Test_issues|Testing]], and s/he can choose which tasks s/he would like to execute. --Chih-yu, Jan 2008
Pictures can be composed with text in a system editor such as Write. (We actually expect Write to do a lot of other things.)
-->
High level topics for "User stories testing" can be divided into a few major categories:


=== One Hour Smoke Test ===
Fancier multimedia like video, audio, and programs can be manipulated in an environment like EToys.


# [[Smoke test]] links to the 1-hour smoke test for different releases, and other smoke tests.
Copy-and-paste media clips between activities


=== Networks ===
Download media clips into the Journal
# [[Tests/100 laptops]]


=== Views and visualizations ===
The section below has to be edited (in progress)…


#[[Tests/Home view|Home view]]
Installing or removing activities should never change the ability of the system to run.
#[[Tests/Groups view|Groups view]]
1 - Start activities at the same speed (including but not limited to all
#[[Tests/Neighborhood view|Neighborhood view]]
fructose activities)
#[[Tests/Frame|Frame]]
2 - Boot to home at the same speed.
3 - Cursor control the same, including number of XOs where it moves
without input or moves without correlation to finger on touchpad
3 - Connect to the same APs in the same time and with the same user
feedback. (e.g. blinks then shows white circle).
4 - Connect to active antennas in the same time and with the same user
feedback (e.g. blinks then shows white circle).
5 - Run all the same activities (can require activity upgrade within
documented bounds). Includes allowing activities to mesh the same way.
6 - Connect to mesh with the same number of XOs in the same time with
the same failure rate.
7 - Save and open files for all activities. Fructose activities at a
minimum otherwise all activities per 5 above. Including when journal has
thousands of entries.
8 - Use the same NAND space.
9 - Always boots up, especially when there is no space on NAND
10 - Open and close all activities per 5 above.
11 - Must support all languages and keyboards previously supported.
"support" means all previously translated strings still work in
activities and sugar. All language types work the same (e.g. RTL)
12 - No new cases where the XO crashes and needs hard reboot.
13 - No new cases where the cursor stops responding (AKA hangs) for more
than 30 seconds.
14 - Sound and video recording and playback must record at the same
rate. Must playback all the same kinds of files. Must playback with the
same quality (assuming all other variables constant, e.g. network,
RAN=M, disk space, etc.)
15 - Browse must render the same web sites as before. See also
http://dev.laptop.org/ticket/7421
16 - USB read, write, mount and unmount must work the same and for all
the same devices.
17 - Mouse and keyboard must connect and work the same
18 - Journal has the same capabilities.
19 - Must use the same or less power for the same user interaction
20 - Must have the same security mechanisms and be as secure as previous
releases.
21 - Must be installable in the factory and upgradeable from 656, 703
and 708 via USB or network.
--------
Collaboration/Connectivity
Between XOs with simple mesh (associate with other XO or Active-Antenna 802.11s meshes).
Between XOs with a school server with an active antenna and an access point (associate with 802.11 b/g access points with or without WEP and WPA1 encryption).
In a mixed environment.
With non-XO machines
Security
Laptops should travel through the delivery chain unactivated.
Laptops should not boot until they are activated.
Can be activated wirelessly (with a school server) (not recently tested)


<!--
Can be activated via USB.
{|
Performance/scalability
|-
TBD
! Tests !! Results !!
Localization, including correctness of language-specific icon-related text
|-
Keymaps are correct or are very close to correct for US/International, Amharic, Spanish, Portuguese, and Kreyól keyboards.
| [[Tests/Mesh view]] || [[Results/Mesh view]]
Translations of system strings need help!
|-
User documentation - inside XO and online (wiki) available
| [[Tests/Neighborhood view]] || [[Results/Neighborhood view]]
TBD
|-
Maintaining history
|}
List, search, and filter records of actions on the system by time
-->
filter records of actions by title


=== Mime Types ===
----------------


# [http://www.yolinux.com/TUTORIALS/LinuxTutorialMimeTypesAndApplications.html Mime Types test] from ''yolinux.com''
To report results from a set of test cases, add a line to the appropriate table in the test case pages below with a quick summary; and include details, including setup and test team, on the talk page.
:*[[What should go into Mime Type tests]]


===Battery Life===
* [[8.1.1_Features_to_Test|8.1.1 Features to be Tested]]
Base line test for battery life. Boot up the machines, fully charge, remove the adapters and see how long the battery lasts.
* [[Update.1 tests]]
* [[Battery Results]]
* [[Ship2.2|Ship2.2 test cases]] - complete
**[[Image:Baseline_battery_test.pdf | Battery Life Test 1 Results]] <br>
* User-focused test plans:
*: User-focused test plans are being developed for all the basic features of the laptop, for many of the activities, and for the interaction with the school server, collaboration, connectivity, etc. Please follow the [[User Stories Testing|User-Focused Test Plans]] page to read, review, and help create test plans.


====Items to Test====
=== Regular processes ===

# [[Tests/Start up and Activation]]
# [[Test Basic Operation]]
# [[Tests/Connectivity and Collaboration]]
# [[Tests/Archive, Backup, Content]]
# [[Tests/Invite]]

=== International Laptops ===
# [[Tests/Keyboard mappings]]
# [[Tests/Language settings]]

=== Upgrading ===
# [[From last stable build]]
# [[Tests/Backward_Comp]]

=== Hardware and firmware ===

# [[Tests/SD card]]
# [[Tests/SD card acting as a usb drive in card reader]]
# [[Tests/USB stick]]
# [[Tests/Manufacturing Data]]
# [[Tests/Suspend_Resume|Tests/Suspend and resume]]

=== Network/Time Sync ===

# [[Tests/Time sync]]
# [[Tests/Network mgr]]

=== SchoolServer ===


===In-house testing (from 2007?) ===
''Old''?

Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:


Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:
* All keyboards. - [[Tests/Keyboard_mappings|Test: Keyboard Settings]]
* All keyboards. - [[Tests/Keyboard_mappings|Test: Keyboard Settings]]
** Keys match the layouts designed
** Keys match the layouts designed
Line 252: Line 224:
* Security
* Security


=== Other test plans ===


*[[802.11s Connectivity Test Plan]] - Connectivity, wifi protocol from 2007
Other Test plans:
*[[802.11s Connectivity Test Plan]] - Connectivity, wifi protocol
*[[Image:B3-B4 OLPC Test Plan.xls]] - Low level test plan from 2007
*[[Image:B3-B4 OLPC Test Plan.xls]] - Low Level Test Plan
*<strike>[[Tinderbox Testing]] - automated testing for each build</strike> (outdated) --[[User:Chihyu|Chihyu]] 13:58, 29 January 2008 (EST)
*<strike>[[Tinderbox Testing]] - automated testing for each build</strike> (outdated) --[[User:Chihyu|Chihyu]] 13:58, 29 January 2008 (EST)
*[[XMPP collaboration and scalability testing]] - XMPP collaboration and scalability testing
* see [[:Category:Tests]] and [[:Category:Test Plans]] ''TODO: These older test plans should be marked obsolete or merged into test cases.''


==Schedule==

'''Schedule:'''<br>


Please see the [http://dev.laptop.org/roadmap official roadmap] (from the trac main page) for schedule dates and features for each release.
Please see the [http://dev.laptop.org/roadmap official roadmap] (from the trac main page) for schedule dates and features for each release.


== Also See ==
==Test setups==

This section covers generic ways to set up before running different kinds of tests. (These are not specific test cases, but can be used as shorthand references to common procedures that are used across many test cases.
* [[Test Config Notes]]
* [[Memory leak testing]]
* [[Olpc-update]]
* [[Clean-install procedure]]

== See also ==


[http://code.google.com/soc/2008/psf/appinfo.html?csaid=F89A4969030B59E6 GSOC08 OLPC Project Automated Testing]
* [http://code.google.com/soc/2008/psf/appinfo.html?csaid=F89A4969030B59E6 GSOC08 OLPC Project Automated Testing]
* [[Test process sprint for 2007 first software release]]- Wed, Oct 17th, 2007


[[Category:Test Plans]]
[[Category:Tests]]
[[Category:Developers]]
[[Category:Developers]]
[[Category:Software]]
[[Category:Software]]
[[Category:Hardware]]
[[Category:Hardware]]
[[Category:Subsystems]]
[[Category:Testing]]

Latest revision as of 05:17, 6 August 2013

The contents of this page are considered outdated and some of the information may be stale. Please use information here with caution, or update it.
  This page is monitored by the OLPC team.

The community and core team work through a slate of test issues for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.


 + Software 
XO
13.2.11 2020-01-29
XS
xs-0.7 2012-02-20


Release info

Testing for release 11.3.1

Testers are reporting test results on the testing mailing list or by reporting bugs.

They are not using Test group release notes.

Testing for release 11.2.0

See Test_cases/11.2 for information about testing the 11.2.0 release.

Testing for the 10.1.x releases

Testing for major release 8.2.0

Testing for minor releases 8.1.x

Testing for release 8.1.0

Release 8.1.0 was also known as "Update.1", see Update.1 tests for tests and Testing Update.1 Results.

Community testing

People interested in testing should join the Testing mailing list, which is also mirrored on an external forum.

The awesome New Zealand testers use a very simple Activity testing template.

Test beds:

Older obsolete community efforts:

Links of Interest to Testing

Equipment specs:

  • Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
  • Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
  • Server HW Specs

Builds of interest

See OS images for build streams, release candidates, joyride builds, etc.

For latest activities, run Software update in Sugar Control Panel, or download individual Activities.

Older builds and activities

Activities script/latest activities for 8.1:

Notes and minutes

General navigation

Test cases 8.2.0 lists the test cases created for the recent release 8.2.0.

Test results are in TestResults 8.2.0

The {{Community testing}} navigation template is shown below:

XO Checkbox


The navigation template {{Test-nav}} is shown below, it should be updated and many related pages need to be merged:

Test cases and test results

Mid-2008 users including Femslade, Charlie, and Kimquirk created test cases for 8.2.0 that can be created and modified using a form. Testers can also use the same form to add testing results, see Reporting test results.

See, e.g. Tests/Activity/Write/Public_sharing as a sample.

All these test cases are in Category:Test cases and most are listed by the queries in Test cases 8.2.0.

In 2007 and early 2008, tests were just wiki pages, e.g. Tests/Browse. Those older test cases are mostly in Category:Test Plans and/or Category:Tests.

Test case management

To add test categories to the pull down menu in Form:Test case, modify Property:Test category

To add stream checkboxes to Form:Test case, modify Property:Build stream

To build queries that list test cases, edit TestCase Queries and copy the {{#ask: ... }} markup. For other examples of queries, see Testcase Query Examples

Comments at Semantic MediaWiki#Issues for Test cases.

Testing areas

These "User stories" tests date from 2007-2008

High level topics for "User stories testing" can be divided into a few major categories:

One Hour Smoke Test

  1. Smoke test links to the 1-hour smoke test for different releases, and other smoke tests.

Networks

  1. Tests/100 laptops

Views and visualizations

  1. Home view
  2. Groups view
  3. Neighborhood view
  4. Frame


Mime Types

  1. Mime Types test from yolinux.com

Battery Life

Base line test for battery life. Boot up the machines, fully charge, remove the adapters and see how long the battery lasts.

Regular processes

  1. Tests/Start up and Activation
  2. Test Basic Operation
  3. Tests/Connectivity and Collaboration
  4. Tests/Archive, Backup, Content
  5. Tests/Invite

International Laptops

  1. Tests/Keyboard mappings
  2. Tests/Language settings

Upgrading

  1. From last stable build
  2. Tests/Backward_Comp

Hardware and firmware

  1. Tests/SD card
  2. Tests/SD card acting as a usb drive in card reader
  3. Tests/USB stick
  4. Tests/Manufacturing Data
  5. Tests/Suspend and resume

Network/Time Sync

  1. Tests/Time sync
  2. Tests/Network mgr

SchoolServer

In-house testing (from 2007?)

Old?

Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:

  • All keyboards. - Test: Keyboard Settings
    • Keys match the layouts designed
    • Language, keyboard, keymappings match the settings
    • All language and keyboard settings are preserved across updates
  • Languages - Test: Language Settings
  • Firmware
    • WPA - Richardo/Michailis
    • WEP - Richardo/Michailis
    • Mesh - upgrade under loaded network - Scott
    • Suspend/resume - Wad - Test: Suspend/resume
  • Scaling/performance
    • Jabber server scaling - OLPC/Collabora
    • Link local presence (Salut) - OLPC/Collabora
    • Journal/datastore
  • Upgrades /backward compatibility
  • Security

Other test plans

Schedule

Please see the official roadmap (from the trac main page) for schedule dates and features for each release.

Test setups

This section covers generic ways to set up before running different kinds of tests. (These are not specific test cases, but can be used as shorthand references to common procedures that are used across many test cases.

See also

Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=Testing&oldid=290836"