Testing: Difference between revisions
m (→Test cases and results: fix text) |
(move Reporting test results into Test results and test cases, fix See also section, etc.) |
||
Line 46: | Line 46: | ||
* [[Update.1 tests]] - test process for the 8.1.0/Update.1 builds (builds 691...703) |
* [[Update.1 tests]] - test process for the 8.1.0/Update.1 builds (builds 691...703) |
||
** [[Release Notes/8.1.0]] - release notes for 8.1.0 also known as "Update.1" |
** [[Release Notes/8.1.0]] - release notes for 8.1.0 also known as "Update.1" |
||
** [[ |
** [[Testing Update.1 Results]] - some test results for Update.1 (in progress...) |
||
** [[OLPC Ship.2 Software Release Notes]] - release notes for Ship2, build 650 |
** [[OLPC Ship.2 Software Release Notes]] - release notes for Ship2, build 650 |
||
* 100 Laptop Testbed: |
* 100 Laptop Testbed: |
||
Line 92: | Line 92: | ||
{{Test-nav}} |
{{Test-nav}} |
||
== Test cases and results == |
== Test cases and test results == |
||
Mid-2008 users including Femslade, Charlie, and Kimquirk created test cases for [[8.2.0]] that can be created and modified using a form. |
Mid-2008 users including Femslade, Charlie, and Kimquirk created test cases for [[8.2.0]] that can be created and modified using a form. |
||
Testers can also use the same form to add testing results. |
Testers can also use the same form to add testing results, see [[Reporting test results]]. |
||
See, e.g. [[Tests/Activity/Write/Public_sharing]]. |
See, e.g. [[Tests/Activity/Write/Public_sharing]] as a sample. |
||
All these test cases are in [[:Category:Test cases]] and most are listed by the queries in [[Test cases 8.2.0]]. |
All these test cases are in [[:Category:Test cases]] and most are listed by the queries in [[Test cases 8.2.0]]. |
||
Line 201: | Line 203: | ||
* [[Clean-install procedure]] |
* [[Clean-install procedure]] |
||
== |
== See also == |
||
[http://code.google.com/soc/2008/psf/appinfo.html?csaid=F89A4969030B59E6 GSOC08 OLPC Project Automated Testing] |
* [http://code.google.com/soc/2008/psf/appinfo.html?csaid=F89A4969030B59E6 GSOC08 OLPC Project Automated Testing] |
||
⚫ | |||
⚫ | |||
* [[Test process sprint]]- Wed, Oct 17th, 2007 |
* [[Test process sprint]]- Wed, Oct 17th, 2007 |
||
=== Reporting test results === |
|||
See [[Reporting test results]]. |
|||
[[Category:Developers]] |
[[Category:Developers]] |
Revision as of 04:12, 17 November 2008
The community and core team work through a slate of test issues for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.
For the latest tests, see Update.1 tests.
Release info
Testing for major release 8.2.0
- New features in 8.2.0, on top of XO_Base_Features of 8.1.1
- TestPlan 8.2.0
- Test cases 8.2.0
- TestResults 8.2.0
Testing for minor releases 8.1.x
- Release 8.1.3, OLPC SW-ECO 7, More Amharic support
- Release 8.1.2, OLPC SW-ECO 6, Nand-full, SD card corruption, support of C3 production boards
- Release 8.1.1, OLPC SW-ECO 5, Amharic and Kreyol support
Community Testing
- Community testing (main page)
- Friends in testing
- Systematic testing
Test beds:
- Creating a testbed
- Wireless Sparse Testbed - Universidade Federal Fluminense, Brazil
- Ejabberd resource tests/try_5 school server jabber testing
Older community efforts (should be updated to the new test template):
Links of Interest to Testing
- Test Config Notes - Links to configuration info that are useful in testing
- Test Group Release Notes - Quick info/smoke test on the latest builds. Read this before you bother to load a build
- Different upgrade paths and which to use
- Also see Builds of Interest below
- Multi-hop mesh network in MIT campus
- Networking scenarios
- Simple mesh test (Cerebro)
- School Server general info: XS
- Update.1 tests - test process for the 8.1.0/Update.1 builds (builds 691...703)
- Release Notes/8.1.0 - release notes for 8.1.0 also known as "Update.1"
- Testing Update.1 Results - some test results for Update.1 (in progress...)
- OLPC Ship.2 Software Release Notes - release notes for Ship2, build 650
- 100 Laptop Testbed:
- Collaboration_Network_Testbed
- Peabody Setup - 100 laptop test setup in Peabody, MA
- Activation and Developer Keys - how to activate or get a developer key
- Scenario taxonomy
- Requirements (no longer used)
Equipment specs:
- Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
- Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
- Server HW Specs
Builds of Interest:
- OLPC Archives
- "8.2" builds
- Recent stable builds
- "Update.1" builds
- "Bleeding-edge" builds
- "Candidate" builds before they go public
Activities script/latest activities:
- From a laptop that is connected to the internet, start a Terminal Activity and type: wget http://dev.laptop.org/~erikos/sucrose-activities.py
- Then type: python sucrose-activities.py
- Link to Latest Activities
Notes and minutes
- Testing meetings - Weekly meetings of interested test people, usually Thursdays
Test cases 8.2.0 lists the test cases created for the recent release 8.2.0.
Test results are in TestResults 8.2.0
The {{Community testing}} navigation template is shown below:
The navigation template {{Test-nav}} is shown below, it should be updated and many related pages need to be merged:
To merge: Testing | Testing ideas | Friends in testing
See also: Sugar Labs testing | the Testing mailing list
Test cases and test results
Mid-2008 users including Femslade, Charlie, and Kimquirk created test cases for 8.2.0 that can be created and modified using a form. Testers can also use the same form to add testing results, see Reporting test results.
See, e.g. Tests/Activity/Write/Public_sharing as a sample.
All these test cases are in Category:Test cases and most are listed by the queries in Test cases 8.2.0.
In 2007 and early 2008, tests were just wiki pages, e.g. Tests/Browse. Those older test cases are mostly in Category:Test Plans and/or Category:Tests.
An old test case format
This is temporary place for a sample of the test case format. Test area: Sugar Control Panel
Number/Title | 1/Change Timezone | |
Objective | Verify that the user can change their XO's timezone from the default UTC setting. | |
Feature | Users are able to change their XO's timezone to match the local time without having to go into a terminal to do so. | |
Source | http://wiki.laptop.org/go/Sugar_Control_Panel#Date_.26_Time] | |
Approach | Act as an end-user trying to change the XO's timezone to match the local time. | |
Test Tools | No test tools required. | |
Test Setup | One XO laptop running an 8.2.0 (pre-)release build. | |
Test Procedure | 1. Open the graphical Sugar Control Panel from the Home view. 2. Click on the "Date & Time" panel. | |
Expected Results & Pass Criteria | The timezone for the laptop has been changed correctly and the timezone is represented properly by the 'date' command. | |
Comments |
Testing areas
Items to test
Old?
Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:
- All keyboards. - Test: Keyboard Settings
- Keys match the layouts designed
- Language, keyboard, keymappings match the settings
- All language and keyboard settings are preserved across updates
- Languages - Test: Language Settings
- Firmware
- WPA - Richardo/Michailis
- WEP - Richardo/Michailis
- Mesh - upgrade under loaded network - Scott
- Suspend/resume - Wad - Test: Suspend/resume
- Scaling/performance
- Jabber server scaling - OLPC/Collabora
- Link local presence (Salut) - OLPC/Collabora
- Journal/datastore
- Upgrades /backward compatibility
- Security
Other test plans
- 802.11s Connectivity Test Plan - Connectivity, wifi protocol
- File:B3-B4 OLPC Test Plan.xls - Low Level Test Plan
Tinderbox Testing - automated testing for each build(outdated) --Chihyu 13:58, 29 January 2008 (EST)- XMPP collaboration and scalability testing - XMPP collaboration and scalability testing
- see Category:Test Plans
TODO: These older test plans should be marked obsolete or turned into test cases.
Test Case Management System
To add categories to the Test Case pull down menu, click here:
Property:Test_category
To add streams to the Test Case form, click here:
Property:Build_stream
How to build queries: TestCase_Queries
For other examples of queries, see Testcase Query Examples
Comments at Semantic MediaWiki#Suggestions_for_test_cases.
Schedule
Please see the official roadmap (from the trac main page) for schedule dates and features for each release.
Test setups
This section covers generic ways to set up before running different kinds of tests. (These are not specific test cases, but can be used as shorthand references to common procedures that are used across many test cases.
See also
Older notes
- Test process sprint- Wed, Oct 17th, 2007