Testing: Difference between revisions

From OLPC
Jump to navigation Jump to search
No edit summary
m (Reverted edits by 90.204.70.9 (Talk); changed back to last version by Kimquirk)
Line 1: Line 1:
{{OLPC}}
The community and core team work through a slate of '''test issues''' for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.

For the latest tests, see [[Update.1]].

== Notes and minutes ==
* [[Test meeting Minutes]] - Weekly meetings of interested test people, Mondays 1pm EDT
* [[Requirements]]
* [http://www.laptop.org/en/jobs.shtml#QA%20Engineer QA engineer needed] - want to work at our office in Boston to coordinate testing? Apply now.


==== Release info ====

* August Release 8.2.0
** [[Features_8.2.0]]
** [[TestCases_8.2.0]]
** [[TestResults_8.2.0]]
* [http://wiki.laptop.org/go/OLPC_SW-ECO_5 Minor Release 8.1.1]

==== Older notes ====
* [[Test process sprint]]- Wed, Oct 17th, 2007

== Links of Interest ==
* [[Multi-hop mesh network in MIT campus]]
* [[Networking scenarios]]
* [[Simple mesh test (Cerebro)]]
* [[Schoolserver Testing]]
* [[Test Group Release Notes]] - Quick info/smoke test on the latest builds. Read this before you bother to load a build
** [[Update.1]] - test process for the Update.1 builds (691, 693, 697, &c)
** [[OLPC Ship.2 Software Release Notes]] - release notes for Ship2, 650
** [[OLPC Update.1 Software Release Notes]] - release notes for Update.1 (in progress...)
** [[Testing_Update.1_Results]] - some test results for Update.1 (in progress...)
* [[Test Config Notes]] - Links to configuration info that are useful in testing
** [[Upgrade Paths| Different upgrade paths and which to use]]
* 100 Laptop Testbed:
**[[Collaboration_Network_Testbed]]
**[[Peabody Setup]] - 100 laptop test setup in Peabody, MA
* [[Activation and Developer Keys]] - how to activate or get a developer key
* [[Scenario taxonomy]]

Equipment specs:
* Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
* Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
* [[XS_Server_Specification#XSX_Specifications|Server HW Specs]] (Approx. $3000 USD)

Check out these new links to test plans and result matrices -- Get involved and help test some activities:

==Community Testing:==
* [[Friends in testing]]
* [[Activity Testing Project]]
* [[Activity Testing Matrix]]
* [[Activity Testing Template]]

== Builds of Interest:==
* [http://downloads.laptop.org/xo-1/os/official/ Recent stable builds]
* [http://pilgrim.laptop.org/~pilgrim/olpc/streams/update.1/ "Update.1" builds]
* [http://xs-dev.laptop.org/~cscott/olpc/streams/ "Bleeding-edge" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/joyride "Joyride" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/faster "Faster" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/meshtest "Meshtest" builds]
** [http://xs-dev.laptop.org/~cscott/olpc/streams/ship.2 "Ship.2" builds]
* [http://pilgrim.laptop.org/~pilgrim/olpc/streams/olpc3/ "OLPC-3" builds]
* [http://download.laptop.org/xo-1/os/candidate/ "Candidate" builds] before they go public

== Testing teams ==

The Activities on the XO have been developed by community members. Many of them are not well documented and there may not be much information on how to use them; so this testing can be described as 'Descriptive Testing', where you are helping to provide and/or correct the wiki pages that describe how an activity works. If you want to help, please refer to the '''[[Community_Testing|Community Testing]]''' page for more details.

===Testing at OLPC===

====Test Plans====
To report results from a set of test cases, add a line to the appropriate table in the test case pages below with a quick summary; and include details, including setup and test team, on the talk page.

* [[8.1.1_Features_to_Test|8.1.1 Features to be Tested]]
* [[Update.1|Update.1 test cases]]
* [[Ship2.2|Ship2.2 test cases]] - complete
* User-focused test plans:
*: User-focused test plans are being developed for all the basic features of the laptop, for many of the activities, and for the interaction with the school server, collaboration, connectivity, etc. Please follow the [[User Stories Testing|User-Focused Test Plans]] page to read, review, and help create test plans.

====Items to Test====

Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:
* All keyboards. - [[Tests/Keyboard_mappings|Test: Keyboard Settings]]
** Keys match the layouts designed
** Language, keyboard, keymappings match the settings
** All language and keyboard settings are preserved across updates
* Languages - [[Tests/Language_settings|Test: Language Settings]]
* Firmware
** WPA - Richardo/Michailis
** WEP - Richardo/Michailis
** Mesh - upgrade under loaded network - Scott
** Suspend/resume - Wad - [[Tests/Suspend_Resume|Test: Suspend/resume]]
* Scaling/performance
** Jabber server scaling - OLPC/Collabora
** Link local presence (Salut) - OLPC/Collabora
** Journal/datastore
* Upgrades /backward compatibility
* Security


Other Test plans:
*[[802.11s Connectivity Test Plan]] - Connectivity, wifi protocol
*[[Image:B3-B4 OLPC Test Plan.xls]] - Low Level Test Plan
*<strike>[[Tinderbox Testing]] - automated testing for each build</strike> (outdated) --[[User:Chihyu|Chihyu]] 13:58, 29 January 2008 (EST)


'''Schedule:'''<br>

Please see the [http://dev.laptop.org/roadmap official roadmap] (from the trac main page) for schedule dates and features for each release.

== Also See ==

[http://code.google.com/soc/2008/psf/appinfo.html?csaid=F89A4969030B59E6 GSOC08 OLPC Project Automated Testing]

[[Category:Test Plans]]
[[Category:Tests]]
[[Category:Developers]]
[[Category:Software]]
[[Category:Hardware]]

Revision as of 19:51, 20 June 2008

  This page is monitored by the OLPC team.

The community and core team work through a slate of test issues for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.

For the latest tests, see Update.1.

Notes and minutes


Release info

Older notes

Links of Interest

Equipment specs:

  • Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
  • Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
  • Server HW Specs (Approx. $3000 USD)

Check out these new links to test plans and result matrices -- Get involved and help test some activities:

Community Testing:

Builds of Interest:

Testing teams

The Activities on the XO have been developed by community members. Many of them are not well documented and there may not be much information on how to use them; so this testing can be described as 'Descriptive Testing', where you are helping to provide and/or correct the wiki pages that describe how an activity works. If you want to help, please refer to the Community Testing page for more details.

Testing at OLPC

Test Plans

To report results from a set of test cases, add a line to the appropriate table in the test case pages below with a quick summary; and include details, including setup and test team, on the talk page.

Items to Test

Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:

  • All keyboards. - Test: Keyboard Settings
    • Keys match the layouts designed
    • Language, keyboard, keymappings match the settings
    • All language and keyboard settings are preserved across updates
  • Languages - Test: Language Settings
  • Firmware
    • WPA - Richardo/Michailis
    • WEP - Richardo/Michailis
    • Mesh - upgrade under loaded network - Scott
    • Suspend/resume - Wad - Test: Suspend/resume
  • Scaling/performance
    • Jabber server scaling - OLPC/Collabora
    • Link local presence (Salut) - OLPC/Collabora
    • Journal/datastore
  • Upgrades /backward compatibility
  • Security


Other Test plans:


Schedule:

Please see the official roadmap (from the trac main page) for schedule dates and features for each release.

Also See

GSOC08 OLPC Project Automated Testing