Systematic testing: Difference between revisions

From OLPC
Jump to navigation Jump to search
mNo edit summary
 
(22 intermediate revisions by 5 users not shown)
Line 1: Line 1:
{{developers}}
<noinclude>{{developers}}
{{draft}}
{{testers}}
<center>See [[Friends in testing]] for detailed instructions on how to prepare for [[exploratory testing|exploratory]] or systematic testing.</center>
</noinclude>
== Systematic Testing ==


This page describes a systematic testing effort designed to achieve [[Test cases 8.2.0|test coverage]] sufficient to make good ship/no-ship decisions for the [[8.2.0|8.2.0 release]].
In addition to our freeform [[exploratory testing]] effort, we also engage in [[systematic testing]] efforts designed to achieve the test coverage necessary to make release decisions around [[future releases]], much like [[release notes|past releases]].


It consists of several basic tasks:
Systematic testing consists of several basic tasks:


* improving the list of '''[[OLPC 8.2.0 Features|features]]''' present in 8.2.0.
* Reviewing a '''[[Test_cases_8.2.1|test plan]]'''.
* writing '''[[Test cases 8.2.0#Create New Test Cases|test cases]]''' for each [[OLPC 8.2.0 Features|feature]] (in priority order).
* Writing '''[[Test cases 8.2.1#Create New Test Cases|the test cases]]''', if needed.
* executing the [[Test cases 8.2.0|test cases]] and recording '''[[test results]]'''.
* Executing the '''[[Test_cases_8.2.1#Test_cases|test cases]]''' and recording test results.
** ''To record results on a particular test case page,'' click on the '''"Edit with form"''' button in the top of the page, and use the '''"Add Another" button''' just above the '''"Add New Results" section''' (i.e. at the bottom of the page).
* contributing patches to the '''[[Tinderbox]]''' so that it can execute test cases!
* Contributing patches to the '''[[Tinderbox]]''' or '''[[Sugarbot]]''' automated testing platforms.


=== Test 1: Multiple Key Support ===
[[Category:Testing]]

We are particularly interested, this week, in systematically testing [[Firmware|OFW]]'s new [[Firmware_security#Multiple-Key_Support|multiple key support]].

Latest revision as of 15:58, 10 December 2010

  For Testers
See Friends in testing for detailed instructions on how to prepare for exploratory or systematic testing.

Systematic Testing

In addition to our freeform exploratory testing effort, we also engage in systematic testing efforts designed to achieve the test coverage necessary to make release decisions around future releases, much like past releases.

Systematic testing consists of several basic tasks:

  • Reviewing a test plan.
  • Writing the test cases, if needed.
  • Executing the test cases and recording test results.
    • To record results on a particular test case page, click on the "Edit with form" button in the top of the page, and use the "Add Another" button just above the "Add New Results" section (i.e. at the bottom of the page).
  • Contributing patches to the Tinderbox or Sugarbot automated testing platforms.

Test 1: Multiple Key Support

We are particularly interested, this week, in systematically testing OFW's new multiple key support.