Test cases 8.2.1: Difference between revisions
No edit summary |
(Mark testcase page as for a previous OS release) |
||
(29 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
{{DatedTestcase}} |
|||
{{TOCright}} |
|||
== Introduction == |
== Introduction == |
||
This is the test plan page for the [[8.2.1]] release. |
This is the test plan page for the [[8.2.1]] release. A large part of it is based on the tickets given in the [[Eco/8.2.1|ECO]]. Please email questions, criticisms, concerns, ideas, and test results you might have to the [http://lists.laptop.org/listinfo/testing testing mailing list]. See [[Friends in Testing]] to download the latest build under test. |
||
== Status == |
== Status == |
||
See the page on the role of a [[test manager]] for more information about these two questions. |
|||
* Working on getting all the test cases in here first, before I take a first pass at finalizing the cases themselves. [[Special:Contributions/71.184.182.23|71.184.182.23]] 15:00, 17 December 2008 (UTC) |
|||
* '''Are we done yet?''' 0 out of 17 tickets (0%) have been verified as closed in the release candidate build. |
|||
== Unresolved questions == |
|||
* '''What are the risks?''' The largest current risk is that we do not know potential areas of risk, but connectivity is a potential regression area. (This question will become more important as the answer to "Are we done yet?" gets closer to "we think so.") |
|||
=== Help unblock testers! === |
|||
* is [http://dev.laptop.org/query?status=assigned&status=new&status=reopened&groupdesc=1&group=priority&order=priority&col=id&col=summary&col=status&col=type&col=component&milestone=8.2.1&report=34 this trac query] canonical, or [[Eco/8.2.1]]? |
|||
* Are all the test cases appropriate and clearly written at the level where they can be run by community testing members with the necessary equipment? (I know the current answer is 'no,' and will soon call for help identifying and fixing the ones that aren't. [[Special:Contributions/71.184.182.23|71.184.182.23]] 15:00, 17 December 2008 (UTC)) |
|||
* Does OFW testing need to be done separate from OFW-integrated-in-build testing? |
|||
* Connectivity/networking test coverage is particularly poor in this test plan, as I don't fully understand what needs to happen. What can I do to improve this? (Actively asking people for help on this area. [[Special:Contributions/71.184.182.23|71.184.182.23]] 15:00, 17 December 2008 (UTC)) |
|||
These are things we need - things that are actively blocking our ability to test the 8.2.1 release. If you can get us these resources, it would be a great help - if you clear a blocker, please email the testing mailing list and cc Mel (see [[#Introduction]]) so that we're all informed. |
|||
== Test cases == |
|||
* <s>We need a build to test</s> |
|||
⚫ | |||
* <s>For each build we're expected to test, we need a build changelog.</s> |
|||
=== Things testers need to do === |
|||
* Each ticket needs to be examined (talk with developers!) for areas of potential risk/exploration, and additional test cases for those areas should be added. |
|||
* The smoke test needs to be turned from 4 hours down into 1 hour through whatever means we can find, without reducing coverage. |
|||
== Tests == |
|||
=== Smoke tests === |
|||
Test results are not reported below. |
|||
These are the tests that should be run on every build before it is listed as the build to test at [[Friends in testing]]. |
|||
⚫ | |||
! Test case !! Short name !! Test objective !! Add test result |
! Test case !! Short name !! Test objective !! Add test result |
||
|- |
|- |
||
{{#ask: |
{{#ask: |
||
[[Category:Test cases]] [[ |
[[Category:Test cases]] [[Test category::SmokeTest]] |
||
| ?Short name |
| ?Short name |
||
| ?Test objective |
| ?Test objective |
||
| format=template |
|||
| template=test-case-query |
| template=test-case-query |
||
| default=No |
| default=No articles found in [[:Category:Test cases]] with [[Property:Test category]] of SmokeTest?! |
||
}} |
}} |
||
|} |
|} |
||
== Network Tests == |
|||
{|class="wikitable" |
|||
! Test case !! Short name !! Test objective !! Add test result |
|||
|- |
|||
{{#ask: |
|||
[[Category:Test cases]] [[Test category::Network]] |
|||
| ?Short name |
|||
| ?Test objective |
|||
| template=test-case-query |
|||
| default=No articles found in [[:Category:Test cases]] with [[Property:Test category]] of Network?! |
|||
}} |
|||
|} |
|||
=== Tickets for this build === |
|||
Every test case that has a result for [[Property:Build stream]] 8.2.1 and also has a [[Property:Trac bug number]] — ''the ticket may be for a test result for a completely unrelated release!''. |
|||
{{#ask: |
|||
[[Build stream::8.2.1]] [[Trac_bug_number::+]] |
|||
| ?Build stream |
|||
| ?Trac bug number |
|||
| link=subject |
|||
| default=No test cases found for [[Property:Build stream]] 8.2.1 with a [[Property:Trac bug number]] !? |
|||
}} |
|||
== Test results == |
== Test results == |
||
''Note! The values in the different columns are '''unrelated'''. Just because a build and "Fail" are on the same row doesn't mean that's the failing test result. You have to look at the original test case to see what values are from the same test result. |
|||
{{#ask: |
|||
[[Category:Test cases]] [[Test category::SmokeTest]] |
|||
|?Build stream |
|||
|?Build number |
|||
|?Trac bug number |
|||
|?PassFail |
|||
|link=subject |
|||
|default=Nothing in [[:Category:Test cases]] found with [[Test category::SmokeTest]]?! |
|||
}} |
|||
{{#ask: |
|||
[[Category:Test cases]] [[Test category::Network]] |
|||
|?Build stream |
|||
|?Build number |
|||
|?Trac bug number |
|||
|?PassFail |
|||
|link=subject |
|||
|default=Nothing in [[:Category:Test cases]] found with [[Test category::Network]]?! |
|||
}} |
|||
Test case results for 'build stream = 8.2.1': |
|||
{{#ask: |
{{#ask: |
||
[[Category:Test cases]] [[Build stream::8.2.1]] |
[[Category:Test cases]] [[Build stream::8.2.1]] |
||
|?Build stream |
|?Build stream |
||
|?Build number |
|?Build number |
||
|?Trac bug number |
|?Trac bug number |
||
|?PassFail |
|?PassFail |
||
|link=subject |
|||
|default=Nothing in [[:Category:Test cases]] found with [[Property:Build stream]] of 8.2.1?! |
|||
}} |
}} |
||
Latest revision as of 17:24, 3 September 2010
Introduction
This is the test plan page for the 8.2.1 release. A large part of it is based on the tickets given in the ECO. Please email questions, criticisms, concerns, ideas, and test results you might have to the testing mailing list. See Friends in Testing to download the latest build under test.
Status
See the page on the role of a test manager for more information about these two questions.
- Are we done yet? 0 out of 17 tickets (0%) have been verified as closed in the release candidate build.
- What are the risks? The largest current risk is that we do not know potential areas of risk, but connectivity is a potential regression area. (This question will become more important as the answer to "Are we done yet?" gets closer to "we think so.")
Help unblock testers!
These are things we need - things that are actively blocking our ability to test the 8.2.1 release. If you can get us these resources, it would be a great help - if you clear a blocker, please email the testing mailing list and cc Mel (see #Introduction) so that we're all informed.
We need a build to testFor each build we're expected to test, we need a build changelog.
Things testers need to do
- Each ticket needs to be examined (talk with developers!) for areas of potential risk/exploration, and additional test cases for those areas should be added.
- The smoke test needs to be turned from 4 hours down into 1 hour through whatever means we can find, without reducing coverage.
Tests
Smoke tests
Test results are not reported below. These are the tests that should be run on every build before it is listed as the build to test at Friends in testing.
{{#ask: Test category::SmokeTestTest case | Short name | Test objective | Add test result |
---|---|---|---|
?Short name | ?Test objective | template=test-case-query | default=No articles found in Category:Test cases with Property:Test category of SmokeTest?!
}} |
Network Tests
{{#ask: Test category::NetworkTest case | Short name | Test objective | Add test result |
---|---|---|---|
?Short name | ?Test objective | template=test-case-query | default=No articles found in Category:Test cases with Property:Test category of Network?!
}} |
Tickets for this build
Every test case that has a result for Property:Build stream 8.2.1 and also has a Property:Trac bug number — the ticket may be for a test result for a completely unrelated release!.
{{#ask:
Build stream::8.2.1 Trac_bug_number::+ | ?Build stream | ?Trac bug number | link=subject | default=No test cases found for Property:Build stream 8.2.1 with a Property:Trac bug number !?
}}
Test results
Note! The values in the different columns are unrelated. Just because a build and "Fail" are on the same row doesn't mean that's the failing test result. You have to look at the original test case to see what values are from the same test result.
{{#ask: Test category::SmokeTest
|?Build stream |?Build number |?Trac bug number |?PassFail |link=subject |default=Nothing in Category:Test cases found with Test category::SmokeTest?!
}}
{{#ask: Test category::Network
|?Build stream |?Build number |?Trac bug number |?PassFail |link=subject |default=Nothing in Category:Test cases found with Test category::Network?!
}}
Test case results for 'build stream = 8.2.1':
{{#ask: Build stream::8.2.1
|?Build stream |?Build number |?Trac bug number |?PassFail |link=subject |default=Nothing in Category:Test cases found with Property:Build stream of 8.2.1?!
}}