Test cases 8.2.0: Difference between revisions

From OLPC
Jump to navigation Jump to search
(→‎Test results: more documentation)
(removed the "format=template" argument, no longer used)
 
(56 intermediate revisions by 10 users not shown)
Line 1: Line 1:
== Create New Test Cases ==
== Add test results ==
{{merge|Reporting test results}}


The test case form has a test result form within it that you can fill in, and you can add additional test results by clicking on the [Add another] button under the test case form.
To add a new test case, click here: [http://wiki.laptop.org/go/Form:Test_case New Test Case] <br>


The tables below have a shortcut: just click the '+' sign next to a test case to edit it in the form, then click the [Add another] button.
* Use /Tests/<category>/<sub-category/ as the name of the new test case
* Try to use categories and sub-categories that already exist before creating new ones.


Here are what the fields are for:
Top level categories: Boot, Network, Upgrades, Journal, SugarUI, SugarControlPanel, Peripherals, Activity, XS (school server)
; Tested Release : What release build was this? 8.1.1? 7.1.0? A Release Candidate?
; Tested Stream : What build stream was used? Joyride? Update.1?
; Tested Build : What is the build number that was used?
; Pass/Fail : Did the test pass or fail?
; Associated trac tickets : List the trac tickets associated with this test if any were filed.
; Comments : How did the test fail? A short description of what went wrong.
; Today's Date : When did you run the testcase? The month and year will be filled in for you automatically.


You can also go to the test case's page and click the "edit with form" tab and add results for the test case using the same method.
== General (older) Test Cases ==
This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.


== Test cases ==
* [[Tests/Home_view]]
* [[Tests/100_laptops]] - update chat, read, and add write, browse, and record
* [[Battery_Results]] - need new battery life tests for 8.2
* [[Use_Cases]]
* many of the pages in [[:Category:Test Plans]], e.g. those named Tests/''Activity Name''


== Test Cases ==
=== Activities ===
If you are creating test cases for an activity, please include the base functionality that is important for all activities; then you can include other functional testing as well.
Test cases should use [[Template:Test case]] so they can be queried and reported automatically.


The "NZ activity test" is [http://wiki.laptop.org/go/Activity_testing_template#The_NZ_activity_test here]
Here is a test query that lists all the test cases. Edit this page to see the syntax.
We want to ask for all test cases that apply to 8.2.0.
There is a [[Property:Build stream]], so let's ask for all [[:Category:Test cases]] that are in the [[Joyride]] or Any streams.


====Basic activity testing====
# Activity installs from download (if not part of default installation) from website or USB key
# Activity starts up
# You can re-name the activity
# User specific data can be created
# You can force a save
# Activity closes properly from inside the activity
# You can resume the activity from the Journal
# You see the user specific data after resume
# You can close the activity from the Sugar frame


==== Activity-specific test cases ====
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
{{#ask:
[[Category:Test cases]] [[Build stream::joyride||any]]
[[Category:Test cases]] [[Test category::Activity]]
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]] with [[Property:Stream]] of [[joyride]] or any?
| default=No articles found in [[:Category:Test cases]] that [[Property:Test category|test category "Activity"]] ?!
}}
}}
|}


=== Boot ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::Boot]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}


=== Journal ===
Comments at [[Semantic MediaWiki#Suggestions_for_test_cases]];
{|
details of queries at http://semantic-mediawiki.org/wiki/Help:Inline_queries
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::Journal]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}


=== Network ===
For other examples of queries, see [[Testcase Query Examples]]
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::Network]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}


== Test results ==
=== Peripherals ===
{|
This is a little tricky. Currently each test cast page has zero-to-many test results embedded in it, which means a test case can have multiple values for build number, pass/fail, etc. and these values are probably '''not''' tied to each other. See [[Semantic MediaWiki]] for alternative approaches.
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::Peripherals]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}


=== SugarUI ===
Anyway, here's a query for any page with a Fail that also displaying some other values.
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::SugarUI]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}



=== Sugar Control Panel ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
{{#ask:
[[Category:Test cases]] [[Test category::SugarControlPanel]]
[[PassFail::Fail]]
| ?PassFail
| ?Short name
| ?Build number
| ?Test objective
| template=test-case-query
| ?Trac bug number
| default = No tests failing??
| default=No articles found in [[:Category:Test cases]]
}}
}}
|}

=== Upgrades ===
{|
! Test case !! Short name !! Test objective !! Add test result
|- {{#ask:
[[Category:Test cases]] [[Test category::Upgrades]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]}}
|}

=== School Server, XS ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::XS]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}

=== Internationalization (I18N) ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::I18N]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}

=== Smoke Test ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::SmokeTest]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}

=== Other Test Cases ===
{|
! Test case !! Short name !! Test objective !! Add test result
|-
{{#ask:
[[Category:Test cases]] [[Test category::other]]
| ?Short name
| ?Test objective
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
}}
|}


=== Other queries ===

(Edit a section to see its query's syntax.)

For other examples of queries, see Other [[TestCase Queries]], [[Testcase Query Examples]], and
comments at [[Semantic MediaWiki#Suggestions_for_test_cases]].

== General (older) test cases ==
This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.

* [[Tests/Home view]]
* [[Tests/100 laptops]] - update chat, read, and add write, browse, and record
* [[Battery Results]] - need new battery life tests for 8.2
* [[Use Cases]]
* [[Testing matrix]]
* many of the pages in [[:Category:Test Plans]], e.g. those named Tests/''Activity Name''

[[Category:Test plans]]

Latest revision as of 19:55, 17 March 2010

Add test results

Merge-arrows.gif
It has been suggested that this article or section be merged with Reporting test results. (Discuss)


The test case form has a test result form within it that you can fill in, and you can add additional test results by clicking on the [Add another] button under the test case form.

The tables below have a shortcut: just click the '+' sign next to a test case to edit it in the form, then click the [Add another] button.

Here are what the fields are for:

Tested Release
What release build was this? 8.1.1? 7.1.0? A Release Candidate?
Tested Stream
What build stream was used? Joyride? Update.1?
Tested Build
What is the build number that was used?
Pass/Fail
Did the test pass or fail?
Associated trac tickets
List the trac tickets associated with this test if any were filed.
Comments
How did the test fail? A short description of what went wrong.
Today's Date
When did you run the testcase? The month and year will be filled in for you automatically.

You can also go to the test case's page and click the "edit with form" tab and add results for the test case using the same method.

Test cases

Activities

If you are creating test cases for an activity, please include the base functionality that is important for all activities; then you can include other functional testing as well.

The "NZ activity test" is here

Basic activity testing

  1. Activity installs from download (if not part of default installation) from website or USB key
  2. Activity starts up
  3. You can re-name the activity
  4. User specific data can be created
  5. You can force a save
  6. Activity closes properly from inside the activity
  7. You can resume the activity from the Journal
  8. You see the user specific data after resume
  9. You can close the activity from the Sugar frame

Activity-specific test cases

{{#ask: Test category::Activity
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases that test category "Activity" ?!

}}

Boot

{{#ask: Test category::Boot
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Journal

{{#ask: Test category::Journal
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Network

{{#ask: Test category::Network
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Peripherals

{{#ask: Test category::Peripherals
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

SugarUI

{{#ask: Test category::SugarUI
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}


Sugar Control Panel

{{#ask: Test category::SugarControlPanel
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Upgrades

Test category::Upgrades
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases}}

School Server, XS

{{#ask: Test category::XS
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Internationalization (I18N)

{{#ask: Test category::I18N
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Smoke Test

{{#ask: Test category::SmokeTest
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Other Test Cases

{{#ask: Test category::other
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}


Other queries

(Edit a section to see its query's syntax.)

For other examples of queries, see Other TestCase Queries, Testcase Query Examples, and comments at Semantic MediaWiki#Suggestions_for_test_cases.

General (older) test cases

This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.

Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=Test_cases_8.2.0&oldid=233476"