Test cases 8.2.0: Difference between revisions

From OLPC
Jump to navigation Jump to search
(removed the "format=template" argument, no longer used)
 
(4 intermediate revisions by 3 users not shown)
Line 1: Line 1:
== Create new test cases ==
{{pending|Now 8.2.0 is complete this section should be its own page "[[Creating new test cases]]".}}

First review the set of test cases that already exist [[#Test_cases|below]]. Some of them are stubs to be filled out and others include procedures. Also review the category and sub-categories that determine part of your test case name.

=== Naming a test case ===
* Use /Tests/''TestCategory''/''SubCategory''(as needed)/''TestName'' as the name of the new test case, for example [[Tests/Network/XO/SimpleMesh]].
* Use the following categories (see [[Property:Test category]]):
** Tests/Boot/, Tests/Network/, Tests/Upgrades/, Tests/Journal/, Tests/SugarUI/, Tests/SugarControlPanel/, Tests/Power/, Tests/Peripherals/, Tests/Activity/, Tests/XS/ (school server), Tests/I18N/, Test/SmokeTest/
** Use Test/Activity/''TheActivityName'' as sub-category for an activity, for example [[Tests/Activity/Record/Private photo sharing]].

=== Form information ===
The form has several fields for you to fill in. Here is what they are used for:
* '''Name of the test case:''' Short description of the test case.
* '''Category:''' The category this test case falls under. Select the value you used for the <category> part of the name for the new test case.
* '''Sub-category:''' The sub-category this test case falls under. Select the value you used for the <nowiki><sub-category></nowiki> part of the name for the new test case.
* '''Stream:''' What stream of builds does this test belong to? Is it specific to Joyride? Update.1? Any stream?
* '''Build:''' If this test is for a specific stream, what is the earliest build number that it applies to? (optional field)
* '''Component being tested:''' What is the activity or feature of the XO that this test case is for?
* '''Wiki link to the feature:''' Text field.
* '''Summary:''' A brief description describing what functionality the test case is intended to verify.
* '''Tools:''' Do you need any special tools for the test? In most cases, the answer will be no.
* '''Setup:''' Do you need the laptops to have specific builds or activities? Do the laptops explicitly need to be registered (or not) with a schoolserver?
* '''Procedure:''' The steps the tester must take to finish the test case.
* '''Expected results:''' What should happen if everything is working as expected? What must happen for a run-through of this test case to be considered a pass?
* '''Notes:''' Anything else that doesn't fit in the other fields.

=== Adding the test case ===
To add a new test case, go to [[Form:Test case]] and give it your new name.

== Add test results ==
== Add test results ==
{{merge|Reporting test results}}
{{merge|Reporting test results}}
Line 52: Line 22:
If you are creating test cases for an activity, please include the base functionality that is important for all activities; then you can include other functional testing as well.
If you are creating test cases for an activity, please include the base functionality that is important for all activities; then you can include other functional testing as well.


The "NZ activity test" is [http://wiki.laptop.org/go/Activity_testing_template#The_NZ_activity_test here]
Base Activity Testing: <br>

====Basic activity testing====
# Activity installs from download (if not part of default installation) from website or USB key
# Activity installs from download (if not part of default installation) from website or USB key
# Activity starts up
# Activity starts up
Line 63: Line 35:
# You can close the activity from the Sugar frame
# You can close the activity from the Sugar frame


==== Activity-specific test cases ====
{|
{|
! Test case !! Short name !! Test objective !! Add test result
! Test case !! Short name !! Test objective !! Add test result
Line 70: Line 43:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]] that [[Property:Test category|test category "Activity"]] ?!
| default=No articles found in [[:Category:Test cases]] that [[Property:Test category|test category "Activity"]] ?!
Line 84: Line 56:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 98: Line 69:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 112: Line 82:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 126: Line 95:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 140: Line 108:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 155: Line 122:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 168: Line 134:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]}}
| default=No articles found in [[:Category:Test cases]]}}
Line 181: Line 146:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 195: Line 159:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 209: Line 172:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 223: Line 185:
| ?Short name
| ?Short name
| ?Test objective
| ?Test objective
| format=template
| template=test-case-query
| template=test-case-query
| default=No articles found in [[:Category:Test cases]]
| default=No articles found in [[:Category:Test cases]]
Line 237: Line 198:
comments at [[Semantic MediaWiki#Suggestions_for_test_cases]].
comments at [[Semantic MediaWiki#Suggestions_for_test_cases]].


== General (older) Test Cases ==
== General (older) test cases ==
This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.
This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.


* [[Tests/Home_view]]
* [[Tests/Home view]]
* [[Tests/100_laptops]] - update chat, read, and add write, browse, and record
* [[Tests/100 laptops]] - update chat, read, and add write, browse, and record
* [[Battery_Results]] - need new battery life tests for 8.2
* [[Battery Results]] - need new battery life tests for 8.2
* [[Use_Cases]]
* [[Use Cases]]
* [[Testing matrix]]
* [[Testing matrix]]
* many of the pages in [[:Category:Test Plans]], e.g. those named Tests/''Activity Name''
* many of the pages in [[:Category:Test Plans]], e.g. those named Tests/''Activity Name''

Latest revision as of 19:55, 17 March 2010

Add test results

Merge-arrows.gif
It has been suggested that this article or section be merged with Reporting test results. (Discuss)


The test case form has a test result form within it that you can fill in, and you can add additional test results by clicking on the [Add another] button under the test case form.

The tables below have a shortcut: just click the '+' sign next to a test case to edit it in the form, then click the [Add another] button.

Here are what the fields are for:

Tested Release
What release build was this? 8.1.1? 7.1.0? A Release Candidate?
Tested Stream
What build stream was used? Joyride? Update.1?
Tested Build
What is the build number that was used?
Pass/Fail
Did the test pass or fail?
Associated trac tickets
List the trac tickets associated with this test if any were filed.
Comments
How did the test fail? A short description of what went wrong.
Today's Date
When did you run the testcase? The month and year will be filled in for you automatically.

You can also go to the test case's page and click the "edit with form" tab and add results for the test case using the same method.

Test cases

Activities

If you are creating test cases for an activity, please include the base functionality that is important for all activities; then you can include other functional testing as well.

The "NZ activity test" is here

Basic activity testing

  1. Activity installs from download (if not part of default installation) from website or USB key
  2. Activity starts up
  3. You can re-name the activity
  4. User specific data can be created
  5. You can force a save
  6. Activity closes properly from inside the activity
  7. You can resume the activity from the Journal
  8. You see the user specific data after resume
  9. You can close the activity from the Sugar frame

Activity-specific test cases

{{#ask: Test category::Activity
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases that test category "Activity" ?!

}}

Boot

{{#ask: Test category::Boot
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Journal

{{#ask: Test category::Journal
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Network

{{#ask: Test category::Network
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Peripherals

{{#ask: Test category::Peripherals
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

SugarUI

{{#ask: Test category::SugarUI
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}


Sugar Control Panel

{{#ask: Test category::SugarControlPanel
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Upgrades

Test category::Upgrades
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases}}

School Server, XS

{{#ask: Test category::XS
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Internationalization (I18N)

{{#ask: Test category::I18N
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Smoke Test

{{#ask: Test category::SmokeTest
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}

Other Test Cases

{{#ask: Test category::other
Test case Short name Test objective Add test result
?Short name ?Test objective template=test-case-query default=No articles found in Category:Test cases

}}


Other queries

(Edit a section to see its query's syntax.)

For other examples of queries, see Other TestCase Queries, Testcase Query Examples, and comments at Semantic MediaWiki#Suggestions_for_test_cases.

General (older) test cases

This is a list of test cases that existed before the test case template. Once these have been moved into the template, this section can go away.