Testcase Query Examples

From OLPC

Jump to: navigation, search

Other ways to query for test cases than the query(s) on Test cases 8.2.0

Copy these to make your own.

Contents

[edit] Basics

The basic query is 

 {{#ask: [[Category:Test cases]] [[Build stream::joyride|Any]]  | additional options }}

One option you should always add is |default=Query for xyz found nothing?!, otherwise you'll have no indication a page has a query that isn't working.

See Inline query output formats.


[edit] Query counting each test case

There are 169 total test cases in Category:Test cases.

There are 25 test cases in Category:Test cases with Property:Build stream of Joyride.

There are 117 test cases in Category:Test cases with Property:Build stream of 8.2.

There are 90 test cases in Category:Test cases with category Activity.

[edit] Querying for test results (problematic!)

This is tricky, because multipled test results are lumped into one test case page. See Semantic MediaWiki#Issues for test results.

Show any test case for 8.2.1 with a bug number or a fail but the failure may not be in 8.2.1 testing.

Short name Build stream PassFail Trac bug number Comments
Tests/Activity/Memorize/FullTest FullFunctionTests 8.2.1 Pass
Fail		 Activity opens and creates new game, icon appears in Activity Doughnut
Difficulty of (4x4) is selected and new games loads with 4x4
Load Demo of addition is selected and new game is created.
When game of 4x4 addition is completed there is no sign or notification that the game has been completed, all the tiles are face up and highlighted purple but nothing else notifys the user that they were successful or that the game is over
Activity is closed successfully and icon is removed from activity doughnut
Tests/Activity/Memorize/FullTest3 FullFunctionTest, Sequence 3 8.2.1 Fail
Pass		 Activity opens but previous games state is lost. Icon appears in Activity Doughnut
When 6x6 is selected as the diffculty and the game type is selected as sounds a new game is loaded and displayed
When 2 pieces are correctly matched they stay face up and gain a purple border.
When game of 6x6 sounds is completed there is no sign or notification that the game has been completed, all the tiles are face up and highlighted purple but nothing else notifys the user that they were successful or that the game is over
Activity is closed successfully and icon is removed from activity doughnut
Tests/Network/XO/WEP WEP Access Point connection 8.2
11.2
Any
Joyride
Staging
8.2.1		 Pass 92239,223 no problems
Started with cleaninstall of gg-766-3.
started with cleaninstall
It worked the second time I clicked on it and added the passphrase (ascii). Going back and forth between this and other APs, this one connects without asking for passphrase again and is pretty quick.
used olpc-update on build 25 to candidate-800, and network via WEB works first reboot
Tests/SmokeTest/Activities Activities 8.2.1
11.2
Any
8.2		 Fail
Pass		 87388,738 measure not working
everything on track
Signed clean-install of 766.
olpc-update candidate-766

saw a bug where some older items were at the top of the journal queue despite not being worked in for quite some time. newer items were showing up below these. haven't reproduced yet.
All work as described.

Scratch can save to Project and Subfolders
smoke testing firmware q2e21
Firmware q2e29a, software build os24.img


[edit] Query displaying each test case

If the pages you are including are small, you can embed them with format=embedded. This is like transcluding each page with {{:Title of page}} {{:Another page}} ..., but dynamic. This can confuse editors, and it puts the page that uses it into any categories in the embedded pages!

The example below is limited to three results

Tests/Activity/Calculate/SquareTest

Test case: square
How to report results

Stream
Category Activity Sub-category calculate
Component numbers
Feature Tests/Activity/Calculate/SquareTest
Objective passed
Tools calculater and numbers
Setup
Procedure #turn on the calculator.
  1. click on 2 button.
  2. click on x^2 button.
  3. click on = button.
Expected Results
and Pass Criteria 		number 4.
Comments test has passed.
Release Stream Build Pass/Fail Trac Ticket(s) Comment(s) Date of Test
7.1.0 (650) joyride Pass


Tests/Activity/Chat/Private chat

Test case: Private Chat
How to report results

Stream 8.2, 11.2
Category Activity Sub-category Chat
Component Chat
Feature Chat
Objective Verify that users can start and participate in a private (invite-only) chat.
Tools No test tools required.
Setup At least two laptops running the same version of Chat, preferably the most recent.
Procedure 1. On one XO, start up the Chat activity.

2. Switch to the Neighborhood view.
3. Find the other XO(s) being used for the test in the Neighborhood view and invite them to the chat by hovering the mouse cursor over their XO symbol and selecting the option with the appropriately-colored Chat icon.
4. On the other XO(s), a Chat icon with the colors of the first XO should appear in the frame.

  • In pre-8.2.0 builds, this icon will appear in the activity tray on the bottom of the screen in the home view or on the frame.
  • In joyride, 8.2.0 and beyond, this icon will flash once or twice in the top-left corner and then will stay in the top part of the frame in the list of active activities until the invitation is declined or the activity is stopped.

5. Select the "join" option or click on the icon to join the chat.
6. Chat.
7. Have one of the joining XOs leave the chat, then reinvite them from the host XO.
8. Join the chat again.
9. Leave the chat again on one of the XOs that joined the chat, then reinvite them from the host XO.
10. Have the other XOs (if any, including the host) leave the chat activity before the reinvited XO rejoins the chat.

Expected Results
and Pass Criteria 		1. On the Neighborhood view, there should be no Chat icon representing the host visible anywhere.

2. XOs can join the activity and chat reliably.
3. If an XO declines an invite or leaves the chat, they can still be reinvited back to the chat.
4. If the chat ends before an invited XO joins, the invitation should disappear.

Comments None.
Release Stream Build Pass/Fail Trac Ticket(s) Comment(s) Date of Test
Candidate joyride 2311 Pass No unexpected behavior.


Tests/Activity/Chat/Public chat

Test case: Public Chat
How to report results

Stream 8.2, 11.2
Category Activity Sub-category Chat
Component Chat
Feature Chat
Objective Verify that users can start and participate in a public (visible to the neighborhood) chat.
Tools No test tools required.
Setup At least two laptops running the same version of Chat, preferably the most recent.
Procedure 1. Start up a Chat activity on one XO. Share it with the Neighborhood.

2. On the other XOs, go to the Neighborhood view and join the chat.
3. Send messages to the chat from all of the XOs.
4. Have one or more of the XOs (not the host) leave the chat for a few minutes, then rejoin.
5. Chat some more.
6. Have one of the non-host XOs leave the chat again.
7. Have the rest of the XOs (host included) leave the chat.

Expected Results
and Pass Criteria 		1. When the XOs join the chat, the icon should appear with the colors of the host XO.

2. XOs can join the activity and chat reliably.
3. If the chat ends (everyone leaves), the icon should disappear from the Neighborhood view.

Comments None.
Release Stream Build Pass/Fail Trac Ticket(s) Comment(s) Date of Test
Candidate joyride 2311 Pass No unexpected behavior.


Candidate 8.2 763 Pass chat-47


… further results

[edit] Bug: query for a disallowed value sometimes still works

Bug: if I query for a bogus value, it counts all of them. A query for Build stream==BADVALUE returns a count of 143

Retrieved from "http://wiki.laptop.org/go/Testcase_Query_Examples"
Personal tools
  • Log in / create account
  • Login with OpenID
About OLPC
About the XO
Projects
OLPC wiki
Toolbox