Test cases 8.2.1
From OLPC
| This test case page is written for a previous release of the XO Software. | Please make sure that you are running the proper test case page for the build you are testing. If you are not sure, you may wish to go to the Smoke test page. |
|
[edit] Introduction
This is the test plan page for the 8.2.1 release. A large part of it is based on the tickets given in the ECO. Please email questions, criticisms, concerns, ideas, and test results you might have to the testing mailing list. See Friends in Testing to download the latest build under test.
[edit] Status
See the page on the role of a test manager for more information about these two questions.
- Are we done yet? 0 out of 17 tickets (0%) have been verified as closed in the release candidate build.
- What are the risks? The largest current risk is that we do not know potential areas of risk, but connectivity is a potential regression area. (This question will become more important as the answer to "Are we done yet?" gets closer to "we think so.")
[edit] Help unblock testers!
These are things we need - things that are actively blocking our ability to test the 8.2.1 release. If you can get us these resources, it would be a great help - if you clear a blocker, please email the testing mailing list and cc Mel (see #Introduction) so that we're all informed.
-
We need a build to test -
For each build we're expected to test, we need a build changelog.
[edit] Things testers need to do
- Each ticket needs to be examined (talk with developers!) for areas of potential risk/exploration, and additional test cases for those areas should be added.
- The smoke test needs to be turned from 4 hours down into 1 hour through whatever means we can find, without reducing coverage.
[edit] Tests
[edit] Smoke tests
Test results are not reported below. These are the tests that should be run on every build before it is listed as the build to test at Friends in testing.
| Test case | Short name | Test objective | Add test result |
|---|
| Short name | Test objective | |
|---|---|---|
| Tests/SmokeTest/.oggFiles | Playing an .ogg File in Browse | Go online in the XO and play an .ogg file to confirm totem-player works |
| Tests/SmokeTest/Activities | Activities | Open and perform various activities on the XO unit and then close them. |
| Tests/SmokeTest/Chat | Collaboration with Chat | Initiate a chat within your neighborhood |
| Tests/SmokeTest/Distance | Distance | Get 2 XOs running the distance activity |
| Tests/SmokeTest/ImageTransferringandInvite | Image Transferring and Invite | You will open browse, do a search, incorporate that search into a write doc and then invite someone within the mesh to view and comment. |
| Tests/SmokeTest/InstallingaLibraryBundle | Installing a Library Bundle | Go to the Collections wiki on the XO unit and download some reference materials |
| Tests/SmokeTest/InstallinganActivityBundle | Installing an Activity Bundle | On a separate computer download an activity bundle to a USB stick then install it on the XO unit. |
| Tests/SmokeTest/JournalFill | Filling up the journal | Get to the point where the journal has 200+ items to determine how it effects the XO unit |
| Tests/SmokeTest/NetworkConnections | Trying different connection types | Connect with a school server and confirm in terminal; connect to WPA, WPA2, WEP |
| Tests/SmokeTest/StartUp | Start Up | Boot up your XO unit in secure and/or non secure mode. You can only boot in secure mode if you are testing a signed release. |
| Tests/SmokeTest/SuspendResume | Suspend/Resume due to closed unit | Practically close the XO unit (but not fully) to see how the unit reacts |
| Tests/SmokeTest/USBfiletransfer | Transfer files to a USB stick | Take files either in the journal or in the journal from the activities smoke test |
[edit] Network Tests
| Test case | Short name | Test objective | Add test result |
|---|
| Short name | Test objective | |
|---|---|---|
| Tests/Connectivity/Collaboration | Collaboration: access point environment | Laptops can collaborate with each other while connected to an access point. |
| Tests/Network/100XO/Collaboration | 100 XO, 2 AP collaboration | To verify collaboration working with a 100 XO, 2 AP testbed. |
| Tests/Network/50XO/Collaboration | 50 XO, 1 AP collaboration | To verify collaboration working with a 50 XO, 1 AP testbed. |
| Tests/Network/WirelessActivation | Wireless activation | http://dev.laptop.org/ticket/8976 |
| Tests/Network/XO/Ad-hoc | Ad-hoc network sharing | Ensure laptops can connect to ad-hoc networks and collaborate |
| Tests/Network/XO/Mesh | Mesh network sharing | Ensure laptops can connect to Mesh networks and collaborate |
| Tests/Network/XO/SimpleMesh | Test XOs in Simple Mesh | 10 Laptops connect and collaborate in simple mesh |
| Tests/Network/XO/Unsecured AP | Unsecure network sharing using an access point | Ensure laptops can connect to Unsecured AP networks and collaborate |
| Tests/Network/XO/WEP | WEP Access Point connection | Ensure that the XO can connect to a WEP AP and browse the internet. |
| Tests/Network/XO/WPA | WPA Access Point Connection | Ensure laptops can connect to WPA AP, and browse the internet |
| Tests/Network/XO/WPA2 | XO connection to WPA2 | Ensure the XO can connect to the WPA2 in the garden. |
| Tests/Network/XS | Test/Network/XS/Dual access points | Find out behavior of laptops trying to connect to the school server with two access points attached. Specifically, whether the laptops switch from one access point to another automatically, and whether they prefer one access point to another. |
| Tests/Network/XS/20XOPersistence | 20 XOs connected to XS maintain extended collaboration | This test determines whether large numbers of XOs (20) can collaborate on various Activities (here we used Chat, Browse, and Write) for an extended length of time. |
| Tests/Network/XS/AP/20XOs | 20 laptops connect to XS through AP | This test is meant to ensure that 20 laptops can connect to a school server through an infrastructure AP; and browse the web. |
| Tests/Network/XS/AP/Registration | School Server (XS) Registration | Verify that an XO computer can register to a School Server (XS) properly. |
[edit] Tickets for this build
Every test case that has a result for Property:Build stream 8.2.1 and also has a Property:Trac bug number — the ticket may be for a test result for a completely unrelated release!.
| Build stream | Trac bug number | |
|---|---|---|
| Tests/Network/XO/WEP | 8.2 11.2 Any Joyride Staging 8.2.1 |
92239,223 |
| Tests/SmokeTest/Activities | 8.2.1 11.2 Any 8.2 |
87388,738 |
[edit] Test results
Note! The values in the different columns are unrelated. Just because a build and "Fail" are on the same row doesn't mean that's the failing test result. You have to look at the original test case to see what values are from the same test result.
| Build stream | Build number | Trac bug number | PassFail | |
|---|---|---|---|---|
| Tests/SmokeTest/.oggFiles | 8.2.1 11.2 Any 8.2 |
759759 760 762 765 766 767 24 |
Pass | |
| Tests/SmokeTest/Activities | 8.2.1 11.2 Any 8.2 |
759759 760 762 763 765 766 767 24 |
87388,738 | Fail Pass |
| Tests/SmokeTest/Chat | 8.2.1 11.2 Any 8.2 |
759759 760 762 765 766 767 24 |
Pass | |
| Tests/SmokeTest/Distance | 8.2.1 11.2 Any 8.2 |
760760 762 766 767 |
Pass | |
| Tests/SmokeTest/ImageTransferringandInvite | 11.2 Any 8.2 8.2.1 |
759759 760 762 763 765 766 767 24 |
Pass | |
| Tests/SmokeTest/InstallingaLibraryBundle | Any 8.2 8.2.1 |
759759 760 762 765 766 767 24 |
Pass | |
| Tests/SmokeTest/InstallinganActivityBundle | Any 8.2 |
759759 760 763 765 766 767 |
87298,729 | Pass Fail |
| Tests/SmokeTest/JournalFill | Any | |||
| Tests/SmokeTest/NetworkConnections | Any 8.2 Staging |
765765 766 767 24 |
92239,223 | Pass |
| Tests/SmokeTest/StartUp | Any 8.2 |
760760 762 763 765 766 767 |
Pass | |
| Tests/SmokeTest/SuspendResume | Any 8.2 8.2.1 |
766766 767 24 |
Pass | |
| Tests/SmokeTest/USBfiletransfer | Any 8.2 |
759759 760 763 765 766 767 |
83718,371 8,730 8,937 8,939 |
Fail Pass |
| Build stream | Build number | Trac bug number | PassFail | |
|---|---|---|---|---|
| Tests/Connectivity/Collaboration | Joyride 8.2 11.2 Any |
760760 | Pass | |
| Tests/Network/100XO/Collaboration | Any | |||
| Tests/Network/50XO/Collaboration | Any | |||
| Tests/Network/WirelessActivation | 8.2.1 11.2 |
|||
| Tests/Network/XO/Ad-hoc | 11.2 Any |
|||
| Tests/Network/XO/Mesh | 11.2 Any |
|||
| Tests/Network/XO/SimpleMesh | 8.2 11.2 Any |
|||
| Tests/Network/XO/Unsecured AP | 11.2 Any |
|||
| Tests/Network/XO/WEP | 8.2 11.2 Any Joyride Staging 8.2.1 |
23012,301 766 767 24 800 |
92239,223 | Pass |
| Tests/Network/XO/WPA | 8.2 11.2 Any Staging |
767767 24 |
92239,223 | Pass |
| Tests/Network/XO/WPA2 | 11.2 Any 8.2 Staging |
766766 767 24 |
92239,223 | Pass |
| Tests/Network/XS | 8.2 | 767767 | ||
| Tests/Network/XS/20XOPersistence | Joyride 8.2 Any |
760760 | Pass | |
| Tests/Network/XS/AP/20XOs | Joyride 8.2 Any |
|||
| Tests/Network/XS/AP/Registration | 11.2 Any |
Test case results for 'build stream = 8.2.1':
