Test cases 8.2.1

From OLPC

Revision as of 17:24, 3 September 2010 by Greenfeld (Talk | contribs)
(diff) ← Older revision | Current revision (diff) | Newer revision → (diff)
Jump to: navigation, search
55px-Emblem-warning.svg.png This test case page is written for a previous release of the XO Software. Please make sure that you are running the proper test case page for the build you are testing. If you are not sure, you may wish to go to the Smoke test page.

Contents

Introduction

This is the test plan page for the 8.2.1 release. A large part of it is based on the tickets given in the ECO. Please email questions, criticisms, concerns, ideas, and test results you might have to the testing mailing list. See Friends in Testing to download the latest build under test.

Status

See the page on the role of a test manager for more information about these two questions.

  • Are we done yet? 0 out of 17 tickets (0%) have been verified as closed in the release candidate build.
  • What are the risks? The largest current risk is that we do not know potential areas of risk, but connectivity is a potential regression area. (This question will become more important as the answer to "Are we done yet?" gets closer to "we think so.")

Help unblock testers!

These are things we need - things that are actively blocking our ability to test the 8.2.1 release. If you can get us these resources, it would be a great help - if you clear a blocker, please email the testing mailing list and cc Mel (see #Introduction) so that we're all informed.

  • We need a build to test
  • For each build we're expected to test, we need a build changelog.

Things testers need to do

  • Each ticket needs to be examined (talk with developers!) for areas of potential risk/exploration, and additional test cases for those areas should be added.
  • The smoke test needs to be turned from 4 hours down into 1 hour through whatever means we can find, without reducing coverage.

Tests

Smoke tests

Test results are not reported below. These are the tests that should be run on every build before it is listed as the build to test at Friends in testing.

Test case Short name Test objective Add test result
Short name Test objective
Tests/SmokeTest/.oggFiles Playing an .ogg File in Browse Go online in the XO and play an .ogg file to confirm totem-player works
Tests/SmokeTest/Activities Activities Open and perform various activities on the XO unit and then close them.
Tests/SmokeTest/Chat Collaboration with Chat Initiate a chat within your neighborhood
Tests/SmokeTest/Distance Distance Get 2 XOs running the distance activity
Tests/SmokeTest/ImageTransferringandInvite Image Transferring and Invite You will open browse, do a search, incorporate that search into a write doc and then invite someone within the mesh to view and comment.
Tests/SmokeTest/InstallingaLibraryBundle Installing a Library Bundle Go to the Collections wiki on the XO unit and download some reference materials
Tests/SmokeTest/InstallinganActivityBundle Installing an Activity Bundle On a separate computer download an activity bundle to a USB stick then install it on the XO unit.
Tests/SmokeTest/JournalFill Filling up the journal Get to the point where the journal has 200+ items to determine how it effects the XO unit
Tests/SmokeTest/NetworkConnections Trying different connection types Connect with a school server and confirm in terminal; connect to WPA, WPA2, WEP
Tests/SmokeTest/StartUp Start Up Boot up your XO unit in secure and/or non secure mode. You can only boot in secure mode if you are testing a signed release.
Tests/SmokeTest/SuspendResume Suspend/Resume due to closed unit Practically close the XO unit (but not fully) to see how the unit reacts
Tests/SmokeTest/USBfiletransfer Transfer files to a USB stick Take files either in the journal or in the journal from the activities smoke test

Network Tests

Test case Short name Test objective Add test result
Short name Test objective
Tests/Connectivity/Collaboration Collaboration: access point environment Laptops can collaborate with each other while connected to an access point.
Tests/Network/100XO/Collaboration 100 XO, 2 AP collaboration To verify collaboration working with a 100 XO, 2 AP testbed.
Tests/Network/50XO/Collaboration 50 XO, 1 AP collaboration To verify collaboration working with a 50 XO, 1 AP testbed.
Tests/Network/WirelessActivation Wireless activation http://dev.laptop.org/ticket/8976
Tests/Network/XO/Ad-hoc Ad-hoc network sharing Ensure laptops can connect to ad-hoc networks and collaborate
Tests/Network/XO/Mesh Mesh network sharing Ensure laptops can connect to Mesh networks and collaborate
Tests/Network/XO/SimpleMesh Test XOs in Simple Mesh 10 Laptops connect and collaborate in simple mesh
Tests/Network/XO/Unsecured AP Unsecure network sharing using an access point Ensure laptops can connect to Unsecured AP networks and collaborate
Tests/Network/XO/WEP WEP Access Point connection Ensure that the XO can connect to a WEP AP and browse the internet.
Tests/Network/XO/WPA WPA Access Point Connection Ensure laptops can connect to WPA AP, and browse the internet
Tests/Network/XO/WPA2 XO connection to WPA2 Ensure the XO can connect to the WPA2 in the garden.
Tests/Network/XS Test/Network/XS/Dual access points Find out behavior of laptops trying to connect to the school server with two access points attached. Specifically, whether the laptops switch from one access point to another automatically, and whether they prefer one access point to another.
Tests/Network/XS/20XOPersistence 20 XOs connected to XS maintain extended collaboration This test determines whether large numbers of XOs (20) can collaborate on various Activities (here we used Chat, Browse, and Write) for an extended length of time.
Tests/Network/XS/AP/Registration School Server (XS) Registration Verify that an XO computer can register to a School Server (XS) properly.

Tickets for this build

Every test case that has a result for Property:Build stream 8.2.1 and also has a Property:Trac bug numberthe ticket may be for a test result for a completely unrelated release!.

Build stream Trac bug number
Tests/Network/XO/WEP 8.2
11.2
Any
Joyride
Staging
8.2.1
92239,223
Tests/SmokeTest/Activities 8.2.1
11.2
Any
8.2
87388,738


Test results

Note! The values in the different columns are unrelated. Just because a build and "Fail" are on the same row doesn't mean that's the failing test result. You have to look at the original test case to see what values are from the same test result.

Build stream Build number Trac bug number PassFail
Tests/SmokeTest/.oggFiles 8.2.1
11.2
Any
8.2
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/Activities 8.2.1
11.2
Any
8.2
759759
760
762
763
765
766
767
24
87388,738 Fail
Pass
Tests/SmokeTest/Chat 8.2.1
11.2
Any
8.2
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/Distance 8.2.1
11.2
Any
8.2
760760
762
766
767
Pass
Tests/SmokeTest/ImageTransferringandInvite 11.2
Any
8.2
8.2.1
759759
760
762
763
765
766
767
24
Pass
Tests/SmokeTest/InstallingaLibraryBundle Any
8.2
8.2.1
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/InstallinganActivityBundle Any
8.2
759759
760
763
765
766
767
87298,729 Pass
Fail
Tests/SmokeTest/JournalFill Any
Tests/SmokeTest/NetworkConnections Any
8.2
Staging
765765
766
767
24
92239,223 Pass
Tests/SmokeTest/StartUp Any
8.2
760760
762
763
765
766
767
Pass
Tests/SmokeTest/SuspendResume Any
8.2
8.2.1
766766
767
24
Pass
Tests/SmokeTest/USBfiletransfer Any
8.2
759759
760
763
765
766
767
83718,371
8,730
8,937
8,939
Fail
Pass


Build stream Build number Trac bug number PassFail
Tests/Connectivity/Collaboration Joyride
8.2
11.2
Any
760760 Pass
Tests/Network/100XO/Collaboration Any
Tests/Network/50XO/Collaboration Any
Tests/Network/WirelessActivation 8.2.1
11.2
Tests/Network/XO/Ad-hoc 11.2
Any
Tests/Network/XO/Mesh 11.2
Any
Tests/Network/XO/SimpleMesh 8.2
11.2
Any
Tests/Network/XO/Unsecured AP 11.2
Any
Tests/Network/XO/WEP 8.2
11.2
Any
Joyride
Staging
8.2.1
23012,301
766
767
24
800
92239,223 Pass
Tests/Network/XO/WPA 8.2
11.2
Any
Staging
767767
24
92239,223 Pass
Tests/Network/XO/WPA2 11.2
Any
8.2
Staging
766766
767
24
92239,223 Pass
Tests/Network/XS 8.2 767767
Tests/Network/XS/20XOPersistence Joyride
8.2
Any
760760 Pass
Tests/Network/XS/AP/Registration 11.2
Any


Test case results for 'build stream = 8.2.1':

Build stream Build number Trac bug number PassFail
Tests/Activity/EToys/Mp3 8.2.1
Tests/Activity/Memorize Any
8.2
8.2.1
763763
767
801
Pass
Fail
Tests/Activity/Memorize/FullTest 8.2.1 801801 Pass
Fail
Tests/Activity/Memorize/FullTest2 8.2.1 801801 Pass
Tests/Activity/Memorize/FullTest3 8.2.1 801801 Fail
Pass
Tests/Il8N/JournalFullMessage 8.2.1
Tests/Il8N/SoftwareUpdateControlPanel 8.2.1
Tests/Journal/DuplicateFiles 8.2.1
Tests/Network/WirelessActivation 8.2.1
11.2
Tests/Network/XO/WEP 8.2
11.2
Any
Joyride
Staging
8.2.1
23012,301
766
767
24
800
92239,223 Pass
Tests/Peripherals/SynapticsAndAlpsTouchpad 8.2.1
11.2
Tests/Peripherals/TouchpadXorg.Conf 8.2.1
Tests/SmokeTest/.oggFiles 8.2.1
11.2
Any
8.2
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/Activities 8.2.1
11.2
Any
8.2
759759
760
762
763
765
766
767
24
87388,738 Fail
Pass
Tests/SmokeTest/Chat 8.2.1
11.2
Any
8.2
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/Distance 8.2.1
11.2
Any
8.2
760760
762
766
767
Pass
Tests/SmokeTest/ImageTransferringandInvite 11.2
Any
8.2
8.2.1
759759
760
762
763
765
766
767
24
Pass
Tests/SmokeTest/InstallingaLibraryBundle Any
8.2
8.2.1
759759
760
762
765
766
767
24
Pass
Tests/SmokeTest/SuspendResume Any
8.2
8.2.1
766766
767
24
Pass
Tests/SugarUI/FedoraLogo 8.2.1
Tests/Upgrades/SigningCustomBuilds 8.2.1
Personal tools
  • Log in
  • Login with OpenID
About OLPC
About the laptop
About the tablet
Projects
OLPC wiki
Toolbox