Nepal: XO Testing Plan

The OLE Nepal team will use this document as the basis for acceptance testing for new XO's. This plan will test for hardware and software problems. Berrybw 06:55, 14 March 2008 (EDT)

We are using this document on a daily basis. If you have a tried-and-true solution you are welcome to post it here. Please keep suggestions or points for discussion onto the Talk Page that will make this document more easy to use.

The new XO's will be kept in the OLE Nepal storage room and not moved until testing is complete. Otherwise they will mingle w/ our other XO's and everything will be confused. We will test them in batches of 24 XO's at a time. (Why 24? because they are stacked 6 high.)

We will test the XO's over the period of a week and we will actually spend most of this time testing the Update.1 XO Build with customized activities for Nepal.

Stage 1 - Receipt of XO's

Stage 1 will be done by Upaya, Bryan, and Sulochan. Covers receipt and basic testing

1. At airport, count # of XO's if individually packed
2. Upon arrival at office, recount XO's and note any discrepancies
3. Inventory the XO's in a spreadsheet. The spreadsheet should record the XO's serial #, whether it shows any physical damage, or won't boot. Here is a inventory template spreadsheet you can use File:XO-Inventory-template.xls
   • If there is physical damage, write "physical damage" on the box w/ a red marker. If it won't boot, write "won't boot" with red marker.
   • In case of damage or not booting, put in the damaged stack
4. Insert USB key, containing runos.zip and actos.zip, see Procedure for Collecting UUID's and Serial Numbers
   • You should see a message like "SHFxxxxxxxx nnnnnnnnnnnnnnn; Laptop data recorded successfully"
   • The XO will then reboot, remove the USB key
5. At the login screen enter the Serial Number as the Name. This will distinguish the XO while you are testing it.
6. Attach a label to the XO that has the Serial Number as the identifier
7. Send file to OLPC containing the information needed to get developer keys for each XO to help@laptop.org
8. Put the XO back in its box
9. If everything worked, write in blue marker on the box Stage 1 OK
10. Once you have done this procedure for half of your XO's backup the laptops.dat and inventory spreadsheet w/ timestamps in the filenames (yes, I am paranoid)

Stage 2 - Serious Testing

Stage 2 will be done by Bryan, Upaya, Rajeev, Sulochan, Rabi, and Saurav

What you Need

For Stage you need a USB key with the following contents:

• Develop.sig -- developer key for this specific laptop. Create the /security folder at the USB root and place the develop.sig in that folder.
• your customized XO build, we will most likely use os699
• Any Bundles you will use according together with the Customization key
• Customization key

Print out a copy of this File:Nepal Testing Plan.xls spreadsheet for every XO you will test (note: may be easier to record data on regular laptops.)

Firmware Testing

1. Write the Serial # for the XO on Testing Plan
2. Place develop.sig specific to the XO you will test onto the USB key
3. Hit the "X" Escape key in the upper left-hand corner
4. Type test-all at the OK prompt
   • Note down any error messages you see during this process, basically any individual test that does not produce an OK result
   • If you do get an error message, write Firmware -- Component xxx failed w/ a red marker on the XO's box
5. after test-all completes, it is time to change the locale to Nepali from within the firmware (note: the XO's we received in Nepal had US as the locale)
   • At the OK prompt, type change-tag LA ne_NP.UTF-8
   • Turn off the XO and remove USB

TODO: I want to test the batteries for each XO but am not sure how to do this w/out spending massive amounts of time

Stage 3 - Load Testing

Stage 3 will be Bryan, Sulochan, and Dev (if available)

Will test many XO's together w/ School Server, Moodle, activities we will pre-install. It will be a testing bonanza!

1. Test 70 XO's together w/ access point