Testing

  This page is monitored by the OLPC team.

Test Strategy

There are many people and organizations who are helping out with the test effort for the XO, network communications, the server, performance and system testing. This page will summarize all the test efforts and link to more details where ever possible.

The open source community is providing a good test effort for much of the open source code. In our local test plans we need to concentrate on areas that are not easy or possible for the community due to lack of physical XO, Server, or other OLPC specific equipment.

Trac is being used to track bugs found during test. We currently don't have a system for test case management, but we may want to implement something for that as well.

Release Criteria

Trial-2

The release criteria for Trial-2 software is based on meeting the expectations of as many as 2000 children and teachers using OLPC products to evaluate whether this is the right product for their school/country. It is expected to be alpha level quality with no serious crash bugs. It is important to be able to demo some of the new features that make our product unique: collaboration both locally and with access to internet, good power consumption, great mechanics/hardware to meet environmental conditions, "open" product -- hardware, firmware, software, activities.

With that in mind, we need to focus on a few good features to demonstrate 'explore', 'express', 'communicate', and 'collaborate' with good quality. This translates into the prioritized feature set for the Trial-2 milestone, which is found here:

< http://dev.laptop.org/milestone/Trial-2 >

Trial-3

Trial-3 needs to meet our beta level expectations. Many more features and activities are demonstrable with collaboration and a solid journal/sugar UI. It is also key that we have activation and upgrades working well. This is the first step in our BitFrost security plan.

We will not be adding many new features (perhaps none) between trial-3 and first deployment, so we really need to focus on blocking and high priority bugs associated with basic features and functionality including mesh, connectivity, power management, and activities.

The prioritized feature list for Trial-3 can be found here:

< http://dev.laptop.org/milestone/Trial-3 >

First Deployment

Release criteria:

See Release Criteria

Test plans/pages

1. Quanta HW test plan - One time test per build. This test is aimed at environmental conditions (thermal, humidity, altitude, shake)
2. Quanta Mfg Test - Every laptop goes through these tests as part of the manufacturing line.
3. File:B3-B4 OLPC Test Plan.xls - One time test per build. Written for B2, to be modified for B3 so as not to overlap Tinderbox or Quanta testing. Detailed manual testing for camera, keyboard, USB, mouse pad, other devices, power management.
4. Tinderbox Testing - Regression after all new SW builds. This test is aimed at boot up, X drivers, low level device testing, network, and performance at the CPU level, and power management.
5. 802.11s Connectivity Test Plan - Mesh discovery, performance, reliability tests
6. User Stories Testing - This testing is aimed at functional and system level testing based on real user stories. Activity Test Plans can be found here.

Test meeting Minutes
Test Group Release Notes