Testing

From OLPC
Revision as of 16:47, 5 August 2008 by Kimquirk (talk | contribs) (→‎Release info)
Jump to: navigation, search
  This page is monitored by the OLPC team.

The community and core team work through a slate of test issues for each major build and release. This page highlights the current tests being run, the testing process in general, and how to contribute your own results or bugs.

For the latest tests, see Update.1 tests.

Notes and minutes

General navigation

Many related pages need to be merged:

Activity testing project | Testing matrix | Activity testing guide | Activity testing template +/-

To merge: Testing | Testing ideas | Friends in testing

 See also: Sugar Labs testing | the Testing mailing list


Release info

Older notes

Links of Interest

Equipment specs:

  • Infrastructure_AP: Zoom 4400 AP+2 Wireless-G Access Point (Approx. $50 USD)
  • Long range Wireless: Wavion’s WS410 Spatially Adaptive Wi-Fi Access Point (Approx. $1600 USD)
  • Server HW Specs (Approx. $3000 USD)

Check out these new links to test plans and result matrices -- Get involved and help test some activities:

Community Testing:

Builds of Interest:

Activities script/latest activities:

Testing teams

The Activities on the XO have been developed by community members. Many of them are not well documented and there may not be much information on how to use them; so this testing can be described as 'Descriptive Testing', where you are helping to provide and/or correct the wiki pages that describe how an activity works. If you want to help, please refer to the Community Testing page for more details.

Also, the developers ask advanced users to try early builds with new features, see Friends in testing.


These test cases should be on separate pages, transclude them into a master page with {{Test_case/RIPv2}} you want -- Skierpage 19:49, 1 August 2008 (UTC)

Test area: Sugar Control Panel

Number/Title 1/Change Timezone
Objective Verify that the user can change their XO's timezone from the default UTC setting.
Feature Users are able to change their XO's timezone to match the local time without having to go into a terminal to do so.
Source http://wiki.laptop.org/go/Sugar_Control_Panel#Date_.26_Time]
Approach Act as an end-user trying to change the XO's timezone to match the local time.
Test Tools No test tools required.
Test Setup One XO laptop running an 8.2.0 (pre-)release build.
Test Procedure 1. Open the graphical Sugar Control Panel from the Home view.

2. Click on the "Date & Time" panel.
3. Find the desired timezone in the list and click on it.
4. Click the check-mark on the top-right. Select either "Later" or "Restart now".
4a. If you picked "Later", restart the laptop after a minute or two.
5. After the XO reboots, check that the timezone changed by opening a terminal and typing 'date'.

Expected Results & Pass Criteria The timezone for the laptop has been changed correctly and the timezone is represented properly by the 'date' command.
Comments
Number/Title 2/Corner Activation
Objective Verify that a user can change the delay before the frame appears when the cursor is moved into the corner of the screen.
Feature Sugar Control Panel#Frame
Source [2] Section 3.1, [9]
Approach Compliance will be verified using ANVL. ANVL will send a RIP response to the SuperRouter with an incorrectly formatted RIP header. The SuperRouter should ignore these packets. ANVL will then send a couple of valid packets, which the SuperRouter should accept.
Test Tools * ANVL by Midnight Networks
  • Sun workstation with SunOS 4.1.3 and 2 Ethernet interfaces
  • SuperRouter
Test Setup * Verify that the SuperRouter and Sun workstation are on a stand-alone network.
  • See RTN Configuration #1.
Test Procedure * Verify that the ANVL configuration file (create as needed) is updated to reflect the SuperRouter interfaces that are connected to the Sun Workstation.
  • Enter the following command from the ANVL directory:

anvl -f <config file name> -l med rip 2.2

  • Observe the output on the Sun workstation
Expected Results & Pass Criteria The SuperRouter shall not accept the packets that contain the invalid fields. Pass or failure of this test will be reported by ANVL.
Comments
Number/Title RTN-1004
Objective Verify that RIPv2 ignores packets with invalid fields.
Feature RIPv2 should not accept packets containing invalid fields.
Source [2] Section 3.1, [9]
Approach Compliance will be verified using ANVL. ANVL will send a RIP response to the SuperRouter with an incorrectly formatted RIP header. The SuperRouter should ignore these packets. ANVL will then send a couple of valid packets, which the SuperRouter should accept.
Test Tools * ANVL by Midnight Networks
  • Sun workstation with SunOS 4.1.3 and 2 Ethernet interfaces
  • SuperRouter
Test Setup * Verify that the SuperRouter and Sun workstation are on a stand-alone network.
  • See RTN Configuration #1.
Test Procedure * Verify that the ANVL configuration file (create as needed) is updated to reflect the SuperRouter interfaces that are connected to the Sun Workstation.
  • Enter the following command from the ANVL directory:

anvl -f <config file name> -l med rip 2.2

  • Observe the output on the Sun workstation
Expected Results & Pass Criteria The SuperRouter shall not accept the packets that contain the invalid fields. Pass or failure of this test will be reported by ANVL.
Comments

Reporting test results

To report results from a set of test cases, add a line to the appropriate table in the test case pages below with a quick summary; and include details, including setup and test team, on the talk page.

Items to Test

Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:

  • All keyboards. - Test: Keyboard Settings
    • Keys match the layouts designed
    • Language, keyboard, keymappings match the settings
    • All language and keyboard settings are preserved across updates
  • Languages - Test: Language Settings
  • Firmware
    • WPA - Richardo/Michailis
    • WEP - Richardo/Michailis
    • Mesh - upgrade under loaded network - Scott
    • Suspend/resume - Wad - Test: Suspend/resume
  • Scaling/performance
    • Jabber server scaling - OLPC/Collabora
    • Link local presence (Salut) - OLPC/Collabora
    • Journal/datastore
  • Upgrades /backward compatibility
  • Security

Other Test plans:

Schedule

Please see the official roadmap (from the trac main page) for schedule dates and features for each release.

Also See

GSOC08 OLPC Project Automated Testing

Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=Testing&oldid=150146"