Update.1 tests: Difference between revisions

From OLPC
Jump to navigation Jump to search
No edit summary
 
(153 intermediate revisions by 16 users not shown)
Line 1: Line 1:
'''End Users''': ''see [[Release notes/8.1.0]] for more relevant information.''
this is still under construction --[[User:Chihyu|Chihyu]] 12:30, 17 January 2008 (EST)

==Schedule & Features==

The focus of this build is to
# fix bugs
# get the suspend/resume working for better battery life
# get the first level activity isolation for security
# backup of laptops to the school server
# there is a new wireless driver - some rewriting

Please also refer to the [http://dev.laptop.org/milestone/Update.1 milestone] and the [http://dev.laptop.org/roadmap official roadmap] for schedule dates and features for each release.


==Test Plans==
==Test Plans==


A [[smoke test|1hr smoke test]] should be performed with each candidate, and the smoke test results should be reported in [[Test_Group_Release_Notes#Update.1_Builds|Test Group Release Notes]].
=== One Hour Smoke Test ===


===Major Foci===
# [[1 Hour Smoke Test]]


=== Networks ===
====Power Management====


# Suspend/resume (does not apply to B4 machines)
# [[Tests/100 laptops]]
#* [[Tests/Suspend_Resume|Suspend-Resume test cases]]
<!--#* [http://dev.laptop.org/ticket/5400 #5400] covered in generic test cases-->
<!--#* [http://dev.laptop.org/ticket/4843 #4843] covered in generic test cases-->
<!-- covered in generic test cases
# Wakeup event is repeated, [http://dev.laptop.org/ticket/2401 #2401]
#* To test, load a PDF in Read, push the game key down button, five seconds later the machine should suspend with the backlight on full. While suspended, push the game key down button again. The screen should scroll down once, and only once. [[User:Cjb|Cjb]] 14:26, 23 January 2008 (EST)
# Ebook reader should suspend on idleness, [http://dev.laptop.org/ticket/1396 #1396]
#* This is as above in the #2401 test case; the machine should suspend five seconds after the last ebook scroll event, with the backlight fully on. [[User:Cjb|Cjb]] 14:26, 23 January 2008 (EST)
-->
# Network mgr SEGV, [http://dev.laptop.org/ticket/4960 #4960]
<!--#* need help with a reasonable test case; how should one make the wireless device go away? --[[User:Chihyu|Chihyu]] 16:47, 18 January 2008 (EST)-->
<!--#* open terminal activity, become root (<tt>sudo su -</tt>), check that NetworkManager process is running (<tt>ps ax | grep NetworkManager</tt> # you'll see it in the results), unload wireless driver (<tt>rmmod usb83xx</tt>), check that unload succeeded (<tt>lsmod</tt> # and check that usb83xx is not mentioned in the results), wait 2 minutes or so, confirm that NetworkManager process is still running (<tt>ps ax | grep NetworkManager</tt>) --[[User:DanielDrake|DanielDrake]] 16:10, 19 January 2008 (EST)-->
#* [[Tests/Network_mgr#Network_mgr_SEGV|Tests: NetworkManager]]
# <strike>ohm logfile [http://dev.laptop.org/ticket/5457 #5457], optional</strike>
#* The code for this doesn't exist yet, so the testcase doesn't either. :) [[User:Cjb|Cjb]] 14:26, 23 January 2008 (EST)


====Security/Upgrades====
=== Views and visualizations ===
(does not apply to B4 machines)


# Activation w/USB, w/school server
#[[Tests/Mesh view|Mesh view]]
#* does "activation" mean upgrade to another build? --[[User:Chihyu|Chihyu]] 11:13, 22 January 2008 (EST)
#[[Tests/Neighborhood view|Neighborhood view]]
# <tt>olpc-update --usb</tt> '''without''' [[Olpc-update#Workaround:_updating_olpc-update|manually upgrading olpc-update]]. ([http://dev.laptop.org/ticket/3881 #3881])
#* Type <tt>olpc-update --version</tt> in the console. Verify that the version is 2.0 or newer.
#* [[Tests/Backward_Comp|Test: Backward Compatibility]]
# Basic activity isolation ([http://dev.laptop.org/ticket/5033 #5033], [http://dev.laptop.org/ticket/5346 #5346])
#* need help confirm that [[Tests/Isolation#Activity_Isolation|Tests: Isolation]] is testing [http://dev.laptop.org/ticket/5033 the correct issues] --[[User:Chihyu|Chihyu]] 11:46, 22 January 2008 (EST)
#* need help create a test case for [http://dev.laptop.org/ticket/5346 #5346] --[[User:Chihyu|Chihyu]] 11:21, 22 January 2008 (EST)
# Automatic Time sync ([http://dev.laptop.org/ticket/3359 #3359])
#* how to test this without using more than one machine? --[[User:Chihyu|Chihyu]] 12:08, 22 January 2008 (EST)
<!--#* test case at [[Tests/Time sync]], currently broken, see #5930 and #5931, -[[User:DanielDrake|DanielDrake]] 16:15, 19 January 2008 (EST) fixed (chihyu)-->
# orphaned files, [http://dev.laptop.org/ticket/5637 #5637]
#* cannot create test cases due to the disappearance of original bug description --[[User:Chihyu|Chihyu]] 12:29, 22 January 2008 (EST)
# Mesh - upgrade under loaded network - Scott


====Wireless/USB/Network Manager====
=== Mime Types ===


# [[Tests/Wireless_Test-scp_loop|Wireless Test Cases]], issues to address:
# [http://www.yolinux.com/TUTORIALS/LinuxTutorialMimeTypesAndApplications.html Mime Types test] from ''yolinux.com''
#* Intermittent connection to jabber service, [http://dev.laptop.org/ticket/4193 #4193]
:*[[What should go into Mime Type tests]]
#* Network sniffing script, [http://dev.laptop.org/ticket/5153 #5153]
#* WPA working from sugar, [http://dev.laptop.org/ticket/5258 #5258]
#* WEP working from sugar, [http://dev.laptop.org/ticket/5485 #5485]


====Tubes/Presence (Scaling/Performance)====
===Battery Life===


# Remove N squared scaling issue in groups ([http://dev.laptop.org/ticket/4965 #4965]): test this once #5311 is fixed. --[[User:Chihyu|Chihyu]] 17:05, 24 January 2008 (EST)
Base line test for battery life. Boot up the machines, fully charge, remove the adapters and see how long the battery lasts.
#* add other XOs as friends
* [[Battery Results]]
#* confirm that friends are recorded in <tt>/home/olpc/.sugar/default/friends</tt>
**[[Image:Baseline_battery_test.pdf | Battery Life Test 1 Results]] <br>
#* confirm that the school server also keeps the same record
#** has a tool been developed to test this? --[[User:Chihyu|Chihyu]] 18:21, 24 January 2008 (EST)
# <strike>eJabberd server issues/bugs ([http://dev.laptop.org/ticket/5934 #5934], [http://dev.laptop.org/ticket/5313 #5313], [http://dev.laptop.org/ticket/5315 #5315], [http://dev.laptop.org/ticket/5311 #5311] - cut traffic, [http://dev.laptop.org/ticket/5310 #5310] - olpc rpm)</strike>
#* waiting for the fixes from Process One --[[User:Chihyu|Chihyu]] 17:28, 24 January 2008 (EST)
# <strike>Looking into Openfire as backup ([http://dev.laptop.org/ticket/5223 #5223], [http://dev.laptop.org/ticket/5224 #5224])</strike>
#* this is a task, not a bug to be tested --[[User:Chihyu|Chihyu]] 18:21, 24 January 2008 (EST)
# <strike>Point Update1 to different jabber server, [http://dev.laptop.org/ticket/5933 #5933]</strike>
#* this is a task, not a bug to be tested --[[User:Chihyu|Chihyu]] 18:21, 24 January 2008 (EST)
# Scaling? [http://dev.laptop.org/ticket/5817 #5817]
# Link local presence (Salut) - OLPC/Collabora
#* need help with main issues and test cases --[[User:Chihyu|Chihyu]] 18:21, 24 January 2008 (EST)


=== Regular processes ===
===Completed Test Cases===


# [[Tests/Start up and Activation]]
# [[Tests/Browse|Browse]]
# [[Test Basic Operation]]
# [[Tests/Write|Write]]
# [[Tests/Connectivity and Collaboration]]
# [[Tests/Record|Record]]
# [[Tests/Archive, Backup, Content]]
# [[Tests/Paint|Paint]]
# [[Tests/Invite]]
# [[Tests/Chat|Chat]]
# [[Testing_matrix|Other activities]]
# [[User_Stories_Testing|User-Focused Test Plans]]. (Some test cases should already be covered in the previous sections).


===Incomplete Test Cases===
=== International Laptops ===


Please help revise/create test cases in [[:Category:Test_Plans|Test Plans]]
# [[Tests/Keyboard mappings]]
# [[Tests/Language settings]]


=== Upgrading ===
===Others===


# [[802.11s Connectivity Test Plan]] - Connectivity, wifi protocol
# [[From last stable build]]
<!--*[[Image:B3-B4 OLPC Test Plan.xls]] - Low Level Test Plan-->
# [[Tinderbox Testing]] - automated testing for each build
# Journal/datastore
#* need help with main issues and test cases --[[User:Chihyu|Chihyu]] 18:21, 24 January 2008 (EST)


===Scaling Tests===
=== Hardware and firmware ===


[[Tests/Conference_scaling|Australia/conference tests]]
# [[Tests/SD card]]
# [[Tests/SD card acting as a usb drive in card reader]]
# [[Tests/USB stick]]
# [[Tests/Manufacturing Data]]


==Test Results==
=== Suspend and Resume ===
See also [[Testing Update.1 Results]].


=== Template ===
# [[Tests/Suspend_Resume|Tests/Suspend and resume]]


# If the table has not been linked to any test cases, either the test cases have not been created, or please help us locate the test cases!
=== SchoolServer ===
# When you sign under each reported result, simply type 4 tildes: <nowiki>~~~~</nowiki> instead of typing your username, date, and time.
# Values to fill in:
#* '''no''': not tested
#* '''good''': tested and passed
#* If a defect is found, please file a trac ticket and fill in the ticket number in the table. For example, [http://dev.laptop.org/ticket/5969 5969].


{| class="wikitable"
! Build
! Test Item
! English
|-
! rowspan="2"| 684
! [[Tests/Keyboard_mappings|keyboard]]
| good
[[User:Chihyu|Chihyu]] 13:56, 17 January 2008 (EST)
|-
! [[Tests/Language_settings|language]]
| [http://dev.laptop.org/ticket/5969 5969]
[[User:Chihyu|Chihyu]] 17:47, 28 January 2008 (EST)
|-
! rowspan="2"| future<br>candidate
! [[Tests/Keyboard_mappings|keyboard]]
| no
|-
! [[Tests/Language_settings|language]]
| no
|}






===Keyboard/Languages===
=== Suspend/resume ===

{| class="wikitable"
! Build
! [[Tests/Suspend_Resume#Suspend_Mode|Suspend Mode]]
! [[Tests/Suspend_Resume#Sleep_Mode_.28power_button.29|Sleep Mode<br>(power button)]]
! [[Tests/Suspend_Resume#Sleep_Mode_.28lid_closing.29|Sleep Mode<br>(lid closing)]]
! [[Tests/Suspend_Resume#Ebook_Mode|Ebook Mode]]
! [[Tests/Suspend_Resume#Restart_Sugar|Restarting Sugar]]
! [[Tests/Suspend_Resume#Shut_Down_in_Battery_Mode|Battery Mode]]
! [[Tests/Suspend_Resume#Turning_off_suspend.2Fresume|Disable<br>Suspend/Resume]]
|-
!|RC1-690
| no
| no
| no
| no
| no
| no
| no
|-
!|RC2-691
| no
| no
| no
| no
| no
| no
| no
|-
|}

=== Security/Upgrades ===

{| class="wikitable"
! Build
! [[Tests/Isolation|Isolation]]
! [[From_last_stable_build|Upgrade]]
! [[Tests/Backward_Comp|Backward Comp]]
|-
!|RC1-690
| no
| no
| no
|-
!|RC2-691
| no
| no
| no
|}

=== Wireless/USB/Network Manager ===

{| class="wikitable"
! Build
! [[Tests/Wireless_Test-scp_loop|Wireless]]
! [http://dev.laptop.org/ticket/4193 Salut Issue]
! [http://dev.laptop.org/ticket/5258 WPA Bug]
! [http://dev.laptop.org/ticket/5485 WEP Bug]
! [[Tests/USB_stick|USB]]
! [[Tests/Time_sync|Time Sync]]
! [[Tests/Network_mgr#Network_mgr_SEGV|Network mgr]]
|-
!|RC1-690
| no
| no
| no
| no
| no
| no
| no
|-
!|RC2-691
| no
| no
| no
| no
| no
| no
| no
|-
|}

=== Tubes/Presence (Scaling/Performance) ===

{| class="wikitable"
! Build
! [http://dev.laptop.org/ticket/5485 Friends]
! [[Tests/Conference_scaling|Conf_Scale]]
|-
!|RC1-690
| no
| no
|-
!|RC2-691
| no
| no
|-
|}

=== Core Activities ===

Please add the testing results for [[Testing_matrix|other core activities]] in this section!

{| class="wikitable"
! Build
! [[Tests/Browse|Browse]]
! [[Tests/Chat|Chat]]
! [[Tests/Paint|Paint]]
! [[Tests/Record|Record]]
! [[Tests/Write|Write]]
|-
!|RC1-690
| no
| no
| no
| no
| no
|-
!|RC2-691
| no
| no
| no
| no
| no
|-
|}

=== User-Focused Test Plans ===

{| class="wikitable"
! Build
! [[Tests/SD_card|SD Card]]
! [[Tests/SD_card_acting_as_a_usb_drive_in_card_reader|SD Card as USB drive]]
|-
!|RC1-690
| no
| no
|-
!|RC2-691
| no
| no
|-
|}


=== Keyboard/Languages ===
Areas that we need to test in house (due to the use of special equipment and quantities of laptops) include:
* All keyboards. - [[Test_Keyboard_mappings|Test: Keyboard Settings]]
** Keys match the layouts designed
** Language, keyboard, keymappings match the settings
** All language and keyboard settings are preserved across updates
* Languages - [[Test_Language_settings|Test: Language Settings]]


: Keyboard/Languages for Update1:
{| class="wikitable"
{| class="wikitable"
! Build
!
! Test Item
! English
! English
! Spanish
! Spanish
Line 85: Line 305:
! Portuguese
! Portuguese
|-
|-
! rowspan="2"| RC1-690
! keyboard tested?
! [[Tests/Keyboard_mappings|keyboard]]
| no
| no
| no
| no
Line 99: Line 320:
| no
| no
|-
|-
! language tested?
! [[Tests/Language_settings|language]]
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
|-
! rowspan="2"| RC2-691
! [[Tests/Keyboard_mappings|keyboard]]
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
| no
|-
! [[Tests/Language_settings|language]]
| no
| no
| no
| no
Line 113: Line 363:
| no
| no
|}
|}

===Firmware===

** WPA - Richardo/Michailis
** WEP - Richardo/Michailis
** Mesh - upgrade under loaded network - Scott
** Suspend/resume [[Tests/Suspend_Resume|Test]] - Wad

===Scaling/performance===
** Jabber server scaling - OLPC/Collabora
** Link local presence (Salut) - OLPC/Collabora
** Journal/datastore

===Upgrades /backward compatibility===

===Security===

===Other Test plans===
*[[802.11s Connectivity Test Plan]] - Connectivity, wifi protocol
*[[Image:B3-B4 OLPC Test Plan.xls]] - Low Level Test Plan
*[[Tinderbox Testing]] - automated testing for each build


===Schedule===

Please see the [https://dev.laptop.org/roadmap official roadmap] (from the trac main page) for schedule dates and features for each release.





[[Category:Test plans]]
[[Category:Test Plans]]
[[Category:Tests]]
[[Category:Test results]]

Latest revision as of 03:36, 27 January 2011

End Users: see Release notes/8.1.0 for more relevant information.

Schedule & Features

The focus of this build is to

  1. fix bugs
  2. get the suspend/resume working for better battery life
  3. get the first level activity isolation for security
  4. backup of laptops to the school server
  5. there is a new wireless driver - some rewriting

Please also refer to the milestone and the official roadmap for schedule dates and features for each release.

Test Plans

A 1hr smoke test should be performed with each candidate, and the smoke test results should be reported in Test Group Release Notes.

Major Foci

Power Management

  1. Suspend/resume (does not apply to B4 machines)
  2. Network mgr SEGV, #4960
  3. ohm logfile #5457, optional
    • The code for this doesn't exist yet, so the testcase doesn't either.  :) Cjb 14:26, 23 January 2008 (EST)

Security/Upgrades

(does not apply to B4 machines)

  1. Activation w/USB, w/school server
    • does "activation" mean upgrade to another build? --Chihyu 11:13, 22 January 2008 (EST)
  2. olpc-update --usb without manually upgrading olpc-update. (#3881)
  3. Basic activity isolation (#5033, #5346)
  4. Automatic Time sync (#3359)
    • how to test this without using more than one machine? --Chihyu 12:08, 22 January 2008 (EST)
  5. orphaned files, #5637
    • cannot create test cases due to the disappearance of original bug description --Chihyu 12:29, 22 January 2008 (EST)
  6. Mesh - upgrade under loaded network - Scott

Wireless/USB/Network Manager

  1. Wireless Test Cases, issues to address:
    • Intermittent connection to jabber service, #4193
    • Network sniffing script, #5153
    • WPA working from sugar, #5258
    • WEP working from sugar, #5485

Tubes/Presence (Scaling/Performance)

  1. Remove N squared scaling issue in groups (#4965): test this once #5311 is fixed. --Chihyu 17:05, 24 January 2008 (EST)
    • add other XOs as friends
    • confirm that friends are recorded in /home/olpc/.sugar/default/friends
    • confirm that the school server also keeps the same record
      • has a tool been developed to test this? --Chihyu 18:21, 24 January 2008 (EST)
  2. eJabberd server issues/bugs (#5934, #5313, #5315, #5311 - cut traffic, #5310 - olpc rpm)
    • waiting for the fixes from Process One --Chihyu 17:28, 24 January 2008 (EST)
  3. Looking into Openfire as backup (#5223, #5224)
    • this is a task, not a bug to be tested --Chihyu 18:21, 24 January 2008 (EST)
  4. Point Update1 to different jabber server, #5933
    • this is a task, not a bug to be tested --Chihyu 18:21, 24 January 2008 (EST)
  5. Scaling? #5817
  6. Link local presence (Salut) - OLPC/Collabora
    • need help with main issues and test cases --Chihyu 18:21, 24 January 2008 (EST)

Completed Test Cases

  1. Browse
  2. Write
  3. Record
  4. Paint
  5. Chat
  6. Other activities
  7. User-Focused Test Plans. (Some test cases should already be covered in the previous sections).

Incomplete Test Cases

Please help revise/create test cases in Test Plans

Others

  1. 802.11s Connectivity Test Plan - Connectivity, wifi protocol
  2. Tinderbox Testing - automated testing for each build
  3. Journal/datastore
    • need help with main issues and test cases --Chihyu 18:21, 24 January 2008 (EST)

Scaling Tests

Australia/conference tests

Test Results

See also Testing Update.1 Results.

Template

  1. If the table has not been linked to any test cases, either the test cases have not been created, or please help us locate the test cases!
  2. When you sign under each reported result, simply type 4 tildes: ~~~~ instead of typing your username, date, and time.
  3. Values to fill in:
    • no: not tested
    • good: tested and passed
    • If a defect is found, please file a trac ticket and fill in the ticket number in the table. For example, 5969.
Build Test Item English
684 keyboard good

Chihyu 13:56, 17 January 2008 (EST)

language 5969

Chihyu 17:47, 28 January 2008 (EST)

future
candidate 		keyboard no
language no


Suspend/resume

Build Suspend Mode Sleep Mode
(power button) 		Sleep Mode
(lid closing) 		Ebook Mode Restarting Sugar Battery Mode Disable
Suspend/Resume
RC1-690 no no no no no no no
RC2-691 no no no no no no no

Security/Upgrades

Build Isolation Upgrade Backward Comp
RC1-690 no no no
RC2-691 no no no

Wireless/USB/Network Manager

Build Wireless Salut Issue WPA Bug WEP Bug USB Time Sync Network mgr
RC1-690 no no no no no no no
RC2-691 no no no no no no no

Tubes/Presence (Scaling/Performance)

Build Friends Conf_Scale
RC1-690 no no
RC2-691 no no

Core Activities

Please add the testing results for other core activities in this section!

Build Browse Chat Paint Record Write
RC1-690 no no no no no
RC2-691 no no no no no

User-Focused Test Plans

Build SD Card SD Card as USB drive
RC1-690 no no
RC2-691 no no

Keyboard/Languages

Build Test Item English Spanish Arabic Mongolian Devanagari Thai Nigerian Amharic Urdu Nepali Pashto Portuguese
RC1-690 keyboard no no no no no no no no no no no no
language no no no no no no no no no no no no
RC2-691 keyboard no no no no no no no no no no no no
language no no no no no no no no no no no no
Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=Update.1_tests&oldid=252056"