G1G1 Activity testing: Difference between revisions

From OLPC
Jump to navigation Jump to search
m (fix link to category)
 
(29 intermediate revisions by 2 users not shown)
Line 1: Line 1:
{{Community testing}}
{{TOCright}}

== Goal ==
== Goal ==


'''Get all [[Activities/G1G1|G1G1-2008 Activities]] tested by Dec. 25, 2008.'''
'''Get all [[Activities/G1G1|G1G1-2008 Activities]] tested by Dec. 25, 2008.'''


There are several goals for this project.
== Impact ==


# Stress-test a good community testing participation framework.
This will enable us to stress-test a good community testing participation framework so that we can recruit Lots Of New Volunteers starting in January - "please help!" pages are only useful inasmuch as there are people, groups, and tasks standing by to welcome newcomers and help them get started.
# Create a solid notion of what it means to "test an Activity," and how to do that.
# Get OLPC used to giving the [[Community testing]] team the resources they need to work on what they want to work on.
# And of course, get G1G1 Activities tested so that teachers, students, XO-deployers, [[Support gang]] volunteers, developers, etc. can make good decisions about what to use and what to fix and what to make based on solid knowledge of how our software measures up against their expectations.


== Activity info ==
== How to help ==


=== Preparation ===
The key activities we want to test are [[Activities/G1G1/8.2]].
They are
[[ Help activity]] | [[Browse]] | [[Read]] | [[Write]] | [[Paint]] | [[Record]] | [[TamTamJam]] | [[TamTamEdit]] | [[TamTamSynthLab]] | [[TamTamMini]] | [[Chat]] | [[Pippy]] | [[Etoys]] | [[Turtle Art]] | [[Calculate]] | [[Measure]] | [[Distance]] | [[Memorize]] | [[Implode]] | [[Maze]] | [[Moon]] | [[Ruler]] | [[Scratch]] | [[Speak]] | [[WikiBrowse English]] | [[Terminal]] | [[Log]] | [[Analyze ]]


There are some things we need to do to finish up the infrastructure. See the [[Talk:G1G1 Activity testing|talk page]] for more details.


== Query info ==
=== Ready for testing ===
Just list all activities and ask for their info. ''Seems to break if you list too many -- need to query for activities with a high [[Property:Priority]]'


This means the Activity has reached a point in its development where it is runnable and testable by people other than the maintainer. All of the G1G1 Activities should have this set to "true" (just go and set it to true, because it is).
{{#ask:

[[ Help activity || Browse || Read || Write || Paint || Record || TamTamJam || TamTamEdit || TamTamSynthLab |]]
=== Smoke tested ===
|?Contact person

|?Team member=Team member(s)
Go through [[Activity smoke testing]] for your Activity, then mark this property as true.
}}

=== Test plans available ===

Create or edit a test plan for the Activity you're testing. This is often the hardest part of testing an Activity: the question you might ask yourself is "what are the things I want to find out about this Activity?" and then write a test case to find out about each.

A test plan is made of one or more test cases; test cases can be black box, white box, exploratory, or use any other methodology you like. See [[:Category:Test cases]] for examples of test cases; [[Tests/Activity/Analyze]] is a good example of a very thorough test case, [[Tests/Activity/Paint]] is a smoke-test-like test case, and [[Tests/Activity/EToys/Mp3]] is a stub test case meant to verify the absence of a bug.

When you are satisfied with the test plans you have available for your Activity, mark this property as True.

=== Test plans executed ===

Execute the test cases listed in the test plan for that Activity. When all tests for that Activity have been executed, mark this property as True.

Make sure you have the right version of the Activity you're testing before you start to test it! The Activity version should be the one listed on http://wiki.laptop.org/go/Activities/G1G1/8.2, and you can check the version you have (in 8.2.0) by putting your Home screen in [http://wiki.laptop.org/go/Image:Home_List_View8.2.png list view] - the number to the right of the Activity name is the version number. (For instance, the link points to a screenshot that shows Assimilate at version 10 and Physics at version 1.)

=== Developers responded ===

Contact the listed maintainer for the Activity with your test results, and ask them what they'd like to do; when you get acknowledgment from the maintainer that they received your message (and hopefully want to work with you to respond to the results of your testing), mark this property as True.

== Activity list ==

The key activities we want to test are the "G1G1" activity group for [[Release notes/8.2.0|Release 8.2.0]]. The page that Software update accesses for this is [[Activities/G1G1/8.2]].

As of 2008-12-04, those activities are:
: [[Help activity]] | [[Browse]] | [[Read]] | [[Write]] | [[Paint]] | [[Record]] | [[TamTamJam]] | [[TamTamEdit]] | [[TamTamSynthLab]] | [[TamTamMini]] | [[Chat]] | [[Pippy]] | [[Etoys]] | [[Turtle Art]] | [[Calculate]] | [[Measure]] | [[Distance]] | [[Memorize]] | [[Implode]] | [[Maze]] | [[Moon]] | [[Ruler]] | [[Scratch]] | [[Speak]] | [[WikiBrowse English]] | [[Terminal]] | [[Log]] | [[Analyze ]]

FYI, compared with the older [[G1G1 activity pack]] for [[Release notes/8.1.0|Release 8.1.0]], the G1G1 activity group for 8.2.0 adds [[Help activity]], [[Implode]], [[Maze]], [[Moon]], [[Ruler]], [[Scratch]], and [[WikiBrowse English]]; it removes [[NewsReader]].


Rest:
| TamTamMini || Chat || Pippy || Etoys || Turtle Art || Calculate || Measure || Distance || Memorize || Implode || Maze || Moon || Ruler || Scratch || Speak || WikiBrowse English || Terminal || Log || Analyze


Rest: | [[Paint]] | [[Record]] | [[TamTamJam]] | [[TamTamEdit]] | [[TamTamSynthLab]] | [[TamTamMini]] | [[Chat]] | [[Pippy]] | [[Etoys]] | [[Turtle Art]] | [[Calculate]] | [[Measure]] | [[Distance]] | [[Memorize]] | [[Implode]] | [[Maze]] | [[Moon]] | [[Ruler]] | [[Scratch]] | [[Speak]] | [[WikiBrowse English]] | [[Terminal]] | [[Log]] | [[Analyze ]]


== Progress table ==
== Progress table ==


Our goal: this entire table, green.

That's ''probably'' the same list that drives "Software update" Sugar Control Panel.


{| class="sortable"
{| class="sortable"
Line 37: Line 64:
!ready for testing
!ready for testing
!smoke tested
!smoke tested
!test plans available
!test plan available
!test plan executed
!more-than-smoke tested
!developer response
!developers are working on it
!more
!link to activity install fragment
|-
|-

| [[Help activity|Help]]
| [[Help activity|Help]]
|
|
Line 50: Line 74:
|
|
|
|
|
| [[Activities/Help-G1G1 | here]]
|-
|-
| [[Browse]]
| [[Browse]]
Line 59: Line 81:
|
|
|
|
|
| [[Activities/Browse-G1G1 | here]]
|-
|-
| [[Read]]
| [[Read]]
Line 68: Line 88:
|
|
|
|
|
| [[Activities/Read-G1G1 | here]]
|-
|-
| [[Write]]
| [[Write]]
Line 77: Line 95:
|
|
|
|
|
| [[Activities/Write-G1G1 | here]]
|-
|-
| [[Paint]]
| [[Paint]]
Line 86: Line 102:
|
|
|
|
|
| [[Activities/Paint-G1G1 | here]]
|-
|-
| [[Record]]
| [[Record]]
Line 95: Line 109:
|
|
|
|
|
| [[Activities/Record-G1G1 | here]]
|-
|-
| [[TamTamJam]]
| [[TamTamJam]]
Line 104: Line 116:
|
|
|
|
|
| [[Activities/TamTamJam-G1G1 | here]]
|-
|-
| [[TamTamEdit]]
| [[TamTamEdit]]
Line 113: Line 123:
|
|
|
|
|
| [[Activities/TamTamEdit-G1G1 | here]]
|-
|-
| [[TamTamSynthLab]]
| [[TamTamSynthLab]]
Line 122: Line 130:
|
|
|
|
|
| [[Activities/TamTamSynthLab-G1G1 | here]]
|-
|-
| [[TamTamMini]]
| [[TamTamMini]]
Line 131: Line 137:
|
|
|
|
|
| [[Activities/TamTamMini-G1G1 | here]]
|-
|-
| [[Chat]]
| [[Chat]]
Line 140: Line 144:
|
|
|
|
|
| [[Activities/Chat-G1G1 | here]]
|-
|-
| [[Pippy]]
| [[Pippy]]
Line 149: Line 151:
|
|
|
|
|
| [[Activities/Pippy-G1G1 | here]]
|-
|-
| [[Etoys]]
| [[Etoys]]
Line 158: Line 158:
|
|
|
|
|
| [[Activities/Etoys-G1G1 | here]]
|-
|-
| [[Turtle Art]]
| [[Turtle Art]]
Line 167: Line 165:
|
|
|
|
|
| [[Activities/Turtle Art-G1G1 | here]]
|-
|-
| [[Calculate]]
| [[Calculate]]
Line 176: Line 172:
|
|
|
|
|
| [[Activities/Calculate-G1G1 | here]]
|-
|-
| [[Measure]]
| [[Measure]]
Line 185: Line 179:
|
|
|
|
|
| [[Activities/Measure-G1G1 | here]]
|-
|-
| [[Distance]]
| [[Distance]]
Line 194: Line 186:
|
|
|
|
|
| [[Activities/Distance-G1G1 | here]]
|-
|-
| [[Memorize]]
| [[Memorize]]
Line 203: Line 193:
|
|
|
|
|
| [[Activities/Memorize-G1G1 | here]]
|-
|-
| [[Implode]]
| [[Implode]]
Line 212: Line 200:
|
|
|
|
|
| [[Activities/Implode-G1G1 | here]]
|-
|-
| [[Maze]]
| [[Maze]]
Line 221: Line 207:
|
|
|
|
|
| [[Activities/Maze-G1G1 | here]]
|-
|-
| [[Moon]]
| [[Moon]]
Line 230: Line 214:
|
|
|
|
|
| [[Activities/Moon-G1G1 | here]]
|-
|-
| [[Ruler]]
| [[Ruler]]
Line 239: Line 221:
|
|
|
|
|
| [[Activities/Ruler-G1G1 | here]]
|-
|-
| [[Scratch]]
| [[Scratch]]
Line 248: Line 228:
|
|
|
|
|
| [[Activities/Scratch-G1G1 | here]]
|-
|-
| [[Speak]]
| [[Speak]]
Line 257: Line 235:
|
|
|
|
|
| [[Activities/Speak-G1G1 | here]]
|-
|-
| [[WikiBrowse English]]
| [[WikiBrowse English]]
Line 266: Line 242:
|
|
|
|
|
| [[Activities/WikiBrowse English-G1G1 | here]]
|-
|-
| [[Terminal]]
| [[Terminal]]
Line 275: Line 249:
|
|
|
|
|
| [[Activities/Terminal-G1G1 | here]]
|-
|-
| [[Log]]
| [[Log]]
Line 284: Line 256:
|
|
|
|
|
| [[Activities/Log-G1G1 | here]]
|-
|-
| [[Analyze]]
| [[Analyze]]
Line 293: Line 263:
|
|
|
|
|
| [[Activities/Analyze-G1G1 | here]]

|}
|}


== Activity info ==

This is a handy cheat sheet for people who are testing Activities or trying to decide what Activities to test, and who want to quickly find information about multiple Activities at once.

Query all activities with [[Property:Activity group]] of [[Activities/G1G1]] — ''should match except for the four TamTam activities!''

Activity pages can hold info for more than one bundle, if so then one of these [[Property:Activity version]]s (possibly the biggest number) is the best version for [[8.2.0]].

{{#ask:
[[Activity group::Activities/G1G1]]
|?Contact person
|?Team member=Team member(s)
|?Activity genre
|?Activity version
|default=No activities with [[Property:Activity group]] of [[Activities/G1G1]]??!
}}

(Note that you can't just list 20 activities in a query &mdash; <small> <nowiki>[[</nowiki> Help activity || Browse || Read || Write || ... ]]</small> &mdash; ''seems to break if you list too many'')

== Contributors ==

* Names go here
* Wiki usernames with user pages that point to contact info are great, too


== See also ==
== See also ==

Latest revision as of 10:43, 28 December 2008

  This page is part of the OLPC Community testing Project. How to test an Activity | Reporting test results | Meetings
XO Checkbox

Goal

Get all G1G1-2008 Activities tested by Dec. 25, 2008.

There are several goals for this project.

  1. Stress-test a good community testing participation framework.
  2. Create a solid notion of what it means to "test an Activity," and how to do that.
  3. Get OLPC used to giving the Community testing team the resources they need to work on what they want to work on.
  4. And of course, get G1G1 Activities tested so that teachers, students, XO-deployers, Support gang volunteers, developers, etc. can make good decisions about what to use and what to fix and what to make based on solid knowledge of how our software measures up against their expectations.

How to help

Preparation

There are some things we need to do to finish up the infrastructure. See the talk page for more details.

Ready for testing

This means the Activity has reached a point in its development where it is runnable and testable by people other than the maintainer. All of the G1G1 Activities should have this set to "true" (just go and set it to true, because it is).

Smoke tested

Go through Activity smoke testing for your Activity, then mark this property as true.

Test plans available

Create or edit a test plan for the Activity you're testing. This is often the hardest part of testing an Activity: the question you might ask yourself is "what are the things I want to find out about this Activity?" and then write a test case to find out about each.

A test plan is made of one or more test cases; test cases can be black box, white box, exploratory, or use any other methodology you like. See Category:Test cases for examples of test cases; Tests/Activity/Analyze is a good example of a very thorough test case, Tests/Activity/Paint is a smoke-test-like test case, and Tests/Activity/EToys/Mp3 is a stub test case meant to verify the absence of a bug.

When you are satisfied with the test plans you have available for your Activity, mark this property as True.

Test plans executed

Execute the test cases listed in the test plan for that Activity. When all tests for that Activity have been executed, mark this property as True.

Make sure you have the right version of the Activity you're testing before you start to test it! The Activity version should be the one listed on http://wiki.laptop.org/go/Activities/G1G1/8.2, and you can check the version you have (in 8.2.0) by putting your Home screen in list view - the number to the right of the Activity name is the version number. (For instance, the link points to a screenshot that shows Assimilate at version 10 and Physics at version 1.)

Developers responded

Contact the listed maintainer for the Activity with your test results, and ask them what they'd like to do; when you get acknowledgment from the maintainer that they received your message (and hopefully want to work with you to respond to the results of your testing), mark this property as True.

Activity list

The key activities we want to test are the "G1G1" activity group for Release 8.2.0. The page that Software update accesses for this is Activities/G1G1/8.2.

As of 2008-12-04, those activities are:

Help activity | Browse | Read | Write | Paint | Record | TamTamJam | TamTamEdit | TamTamSynthLab | TamTamMini | Chat | Pippy | Etoys | Turtle Art | Calculate | Measure | Distance | Memorize | Implode | Maze | Moon | Ruler | Scratch | Speak | WikiBrowse English | Terminal | Log | Analyze

FYI, compared with the older G1G1 activity pack for Release 8.1.0, the G1G1 activity group for 8.2.0 adds Help activity, Implode, Maze, Moon, Ruler, Scratch, and WikiBrowse English; it removes NewsReader.


Progress table

Our goal: this entire table, green.

Activity name/wiki page ready for testing smoke tested test plan available test plan executed developer response
Help
Browse
Read
Write
Paint
Record
TamTamJam
TamTamEdit
TamTamSynthLab
TamTamMini
Chat
Pippy
Etoys
Turtle Art
Calculate
Measure
Distance
Memorize
Implode
Maze
Moon
Ruler
Scratch
Speak
WikiBrowse English
Terminal
Log
Analyze

Activity info

This is a handy cheat sheet for people who are testing Activities or trying to decide what Activities to test, and who want to quickly find information about multiple Activities at once.

Query all activities with Property:Activity group of Activities/G1G1 — should match except for the four TamTam activities!

Activity pages can hold info for more than one bundle, if so then one of these Property:Activity versions (possibly the biggest number) is the best version for 8.2.0.

{{#ask: 

 Activity group::Activities/G1G1
 |?Contact person
 |?Team member=Team member(s)
 |?Activity genre
 |?Activity version
 |default=No activities with Property:Activity group of Activities/G1G1??!

}}

(Note that you can't just list 20 activities in a query — [[ Help activity || Browse || Read || Write || ... ]] — seems to break if you list too many)

Contributors

  • Names go here
  • Wiki usernames with user pages that point to contact info are great, too

See also

Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=G1G1_Activity_testing&oldid=188963"