OLPC Oceania/Evaluation/Solomons Framework: Difference between revisions

From OLPC
Jump to navigation Jump to search
m (New page: = Measurable Objectives for evaluation framework – Solomon Islands example = {| class="prettytable" | '''Objectives''' | '''Sub-objectives''' | '''Indicators and instruments (how it is ...)
 
mNo edit summary
Line 1: Line 1:
{{OLPC_Oceania}}
= Measurable Objectives for evaluation framework – Solomon Islands example =

= Measurable Objectives and evaluation framework – Solomon Islands example =


{| class="prettytable"
{| class="prettytable"
| '''Objectives'''
| '''Objectives'''
| '''Sub-objectives'''
| '''Expected outputs'''
| '''Indicators and instruments (how it is measured)'''
| '''Indicators and instruments (how it is measured)'''


|-
|-
| Awareness raised of OLPC
| Awareness raised about OLPC and the objectives of the trial in Western Province
| Ministry, teachers, sector partners aware of:
| Ministry, teachers, sector partners and communities aware of:* The vision of OLPC

* The vision of OLPC
* The function of OLPC/XO/XS
* The function of OLPC/XO/XS
* Objectives trial in the Western Province.




| * Consultation and briefing meetings held with the Ministry, schools and communities

* Interviews and survey
|
* Consultation and briefing meetings held with the Ministry, schools and communities
* Media awareness campaign
* Interviews and surveys






|-
|-
| OLPC used extensively in Teaching and Learning
| To assess the impact of OLPC in the area of Teaching and Learning



(In each sub-sector: Early Childhood, Primary, Secondary, TVET)
(In each sub-sector: Early Childhood, Primary, Secondary, TVET)
| * The XO is used in T & L at schools and centres
|
* The XO is used extensively in T & L
* The XO is utilised in particular for some of the subjects
* The XO is integrated into T & L
* The XO is integrated into normal/formal T & L-formal education delivery
* Teaching methods affected positively through the use of the XO in T & L, including more/improved:
* Teaching methods are affected positively through the use of the XO in T & L, including more/improved:
** Learning by Doing
** Child-focused teaching
** Group work/sharing/collaboration
** Inclusion / engagement of all students
* Improved curriculum as a result of the XO/OLPC project
* Impacts seen in all sub-sectors, but mostly with early age education


(a) Learning by Doing


(b) Child-focused teaching
|

* Interviews and surveys
(c) Group work/sharing/collaboration

(d) Inclusion / engagement of all students

(e) Curriculum changes as a result of the XO/OLPC project

(f) Impacts seen in all sub-sectors, but mostly with early age education (ECE and PE)

(g) Also assess any possible negative or non-impact; learners and teachers not using XO or only after school hours
| * Interviews and surveys with school managers, teachers, students, students, community members
* Teacher log books/diaries
* Teacher log books/diaries
* Class observations
* Demonstrations by teachers for inspectors
* Demonstrations by teachers about the workings of XO
* Inspections by standards officers
* Increased use of XO by learners in formal lessons and after school hours



|-
| To assess impact of OLPC on enrolment or attendance
| Increased enrolment or improved attendance at selected schools compared to schools where OLPC or XO has not been introduced
| * Attendance register






|-
|-
| To assess impact of OLPC or XO in delivering/producing new curriculum materials/learning content
| Improved access to content
| * New electronic content made available (in schools)
|
* New electronic content made available (in schools)
* The school server is an effective source of content
* The school server is an effective source of content
* ‘Wiki Educator’ more frequently used




| Materials provided by* School
|
* Ministry/curriculum
* Number of materials provided by
* NGOs / partners of education sector
** Ministry/curriculum
* OLPC Oceania / SPC
** NGOs / partners of education sector
** OLPC Oceania / SPC
** Other






|-
|-
| OLPC technology is technically feasible
| To assess if OLPC/XO- technology is technically feasible and sustainable
| * Teachers and students are able to use and continue to use the laptops
|
* Power supplies are feasible , affordable
* Teachers and students are able to use the laptops
* Good quality Internet connectivity
* Power supplies are feasible
* Internet connectivity feasible where access is available
* Required level of technical support, maintenance is available
* XO-Equipment is reliable, functional and still working
* Required level of technical support is feasible
* Interviews, consultations and surveys
* Equipment is reliable and functional




| * Demonstrations by students, teachers
|
* Interviews, consultations and surveys
* Demonstrations by students for inspectors
* Technical report on power and connectivity infrastructure
* Technical report on power and connectivity infrastructure
** Options, performance, cost,
* Options, performance, cost,
* Number and type of equipment failures
* Number and type of equipment failures


Line 82: Line 90:


|-
|-
| Teacher capacity is built for/by the OLPC project
| To assess impact of capacity building for teachers (and learners) in the OLPC project
| * Training (for XO) has built sustained capacity
|
* Training (for XO) has built sustained capacity
* Training system/schedule and methodology is effective
* Teachers are able to integrate the use of XO in formal and informal class-work
* Training system/schedule is effective
* Teachers are able to integrate the use of XO in class-work
* Teachers have improved access to resources and training support
* Teachers have improved access to resources and training support




| * Interviews, consultations and surveys with trainers, teachers and learners
|
* Evaluations of training, capacity building
* Interviews, consultations and surveys
* Quick tests






|-
|-
| To assess the impact of OLPC on the learning, and school environment
| colspan="2" |
| * Teachers and students regard the XO and OLPC project positively
{| class="prettytable"
| OLPC impacts positively on the school
|
* Teachers and students regard the XO and OLPC project positively
* School seen more positively by the community
* School seen more positively by the community
* Teachers have improved morale
* Teachers have improved morale
* Absenteeism is reduced
* Absenteeism under teachers and learners is reduced
* There is improved discipline
* Higher demand / enrolment / retention (teachers and students)
* Higher demand / enrolment / retention (teachers and students)




| * Interviews, consultations and surveys with teachers, learners and community members

* School records, minutes of school board/committee meetings
|-
| OLPC impacts positively on community
|
* Community regard the OLPC positively
* Community have improved access to information and services
* More involvement of parents in the school



|}

|
{| class="prettytable"
|
* Interviews, consultations and surveys
* School records
* Public meetings
* Public meetings
* Parents meetings
* Parents meetings
* Inspectorate visits
* Note: OLPC/SPC will provide advice on survey instruments/questionnaires/inspections






|-
|-
| To assess the impact of OLPC, XO’s on the community
|
| * To assess the impact of OLPC, XO’s on the community
* Also community members involved in the use of XO’s
* Community regards the OLPC positively or negatively
* Community have improved access to information and communication services
* More involvement or active participation of parents in the school


| * Interviews, consultations, surveys with community members, teachers, learners
* Minutes of school committees and boards
* Group interviews with community members
* Demonstrations of parents using these XO’s


|}





Revision as of 06:25, 31 July 2008


Oceania Community - News - Content - Evaluation - Languages - Countries
Cook Islands -French Polynesia - Kiribati - Nauru - New Caledonia - Niue - Palau - Papua New Guinea - Samoa- Solomon Islands - Tonga - Tokelau - Tuvalu - Vanuatu


Measurable Objectives and evaluation framework – Solomon Islands example

Objectives Expected outputs Indicators and instruments (how it is measured)
Awareness raised about OLPC and the objectives of the trial in Western Province Ministry, teachers, sector partners and communities aware of:* The vision of OLPC
  • The function of OLPC/XO/XS
  • Objectives trial in the Western Province.


* Consultation and briefing meetings held with the Ministry, schools and communities
  • Interviews and survey


To assess the impact of OLPC in the area of Teaching and Learning


(In each sub-sector: Early Childhood, Primary, Secondary, TVET)

* The XO is used in T & L at schools and centres
  • The XO is utilised in particular for some of the subjects
  • The XO is integrated into normal/formal T & L-formal education delivery
  • Teaching methods are affected positively through the use of the XO in T & L, including more/improved:

(a) Learning by Doing

(b) Child-focused teaching

(c) Group work/sharing/collaboration

(d) Inclusion / engagement of all students

(e) Curriculum changes as a result of the XO/OLPC project

(f) Impacts seen in all sub-sectors, but mostly with early age education (ECE and PE)

(g) Also assess any possible negative or non-impact; learners and teachers not using XO or only after school hours

* Interviews and surveys with school managers, teachers, students, students, community members
  • Teacher log books/diaries
  • Class observations
  • Demonstrations by teachers about the workings of XO
  • Increased use of XO by learners in formal lessons and after school hours


To assess impact of OLPC on enrolment or attendance Increased enrolment or improved attendance at selected schools compared to schools where OLPC or XO has not been introduced * Attendance register


To assess impact of OLPC or XO in delivering/producing new curriculum materials/learning content * New electronic content made available (in schools)
  • The school server is an effective source of content
  • ‘Wiki Educator’ more frequently used


Materials provided by* School
  • Ministry/curriculum
  • NGOs / partners of education sector
  • OLPC Oceania / SPC


To assess if OLPC/XO- technology is technically feasible and sustainable * Teachers and students are able to use and continue to use the laptops
  • Power supplies are feasible , affordable
  • Good quality Internet connectivity
  • Required level of technical support, maintenance is available
  • XO-Equipment is reliable, functional and still working
  • Interviews, consultations and surveys


* Demonstrations by students, teachers
  • Technical report on power and connectivity infrastructure
  • Options, performance, cost,
  • Number and type of equipment failures


To assess impact of capacity building for teachers (and learners) in the OLPC project * Training (for XO) has built sustained capacity
  • Training system/schedule and methodology is effective
  • Teachers are able to integrate the use of XO in formal and informal class-work
  • Teachers have improved access to resources and training support


* Interviews, consultations and surveys with trainers, teachers and learners
  • Evaluations of training, capacity building


To assess the impact of OLPC on the learning, and school environment * Teachers and students regard the XO and OLPC project positively
  • School seen more positively by the community
  • Teachers have improved morale
  • Absenteeism under teachers and learners is reduced
  • Higher demand / enrolment / retention (teachers and students)


* Interviews, consultations and surveys with teachers, learners and community members
  • School records, minutes of school board/committee meetings
  • Public meetings
  • Parents meetings
  • Inspectorate visits
  • Note: OLPC/SPC will provide advice on survey instruments/questionnaires/inspections


To assess the impact of OLPC, XO’s on the community * To assess the impact of OLPC, XO’s on the community
  • Also community members involved in the use of XO’s
  • Community regards the OLPC positively or negatively
  • Community have improved access to information and communication services
  • More involvement or active participation of parents in the school


* Interviews, consultations, surveys with community members, teachers, learners
  • Minutes of school committees and boards
  • Group interviews with community members
  • Demonstrations of parents using these XO’s