OLPC research

This page is currently under construction, please bear with us

Research, Outcome Monitoring & Impact Evaluation

Introduction

This page provides links to reports related to the OLPC project. We begin by looking at the resources used; share instruments and frameworks as well as white papers and inform about the organizations involved.

We then arrange the reports under three main headings: Research(link), Outcome Monitoring(link), Impact Evaluation(link). Research, Monitoring & Evaluating is not only important as a way of improving, assessing and understanding what is happening in respective OLPC projects around the world, but also to connect this growing community at the forefront of technology integration in education to help build, suggest, and inform this field as it quickly grows and develops. In addition to the work itself, we are also at the apex of rethinking these approaches and models and innovating them to make sure the appropriate information and outcomes are being collected. The OLPC Learning Team, lead by Dr. Claudia Urrea have put forth a paper outlining the need for “Innovation in Evaluation.” (link)

We look forward for OLPC communities to continue contributing and sharing their work as well as welcome those looking for information on OLPC projects.

Please see also Experience, Constructionism, Reviews of OLPC, and Class Acts (a FLOSS Manuals community publication) for articles and other anecdotal works.

Resources

Instruments & Framework

to be added

White Papers

Urrea & Bender, Innovation in Evaluation

A look at the role of innovation in evaluation within OLPC projects and tools available through Sugar.

Assessment and Overview of international M&E Reports, by the the OLPCF Learning Team.

Recently published assessment of existing international M&E literature by local and government actors on OLPC distributions

Ghana: The One Laptop per Child Project and Its Applicability to Ghana (BOA), Buchele & Owusu-Aning (pdf).

An academic overview of work in Ghana so far, providing data and raising questions for anyone considering a national implementation.'

Proposals (works in progress)

Research

Research(link) is defined as the intent to add new general knowledge to the field using gathered information and data, http://en.wikipedia.org/wiki/Research http://journals.cluteonline.com/index.php/JBER/article/viewFile/2532/2578

Literature

Proposals (works in progress)

Outcome Monitoring

while Outcome Monitoring(link) is a form of evaluation or assessment. It allows programs to determine what is working, and what is not working, based from expected results, so that it may be addressed and improved on an on-going basis. http://www.endvawnow.org/en/articles/340-evaluation-monitoring-outcome-and-impact.html

Literature

Early OLPC experiences in an Uruguayan School (pdf)

This report on the first Uruguayan XO pilot, with 150 students in a rural school, provides a good observational overview of XO activities in the classroom.

Ceibal Assessment 2010 Summary Document .doc

English translation of Evaluación del Plan Ceibal 2010 DOCUMENTO RESUMEN http://www.anep.edu.uy/anepweb/servlet/main004?403

File:Ceibal Assessment 2010 Summary Document .doc

Síntesis del informe de monitoreo del estado del parque de XO a abril de 2010.

Executive Summary of the 2010 OLPC monitoring report (Spanish) (http://www.ceibal.org.uy/docs/Plan_Ceibal____Informe_Estado_XO__Abril_2010.pdf)

Monitoreo y evaluación educativa del Plan Ceibal

Primeros resultados a nivel nacional

Plan Ceibal 2010 Monitoring Report (Spanish) Salamano, I., Pagés, P., Baraibar, A., Ferro, H., Pérez, L., & Pérez, M. (http://www.ceibal.org.uy/docs/evaluacion_educativa_plan_ceibal_resumen.pdf)

One to One Laptop Schools review

http://en.wikibooks.org/wiki/One-to-One_Laptop_Schools Excerpt: High-level overviews of the major 1:1 projects around the world, including the Magellan project and many OLPC projects.

OLPC Haiti pre-pilot evaluation report (IDB)

The Education Division of the Inter-American Development Bank (IDB) conduted an assessment following their partial funding of the current program in Haiti. The report provides an analysis of usage trends and outcomes for grades 1-5 after studying 50 students, assessed by interviews and observations. Gains were observed particularly in literacy (reading and writing) and student preparedness for the future (research about / envisioning their future work options). Teachers, technical staff, and administrators were also interviewed. Data analysis and interview guides are included in the document.

Eduvision Ethiopia Implementation Report, Sep-Dec 2007

Ethiopia Implementation Report, September - December 2007 SOM from text

Ethiopia Implementation Report, September - December 2007,

Bjorn Everts, Matthew Herren, David Hollow, Eduvision, February 2008

See the discussion about this document.

The study involved 12 teachers trained to teach XO basics to classes of 2d, 7th, and 8th graders. After distribution and use for 2 months, students were given batteries of activity tests, task completion tests, and questionnaires. Structured interviews were then held with students and teachers. Positive changes observed and tracked included

1. productive changes in teaching styles (of teachers)
2. increased student collaboration and dialogue
3. support of eachother's learning process and objectives

Student motivation improved, and introducing gaming was cited as a way to promote attention to the curriculum.

First Experiences with OLPC in European Classrooms

First Experiences with OLPC in European Classrooms describes early programs in Graz, Austria. 10/30/2009

Formative Evaluation of OLPC Project Nepal

A Summary

http://blog.olenepal.org/index.php/archives/321

"Rabi Karmacharya, OLE Nepal, June-August 2008

This is a summary of the findings of a formative evaluation carried out by Mr. Uttam Sharma, a doctoral student at at the Department of Applied Economics at the University of Minnesota. The evaluation was carried out for OLE Nepal’s internal purpose. The results are expected to help learn about the shortcomings of the current test phase of the OLPC project so that necessary fine tuning can be done before next year’s larger deployment in more districts.

Evaluation of the Teaching Matters OLPC Pilot at Kappa IV (New York)

Evaluation of the Teaching Matters One Laptop Per Child (XO) Pilot at Kappa IV.

Dr. Susan Lowes, Director, Research and Evaluation; and Cyrus Luhr, Research Assistant. Institute for Learning Technologies, Teachers College/Columbia University, June 2008.

Look at the impact of the implementation of XO laptops in Teaching Matters program in New York, USA.

Proposals (works in progress)

Impact Evaluation

“Impact Evaluations(link) are a particular type of evaluation that seeks to answer cause-and-effect questions. Unlike general evaluations, which can answer many types of questions, impact evaluations are structured around one particular type of question: What is the impact (or causal effect) of a program on an outcome of interest.” http://siteresources.worldbank.org/EXTHDOFFICE/Resources/5485726-1295455628620/Impact_Evaluation_in_Practice.pdf http://www.endvawnow.org/en/articles/340-evaluation-monitoring-outcome-and-impact.html

Literature

Usability Engineering evaluation of OLPC

Evaluación de OLPC con Ingeniería de Usabilidad, An academic thesis by Ingeniero Carlos Mauro Cárdenas, Perú

OLPC for Health Clinics (Fontelo+)

OLPC for Health Clinics in Developing Countries (Fontelo, et. al. in AMIA symposium)

Extending the Benefits of OLPC for Health (Fontelo, BMJ '09)

An assessment of the usefulness of XOs in health clinics

XOs were used to provide access to health records (OpenEMR and CHITS) including medical imaging information and access to research docs (via PubMed).  Possibilities for use in health educaiton and child ownership of health information are addressed.

Evaluation of OLPC programs globally: a literature review, Version 4, by Dita Nugroho and Michele Lonsdale. Australian Council for Educational Research, August 2010.

PDF Country program summaries, with XO deployment data, funding, and reported outcomes and impacts.

The Australian Council for Educational Research conducted its own review several times a year, including summary observation. They provide a good overview of both formal and informal evaluations of OLPC programs in 12 countries. They include timelines, methodologies, and outcomes (or expected outcomes). While their meta-evaluation shows positive global trends in evaluation of OLPC programs, they note that most programs have begun only recently. Different evaluations covered vary in scope, methodology, and stakeholders.

• L’évaluation des déploiements OLPC : quelles méthodes ? (PDF), In French, 22 pages, August 26th 2010, by Pierre Varly, consultant, member of OLPC France

Evaluation in OLPC: What for ? what has been done, what could be done?, October 22nd 2010 SOM from report text

• Evaluation in OLPC: What for ? what has been done, what could be done? (PDF), October 22nd 2010, by Pierre Varly, consultant, member of OLPC France

Proposals (works in progress)