OLPC research
Research, Outcome Monitoring & Impact Evaluation
Introduction
This page provides links to reports related to the OLPC project. We begin by looking at the resources used; share instruments and frameworks as well as white papers and inform about the organizations involved.
We then arrange the reports under four main headings: Research[1], Outcome Monitoring [2], Impact Evaluation [3] and other works under Miscellaneous [4] Research, Monitoring & Evaluating is not only important as a way of improving, assessing and understanding what is happening in respective OLPC projects around the world, but also to connect this growing community at the forefront of technology integration in education to help build, suggest, and inform this field as it quickly grows and develops. In addition to the work itself, we are also at the apex of rethinking these approaches and models and innovating them to make sure the appropriate information and outcomes are being collected. The OLPC Learning Team, lead by Dr. Claudia Urrea have put forth a paper outlining the need for “Innovation in Evaluation.”[5]
We look forward for OLPC communities to continue contributing and sharing their work as well as welcome those looking for information on OLPC projects.
Please see also Experience, Constructionism, Reviews of OLPC, and Class Acts (a FLOSS Manuals community publication) for articles and other anecdotal works.
Resources
Instruments & Framework
to be added
White Papers
Innovation in Evaluation By Dr. Claudia Urrea & Walter Bender
A look at the role of innovation in evaluation within OLPC projects and tools available through Sugar.
Assessment and Overview of international M&E Reports, by the the OLPCF Learning Team.
Recently published assessment of existing international M&E literature by local and government actors on OLPC distributions
Ghana: The One Laptop per Child Project and Its Applicability to Ghana By Buchele & Owusu-Aning
An academic overview of work in Ghana, providing data and raising questions for anyone considering a national implementation.'
2011 OLPC in Rwanda Report
An OLPC HQ report on aspects of the Rwanda implementation.
Proposals
Please share works in progress
Research
Research is defined as the intent to add new general knowledge to the field using gathered information and data, [6] [7]
Literature
Tackling the Problems of Quality and Disparity in Nepal's School - Education: The OLPC Model
Dr. Saurav Dev Bhatta, OLE Nepal, June 2008
The paper argues that utilizing the full potential of the OLPC concept requires simultaneous work in four areas: digital content development, teacher preparation, network and power infrastructure development, and government capacity development.
1:1 Technologies/Computing in the Developing World: Challenging the Digital Divide
Mary Hooker, Education Specialist, Global e-Schools and Communities Initiative. Requires ACM Membership to view.
In OLPC: What For? What Has Been Done, What Could Be Done?
Pierre Varly. This paper makes proposal to include evaluation plans and longitudinal studies in the OLPC deployments.
Innovating for Development : Can One Laptop Per Child Save the World's Poor?
Mark Warschauer and Morgan Ames
http://jia.sipa.columbia.edu/files/jia/033-051_Warschauer_bluelines.pdf
The paper reviews the theoretical underpinnings of OLPC, analyzes the program’s development and summarizes the current state of OLPC deployments around the world
Educational Outcomes and Research from 1:1 Computing Settings
Damian Bebell and Laura O'Dwyer The current special edition of the Journal of Technology and Assessment presents four empirical studies of K–12 1:1 computing programs and one review of key themes in the conversation about 1:1 computing among advocates and critics. In this introduction to our 1:1 special edition, we synthesize across the studies and discuss the emergent themes.
The End of Techno-Critique: The Naked Truth about 1:1 Laptop Initiatives (Weston, Bain. JTLA)
The End of Techno-Critique: The Naked Truth about 1:1 Laptop Initiatives and Educational Change SOM from text]] The Journal of Technology, Learning and Assessment (JTLA)
- Mark E. Weston and Alan Bain
Designing Collaborative Learning Tech for the Developing World (Hoadley, et al.)
Designing Appropriate Collaborative Learning Technologies for the Developing World
Christopher Hoadley, Sameer Honwad, Kenneth Tamminga. 205 ECC. September 26, 2007 10:00 In this presentation we report on two attempts to intervene in rural Himalayan villages with educational technology, one involving desktop computer technology, and one involving participatory video. We describe the unique constraints of designing appropriate educational technology for the developing world, and we propose a fourfold framework for design.
Proposals (works in progress)
Outcome Monitoring
while Outcome Monitoring( is a form of evaluation or assessment. It allows programs to determine what is working, and what is not working, based from expected results, so that it may be addressed and improved on an on-going basis. http://www.endvawnow.org/en/articles/340-evaluation-monitoring-outcome-and-impact.html
Literature
- Early OLPC experiences in an Uruguayan School (pdf)
This report on the first Uruguayan XO pilot, with 150 students in a rural school, provides a good observational overview of XO activities in the classroom.
- Ceibal Assessment 2010 Summary Document .doc
English translation of Evaluación del Plan Ceibal 2010 DOCUMENTO RESUMEN http://www.anep.edu.uy/anepweb/servlet/main004?403
File:Ceibal Assessment 2010 Summary Document .doc
- Síntesis del informe de monitoreo del estado del parque de XO a abril de 2010.
Executive Summary of the 2010 OLPC monitoring report (Spanish) (http://www.ceibal.org.uy/docs/Plan_Ceibal____Informe_Estado_XO__Abril_2010.pdf)
- Monitoreo y evaluación educativa del Plan Ceibal
- Primeros resultados a nivel nacional
Plan Ceibal 2010 Monitoring Report (Spanish) Salamano, I., Pagés, P., Baraibar, A., Ferro, H., Pérez, L., & Pérez, M. (http://www.ceibal.org.uy/docs/evaluacion_educativa_plan_ceibal_resumen.pdf)
Evaluation, Uruguay
Evaluacion Educativa
El presente resumen de evaluación educativa contiene los primeros datos representativos a nivel nacional producidos en torno al Plan Ceibal.
Ubiquitous Computing and High School Science in Three Experienced, High-Technology Schools
- Brian Drayton, Joni K. Falk, Rena Stroud, Kathryn Hobbs, and James Hammerman
. The present study presents data on 3 high schools with carefully elaborated ubiquitous computing systems, who have gone through at least one "obsolescence cycle" and are therefore several years past first implementation.
Using Affordable Technology to Decrease Digital Inequality (Birmingham, AL)
Shelia Cotten, et al. This report focused on positive results for students who chose to take advantage of the program, differences that might account for teacher and student interest in taking advantage of it, and the value of bridging the digitial divide.
- One to One Laptop Schools review
http://en.wikibooks.org/wiki/One-to-One_Laptop_Schools Excerpt: High-level overviews of the major 1:1 projects around the world, including the Magellan project and many OLPC projects.
- OLPC Haiti pre-pilot evaluation report (IDB)
The Education Division of the Inter-American Development Bank (IDB) conduted an assessment following their partial funding of the current program in Haiti. The report provides an analysis of usage trends and outcomes for grades 1-5 after studying 50 students, assessed by interviews and observations. Gains were observed particularly in literacy (reading and writing) and student preparedness for the future (research about / envisioning their future work options). Teachers, technical staff, and administrators were also interviewed. Data analysis and interview guides are included in the document.
- Eduvision Ethiopia Implementation Report, Sep-Dec 2007
Ethiopia Implementation Report, September - December 2007,
- Bjorn Everts, Matthew Herren, David Hollow, Eduvision, February 2008
See the discussion about this document. The study involved 12 teachers trained to teach XO basics to classes of 2d, 7th, and 8th graders.
Quantitative Results from the Berkshire Wireless Learning Initiative (Bebell, Kay. JTLA)
The Journal of Technology, Learning and Assessment (JTLA)
Educational Outcomes and Research from 1:1 Computing Settings (Bebell, O'Dwyer. JTLA)
The Journal of Technology, Learning and Assessment (JTLA)
Implementation Fidelity of Tech Immersion and Student Achievement (Shapley, et al. JTLA)
The Journal of Technology, Learning and Assessment (JTLA)
One to One Computing: A Summary of the Quantitative Results from the Berkshire Wireless Learning Initiative
Damian Bebell and Rachel Kay This paper examines the educational impacts of the Berkshire Wireless Learning Initiative (BWLI), a pilot program that provided 1:1 technology access to all students and teachers across five public and private middle schools in western Massachusetts.
- First Experiences with OLPC in European Classrooms
First Experiences with OLPC in European Classrooms describes early programs in Graz, Austria. 10/30/2009
- Formative Evaluation of OLPC Project Nepal
- A Summary
http://blog.olenepal.org/index.php/archives/321
- "Rabi Karmacharya, OLE Nepal, June-August 2008
This is a summary of the findings of a formative evaluation carried out by Mr. Uttam Sharma, a doctoral student at at the Department of Applied Economics at the University of Minnesota. The evaluation was carried out for OLE Nepal’s internal purpose. The results are expected to help learn about the shortcomings of the current test phase of the OLPC project so that necessary fine tuning can be done before next year’s larger deployment in more districts.
Evaluation of the Teaching Matters OLPC Pilot at Kappa IV (New York)
- Evaluation of the Teaching Matters One Laptop Per Child (XO) Pilot at Kappa IV.
- Dr. Susan Lowes, Director, Research and Evaluation; and Cyrus Luhr, Research Assistant. Institute for Learning Technologies, Teachers College/Columbia University, June 2008.
Look at the impact of the implementation of XO laptops in Teaching Matters program in New York, USA.
Proposals (works in progress)
Impact Evaluation
“Impact Evaluations(link) are a particular type of evaluation that seeks to answer cause-and-effect questions. Unlike general evaluations, which can answer many types of questions, impact evaluations are structured around one particular type of question: What is the impact (or causal effect) of a program on an outcome of interest.” http://siteresources.worldbank.org/EXTHDOFFICE/Resources/5485726-1295455628620/Impact_Evaluation_in_Practice.pdf http://www.endvawnow.org/en/articles/340-evaluation-monitoring-outcome-and-impact.html
Literature
Experimental Assessment of the Program "One Laptop Per Child" in Peru 2010
(http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=35422036) nter-American Development Bank July 2010
This paper presents the impact of the first large-scale randomized evaluation of the OLPC program, using data collected after 15 months of implementation in 319 primary schools in rural Peru. The results indicate that the program increased the ratio of computers per student from 0.12 to 1.18 in treatment schools.
Working Papers, Technology and Child Development: Evidence from the One Laptop per Child Program in Peru 2012
(http://www.iadb.org/en/research-and-data/publication-details,3169.html?pub_id=IDB-WP-304) Inter-American Development Bank February 2012 Even though this program has only recently been implemented, this document presents a few preliminary findings that could be relevant for its future development. On the one hand, we find evidence of better attitudes and expectations among teachers and parents; students that are more critical of school work and of their own performance; and a greater development of technological skills among girls and boys. On the other hand, there seems to be a decrease in the intensity of computer use in the classroom, as time passes and difficulties arise in the implementation of the project.
Usability Engineering evaluation of OLPC
Evaluación de OLPC con Ingeniería de Usabilidad, An academic thesis by Ingeniero Carlos Mauro Cárdenas, Perú
Laptops & Fourth Grade Literacy
http://escholarship.bc.edu/jtla/vol9/5/ Laptops and Fourth Grade Literacy: Assisting the Jump over the Fourth-Grade Slump]
- Kurt A. Suhr, David A. Hernandez, Doug Grimes, and Mark Warschauer
.This study investigated whether a one-to-one laptop program could help improve English language arts (ELA) test scores of upper elementary students.
Fidelity of Technology Immersion and its Relationship with Student Achievement
- Kelly S. Shapley, Daniel Sheehan, Catherine Maloney, and Fanny Caranikas-Walker
This article examines the fidelity of model implementation and associations between implementation indicators and student achievement.
OLPC for Health Clinics (Fontelo+)
- OLPC for Health Clinics in Developing Countries (Fontelo, et. al. in AMIA symposium)
- Extending the Benefits of OLPC for Health (Fontelo, BMJ '09)
An assessment of the usefulness of XOs in health clinics
XOs were used to provide access to health records (OpenEMR and CHITS) including medical imaging information and access to research docs (via PubMed). Possibilities for use in health educaiton and child ownership of health information are addressed.
Evaluation of OLPC programs globally: a literature review, Version 4, by Dita Nugroho and Michele Lonsdale. Australian Council for Educational Research, August 2010.
PDF Country program summaries, with XO deployment data, funding, and reported outcomes and impacts.
The Australian Council for Educational Research shows positive global trends in evaluation of OLPC programs, they note that most programs have begun only recently. Different evaluations covered vary in scope, methodology, and stakeholders.
- L’évaluation des déploiements OLPC : quelles méthodes ? (PDF), In French, 22 pages, August 26th 2010, by Pierre Varly, consultant, member of OLPC France
Evaluation in OLPC: What for ? what has been done, what could be done?, October 22nd 2010 SOM from report text]]
- Evaluation in OLPC: What for ? what has been done, what could be done? (PDF), October 22nd 2010, by Pierre Varly, consultant, member of OLPC France
Proposals (works in progress)
Miscellaneous
Reflections on a Pilot OLPC Experience in Uruguay (pdf)
Juan Pablo Hourcade, Daiana Beitler, Fernando Cormenzana, and Pablo Flores, 2007, Uruguay ...A two-page position paper presenting opinions regarding a pilot in Uruguay. From empirical data and observations, a positive impact on the children and their school activities is claimed by this Uruguayan team...
One year of experiences with XO laptops in Uruguay
One Laptop Per Child Pilot Project [Addendum to Comprehensive Technology Plan]
http://www.box.net/shared/k6fsitchrvtquv7jvrut Produced by the Republic of Marshall Islands Ministry of Education, this document outlines the Project Implementation Plan for the OLPC Pilot in the Marshall Islands. It is an addendum to the MOE Comprehensive Technology Plan.
Autonomous Learning Skills: Education and Technology for Strengthening Culture (Colombia)
"Sandra Barragán" ([8])
New Technology in Developing Countries: A Critique of the One-Laptop-Per-Child Program
[9] Jeffrey James A critical economic analysis of OLPC as development policy in resource limited environments
Pre and post test survey results from the Birmingham, Alabama USA XO laptop dissemination (Shelia Cotten, University of Alabama-Birmingham, PI of the project)
Teacher Logs from Uruguay
Objective research in Uruguay done by sampling the previously recorded Lesson Plan logs of teachers for one week, to ascertain how many had included activities involving using XOs for learning activities.[10] and [11] give basic data, such as an average use of the XO for learning activities of less than 1.5 times per week, further interpretation would be useful.
OLPCNews: OLPC Overview in 2009
By Wayan Vota, Christoph Derndorfer and Bryan Berry of OLPC News (completely independent of OLPC)
http://www.olpcnews.com/commentary/olpc_news/one_laptop_per_child_overview_2009.html
http://www.olpcnews.com/files/One_Laptop_Per_Child_Overview_2009.pdf
Briefing Note – One Laptop Per Child (OLPC) in Afghanistan
Lima Ahmad (AIMS), Kenneth Adams (AIMS), Mike Dawson (PAIWASTOON), Carol Ruth Silver (MTSA)
http://www.paiwastoon.net/olpcbn/OLPC-BriefingNote.pdf
EduTech Debate: discussion on OLPC impact in 2010
http://edutechdebate.org/one-laptop-per-child-impact/
External links
- Portal Ceibal (Uruguay)
- Peru Educa (Peru)
- Paraguay Educa (Paraguay)
- Mochila Digital (Mexico)