List of potentially useful Criteria to monitor and evaluate an OLPC implementation

From OLPC
Jump to: navigation, search

The viewpoints expressed hereunder do not necessarily reflect the opinion of OLPC.
This page was created by a member of the free volunteer community supporting OLPC.

  1. suitable indicators for measuring impact very much depend on the local context. In one country it might be important to measure literacy improvement, in another that might be achieved and it might be more about bridging the digital divide.
  2. Measuring "literacy"--SvenAERTS
  3. Measuring "literacy improvement"--SvenAERTS
  4. Measuring "child hope"--SvenAERTS 22:46, 2 May 2012 (UTC)
  5. Measuring "child comfort"--SvenAERTS 22:46, 2 May 2012 (UTC)
  6. Measuring "child anxiety"--SvenAERTS 22:46, 2 May 2012 (UTC)
  7. Measuring "self-esteem"--SvenAERTS 22:46, 2 May 2012 (UTC)
  8. Measuring "reaching out capability"--SvenAERTS 22:46, 2 May 2012 (UTC)
  9. Measuring "number of attempts of reaching out"--SvenAERTS 22:46, 2 May 2012 (UTC)
  10. Measuring "number of successful attempts of reaching out"--SvenAERTS 22:46, 2 May 2012 (UTC)
  11. Measuring "opportunity to outside school learning"--SvenAERTS 22:46, 2 May 2012 (UTC)
  12. Measuring "outside school learning"--SvenAERTS 22:46, 2 May 2012 (UTC)
  13. Measuring "opportunity to inside school learning"--SvenAERTS 22:46, 2 May 2012 (UTC)
  14. Measuring "inside school learning"--SvenAERTS 22:46, 2 May 2012 (UTC)
  15. Measuring "need for solution finding"--SvenAERTS 22:46, 2 May 2012 (UTC)
  16. Measuring "solution finding"--SvenAERTS 22:46, 2 May 2012 (UTC)
  17. Measuring "attempts for solution finding"--SvenAERTS 22:46, 2 May 2012 (UTC)
  18. Measuring "competence in operating laptops in tasks related to core applications (like a word processor)"
  19. Measuring "competence in searching for information on the computer
  20. Measuring "need for reaching out"--SvenAERTS 22:46, 2 May 2012 (UTC)
  21. Measuring "number of times a kid gets sick"--SvenAERTS 22:46, 2 May 2012 (UTC)
  22. Measuring "number of attempts a kid reaches out to find a cure"--SvenAERTS 22:46, 2 May 2012 (UTC)
  23. Measuring "number of successful attempts a kid reaches out and finds a cure"--SvenAERTS 22:46, 2 May 2012 (UTC)
  24. Measuring the extend of reaching and bringing learning to the parents via the kids: establish by when about all kids are sleeping. If the laptop is still used then, it must be parents or older kids using the laptop. Same logging / data collection can be used as on the main page.--SvenAERTS 22:46, 2 May 2012 (UTC)
  25. Measuring "parent involvement"
  26. Measuring "critical thinking"
  27. Measuring "creative thinking"
  28. Measuring "initiative"
  29. Measuring "discovery"
  30. Measuring "peer to peer teaching"
  31. Measuring "use of computers both at school and at home"
  32. Measuring "effects were found in general cognitive skills"
    1. Measuring "Attention Skills"
    2. Measuring "Sustained Attention
    3. Measuring "Selective Attention
    4. Measuring "Divided Attention: ...multi-tasking
  33. Measuring "Memory
    1. Measuring "Long-Term Memory
    2. Measuring "Short-Term / Working Memory
    3. Measuring "Logic and Reasoning
    4. Measuring "Auditory Processing
    5. Measuring "Visual Processing
    6. Measuring "Processing Speed
  34. Measuring "quality of the teachers"
    1. Measuring "the impact of teachers work in class on test scores" - "The fact that the test results show no impact may be interpreted as "the teachers work in class has no impact on test scores" -- something I am afraid is not far from the truth." extract from "An Alternative Reading of the independent IADB Study on Peru's OLPC Implementation" 18 Apr 2012, by Oscar Becerra, the person responsible for Una Laptop por Niño for almost five years with over 400.000 XO's implemented.
    2. Measuring "Number of Teachers that finished the extra trainings given"
    3. Measuring "Teacher Basic Math reasoning skills"
    4. Measuring "Teacher Evolved reading skills"
    5. Measuring "the extend teacher training was reinforced"
    6. Measuring "number of teachers completing the 8 hours on technical maintenance by teachers"
    7. Measuring "To what extend the education sector ability to attract the best of the best of the country versus the private sector or worse, maybe all leave the country and never come back" - this 2007 study by McKinsey found that the world's most improved school systems had in common their concern for teacher quality and getting the best people into teaching
    8. Measuring "To what extend the kids have been given more options for their future with the OLPC Educational Universal Education Effort"
  35. Measuring "ICT skills" - ICT skills had been identified as key ingredients for success by many organizations (see, for example, this report)
  36. Measuring "access and use of computers"
  37. Measuring "quality of instruction in class"
  38. Measuring "use of a word processor"
  39. Measuring "use of a calculator
  40. Measuring "playing games on a computer"
  41. Measuring "transferred a game you played on the computer into a game played outside"
  42. Measuring "transferred an out- or indoor game you found via the computer into a game you played with or without your friends"
  43. Measuring "playing music on a computer"
  44. Measuring "transferred music you played on the computer into music you played outside"
  45. Measuring "transferred an existing piece of music you found via the computer into music you played with or without your friends"
  46. Measuring "ability to integrate external stakeholders into educational efforts"
  47. Measuring "ability to integrate the XO computers into correct or desirable pedagogical practices"
  48. Measuring "ability to end rote learning and hitting kids"
  49. Measuring "ability to transfer ICT skills to other problems" ICT skills would be easily transferable to other platforms in the future since upgrading to new versions of Windows can be as complex as switching from Sugar to Windows
  50. Measuring "ability to protection against access to inappropriate content, because kids prefer to be busy with more interesting stuff"
  51. Measuring "teacher motivation"
  52. Measuring "student motivation"
  53. Measuring "parent motivation"
  54. Measuring "family motivation"
  55. Measuring "intrinsic motivation towards school work,
  56. Measuring "intrinsic motivation towards attendance
  57. Measuring "intrinsic motivation towards homework
  58. Measuring "interest in school work"
  59. Measuring "pleasure in school work"
  60. Measuring "relation between effort and results obtained"
  61. Measuring "perceived competence for school work"
  62. Measuring "perceived importance of school work
  63. Measuring "creative stress"
  64. Measuring "perceived selection of what to do"
  65. Measuring "improved personal relations"
  66. Measuring "% of laptops malfunctioning"
  67. Measuring "% of laptops successfully repaired"
  68. Measuring "theft ratio"
  69. Measuring "theft ratio of XO's to the national average of other small portable items"
  70. Measuring "perceived competence for school work" - "self-perceived school competence ... evidence of small negative effects" (p.16) I don't agree with the implication of these negative effects as a decrease in self-esteem. What may be inferred is that children realize that they are not well prepared for school, a finding that is good if it motivates them to work harder to achieve what they want. What I found is that children in non-OLPC schools have extremely high perceived competence for school work, in spite of their dismal results, something the presence of the XO seemed to be correcting for good. Extract from "An Alternative Reading of the independent IADB Study on Peru's OLPC Implementation" 18 Apr 2012, by Oscar Becerra, the person responsible for Una Laptop por Niño for almost five years with over 400.000 XO's implemented.
  71. Measuring "negative effects of home computer usage on grades" (like in the West when some kids spend too much time on irrelevant ict use)
  72. Measuring "IQ test results" improved in Ethiopian children who participated in an OLPC program as per study by Nina Hansen
  73. Measuring "the extend to which Students became more critical of the schools system and expected more of it."a
  74. Measuring "ability to bridge internal digital divide and thereby improve social equality"--SvenAERTS
  75. Measuring "price of ICT devices"

Suggested links

  1. as per OLPC Blogger - OLPCnews Christoph Derndorfer : "evaluation efforts are what I’ve previously referred to as the 6 criteria for successful ICT4E projects in developing nations." (https://edutechdebate.org/olpc-in-south-america/olpc-in-south-america-an-overview-of-olpc-in-uruguay-paraguay-and-peru/)
  1. Infrastructure,
  2. maintenance,
  3. teacher training,
  4. content and
  5. materials,
  6. community inclusion, and
  7. monitoring and
  1. Infrastructure: physical s.a. electricity, internet acces, servers, but also logistics, e.g. 5.000 laptop per day, serial numbers how do you do that?
  2. Maintenance: technology breaks down, software gets corrupted, needs updates. How do you do that? Agreement with the postal office to send in broken XO's?Do people trust the postal services that much, they'll get it back?
  3. Content and materials: relevant to the country / region.
  4. Community inclusion: local people must be able to contribute, e.g. community experience sharing, repairs, ... .
  5. Teacher training: TV channel, online/off-line. 1 teacher often teachers 6 grades. 3 day training, but maybe 2 days to arrive and 2 days to go back. Who takes care of the schoolkids meanwhile. 160 h: how to use, but also how to teach now there are laptops. Retraining after 6 months, but many teachers change jobs within a year because it pays too little. How do you manage that high turnover/new teachers?
  6. Monitoring and evaluation: monitor how many laptops are broken, how many teacher lack knowledge, what software is not used, how to train. Is the money spent worth the effort? What are the results? Test-scores is not enough.
Retrieved from "http://wiki.laptop.org/mediawiki/index.php?title=List_of_potentially_useful_Criteria_to_monitor_and_evaluate_an_OLPC_implementation&oldid=290488"