Developers/Stack: Difference between revisions
(Next Section split out...) |
(Added translation templates) |
||
(49 intermediate revisions by 16 users not shown) | |||
Line 1: | Line 1: | ||
{{Developers}} |
|||
[[Developers/Setup|Previous]] [[Developers|Up]] [[Developers/Communication|Next]] |
|||
{{Translations}} |
|||
[[Developers/Setup|Previous]] [[Developers/Issues|Next]] |
|||
There are a number of approaches (software stacks) to develop software for the OLPC environment. The stack you choose will strongly influence what type of [[Developers/Setup|setup]] you need and what your actual development process will look like. |
|||
Official description of the [[Software components]] on the laptop (XXX maybe merge this into that page, we want links to further information about each library, though?) |
|||
= Basic Platform = |
|||
Development Languages: |
|||
See also [[Software components]] for another discussion of the software installed on the OLPC. |
|||
* Python is strongly encouraged, to have a single language "under the hood" when the curious child looks inside |
|||
** C/C++ should be used where Python performance is unacceptable, but try to keep it to a minimum, preferably as standard well-encapsulated and documented components |
|||
* Smalltalk-speaking developers may wish to work within the eToys environment |
|||
* Javascript can be used in web-based applications (Gecko or Opera engine Javascript implementation) |
|||
The normal OLPC Operating stack looks like this: |
|||
GUI Environments: |
|||
* [[Hardware]] -- Normally an OLPC-XO, but could be another machine with Sugar installed, or cross compiled. |
|||
* PyGTK or the PyGTK-derived [[OLPC Python Environment| Sugar]] system should be used for most "Window, Icon, Mouse, Pointer" type GUIs. Note, however, as of 2007-04-21 that the Sugar "graphics" package is in Flux. |
|||
** See [[Developers/Setup]] for choices about running Sugar on a non-XO machine. |
|||
* [[Pygame]] SDL-based 2D game environment can be used for "Canvas" graphics using "Sprites". |
|||
** [[Firmware]] -- the XO uses [[Open Firmware]] |
|||
* (Mozilla) XULRunner can be used to develop Gecko-based activities |
|||
* Fedora Core 7 based Operating System, heavily modified |
|||
* [[EToys]] |
|||
** Linux Kernel (2.6.22 with some patches as of 2007-12-15) |
|||
*[[Software_components#Libraries_and_Plugins|X Window System]] - standard X11 display technology |
|||
*[[Software_components#Libraries_and_Plugins|Matchbox]] - graphical windows manager |
|||
* [[Bitfrost]] -- Security System |
|||
* [[D-BUS]] Services -- various platform-specific services (most XO-specific hardware/operations are exposed via D-BUS) |
|||
** [[Presence Service]] which uses [http://telepathy.freedesktop.org Telepathy] -- inter-machine RPC for presence engine and networking |
|||
* [[OLPC Python Environment|Sugar]] -- GUI Shell (desktop) |
|||
= Activity Development Stacks = |
|||
Operating Stack: |
|||
This section attempts to describe the major Activity development stacks available in the OLPC Sugar environment. |
|||
* [[Hardware]] |
|||
* [[Firmware]] ([[Open Firmware]]) |
|||
* Fedora Core based Operating System |
|||
* [[Bitfrost]] Security System |
|||
* [[OLPC Python Environment|Sugar]] GUI Shell |
|||
== Smalltalk/Etoys == |
|||
Libraries/modules/services of note: |
|||
[[Etoys]] is a kids application written in Squeak, an open-source Smalltalk development environment. Smalltalk is one of the first object-oriented languages, that is, it has been in use for decades, and as a result has a huge body of components and pre-built content and resources that can be used to create new activities. |
|||
* [[D-BUS]] -- efficient Desktop-level RPC engine, most specialized laptop hardware and operations are exposed over DBus |
|||
* Telepathy (Glib, Salut, Gabble) -- collaboration/communications engine with "Tubes" (cross-machine RPC over DBus) and various network traversal and discovery logic, activities are encouraged to use Tubes where ever practical |
|||
The Etoys environment is easily scripted via GUI interactions, and components have access to all of the special hardware features on the laptop. You can often create fascinating projects and useful demonstrations with just a few mouse clicks and a bit of simple logic. |
|||
* [[CSound]] -- acoustically modelled sound-synthesis engine (seen in the TamTam activity) |
|||
* Abiword -- collaborative text editor/word processor usable as a GTK widget that can be embedded in other activities |
|||
See: [[Smalltalk Development on XO]] to start using Squeak to develop for the OLPC. |
|||
* [[SQLite]] -- lightweight relational database |
|||
* XULRunner (with Python DOM-capable bindings) -- Gecko 1.9 (Firefox 3.x) engine |
|||
== Browser == |
|||
Sugar includes a Mozilla-Firefox-derived (Gecko) [[Web|Web Browser]] Activity. This browser includes HTML, XHTML, Javascript and SVG support. You can set up simple web-servers on a laptop using Python, or children may access an application hosted on a public web server (but keep in mind that children often have very poor connectivity). |
|||
You can develop for this platform with no particular hardware or setup, and can test using regular Firefox during initial stages. It is easy to port work from elsewhere into this stack, and easy to export your work for use outside of the OLPC project. The environment is, however, rather constrained, without access to most of the special hardware or software components on the laptop. |
|||
=== Browser Component === |
|||
The built-in Browser is actually just a thin wrapper around the Gecko control. You can use the Gecko control yourself and create web-browser derived activities, either using XUL or Python/PyGTK to instantiate the browser. This gives your Activity access to system services and hardware, at the cost of considerably more complexity. |
|||
See: ??? to start using XULRunner/Web Control to develop for the OLPC. |
|||
== Python/PyGTK == |
|||
Python and GTK based activities are the "standard" way to write software for the OLPC. Using Python and PyGTK is strongly encouraged so that the "View Source" button will normally show the same language wherever the user invokes it. The use of the same language throughout also means that code can often be factored out of one project to be shared with another. |
|||
The support for writing activities provided by the core Sugar system (which is itself largely written in Python) is almost always exposed first through Python libraries. On the Sugar platform, PyGTK has access to the following major libraries: |
|||
* [[Cairo]] -- high performance postscript-like library for drawing vector graphics, with the RSVG SVG-rendering library |
|||
* [[Pango]] -- flexible text layout system capable of dealing with complex internationalization issues |
|||
* [[D-BUS]] -- inter-process communications |
|||
* Telepathy -- inter-machine RPC and presence management with network traversal and discovery logic (activities are encouraged to use Telepathy's Tubes where practical) |
|||
* [http://numpy.scipy.org/ NumPy] -- standard high performance numeric analysis and array-handling module |
|||
* [[CSound]] -- acoustically modelled sound-synthesis engine (seen in the [[TamTam]] activity) |
|||
* [[GStreamer]] -- general purpose media streaming platform, used for accessing the video camera and playing media |
* [[GStreamer]] -- general purpose media streaming platform, used for accessing the video camera and playing media |
||
* [[IPython]] -- enhanced interactive Python interpreter with syntax highlighting, command-completion and the like |
|||
* Avahi -- discovery and advertising mechanism for mesh-hosted services |
|||
GTK Controls: |
|||
* [[Web]] Browser Control ([[HulaHop]]) -- Gecko 1.9 web browser as a simple embeddable control with Python DOM access |
|||
* [[Write|AbiWord]]/AbiCollab Control -- AbiWord word processor as an embeddable control with the ability to collaboratively edit with another user |
|||
** This version of AbiWord also includes support for syntax-colouring and collaborative source-code editing |
|||
* [[Evince]] Control -- PDF and EBook-reading control |
|||
* [[#OLPCGames|Pygame]] -- game development engine based on SDL (see OLPCGames), not exactly a control, but close... |
|||
in addition to the Python standard library, which includes rather a lot of built-in functionality. One key standard library module is the SQLite database engine, which provides a basic single-user SQL database which can be used by activities for storage. |
|||
See: [[API Reference]] for a more exhaustive set of pointers to libraries available with links to their documentation |
|||
See: [[Activity tutorial]] to develop in Python (with PyGTK) for the OLPC. |
|||
Activities can use common Python extensions which are installed into their Activity directory. You may also consider rewriting areas that profiling say are problems in your activity as [[#Low Level|C extensions]]. This can save both processor load and memory depending on the nature of the extension. Keep in mind, though, that premature optimization is generally not a good idea; code first, optimize later. You can also use extensions to wrap already-existing activities (those not normally Sugar or Python based) by creating a GTK control wrapping your activity's core. |
|||
See: [[#Low Level]] for a discussion of extensions lower-level programming-language issues |
|||
=== OLPCGames === |
|||
[[Pygame]] is a high-level wrapper around the C [[SDL]] library, which provides low-level support for developing games. Pygame allows you to easily create raster (pixel-based) graphics for games with reasonable performance thanks to SDL. |
|||
[[OLPCGames]] is a Python package which allows you to create Sugar Activities using Pygame with access to the special features of the laptop. This includes the Telepathy presence and communications infrastructure and the Pango/Cairo graphics capabilities. |
|||
See: [[Game development HOWTO]] to start using Python, Pygame and OLPCGames to develop for the OLPC. |
|||
See: [[Game templates]] for a set of simple templates intended to allow students to create "genres" of games easily |
|||
See also [http://wiki.sugarlabs.org/go/Development_Team/Sugargame Sugargame], a different implementation. |
|||
== Flash == |
|||
Sugar includes the [[Gnash]] engine by default, and the [[Adobe Flash]] playing engine can be installed. At the moment we do not have a Flash authoring tool that can be distributed on the laptops, however. If you have Flash-based content, it may be possible to simply run it on Gnash on Sugar. |
|||
== Low Level == |
|||
Being a regular Fedora 7 Linux machine, the OLPC-XO can run regular Linux i386 executables. However, integration with the Sugar shell is currently a non-trivial exercise. It is often easier to wrap your C/C++/Assembly/Whatever activity in a (normally Python) wrapper than to attempt to implement the entire [[Low-level Activity API]] yourself. |
|||
See: [[Low-level Activity API]] for the most extensive and up-to-date available discussion of how to integrate a low-level activity manually |
|||
See: [[Sugarizing]] for a (somewhat fragmentary) discussion of how to wrap an existing native-code executable/library with a Python wrapper. |
|||
See: [http://dev.laptop.org/git?p=users/albert/sugarize;a=tree;f=xlogo.activity;hb=HEAD Sugarize Demo] for a shared library loader hack that provides much of the X11-level functionality for general X11 activities, allowing them to be run largely unchanged on the XO. Most of the special features of the laptop will not be available, but this approach allows for quick porting/testing of activities. |
|||
When coding in Python, you will occasionally want access to a C or C++ extension, either one already written, or one written to optimize some part of your activity. You can build these extensions for use under Sugar by using the normal Python distutils with GCC tool chain. |
|||
Make sure that you are aware (and respect) the [[Geode instruction set]]. It is about the same as the original Athlon instruction set. See the Geode data book linked in the [[Geode instruction set]] page. |
|||
The best (most reliable and compatible) approach is generally to compile on an official image, using Yum to install the tools required. Doing this on an actual XO, however, is probably '''not''' a good idea, as compilation will tend to cause lots of writes to the disk and reduce the longevity of your flash storage chip. |
|||
See: [[Developers/Setup#Emulation for Compilation/Experiments|Emulation for Compilation]] for a tip on how to compile using emulation |
|||
= Common Libraries Not Available = |
|||
While the Sugar environment is rich, it cannot include every possible library or extension and still fit in 200MB. The following extremely common libraries are '''not''' available by default: |
|||
Common libraries not available: |
|||
* OpenGL |
* OpenGL/MESA |
||
* Server-based relational databases (MySQL, PostgreSQL) |
* Server-based relational databases (MySQL, PostgreSQL) |
||
* Qt/KDE |
|||
* If you are unsure whether something is supported, ask, or load up an emulated machine and check for the presence of the library |
|||
* Gnome |
|||
* Many Kernel-level Linux Drivers (you can [[Kernel Building|build]] missing drivers yourself, preferably in a throw-away emulator overlay) |
|||
[[Developers/Setup|Previous]] [[Developers/Issues|Next]] |
|||
Testing/working: |
|||
= See also = |
|||
* Announce your project on the [http://lists.laptop.org/listinfo/devel OLPC devel list] so that people know what you are working on and duplication of effort is reduced |
|||
* Add your project to the [[Software projects]] page |
|||
* Test your application in an official image (or a physical laptop) before publishing broadly |
|||
* To conserve memory or improve performance, consider replacing problematic areas in your Python code with C. For example, a [http://dev.laptop.org/ticket/1303 rewrite of the hardware manager service] in C saved 1.8 megabytes of private dirty memory. On a machine with only 256 megabytes of RAM and no swap space, efficient use of memory can make the difference between a usable system and a system made unreliable by out-of-memory failures. |
|||
* Distribute your source code under the GPL, LGPL or MIT license. |
|||
* When ready to test with real users add your activity to the [[Activities]] page to allow for easy download and installation |
|||
* [[Java]] includes a discussion of why java is not available and the prospects for including it (summary: open source Java was not available until recently, and now that it is, work remains to be done to remove the bloat and to make the user experience compatible with the Sugar windowless paradigm). |
|||
[[Developers/Setup|Previous]] [[Developers|Up]] [[Developers/Communication|Next]] |
Latest revision as of 04:53, 22 May 2011
Please copy/paste "{{Translationlist | xx | origlang=en | translated={{{translated}}}}}" (where xx is ISO 639 language code for your translation) to Developers/Stack/translations | HowTo [ID# 256294] +/- |
There are a number of approaches (software stacks) to develop software for the OLPC environment. The stack you choose will strongly influence what type of setup you need and what your actual development process will look like.
Basic Platform
See also Software components for another discussion of the software installed on the OLPC.
The normal OLPC Operating stack looks like this:
- Hardware -- Normally an OLPC-XO, but could be another machine with Sugar installed, or cross compiled.
- See Developers/Setup for choices about running Sugar on a non-XO machine.
- Firmware -- the XO uses Open Firmware
- Fedora Core 7 based Operating System, heavily modified
- Linux Kernel (2.6.22 with some patches as of 2007-12-15)
- X Window System - standard X11 display technology
- Matchbox - graphical windows manager
- Bitfrost -- Security System
- D-BUS Services -- various platform-specific services (most XO-specific hardware/operations are exposed via D-BUS)
- Presence Service which uses Telepathy -- inter-machine RPC for presence engine and networking
- Sugar -- GUI Shell (desktop)
Activity Development Stacks
This section attempts to describe the major Activity development stacks available in the OLPC Sugar environment.
Smalltalk/Etoys
Etoys is a kids application written in Squeak, an open-source Smalltalk development environment. Smalltalk is one of the first object-oriented languages, that is, it has been in use for decades, and as a result has a huge body of components and pre-built content and resources that can be used to create new activities.
The Etoys environment is easily scripted via GUI interactions, and components have access to all of the special hardware features on the laptop. You can often create fascinating projects and useful demonstrations with just a few mouse clicks and a bit of simple logic.
See: Smalltalk Development on XO to start using Squeak to develop for the OLPC.
Browser
Sugar includes a Mozilla-Firefox-derived (Gecko) Web Browser Activity. This browser includes HTML, XHTML, Javascript and SVG support. You can set up simple web-servers on a laptop using Python, or children may access an application hosted on a public web server (but keep in mind that children often have very poor connectivity).
You can develop for this platform with no particular hardware or setup, and can test using regular Firefox during initial stages. It is easy to port work from elsewhere into this stack, and easy to export your work for use outside of the OLPC project. The environment is, however, rather constrained, without access to most of the special hardware or software components on the laptop.
Browser Component
The built-in Browser is actually just a thin wrapper around the Gecko control. You can use the Gecko control yourself and create web-browser derived activities, either using XUL or Python/PyGTK to instantiate the browser. This gives your Activity access to system services and hardware, at the cost of considerably more complexity.
See: ??? to start using XULRunner/Web Control to develop for the OLPC.
Python/PyGTK
Python and GTK based activities are the "standard" way to write software for the OLPC. Using Python and PyGTK is strongly encouraged so that the "View Source" button will normally show the same language wherever the user invokes it. The use of the same language throughout also means that code can often be factored out of one project to be shared with another.
The support for writing activities provided by the core Sugar system (which is itself largely written in Python) is almost always exposed first through Python libraries. On the Sugar platform, PyGTK has access to the following major libraries:
- Cairo -- high performance postscript-like library for drawing vector graphics, with the RSVG SVG-rendering library
- Pango -- flexible text layout system capable of dealing with complex internationalization issues
- D-BUS -- inter-process communications
- Telepathy -- inter-machine RPC and presence management with network traversal and discovery logic (activities are encouraged to use Telepathy's Tubes where practical)
- NumPy -- standard high performance numeric analysis and array-handling module
- CSound -- acoustically modelled sound-synthesis engine (seen in the TamTam activity)
- GStreamer -- general purpose media streaming platform, used for accessing the video camera and playing media
- IPython -- enhanced interactive Python interpreter with syntax highlighting, command-completion and the like
GTK Controls:
- Web Browser Control (HulaHop) -- Gecko 1.9 web browser as a simple embeddable control with Python DOM access
- AbiWord/AbiCollab Control -- AbiWord word processor as an embeddable control with the ability to collaboratively edit with another user
- This version of AbiWord also includes support for syntax-colouring and collaborative source-code editing
- Evince Control -- PDF and EBook-reading control
- Pygame -- game development engine based on SDL (see OLPCGames), not exactly a control, but close...
in addition to the Python standard library, which includes rather a lot of built-in functionality. One key standard library module is the SQLite database engine, which provides a basic single-user SQL database which can be used by activities for storage.
See: API Reference for a more exhaustive set of pointers to libraries available with links to their documentation
See: Activity tutorial to develop in Python (with PyGTK) for the OLPC.
Activities can use common Python extensions which are installed into their Activity directory. You may also consider rewriting areas that profiling say are problems in your activity as C extensions. This can save both processor load and memory depending on the nature of the extension. Keep in mind, though, that premature optimization is generally not a good idea; code first, optimize later. You can also use extensions to wrap already-existing activities (those not normally Sugar or Python based) by creating a GTK control wrapping your activity's core.
See: #Low Level for a discussion of extensions lower-level programming-language issues
OLPCGames
Pygame is a high-level wrapper around the C SDL library, which provides low-level support for developing games. Pygame allows you to easily create raster (pixel-based) graphics for games with reasonable performance thanks to SDL.
OLPCGames is a Python package which allows you to create Sugar Activities using Pygame with access to the special features of the laptop. This includes the Telepathy presence and communications infrastructure and the Pango/Cairo graphics capabilities.
See: Game development HOWTO to start using Python, Pygame and OLPCGames to develop for the OLPC.
See: Game templates for a set of simple templates intended to allow students to create "genres" of games easily
See also Sugargame, a different implementation.
Flash
Sugar includes the Gnash engine by default, and the Adobe Flash playing engine can be installed. At the moment we do not have a Flash authoring tool that can be distributed on the laptops, however. If you have Flash-based content, it may be possible to simply run it on Gnash on Sugar.
Low Level
Being a regular Fedora 7 Linux machine, the OLPC-XO can run regular Linux i386 executables. However, integration with the Sugar shell is currently a non-trivial exercise. It is often easier to wrap your C/C++/Assembly/Whatever activity in a (normally Python) wrapper than to attempt to implement the entire Low-level Activity API yourself.
See: Low-level Activity API for the most extensive and up-to-date available discussion of how to integrate a low-level activity manually
See: Sugarizing for a (somewhat fragmentary) discussion of how to wrap an existing native-code executable/library with a Python wrapper.
See: Sugarize Demo for a shared library loader hack that provides much of the X11-level functionality for general X11 activities, allowing them to be run largely unchanged on the XO. Most of the special features of the laptop will not be available, but this approach allows for quick porting/testing of activities.
When coding in Python, you will occasionally want access to a C or C++ extension, either one already written, or one written to optimize some part of your activity. You can build these extensions for use under Sugar by using the normal Python distutils with GCC tool chain.
Make sure that you are aware (and respect) the Geode instruction set. It is about the same as the original Athlon instruction set. See the Geode data book linked in the Geode instruction set page.
The best (most reliable and compatible) approach is generally to compile on an official image, using Yum to install the tools required. Doing this on an actual XO, however, is probably not a good idea, as compilation will tend to cause lots of writes to the disk and reduce the longevity of your flash storage chip.
See: Emulation for Compilation for a tip on how to compile using emulation
Common Libraries Not Available
While the Sugar environment is rich, it cannot include every possible library or extension and still fit in 200MB. The following extremely common libraries are not available by default:
- OpenGL/MESA
- Server-based relational databases (MySQL, PostgreSQL)
- Qt/KDE
- Gnome
- Many Kernel-level Linux Drivers (you can build missing drivers yourself, preferably in a throw-away emulator overlay)
See also
- Java includes a discussion of why java is not available and the prospects for including it (summary: open source Java was not available until recently, and now that it is, work remains to be done to remove the bloat and to make the user experience compatible with the Sugar windowless paradigm).