Display

From OLPC
Revision as of 22:33, 28 June 2007 by MitchellNCharity (talk | contribs) (A check point in the ongoing overhaul.)
Jump to: navigation, search

Designing for the display

Summary

The display is...
1200x900, 200 dpi. 6x4 in (152.4x101.6 mm). 6 bit deep (262k colors).

Use normal font point sizes.

UI elements designed for 100 dpi should be enlarged by about 1/3, or they will look smaller.

Under different lighting conditions, the display may appear to be color, pale color, or monochrome. So check the appearance of your UI in monochrome. Use high-contrast UI elements.

Ignore talk of "mono and color modes", and of screen resolutions other than 1200x900. We named things poorly, and immense confusion has resulted.

Elaboration

Use normal font point sizes. That's points, not pixels, of course. The fonts will appear larger than normal. But compared with adults, children use larger fonts. So a 12 pt font looking 14 pt is fine.

Ignore talk of "mono and color modes", and of screen resolutions other than 1200x900. We named things poorly, and immense confusion has resulted. We called two very different things mono/color. Which combined with the unusual screen hardware, has generated immense confusion,and consequent misinformation. The hardware section below discusses it, but most activities just don't care.

UI design and physical geometry

Think about how large your UI elements will actually be in physical geometry, and design accordingly. Normal viewing distance might be 40-50 cm. Compared to 40 to 60 or 70 cm for adults. Pixel size is 0.127 mm, or about 1 arc minute. Elements designed for 100 dpi should be enlarged 20-50%, or they will look smaller. 1/3 is a nice number. The web browser scales web pages by ~40%. (what is the precise browser number?)


Understanding the hardware

The display has two main parts, the screen, and the DCON screen driver chip.

Screen

The screen is unusual. It can be used in darkness, and in direct sunlight. There are several ways to describe it.

Our screen, described as two screens sharing an LCD

One way to think of the screen is as the combination of two separate screens, which share only an LCD glass. One screen is a normal backlit screen. The other is a normal reflective screen.

The LCD is a 1200x900 grid of square, 0.127 mm (200 dpi) pixels which each have 64 levels of gray (6 bits). As usual, when a pixel is off, it's transparent. And when it is fully on, it is opaque.

The backlit "screen", has a backlight, which shines through a color filter, on to the 1200x900 grid. The filter gives each pixel just one color, red, green, or blue. The pixels are thus behaving like the "sub-pixels" of a normal backlit display.

The reflective "screen" has a reflector behind the LCD grid. So room light comes in (through the LCD), bounces off the reflector, and goes back out, through the LCD. So there are 1200x900 pixels, which depend on ambient outside light to be seen.

The light the user sees comes from both of these. Some from the reflective "screen", and some from the backlit one. How much comes from each depends on how high the backlight is turned on, and how bright the room/outdoors is.

In a completely dark room, you see only the backlit "screen". In direct sunlight, you only see the reflective one. In between, you see both.

If one "screen" is 1200x900, and the other is like 693x520, what's the resolution of the combined screen? In sunlight, or in a normal room with the backlight turned off, it's 1200x900. It a completely dark closet, perception tests put it at something like 800x600. Under normal conditions, with the backlight on, perception tests put it at something like XGA (which is 1024x768). Why use perception tests? Because the whole emphasis of the unusual screen design is to mesh well with how human perception works. So to get a useful measurement, you need to include an eyeball.

Our screen, described in its parts

The screen is composed of several layers. Starting at the back, there is a white LED backlight, a 1200x900 grid of color filters, a semi-reflective layer, and a 1200x900 LCD.

The brightness of the backlight can be adjusted. It has (how many?) settings, including off. (include an image of the backlight control)

The semi-reflective layer both reflects room light, and lets the backlight's light out. How much you see of each, depends on the relative strength of the two light sources.

  • In direct sun, you see only reflected light. The backlight setting doesn't matter.
  • In a completely dark room, there is no reflected light. So you only see the backlight, and if you turn it off, you see nothing.
  • In between, you see some mix. You see more backlight if you turn down the room lighting, or you raise the backlight setting. You see less backlight when the room gets brighter, or you lower the backlight setting.

All color is created by the backlight and filters.

There are 1200x900 pixels. Each one has a single colored filter behind it. So each pixel is capable of either R, G, or B. Only one. It relies on its neighbors to provide the others. So each pixel has:

  • a fixed hue (R, G, or B),
  • a luminance which can be set (6 bit)
  • and a chrominance which depends on the relative strength of the room light and backlight.

This Munsell page has a nice diagram.

Consider a single one of those 1200x900 pixels. A red one. If its value is 0, black, then lighting doesn't matter. If its value is 255 (or whatever, fully transparent), then in bright sunlight you see only white, and in a dark room you see fully saturated red. If its value is in between, in bright sunlight you see a gray, and in a dark room you see a grayed (ie desaturated) red.

The theory

The display employs something the video encoding experts have done for some time: the human visual system sees higher resolution in luminance (B&W) than chrominance (color): for example MPEG luminance resolution is 4X the chrominance resolution. A key thing to understand is that the ambient light level of the room changes the resolution of the display. The pixel has a reflective part that is B&W, and a transmissive part that is one color: red or green or blue. It should be that a red and a green and blue pixel combine to make a single full-color pixel. Thus the resolution should be 1200/sqrt(3) x 900/sqrt(3) or 693x520. But, when the room is totally dark, the resolution given via standard methods of determining display resolution is approximately 800x600 or about 133 dpi. These measurements were done in a number of ways, and are being written up for publication (some were straight fresnel patterns, other perceptual image detail tests). In a dark room the effect is akin to sub-pixel rendering - we see an improvement in resolution of ~33% via sub-pixel rendering.

With room lights on, an additional effect comes into play: the display has luminance (B&W) information at 200dpi in it's reflective mode, with the room lights on the display also reflects 200dpi in black and white. This increases the effective resolution to about XGA or 1024x768 when using test patterns to ascertain the display resolution. Finally, the laptop can be brought outside into bright sunlight and the screen is still viewable - now the color is barely visible (if the backlight is left on), but on the screen the 1200x900 200dpi resolution is seen crisply and clearly.

Other notes

So a resolution rule of thumb is: 1200x900 gray (sunlit, or room with backlight off), ~1024x768 color (room with backlight on); ~800x600 closet (total darkness). But note, even in total darkness, you have better than 100 dpi. So when writing an activity, you basically don't care.

The top left corner pixel is red. So the first row is RGBRG... and the second row is GBRGB... and the 3rd BRGBR... .

A magazine [1] tested a B2 (B1?), and reports a luminous intensity of 64 cd/m^2 ("about half that of a normal notebook panel"), and contrast of 82:1. I don't know how reliable the numbers are, nor how similar B4/XO-1 is. And the intensity likely varies as the LCD backlight ages.

ajax post

http://lists.laptop.org/pipermail/devel/2007-January/003817.html

what is the resolution in color?

1200x900.  And since you brought it up, I'd like to dispel a myth.

It's not like your pixels suddenly get larger in gray mode, the dots
stay the same size.  You just lose chromaticity, so you need to make
sure your colors are still discernable even when just looking at
luminance.  (And yes, it's pretty much the NTSC luminance formula.)

Likewise, there's really no point in adjusting font sizes when changing
from one mode to the other.  There's a minimum size for legibility, and
it's about the same on the XO screen regardless of whether they're
colored or gray pixels.  This minimum size may be slightly smaller on
the XO screen than compared to a normal 100dpi LCD, but not by much, at
least when measured in points.

And of course, don't size your fonts in pixels, because that's Bad And
Wrong.

If you like you can even do the math.  OLPC use for a child will be
about 200dpi at 18"; one degree of arc would be about 0.314" of screen,
or 62.8 dots (18 inch * tan(1 deg) * 200 dots per inch).  Typical 100dpi
use for an adult is about 24" to 30", which is 41.9 to 52.4 dots per
degree.  So your fonts need to be anywhere between 20% and 50% bigger,
in points, to be the same perceptual size in arc sweep.  And since most
text is high-contrast, you can aim for the low end of that range, since
you'll be gaining in dots per unit arc.  But by this same principle,
you're not going to see much effective resolution change for text when
going from color to grayscale, so there's no real need to change font
size when that occurs.

And a good thing too, since I don't believe that event goes out on dbus.

This goes for the rest of the UI too, though there's some nonlinearity
involved due to the color sampling at small sizes.  16 pixel square
icons won't work, but 64^2 might still look reasonable.  The big thing
if you want grayscale mode to work is to pick colors with different
luminances.

From later discussion: design for bigger UI elements and high contrast. 33% is a reasonable scale factor.

think about how large your UI elements will actually be in physical geometry, and design accordingly.
they _will_ be smaller if you design for a 100dpi screen.
they don't need to be quite twice as large, but they do need to be larger.
you only really need to worry about the color effects if you're trying to draw elements smaller than 3 pixels wide or tall;
but that's probably a bad idea anyway since that's going to be tiny.

For the programmer

The frame buffer is always 1200x900, 200 dpi. Always. What that 200dpi looks like varies a great deal depending on lighting. Lit externally, you see the grayscale pixels on a 1/200 inch grid. Lit internally (by the backlight), the display gains color. Depending on the ratio of external to internal lighting, the pixels vary from pure gray (black-to-white), to tinted, to pure color (black-to-... red, green or blue, depending on the pixel).

Software that uses color has to care about the color "mode" (an unfortunate term, since it's a continuum) because of appearances. In grayscale, a white pixel looks just like its white neighbors. In color, it very much doesn't. If you draw a light-gray line one pixel wide, it may look fine in pure grayscale, and oddly dashed and colored in pure color. And in between... in between. Same thing for fonts. The smallest font you can read in pure grayscale may not be readable in pure color. In between, it might be readable but with color artifacts. Visually, the effect is that you have lower resolution to play with, so your software, intending to be readable, has to draw small things bigger; either all the time, or by noticing the current backlight/sunlight context and adjusting. It can make things bigger by scaling everything (overkill, but Cairo makes it simple), or scaling up only the small things. In practice, the tricky things are small fonts and thin (1-3 pixel) diagonal (positive slope) lines.

The DCON has three possible modes: monochrome, color swizzled not antialised, and color swizzled antialised. (Actually there are more, like video pass-thru, but we'll skip those). Using sugar or olpc-hardware-manager to set /sys/devices/platform/dcon/output = 0 (color) gives one of the two color modes, no one knows which. It's not clear whether there is a knob to get the other one.

Once security is implemented, /source may become inaccessible? Then activities like Read would have to find some other way to say "ok, no more changes anticipated for a while - start saving power". /output is expected to remain accessible.

For the artist

Appearance will change with lighting conditions. L a b and Munsell color pickers and palettes are helpful for choosing colors. The xo can be colorful. You just have one extra consideration, iso-luminance, to manage.

We need additional links to Lab or Munsell FOSS/web color pickers, and palettes. And a less-brief description of why. MitchellNCharity 10:49, 24 June 2007 (EDT)

Todo

other things which should be mentioned:

LRGB->RGB utility fuction

I think it would be very useful to have an L RGB->L (discard L)ab->RGB python utility function. So you can simply say "give me a color like rgb, but which has a mono value of g". Then code could then work in familiar rgb terms, and grayscale values would be explicit rather than implicit in rgb choice. MitchellNCharity 11:43, 24 June 2007 (EDT)

See also