Emerging Display Ideas

Augmented Reality Displays and Waveguides

How see-through optics, including waveguides, overlay digital images on the real world, and why brightness, field of view and bulk make this hard.

On this page
  1. The basic problem
  2. Combiners: the simplest idea
  3. What a waveguide does
  4. Why this is hard
  5. Image sources
  6. Uses people explore
  7. What remains uncertain

The basic problem

A normal screen blocks your view of whatever is behind it. An augmented reality display has to do the opposite: let the real world through while adding extra imagery on top. That means the display itself cannot sit directly in front of the eye the way a phone screen does. Instead, light from a small image source is routed by optics and combined with light from the surroundings.

Two broad approaches exist. In video pass-through designs, cameras capture the surroundings and a conventional screen shows the combined result. In optical see-through designs, which are the subject here, the viewer looks through transparent optics and the added image is merged into that view.

Combiners: the simplest idea

The oldest approach is a partly reflective surface, often called a combiner. It is angled in front of the eye. Some light from the real scene passes straight through, while light from a tiny display off to the side bounces off the surface toward the eye. The viewer sees both at once.

This works, but the optics tend to be thick, because the image source and a lens or mirror must sit in a certain geometry. Making the arrangement thin enough to resemble ordinary eyeglasses is a major challenge.

What a waveguide does

A waveguide is a thin, transparent plate, typically glass or plastic, that carries light along its length by repeated internal reflection, much as light travels inside an optical fiber. The idea is:

  1. A small image source, often one of the microdisplays used in headsets, projects light into an edge of the plate.
  2. The light travels along the plate by bouncing between its surfaces.
  3. Structures on the plate, such as tiny gratings or partly reflective surfaces, redirect the light out toward the eye.

Because the plate can be thin and clear, it can sit in front of the eye like a lens. The light from the real world passes through it normally.

Many waveguide designs also spread the light so that the image appears over a larger area, making the position of the eye less critical. That region where the eye can sit and still see the image is often called the eye box, and a larger one makes the device more tolerant of how it is worn.

Why this is hard

Several trade-offs appear repeatedly, and none is fully solved in a way that suits every use.

Brightness. Only a fraction of the light from the image source makes it through the plate and out to the eye. The real world, especially outdoors in daylight, can be far brighter than a small display can compete with. Designers often darken the view with tinting, which in turn dims the real scene. Compare this with the sunlight readability problems of ordinary outdoor screens.

Field of view. The angular size of the digital image is limited by the waveguide’s geometry and materials. A narrow field of view looks like a small window floating in the scene instead of a world filled with graphics.

Color and uniformity. Gratings and reflective structures can treat different colors differently, so images may show uneven color or faint tints across the view. Correcting this is an optical design task.

Stray light and ghosts. Light from bright sources in the real world can scatter inside the plate and create unwanted glare or faint doubled images.

Weight, power and heat. The image source, battery and processing all need to fit on the head. More power means more heat near the face, so comfort limits what is practical.

Focus. Digital content appears at some optical distance that may not match where the real objects it is meant to sit beside are. A mismatch between where the eyes point and where they focus can cause discomfort for some people. This vergence-and-focus issue is also discussed in the context of virtual reality optics.

Image sources

The tiny display feeding the optics matters as much as the optics. It must be bright, since much light is lost, and small, since the whole system must be wearable. That favors very dense, very small panels, with brightness being a particular concern in see-through designs. Different emitter and projection approaches have different strengths here, and the field has not settled on a single best answer.

Uses people explore

General interest in see-through displays covers navigation prompts, step-by-step instructions for repair or assembly, and information overlays for people who need their hands free. Some of those settings, such as aviation and military, involve safety-critical decisions where requirements are set by specialists and regulators, so this article offers only the general idea. Defense display needs and cockpit displays have their own demanding conditions, and nothing here should be treated as guidance for them.

What remains uncertain

It is not clear which optical approach, if any, will give a combination of brightness, clarity, wide view and comfortable size that people want. Different tasks may favor different designs, and some may remain specialist tools. Treat any claim of an imminent “perfect” pair of see-through glasses with caution; the underlying physics imposes trade-offs that cleverness reduces but does not remove.

The complete guide to emerging display ideas

Emerging Display Ideas and Open Questions
Read the guide

Keep exploring

Guides from other topics

All topics →