Image Geometry Correction (often referred to as Image Warping) is the process of digitally manipulating image data such that the image’s projection precisely matches a specific projection surface or shape. Image geometry correction compensates for the
distortion
In signal processing, distortion is the alteration of the original shape (or other characteristic) of a signal. In communications and electronics it means the alteration of the waveform of an information-bearing signal, such as an audio s ...
created by off-axis
projector
A projector or image projector is an optical device that projects an image (or moving images) onto a surface, commonly a projection screen. Most projectors create an image by shining a light through a small transparent lens, but some newer type ...
or screen placement or non-flat screen surface, by applying a pre-compensating inverse distortion to that image in the digital domain.
Usually, Image geometry correction is applied such that equal areas of projection surface are perceived by the viewer map to equal areas in the source image. It can also be used to apply a
special effect
Special effects (often abbreviated as SFX, F/X or simply FX) are illusions or visual tricks used in the theatre, film, television, video game, amusement park and simulator industries to simulate the imagined events in a story or virtual w ...
distortion. The term “Image” Geometry Correction, implying a static image, is slightly misleading. Image geometry correction applies to static or dynamic images (i.e. moving video).
Overview
Image geometry correction is generally implemented in 2 different ways:
# Graphics processing
#
Signal processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
Both techniques involve the real time execution of a spatial transformation from the input image to the output image, and both techniques require powerful
hardware
Hardware may refer to:
Technology Computing and electronics
* Electronic hardware, interconnected electronic components which perform analog or logic operations
** Digital electronics, electronics that operate on digital signals
*** Computer hard ...
. The spatial transformation must be pre-defined for a particular desired geometric, and may be calculated by several different methods (more to follow).
In Graphics Processing, the spatial transformation consists of a
polygon mesh
In 3D computer graphics and solid modeling, a polygon mesh is a collection of , s and s that defines the shape of a polyhedral object. The faces usually consist of triangles ( triangle mesh), quadrilaterals (quads), or other simple convex ...
(usually
triangle
A triangle is a polygon with three edges and three vertices. It is one of the basic shapes in geometry. A triangle with vertices ''A'', ''B'', and ''C'' is denoted \triangle ABC.
In Euclidean geometry, any three points, when non- colli ...
s). The transformation is executed by texture mapping from the
rectilinear mesh of the input image to the transformed shape of the destination image. Each polygon on the input image is thus applied to an equivalent (but transformed in shape and location)
polygon
In geometry, a polygon () is a plane figure that is described by a finite number of straight line segments connected to form a closed '' polygonal chain'' (or ''polygonal circuit''). The bounded plane region, the bounding circuit, or the two t ...
in the output image.
Graphics Processing based Image Geometry Correction, may be performed with inexpensive PC-based graphics controllers. The sophisticated
software
Software is a set of computer programs and associated software documentation, documentation and data (computing), data. This is in contrast to Computer hardware, hardware, from which the system is built and which actually performs the work.
...
that uses the
texture mapping
Texture mapping is a method for mapping a texture on a computer-generated graphic. Texture here can be high frequency detail, surface texture, or color.
History
The original technique was pioneered by Edwin Catmull in 1974.
Texture mappi ...
hardware of a graphics controller is not standard, and is available only through vendors of specialty software (i.e. Mersive Technologies and Scalable Display Technologies).
Graphics Processing based image geometry correction is very effective for content that originates in the PC. Its major drawback is that it is tied to the graphics controller platform, and cannot process signals that originate outside the graphics controller.
In
Signal Processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
based image geometry correction, the spatial transformation consists of spatially defined 2-dimensional image re-sampling or scaling filter. The scaling operation is performed with different scaling ratios in different parts of the image, according to the defined transformation. Special care must be taken in the design of the scaling filter to ensure that spatial frequencies remain balanced in all areas of the image, and that the
Nyquist criterion is met in all areas of the image.
Signal Processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
based image geometry correction is implemented by specially designed
hardware
Hardware may refer to:
Technology Computing and electronics
* Electronic hardware, interconnected electronic components which perform analog or logic operations
** Digital electronics, electronics that operate on digital signals
*** Computer hard ...
in the projection system (i.e. IDT, Silicon Optix or GEO Semiconductor), or in stand-alone Video Signal Processors (i.e. Flexible Picture Systems).
Signal Processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
based image geometry correction is the most flexible form of this technology, enabling the correction of images that originate from ANY graphics controller platform. The drawback of
Signal Processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
based Image Geometry Correction is the extra expense of the hardware that is used to perform it. This extra expense can be mitigated by the inclusion of additional features (such as switching and Edge Blending in the
Signal Processing
Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing '' signals'', such as sound, images, and scientific measurements. Signal processing techniques are used to optimize transmissions, ...
based image geometry correction system).
Calculation of the image geometry correction transformation
The image geometry correction transformation can be calculated by predictive geometry (i.e. calculating exactly where an image should land on a regular surface such as
sphere
A sphere () is a Geometry, geometrical object that is a solid geometry, three-dimensional analogue to a two-dimensional circle. A sphere is the Locus (mathematics), set of points that are all at the same distance from a given point in three ...
or a
cylinder
A cylinder (from ) has traditionally been a three-dimensional solid, one of the most basic of curvilinear geometric shapes. In elementary geometry, it is considered a prism with a circle as its base.
A cylinder may also be defined as an infi ...
), or by an automatic optical feedback system (i.e. a camera can be used to evaluate the alignment of test images), or by user iteration (i.e. movement of points by an operator). In all methods, the transformation is generally described as a 2-dimensional array. The number of points in the 2-dimensional array that are required to do an accurate Image Geometry Correction depends on the surface involved. In the case of Keystone Correction, 4 points are all that are required to completely describe any projection situation.
Applications
The simplest application of image geometry correction is a specific case known as keystone distortion correction derived from
Keystone effect
The keystone effect is the apparent distortion of an image caused by projecting it onto an angled surface. It is the distortion of the image dimensions, such as making a square look like a trapezoid, the shape of an architectural keystone, hence ...
. Keystone distortion gets its name from the symmetric trapezoidal distortion resulting from misaligned projector placement in the vertical dimension (although the term is generally applied to the non-symmetric quadrilateral shape that occurs from an off-axis projection in both dimensions). Keystone correction capabilities are now included in most projectors currently available on the market, allowing users to move the image both vertically and horizontally. Even with this feature, the degree of adjustment available is limited, and image quality may suffer. Keystone correction is ideal for simple business (i.e. conference room) adjustments. For more complex distortion correction, an external processor is required.
Projector Stacking is an advanced form of keystone correction. In this application, two or more projectors are projected onto exactly the same surface. Since the two projectors cannot occupy exactly the same space, the output of each must be at least slightly corrected for Keystone Distortion.
Passive 3D Projector Stacking provides precise alignment for 2 synchronized projectors that are supplying the left eye and right eye of a 3D application.
Image Geometry Correction onto regular surfaces (such as spheres and cylinders) is the next level of complexity. Both these regular shapes are encountered frequently in Professional Audio Video (Pro AV) situations, in the form of domed or curved wall theatres. Other commonly encountered regular-shaped surfaces are subway walls and pillars.
Image Geometry Correction onto irregular surfaces is the most advanced form. This type of projection is common in architectural installations such as casinos.
Edge Blending is a companion application to image geometry correction. Edge blending enables the seamless projection of a large image using several overlapping projectors. Since Keystone Distortion (and frequently the requirement of projection onto a non-flat surface) is a built-in requirement of almost all Edge Blending systems, the pairing of Edge blending and image geometry correction in the same video signal processor is a natural one.
News
* Wired Magazine – Flexible Picture Systems Image AnyPlace-200 Video Upscaler
* White Paper - Geometry Correction
See also
* Geometry correction
*
Image warping
Image warping is the process of digitally manipulating an image such that any shapes portrayed in the image have been significantly distorted. Warping may be used for correcting image distortion as well as for creative purposes (e.g., morphingB ...
* Edge Blending
*
Softwarp {{Short description, Software TechniqueSoftwarp is a software technique to warp an image so that it can be projected on a curved screen. This can be done in real time by inserting the softwarp as a last step in the rendering cycle. The problem is to ...
*
Warpalizer
External links
* http://www.immersaview.com
* http://fly.elise-ng.net
* http://www.warpalizer.com
* http://www.flexiblepicturesystems.com
* http://www.mersive.com
* http://www.scalabledisplay.com
* http://www.showlogix.com
* http://www.vioso.com
References
{{DEFAULTSORT:Image Geometry Correction
Image processing