Polyhedral model

The polyhedral model (also called the polytope method) is a mathematical framework for programs that perform large numbers of operations -- too large to be explicitly enumerated -- thereby requiring a ''compact'' representation. Nested loop programs are the typical, but not the only example, and the most common use of the model is for loop nest optimization in program optimization. The polyhedral method treats each loop iteration within nested loops as lattice points inside mathematical objects called polyhedra, performs affine transformations or more general non-affine transformations such as tiling on the polytopes, and then converts the transformed polytopes into equivalent, but optimized (depending on targeted optimization goal), loop nests through polyhedra scanning.

Simple example

Consider the following example written in C:

const int n = 100;
int i, j, a n];

for (i = 1; i < n; i++)

The essential problem with this code is that each iteration of the inner loop on a j] requires that the previous iteration's result, a j - 1], be available already. Therefore, this code cannot be parallelized or Pipeline (computing), pipelined as it is currently written.

An application of the polytope model, with the affine transformation $(i',\, j') = (i+j,\, j)$ and the appropriate change in the boundaries, will transform the nested loops above into:

a - jj] = a - j - 1j] + a - jj - 1];

In this case, no iteration of the inner loop depends on the previous iteration's results; the entire inner loop can be executed in parallel. (However, each iteration of the outer loop does depend on previous iterations.)

Detailed example

The following C code implements a form of error-distribution dithering similar to Floyd–Steinberg dithering, but modified for pedagogical reasons. The two-dimensional array src contains h rows of w pixels, each pixel having a grayscale value between 0 and 255 inclusive. After the routine has finished, the output array dst will contain only pixels with value 0 or value 255. During the computation, each pixel's dithering error is collected by adding it back into the src array. (Notice that src and dst are both read and written during the computation; src is not read-only, and dst is not write-only.)

Each iteration of the inner loop modifies the values in src j] based on the values of src -1j], src j-1], and src +1j-1]. (The same dependencies apply to dst j]. For the purposes of Loop optimization#Common loop transformations, loop skewing, we can think of src j] and dst j] as the same element.) We can illustrate the dependencies of src j] graphically, as in the diagram on the right.

Performing the affine transformation $(p,\, t) = (i,\, 2j+i)$ on the original dependency diagram gives us a new diagram, which is shown in the next image. We can then rewrite the code to loop on p and t instead of i and j, obtaining the following "skewed" routine.

See also

* Frameworks supporting the polyhedral model
* Loop nest optimization
* Loop optimization
* Loop unrolling
* Loop tiling

External links and references

"The basic polytope method"
tutorial by Martin Griebl containing diagrams of the pseudocode example above
"Code Generation in the Polytope Model"
(1998). Martin Griebl, Christian Lengauer, and Sabine Wetzel
"The CLooG Polyhedral Code Generator""CodeGen+: Z-polyhedra scanning"PoCC: the Polyhedral Compiler CollectionPLUTO - An automatic parallelizer and locality optimizer for affine loop nests
**{{Cite book, last1=Bondhugula, first1=Uday, last2=Hartono, first2=Albert, last3=Ramanujam, first3=J., last4=Sadayappan, first4=P., date=2008-01-01, title=A Practical Automatic Polyhedral Parallelizer and Locality Optimizer, journal=Proceedings of the 29th ACM SIGPLAN Conference on Programming Language Design and Implementation, series=PLDI '08, location=New York, NY, USA, publisher=ACM, pages=101–113, doi=10.1145/1375581.1375595, isbn=9781595938602, s2cid=7086982
polyhedral.info
- A website that collect information about polyhedral compilation
Polly - LLVM Framework for High-Level Loop and Data-Locality Optimizations
*The MI
Tiramisu Polyhedral
Framework.

Compiler optimizations
Articles with example pseudocode
Articles with example C code