Polyglot (computing)

In computing, a polyglot is a computer program or script written in a valid form of multiple programming languages or file formats. The name was coined by analogy to multilingualism. A polyglot file is composed by combining syntax from two or more different formats. When the file formats are to be compiled or interpreted as source code, the file can be said to be a polyglot program, though file formats and source code syntax are both fundamentally streams of bytes, and exploiting this commonality is key to the development of polyglots. Polyglot files have practical applications in compatibility, but can also present a security risk when used to bypass validation or to exploit a vulnerability.

History

Polyglot programs have been crafted as challenges and curios in hacker culture since at least the early 1990s. A notable early example, named simply polyglot was published on the Usenet group rec.puzzles in 1991, supporting 8 languages, though this was inspired by even earlier programs. In 2000, a polyglot program was named a winner in the International Obfuscated C Code Contest.

In the 21st century, polyglot programs and files gained attention as a covert channel mechanism for propagation of malware.

Construction

A polyglot is composed by combining syntax from two or more different formats, leveraging various syntactic constructs that are either common between the formats, or constructs that are language specific but carrying different meaning in each language. A file is a valid polyglot if it can be successfully interpreted by multiple interpreting programs. For example, a PDF-Zip polyglot might be opened as both a valid PDF document and decompressed as a valid zip archive. To maintain validity across interpreting programs, one must ensure that constructs specific to one interpreter are not interpreted by another, and vice versa.
This is often accomplished by hiding language-specific constructs in segments interpreted as comments or plain text of the other format.

Examples

C, PHP, and Bash

Two commonly used techniques for constructing a polyglot program are to make use of languages that use different characters for comments, and to redefine various tokens as others in different languages. These are demonstrated in this public domain polyglot written in ANSI C, PHP and bash:

#define a /*
# /dev/null > /dev/null \ ;
// 2> /dev/null; x=a;
$x=5; // 2> /dev/null \ ;
if (($x))
// 2> /dev/null; then
return 0;
// 2> /dev/null; fi
#define e ?>
#define b */
#include
#define main() int main(void)
#define printf printf(
#define true )
#define function
function main()

#define c /*
main
#*/

Note the following:
*A hash sign marks a preprocessor statement in C, but is a comment in both bash and PHP.
*"//" is a comment in both PHP and C and the root directory in bash.
*Shell redirection is used to eliminate undesirable outputs.
*Even on commented out lines, the "<?php" and "?>" PHP indicators still have effect.
*The statement "function main()" is valid in both PHP and bash; C #defines are used to convert it into "int main(void)" at compile time.
*Comment indicators can be combined to perform various operations.
*"if (($x))" is a valid statement in both bash and PHP.
*printf is a bash shell builtin which is identical to the C printf except for its omission of brackets (which the C preprocessor adds if this is compiled with a C compiler).
*The final three lines are only used by bash, to call the main function. In PHP the main function is defined but not called and in C there is no need to explicitly call the main function.

SNOBOL4, Win32Forth, PureBasicv4.x, and REBOL

The following is written simultaneously in SNOBOL4, Win32Forth, PureBasicv4.x, and REBOL:

*BUFFER : A.A ; .( Hello, world !) @ To Including?
Macro SkipThis; OUTPUT = Char(10) "Hello, World !"
;OneKeyInput Input('Char', 1, ' f2-q1) ; Char
End; SNOBOL4 + PureBASIC + Win32Forth + REBOL = <3
EndMacro: OpenConsole() : PrintN("Hello, world !")
Repeat : Until Inkey() : Macro SomeDummyMacroHere
REBOL Title: "'Hello, World !' in 4 languages"
CopyLeft: "Developed in 2010 by Society" Print
"Hello, world !" EndMacro: func [][] set-modes
system/ports/input [binary: true] Input set-modes
system/ports/input [binary: false] NOP:: EndMacro
; Wishing to refine it with new language ? Go on !

DOS batch file and Perl

The following file runs as a DOS batch file, then re-runs itself in Perl:

@rem = ' --PERL--
@echo off
perl "%~dpnx0" %*
goto endofperl
@rem ';
#!perl
print "Hello, world!\n";
__END__
:endofperl

This allows creating Perl scripts that can be run on DOS systems with minimal effort. Note that there is no requirement for a file to perform exactly the same function in the different interpreters.

Types

Polyglot types include:

* ''stacks'', where multiple files are concatenated with each other
* ''parasites'' where a secondary file format is hidden within comment fields in a primary file format
* ''zippers'' where two files are mutually arranged within each others' comments
* ''cavities'', where a secondary file format is hidden within null-padded areas of the primary file.

Benefits

Polyglot markup

Polyglot markup has been proposed as a useful combination of the benefits of HTML5 and XHTML. Such documents can be parsed as either HTML (which is SGML-compatible) or XML, and will produce the same DOM structure either way. For example, in order for an HTML5 document to meet these criteria, the two requirements are that it must have an HTML5 doctype, and be written in well-formed XHTML. The same document can then be served as either HTML or XHTML, depending on browser support and MIME type.

As expressed by the ''html-polyglot recommendation'', to write a polyglot HTML5 document, the following key points should be observed:

# Processing instructions and the XML declaration are both forbidden in polyglot markup
# Specifying a document’s character encoding
# The DOCTYPE
# Namespaces
# Element syntax (i.e. End tags are not optional. Use self-closing tags for void elements.)
# Element content
# Text (i.e. pre and textarea should not start with newline character)
# Attributes (i.e. Values must be quoted)
# Named entity references (i.e. Only amp, lt, gt, apos, quot)
# Comments (i.e. Use <!-- syntax -->)
# Scripting and styling polyglot markup

The most basic possible polyglot markup document would therefore look like this:

In a polyglot markup document non-void elements (such as script, p, div) cannot be self-closing even if they are empty, as this is not valid HTML. For example, to add an empty textarea to a page, one cannot use </nowiki></code>, but has to use <code><nowiki><textarea> instead.

Composing formats

The DICOM medical imaging format was designed to allow polyglotting with TIFF files, allowing efficient storage of the same image data in a file that can be interpreted by either DICOM or TIFF viewers.

Compatibility

The Python 2 and Python 3 programming languages were not designed to be compatible with each other, but there is sufficient commonality of syntax that a polyglot Python program can be written than runs in both versions.

Security Implications

A polyglot of two formats may steganographically compose a malicious payload within an ostensibly benign and widely accepted wrapper
format, such as a JPEG file that allows arbitrary data in its comment field. A vulnerable JPEG renderer could then be coerced into executing the payload, handing control to the attacker. The mismatch between what the interpreting program expects, and what the file actually contains, is the root cause of the vulnerability.

SQL Injection is a trivial form of polyglot, where a server naively expects user-controlled input to conform to a certain constraint, but the user supplies syntax which is interpreted as SQL code.

Note that in a security context, there is no requirement for a polyglot file to be strictly valid in multiple formats; it is sufficient for the file to trigger unintended behaviour when being interpreted by its primary interpreter.

Highly flexible or extensible file formats have greater scope for polyglotting, and therefore more tightly constrained interpretation offers some mitigation against attacks using polyglot techniques. For example, the PDF file format requires that the magic number %PDF appears at byte offset zero, but many PDF interpreters waive this constraint and accept the file as valid PDF as long as the string appears within the first 1024 bytes. This creates a window of opportunity for polyglot PDF files to smuggle non-PDF content in the header of the file. The PDF format has been described as "diverse and vague", and due to significantly varying behaviour between different PDF parsing engines, it is possible to create a PDF-PDF polyglot that renders as two entirely different documents in two different PDF readers.

Detecting malware concealed within polyglot files requires more sophisticated analysis than relying on file-type identification utilities such as file. In 2019, an evaluation of commercial anti-malware software determined that several such packages were unable to detect any of the polyglot malware under test.

In 2019, the DICOM medical imaging file format was found to be vulnerable to malware injection using a PE-DICOM polyglot technique. The polyglot nature of the attack, combined with regulatory considerations, led to disinfection complications: because "the malware is essentially fused to legitimate imaging files", "incident response teams and A/V software cannot delete the malware file as it contains protected patient health information".

GIFAR attack

Related terminology

* Polyglot programming, referring to the practise of building systems using multiple programming languages, but not necessarily in the same file.
* Polyglot persistence is similar, but about databases.

See also

* Quine (computing)

References

External links

CSE HTML Validator for Windows with polyglot markup supportBenefits of polyglot XHTML5

A polyglot in 378 different languages

A polyglot in 16 different languages

A polyglot in 8 different languages
(written in COBOL, Pascal, Fortran, C, PostScript, Unix shell, Intel x86 machine language and Perl 5)

A polyglot in 7 different languages
(written in C, Pascal, PostScript, TeX, Bash, Perl and Befunge98)

A polyglot in 6 different languages
(written in Perl, C, Unix shell, Brainfuck, Whitespace and Befunge)

List of generic polyglots

A PDF-MP3 polyglot, being a PDF document which is also an MP3 audio version of its content

PoC, , GTFO, a security publication published as polyglot PDF documents

{{DEFAULTSORT:Polyglot (Computing)
Computer programming
Source code
Steganography
Computer file formats