Compiler
Compiler
95 languages
Article
Talk
Read
Edit
View history
Tools
Appearance
hide
Text
Small
Standard
Large
Width
Standard
Wide
Color (beta)
Automatic
Light
Dark
From Wikipedia, the free encyclopedia
This article is about software to translate computer languages. For the manga,
see Compiler (manga).
"Compile" and "Compiling" redirect here. For the software company, see Compile
(company). For other uses, see Compilation.
Program execution
General concepts
Code
Translation
Compiler
Compile time
Optimizing compiler
Intermediate representation (IR)
Execution
Runtime system
Runtime
Executable
Interpreter
Virtual machine
Types of code
Source code
Object code
Bytecode
Machine code
Microcode
Compilation strategies
Ahead-of-time (AOT)
Just-in-time (JIT)
Tracing just-in-time
Compile and go system
Precompilation
Transcompilation
Recompilation
Notable runtimes
Android Runtime (ART)
BEAM (Erlang)
Common Language Runtime (CLR) and Mono
CPython and PyPy
crt0 (C target-specific initializer)
Java virtual machine (JVM)
LuaJIT
Objective-C and Swift's
V8 and Node.js
Zend Engine (PHP)
v
t
e
Related software include decompilers, programs that translate from low-level languages
to higher level ones; programs that translate between high-level languages, usually
called source-to-source compilers or transpilers; language rewriters, usually programs
that translate the form of expressions without a change of language; and compiler-
compilers, compilers that produce compilers (or parts of them), often in a generic and
reusable way so as to be able to produce many differing compilers.
A compiler is likely to perform some or all of the following operations, often called
phases: preprocessing, lexical analysis, parsing, semantic analysis (syntax-directed
translation), conversion of input programs to an intermediate representation, code
optimization and machine specific code generation. Compilers generally implement
these phases as modular components, promoting efficient design and correctness
of transformations of source input to target output. Program faults caused by incorrect
compiler behavior can be very difficult to track down and work around; therefore,
compiler implementers invest significant effort to ensure compiler correctness.[4]
A program compiled to native code tends to run faster than if interpreted. Environments
with a bytecode intermediate form tend toward intermediate speed. Just-in-time
compilation allows for native execution speed with a one-time startup processing time
cost.
Between 1942 and 1945, Konrad Zuse designed the first (algorithmic) programming
language for computers called Plankalkül ("Plan Calculus"). Zuse also envisioned
a Planfertigungsgerät ("Plan assembly device") to automatically translate the
mathematical formulation of a program into machine-readable punched film stock.
[10]
While no actual implementation occurred until the 1970s, it presented concepts later
seen in APL designed by Ken Iverson in the late 1950s.[11] APL is a language for
mathematical computations.
Between 1949 and 1951, Heinz Rutishauser proposed Superplan, a high-level language
and automatic translator.[12] His ideas were later refined by Friedrich L. Bauer and Klaus
Samelson.[13]
High-level language design during the formative years of digital computing provided
useful programming tools for a variety of applications:
May 1952: Grace Hopper's team at Remington Rand wrote the compiler for the A-
0 programming language (and coined the term compiler to describe it),[18][19]
[20]
although the A-0 compiler functioned more as a loader or linker than the modern
notion of a full compiler.[21][22][23]
1952, before September: An Autocode compiler developed by Alick Glennie for
the Manchester Mark I computer at the University of Manchester is considered by
some to be the first compiled programming language.[24]
1954–1957: A team led by John Backus at IBM developed FORTRAN which is
usually considered the first high-level language. In 1957, they completed a
FORTRAN compiler that is generally credited as having introduced the first
unambiguously complete compiler.[25]
1959: The Conference on Data Systems Language (CODASYL) initiated
development of COBOL. The COBOL design drew on A-0 and FLOW-MATIC. By
the early 1960s COBOL was compiled on multiple architectures.
1958–1960: Algol 58 was the precursor to ALGOL 60. It introduced code blocks, a
key advance in the rise of structured programming. ALGOL 60 was the first
language to implement nested function definitions with lexical scope. It
included recursion. Its syntax was defined using BNF. ALGOL 60 inspired many
languages that followed it. Tony Hoare remarked: "... it was not only an improvement
on its predecessors but also on nearly all its successors."[26][27]
1958–1962: John McCarthy at MIT designed LISP.[28] The symbol processing
capabilities provided useful features for artificial intelligence research. In 1962, LISP
1.5 release noted some tools: an interpreter written by Stephen Russell and Daniel
J. Edwards, a compiler and assembler written by Tim Hart and Mike Levin.[29]
Early operating systems and software were written in assembly language. In the 1960s
and early 1970s, the use of high-level languages for system programming was still
controversial due to resource limitations. However, several research and industry efforts
began the shift toward high-level systems programming languages, for
example, BCPL, BLISS, B, and C.
BLISS (Basic Language for Implementation of System Software) was developed for a
Digital Equipment Corporation (DEC) PDP-10 computer by W. A. Wulf's Carnegie
Mellon University (CMU) research team. The CMU team went on to develop BLISS-11
compiler one year later in 1970.
Bell Labs left the Multics project in 1969, and developed a system programming
language B based on BCPL concepts, written by Dennis Ritchie and Ken Thompson.
Ritchie created a boot-strapping compiler for B and wrote Unics (Uniplexed Information
and Computing Service) operating system for a PDP-7 in B. Unics eventually became
spelled Unix.
Bell Labs started the development and expansion of C based on B and BCPL. The
BCPL compiler had been transported to Multics by Bell Labs and BCPL was a preferred
language at Bell Labs.[38] Initially, a front-end program to Bell Labs' B compiler was used
while a C compiler was developed. In 1971, a new PDP-11 provided the resource to
define extensions to B and rewrite the compiler. By 1973 the design of C language was
essentially complete and the Unix kernel for a PDP-11 was rewritten in C. Steve
Johnson started development of Portable C Compiler (PCC) to support retargeting of C
compilers to new machines.[39][40]
In many application domains, the idea of using a higher-level language quickly caught
on. Because of the expanding functionality supported by newer programming
languages and the increasing complexity of computer architectures, compilers became
more complex.
PQCC research into code generation process sought to build a truly automatic compiler-
writing system. The effort discovered and designed the phase structure of the PQC. The
BLISS-11 compiler provided the initial structure.[45] The phases included analyses (front
end), intermediate translation to virtual machine (middle end), and translation to the
target (back end). TCOL was developed for the PQCC research to handle language
specific constructs in the intermediate representation.[46] Variations of TCOL supported
various languages. The PQCC project investigated techniques of automated compiler
construction. The design concepts proved useful in optimizing compilers and compilers
for the (since 1995, object-oriented) programming language Ada.
The Ada STONEMAN document[a] formalized the program support environment (APSE)
along with the kernel (KAPSE) and minimal (MAPSE). An Ada interpreter NYU/ED
supported development and standardization efforts with the American National
Standards Institute (ANSI) and the International Standards Organization (ISO). Initial
Ada compiler development by the U.S. Military Services included the compilers in a
complete integrated design environment along the lines of the STONEMAN document.
Army and Navy worked on the Ada Language System (ALS) project targeted to
DEC/VAX architecture while the Air Force started on the Ada Integrated Environment
(AIE) targeted to IBM 370 series. While the projects did not provide the desired results,
they did contribute to the overall effort on Ada development.[47]
Other Ada compiler efforts got underway in Britain at the University of York and in
Germany at the University of Karlsruhe. In the U. S., Verdix (later acquired by Rational)
delivered the Verdix Ada Development System (VADS) to the Army. VADS provided a
set of development tools including a compiler. Unix/VADS could be hosted on a variety
of Unix platforms such as DEC Ultrix and the Sun 3/60 Solaris targeted to Motorola
68020 in an Army CECOM evaluation.[48] There were soon many Ada compilers
available that passed the Ada Validation tests. The Free Software Foundation GNU
project developed the GNU Compiler Collection (GCC) which provides a core capability
to support multiple languages and targets. The Ada version GNAT is one of the most
widely used Ada compilers. GNAT is free but there is also commercial support, for
example, AdaCore, was founded in 1994 to provide commercial software solutions for
Ada. GNAT Pro includes the GNU GCC based GNAT with a tool suite to provide
an integrated development environment.
"When the field of compiling began in the late 50s, its focus was limited to the
translation of high-level language programs into machine code ... The compiler field is
increasingly intertwined with other disciplines including computer architecture,
programming languages, formal methods, software engineering, and computer
security."[50] The "Compiler Research: The Next 50 Years" article noted the importance
of object-oriented languages and Java. Security and parallel computing were cited
among the future research targets.
Compiler construction
[edit]
This section includes a list of general references, but it lacks sufficient
corresponding inline citations. Please help to improve this section
by introducing more precise citations. (December 2019) (Learn how and when to
remove this message)
In the early days, the approach taken to compiler design was directly affected by the
complexity of the computer language to be processed, the experience of the person(s)
designing it, and the resources available. Resource limitations led to the need to pass
through the source code more than once.
A compiler for a relatively simple language written by one person might be a single,
monolithic piece of software. However, as the source language grows in complexity the
design may be split into a number of interdependent phases. Separate phases provide
design improvements that focus development on the functions in the compilation
process.
The ability to compile in a single pass has classically been seen as a benefit because it
simplifies the job of writing a compiler and one-pass compilers generally perform
compilations faster than multi-pass compilers. Thus, partly driven by the resource
limitations of early systems, many early languages were specifically designed so that
they could be compiled in a single pass (e.g., Pascal).
In some cases, the design of a language feature may require a compiler to perform
more than one pass over the source. For instance, consider a declaration appearing on
line 20 of the source which affects the translation of a statement appearing on line 10. In
this case, the first pass needs to gather information about declarations appearing after
statements that they affect, with the actual translation happening during a subsequent
pass.
The disadvantage of compiling in a single pass is that it is not possible to perform many
of the sophisticated optimizations needed to generate high quality code. It can be
difficult to count exactly how many passes an optimizing compiler makes. For instance,
different phases of optimization may analyse one expression many times but only
analyse another expression once.
Compiler design
Regardless of the exact number of phases in the compiler design, the phases can be
assigned to one of three stages. The stages include a front end, a middle end, and a
back end.
The front end scans the input and verifies syntax and semantics according to a
specific source language. For statically typed languages it performs type
checking by collecting type information. If the input program is syntactically incorrect
or has a type error, it generates error and/or warning messages, usually identifying
the location in the source code where the problem was detected; in some cases the
actual error may be (much) earlier in the program. Aspects of the front end include
lexical analysis, syntax analysis, and semantic analysis. The front end transforms
the input program into an intermediate representation (IR) for further processing by
the middle end. This IR is usually a lower-level representation of the program with
respect to the source code.
The middle end performs optimizations on the IR that are independent of the CPU
architecture being targeted. This source code/machine code independence is
intended to enable generic optimizations to be shared between versions of the
compiler supporting different languages and target processors. Examples of middle
end optimizations are removal of useless (dead-code elimination) or unreachable
code (reachability analysis), discovery and propagation of constant values (constant
propagation), relocation of computation to a less frequently executed place (e.g., out
of a loop), or specialization of computation based on the context, eventually
producing the "optimized" IR that is used by the back end.
The back end takes the optimized IR from the middle end. It may perform more
analysis, transformations and optimizations that are specific for the target CPU
architecture. The back end generates the target-dependent assembly code,
performing register allocation in the process. The back end performs instruction
scheduling, which re-orders instructions to keep parallel execution units busy by
filling delay slots. Although most optimization problems are NP-
hard, heuristic techniques for solving them are well-developed and implemented in
production-quality compilers. Typically the output of a back end is machine code
specialized for a particular processor and operating system.
This front/middle/back-end approach makes it possible to combine front ends for
different languages with back ends for different CPUs while sharing the optimizations of
the middle end.[51] Practical examples of this approach are the GNU Compiler
Collection, Clang (LLVM-based C/C++ compiler),[52] and the Amsterdam Compiler Kit,
which have multiple front-ends, shared optimizations and multiple back-ends.
Front end
[edit]
Line reconstruction converts the input character sequence to a canonical form ready
for the parser. Languages which strop their keywords or allow arbitrary spaces
within identifiers require this phase. The top-down, recursive-descent, table-driven
parsers used in the 1960s typically read the source one character at a time and did
not require a separate tokenizing phase. Atlas Autocode and Imp (and some
implementations of ALGOL and Coral 66) are examples of stropped languages
whose compilers would have a Line Reconstruction phase.
Preprocessing supports macro substitution and conditional compilation. Typically the
preprocessing phase occurs before syntactic or semantic analysis; e.g. in the case
of C, the preprocessor manipulates lexical tokens rather than syntactic forms.
However, some languages such as Scheme support macro substitutions based on
syntactic forms.
Lexical analysis (also known as lexing or tokenization) breaks the source code text
into a sequence of small pieces called lexical tokens.[53] This phase can be divided
into two stages: the scanning, which segments the input text into syntactic units
called lexemes and assigns them a category; and the evaluating, which converts
lexemes into a processed value. A token is a pair consisting of a token name and an
optional token value.[54] Common token categories may include identifiers, keywords,
separators, operators, literals and comments, although the set of token categories
varies in different programming languages. The lexeme syntax is typically a regular
language, so a finite-state automaton constructed from a regular expression can be
used to recognize it. The software doing lexical analysis is called a lexical analyzer.
This may not be a separate step—it can be combined with the parsing step
in scannerless parsing, in which case parsing is done at the character level, not the
token level.
Syntax analysis (also known as parsing) involves parsing the token sequence to
identify the syntactic structure of the program. This phase typically builds a parse
tree, which replaces the linear sequence of tokens with a tree structure built
according to the rules of a formal grammar which define the language's syntax. The
parse tree is often analyzed, augmented, and transformed by later phases in the
compiler.[55]
Semantic analysis adds semantic information to the parse tree and builds
the symbol table. This phase performs semantic checks such as type
checking (checking for type errors), or object binding (associating variable and
function references with their definitions), or definite assignment (requiring all local
variables to be initialized before use), rejecting incorrect programs or issuing
warnings. Semantic analysis usually requires a complete parse tree, meaning that
this phase logically follows the parsing phase, and logically precedes the code
generation phase, though it is often possible to fold multiple phases into one pass
over the code in a compiler implementation.
Middle end
[edit]
The middle end, also known as optimizer, performs optimizations on the intermediate
representation in order to improve the performance and the quality of the produced
machine code.[56] The middle end contains those optimizations that are independent of
the CPU architecture being targeted.
The scope of compiler analysis and optimizations vary greatly; their scope may range
from operating within a basic block, to whole procedures, or even the whole program.
There is a trade-off between the granularity of the optimizations and the cost of
compilation. For example, peephole optimizations are fast to perform during compilation
but only affect a small local fragment of the code, and can be performed independently
of the context in which the code fragment appears. In contrast, interprocedural
optimization requires more compilation time and memory space, but enable
optimizations that are only possible by considering the behavior of multiple functions
simultaneously.
Due to the extra time and space needed for compiler analysis and optimizations, some
compilers skip them by default. Users have to use compilation options to explicitly tell
the compiler which optimizations should be enabled.
Back end
[edit]
The back end is responsible for the CPU architecture specific optimizations and
for code generation.[56]
Interpretation does not replace compilation completely. It only hides it from the user and
makes it gradual. Even though an interpreter can itself be interpreted, a set of directly
executed machine instructions is needed somewhere at the bottom of the execution
stack (see machine language).
Some language specifications spell out that implementations must include a compilation
facility; for example, Common Lisp. However, there is nothing inherent in the definition
of Common Lisp that stops it from being interpreted. Other languages have features that
are very easy to implement in an interpreter, but make writing a compiler much harder;
for example, APL, SNOBOL4, and many scripting languages allow programs to
construct arbitrary source code at runtime with regular string operations, and then
execute that code by passing it to a special evaluation function. To implement these
features in a compiled language, programs must usually be shipped with a runtime
library that includes a version of the compiler itself.
Types
[edit]
One classification of compilers is by the platform on which their generated code
executes. This is known as the target platform.
A native or hosted compiler is one whose output is intended to directly run on the same
type of computer and operating system that the compiler itself runs on. The output of
a cross compiler is designed to run on a different platform. Cross compilers are often
used when developing software for embedded systems that are not intended to support
a software development environment.
The output of a compiler that produces code for a virtual machine (VM) may or may not
be executed on the same platform as the compiler that produced it. For this reason,
such compilers are not usually classified as native or cross compilers.
The lower level language that is the target of a compiler may itself be a high-level
programming language. C, viewed by some as a sort of portable assembly language, is
frequently the target language of such compilers. For example, Cfront, the original
compiler for C++, used C as its target language. The C code generated by such a
compiler is usually not intended to be readable and maintained by humans, so indent
style and creating pretty C intermediate code are ignored. Some of the features of C
that make it a good target language include the #line directive, which can be generated
by the compiler to support debugging of the original source, and the wide platform
support available with C compilers.
While a common compiler type outputs machine code, there are many other types: