10 lines
16 KiB
HTML
10 lines
16 KiB
HTML
<!DOCTYPE html>
|
||
<html lang="en"><head><meta charset="UTF-8"/><meta name="viewport" content="width=device-width, initial-scale=1.0"/><title>High-level Overview of the Native-Code Generation Process · The Julia Language</title><script>(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
|
||
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
|
||
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
|
||
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
|
||
|
||
ga('create', 'UA-28835595-6', 'auto');
|
||
ga('send', 'pageview');
|
||
</script><link href="https://cdnjs.cloudflare.com/ajax/libs/normalize/4.2.0/normalize.min.css" rel="stylesheet" type="text/css"/><link href="https://fonts.googleapis.com/css?family=Lato|Roboto+Mono" rel="stylesheet" type="text/css"/><link href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.6.3/css/font-awesome.min.css" rel="stylesheet" type="text/css"/><link href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/9.12.0/styles/default.min.css" rel="stylesheet" type="text/css"/><script>documenterBaseURL=".."</script><script src="https://cdnjs.cloudflare.com/ajax/libs/require.js/2.2.0/require.min.js" data-main="../assets/documenter.js"></script><script src="../siteinfo.js"></script><script src="../../versions.js"></script><link href="../assets/documenter.css" rel="stylesheet" type="text/css"/><link href="../assets/julia-manual.css" rel="stylesheet" type="text/css"/></head><body><nav class="toc"><a href="../index.html"><img class="logo" src="../assets/logo.png" alt="The Julia Language logo"/></a><h1>The Julia Language</h1><select id="version-selector" onChange="window.location.href=this.value" style="visibility: hidden"></select><form class="search" id="search-form" action="../search.html"><input id="search-query" name="q" type="text" placeholder="Search docs"/></form><ul><li><a class="toctext" href="../index.html">Home</a></li><li><span class="toctext">Manual</span><ul><li><a class="toctext" href="../manual/introduction.html">Introduction</a></li><li><a class="toctext" href="../manual/getting-started.html">Getting Started</a></li><li><a class="toctext" href="../manual/variables.html">Variables</a></li><li><a class="toctext" href="../manual/integers-and-floating-point-numbers.html">Integers and Floating-Point Numbers</a></li><li><a class="toctext" href="../manual/mathematical-operations.html">Mathematical Operations and Elementary Functions</a></li><li><a class="toctext" href="../manual/complex-and-rational-numbers.html">Complex and Rational Numbers</a></li><li><a class="toctext" href="../manual/strings.html">Strings</a></li><li><a class="toctext" href="../manual/functions.html">Functions</a></li><li><a class="toctext" href="../manual/control-flow.html">Control Flow</a></li><li><a class="toctext" href="../manual/variables-and-scoping.html">Scope of Variables</a></li><li><a class="toctext" href="../manual/types.html">Types</a></li><li><a class="toctext" href="../manual/methods.html">Methods</a></li><li><a class="toctext" href="../manual/constructors.html">Constructors</a></li><li><a class="toctext" href="../manual/conversion-and-promotion.html">Conversion and Promotion</a></li><li><a class="toctext" href="../manual/interfaces.html">Interfaces</a></li><li><a class="toctext" href="../manual/modules.html">Modules</a></li><li><a class="toctext" href="../manual/documentation.html">Documentation</a></li><li><a class="toctext" href="../manual/metaprogramming.html">Metaprogramming</a></li><li><a class="toctext" href="../manual/arrays.html">Multi-dimensional Arrays</a></li><li><a class="toctext" href="../manual/linear-algebra.html">Linear algebra</a></li><li><a class="toctext" href="../manual/networking-and-streams.html">Networking and Streams</a></li><li><a class="toctext" href="../manual/parallel-computing.html">Parallel Computing</a></li><li><a class="toctext" href="../manual/dates.html">Date and DateTime</a></li><li><a class="toctext" href="../manual/interacting-with-julia.html">Interacting With Julia</a></li><li><a class="toctext" href="../manual/running-external-programs.html">Running External Programs</a></li><li><a class="toctext" href="../manual/calling-c-and-fortran-code.html">Calling C and Fortran Code</a></li><li><a class="toctext" href="../manual/handling-operating-system-variation.html">Handling Operating System Variation</a></li><li><a class="toctext" href="../manual/environment-variables.html">Environment Variables</a></li><li><a class="toctext" href="../manual/embedding.html">Embedding Julia</a></li><li><a class="toctext" href="../manual/packages.html">Packages</a></li><li><a class="toctext" href="../manual/profile.html">Profiling</a></li><li><a class="toctext" href="../manual/stacktraces.html">Stack Traces</a></li><li><a class="toctext" href="../manual/performance-tips.html">Performance Tips</a></li><li><a class="toctext" href="../manual/workflow-tips.html">Workflow Tips</a></li><li><a class="toctext" href="../manual/style-guide.html">Style Guide</a></li><li><a class="toctext" href="../manual/faq.html">Frequently Asked Questions</a></li><li><a class="toctext" href="../manual/noteworthy-differences.html">Noteworthy Differences from other Languages</a></li><li><a class="toctext" href="../manual/unicode-input.html">Unicode Input</a></li></ul></li><li><span class="toctext">Standard Library</span><ul><li><a class="toctext" href="../stdlib/base.html">Essentials</a></li><li><a class="toctext" href="../stdlib/collections.html">Collections and Data Structures</a></li><li><a class="toctext" href="../stdlib/math.html">Mathematics</a></li><li><a class="toctext" href="../stdlib/numbers.html">Numbers</a></li><li><a class="toctext" href="../stdlib/strings.html">Strings</a></li><li><a class="toctext" href="../stdlib/arrays.html">Arrays</a></li><li><a class="toctext" href="../stdlib/parallel.html">Tasks and Parallel Computing</a></li><li><a class="toctext" href="../stdlib/linalg.html">Linear Algebra</a></li><li><a class="toctext" href="../stdlib/constants.html">Constants</a></li><li><a class="toctext" href="../stdlib/file.html">Filesystem</a></li><li><a class="toctext" href="../stdlib/io-network.html">I/O and Network</a></li><li><a class="toctext" href="../stdlib/punctuation.html">Punctuation</a></li><li><a class="toctext" href="../stdlib/sort.html">Sorting and Related Functions</a></li><li><a class="toctext" href="../stdlib/pkg.html">Package Manager Functions</a></li><li><a class="toctext" href="../stdlib/dates.html">Dates and Time</a></li><li><a class="toctext" href="../stdlib/iterators.html">Iteration utilities</a></li><li><a class="toctext" href="../stdlib/test.html">Unit Testing</a></li><li><a class="toctext" href="../stdlib/c.html">C Interface</a></li><li><a class="toctext" href="../stdlib/libc.html">C Standard Library</a></li><li><a class="toctext" href="../stdlib/libdl.html">Dynamic Linker</a></li><li><a class="toctext" href="../stdlib/profile.html">Profiling</a></li><li><a class="toctext" href="../stdlib/stacktraces.html">StackTraces</a></li><li><a class="toctext" href="../stdlib/simd-types.html">SIMD Support</a></li></ul></li><li><span class="toctext">Developer Documentation</span><ul><li><a class="toctext" href="reflection.html">Reflection and introspection</a></li><li><span class="toctext">Documentation of Julia's Internals</span><ul><li><a class="toctext" href="init.html">Initialization of the Julia runtime</a></li><li><a class="toctext" href="ast.html">Julia ASTs</a></li><li><a class="toctext" href="types.html">More about types</a></li><li><a class="toctext" href="object.html">Memory layout of Julia Objects</a></li><li><a class="toctext" href="eval.html">Eval of Julia code</a></li><li><a class="toctext" href="callconv.html">Calling Conventions</a></li><li class="current"><a class="toctext" href="compiler.html">High-level Overview of the Native-Code Generation Process</a><ul class="internal"><li><a class="toctext" href="#Representation-of-Pointers-1">Representation of Pointers</a></li><li><a class="toctext" href="#Representation-of-Intermediate-Values-1">Representation of Intermediate Values</a></li><li><a class="toctext" href="#Union-representation-1">Union representation</a></li><li><a class="toctext" href="#Specialized-Calling-Convention-Signature-Representation-1">Specialized Calling Convention Signature Representation</a></li></ul></li><li><a class="toctext" href="functions.html">Julia Functions</a></li><li><a class="toctext" href="cartesian.html">Base.Cartesian</a></li><li><a class="toctext" href="meta.html">Talking to the compiler (the <code>:meta</code> mechanism)</a></li><li><a class="toctext" href="subarrays.html">SubArrays</a></li><li><a class="toctext" href="sysimg.html">System Image Building</a></li><li><a class="toctext" href="llvm.html">Working with LLVM</a></li><li><a class="toctext" href="stdio.html">printf() and stdio in the Julia runtime</a></li><li><a class="toctext" href="boundscheck.html">Bounds checking</a></li><li><a class="toctext" href="locks.html">Proper maintenance and care of multi-threading locks</a></li><li><a class="toctext" href="offset-arrays.html">Arrays with custom indices</a></li><li><a class="toctext" href="libgit2.html">Base.LibGit2</a></li><li><a class="toctext" href="require.html">Module loading</a></li></ul></li><li><span class="toctext">Developing/debugging Julia's C code</span><ul><li><a class="toctext" href="backtraces.html">Reporting and analyzing crashes (segfaults)</a></li><li><a class="toctext" href="debuggingtips.html">gdb debugging tips</a></li><li><a class="toctext" href="valgrind.html">Using Valgrind with Julia</a></li><li><a class="toctext" href="sanitizers.html">Sanitizer support</a></li></ul></li></ul></li></ul></nav><article id="docs"><header><nav><ul><li>Developer Documentation</li><li>Documentation of Julia's Internals</li><li><a href="compiler.html">High-level Overview of the Native-Code Generation Process</a></li></ul><a class="edit-page" href="https://github.com/JuliaLang/julia/blob/master/doc/src/devdocs/compiler.md"><span class="fa"></span> Edit on GitHub</a></nav><hr/><div id="topbar"><span>High-level Overview of the Native-Code Generation Process</span><a class="fa fa-bars" href="#"></a></div></header><h1><a class="nav-anchor" id="High-level-Overview-of-the-Native-Code-Generation-Process-1" href="#High-level-Overview-of-the-Native-Code-Generation-Process-1">High-level Overview of the Native-Code Generation Process</a></h1><h2><a class="nav-anchor" id="Representation-of-Pointers-1" href="#Representation-of-Pointers-1">Representation of Pointers</a></h2><p>When emitting code to an object file, pointers will be emitted as relocations. The deserialization code will ensure any object that pointed to one of these constants gets recreated and contains the right runtime pointer.</p><p>Otherwise, they will be emitted as literal constants.</p><p>To emit one of these objects, call <code>literal_pointer_val</code>. It'll handle tracking the Julia value and the LLVM global, ensuring they are valid both for the current runtime and after deserialization.</p><p>When emitted into the object file, these globals are stored as references in a large <code>gvals</code> table. This allows the deserializer to reference them by index, and implement a custom manual mechanism similar to a Global Offset Table (GOT) to restore them.</p><p>Function pointers are handled similarly. They are stored as values in a large <code>fvals</code> table. Like globals, this allows the deserializer to reference them by index.</p><p>Note that <code>extern</code> functions are handled separately, with names, via the usual symbol resolution mechanism in the linker.</p><p>Note too that <code>ccall</code> functions are also handled separately, via a manual GOT and Procedure Linkage Table (PLT).</p><h2><a class="nav-anchor" id="Representation-of-Intermediate-Values-1" href="#Representation-of-Intermediate-Values-1">Representation of Intermediate Values</a></h2><p>Values are passed around in a <code>jl_cgval_t</code> struct. This represents an R-value, and includes enough information to determine how to assign or pass it somewhere.</p><p>They are created via one of the helper constructors, usually: <code>mark_julia_type</code> (for immediate values) and <code>mark_julia_slot</code> (for pointers to values).</p><p>The function <code>convert_julia_type</code> can transform between any two types. It returns an R-value with <code>cgval.typ</code> set to <code>typ</code>. It'll cast the object to the requested representation, making heap boxes, allocating stack copies, and computing tagged unions as needed to change the representation.</p><p>By contrast <code>update_julia_type</code> will change <code>cgval.typ</code> to <code>typ</code>, only if it can be done at zero-cost (i.e. without emitting any code).</p><h2><a class="nav-anchor" id="Union-representation-1" href="#Union-representation-1">Union representation</a></h2><p>Inferred union types may be stack allocated via a tagged type representation.</p><p>The primitive routines that need to be able to handle tagged unions are:</p><ul><li><p>mark-type</p></li><li><p>load-local</p></li><li><p>store-local</p></li><li><p>isa</p></li><li><p>is</p></li><li><p>emit_typeof</p></li><li><p>emit_sizeof</p></li><li><p>boxed</p></li><li><p>unbox</p></li><li><p>specialized cc-ret</p></li></ul><p>Everything else should be possible to handle in inference by using these primitives to implement union-splitting.</p><p>The representation of the tagged-union is as a pair of <code>< void* union, byte selector ></code>. The selector is fixed-size as <code>byte & 0x7f</code>, and will union-tag the first 126 isbits. It records the one-based depth-first count into the type-union of the isbits objects inside. An index of zero indicates that the <code>union*</code> is actually a tagged heap-allocated <code>jl_value_t*</code>, and needs to be treated as normal for a boxed object rather than as a tagged union.</p><p>The high bit of the selector (<code>byte & 0x80</code>) can be tested to determine if the <code>void*</code> is actually a heap-allocated (<code>jl_value_t*</code>) box, thus avoiding the cost of re-allocating a box, while maintaining the ability to efficiently handle union-splitting based on the low bits.</p><p>It is guaranteed that <code>byte & 0x7f</code> is an exact test for the type, if the value can be represented by a tag – it will never be marked <code>byte = 0x80</code>. It is not necessary to also test the type-tag when testing <code>isa</code>.</p><p>The <code>union*</code> memory region may be allocated at <em>any</em> size. The only constraint is that it is big enough to contain the data currently specified by <code>selector</code>. It might not be big enough to contain the union of all types that could be stored there according to the associated Union type field. Use appropriate care when copying.</p><h2><a class="nav-anchor" id="Specialized-Calling-Convention-Signature-Representation-1" href="#Specialized-Calling-Convention-Signature-Representation-1">Specialized Calling Convention Signature Representation</a></h2><p>A <code>jl_returninfo_t</code> object describes the calling convention details of any callable.</p><p>If any of the arguments or return type of a method can be represented unboxed, and the method is not varargs, it'll be given an optimized calling convention signature based on its <code>specTypes</code> and <code>rettype</code> fields.</p><p>The general principles are that:</p><ul><li><p>Primitive types get passed in int/float registers.</p></li><li><p>Tuples of VecElement types get passed in vector registers.</p></li><li><p>Structs get passed on the stack.</p></li><li><p>Return values are handle similarly to arguments, with a size-cutoff at which they will instead be returned via a hidden sret argument.</p></li></ul><p>The total logic for this is implemented by <code>get_specsig_function</code> and <code>deserves_sret</code>.</p><p>Additionally, if the return type is a union, it may be returned as a pair of values (a pointer and a tag). If the union values can be stack-allocated, then sufficient space to store them will also be passed as a hidden first argument. It is up to the callee whether the returned pointer will point to this space, a boxed object, or even other constant memory.</p><footer><hr/><a class="previous" href="callconv.html"><span class="direction">Previous</span><span class="title">Calling Conventions</span></a><a class="next" href="functions.html"><span class="direction">Next</span><span class="title">Julia Functions</span></a></footer></article></body></html>
|