| =============== |
| LLVMBuild Guide |
| =============== |
| |
| .. contents:: |
| :local: |
| |
| Introduction |
| ============ |
| |
| This document describes the ``LLVMBuild`` organization and files which |
| we use to describe parts of the LLVM ecosystem. For description of |
| specific LLVMBuild related tools, please see the command guide. |
| |
| LLVM is designed to be a modular set of libraries which can be flexibly |
| mixed together in order to build a variety of tools, like compilers, |
| JITs, custom code generators, optimization passes, interpreters, and so |
| on. Related projects in the LLVM system like Clang and LLDB also tend to |
| follow this philosophy. |
| |
| In order to support this usage style, LLVM has a fairly strict structure |
| as to how the source code and various components are organized. The |
| ``LLVMBuild.txt`` files are the explicit specification of that |
| structure, and are used by the build systems and other tools in order to |
| develop the LLVM project. |
| |
| Project Organization |
| ==================== |
| |
| The source code for LLVM projects using the LLVMBuild system (LLVM, |
| Clang, and LLDB) is organized into *components*, which define the |
| separate pieces of functionality that make up the project. These |
| projects may consist of many libraries, associated tools, build tools, |
| or other utility tools (for example, testing tools). |
| |
| For the most part, the project contents are organized around defining |
| one main component per each subdirectory. Each such directory contains |
| an ``LLVMBuild.txt`` which contains the component definitions. |
| |
| The component descriptions for the project as a whole are automatically |
| gathered by the LLVMBuild tools. The tools automatically traverse the |
| source directory structure to find all of the component description |
| files. NOTE: For performance/sanity reasons, we only traverse into |
| subdirectories when the parent itself contains an ``LLVMBuild.txt`` |
| description file. |
| |
| Build Integration |
| ================= |
| |
| The LLVMBuild files themselves are just a declarative way to describe |
| the project structure. The actual building of the LLVM project is |
| handled by another build system (See: :doc:`CMake <CMake>`). |
| |
| The build system implementation will load the relevant contents of the |
| LLVMBuild files and use that to drive the actual project build. |
| Typically, the build system will only need to load this information at |
| "configure" time, and use it to generate native information. Build |
| systems will also handle automatically reconfiguring their information |
| when the contents of the ``LLVMBuild.txt`` files change. |
| |
| Developers generally are not expected to need to be aware of the details |
| of how the LLVMBuild system is integrated into their build. Ideally, |
| LLVM developers who are not working on the build system would only ever |
| need to modify the contents of the ``LLVMBuild.txt`` description files |
| (although we have not reached this goal yet). |
| |
| For more information on the utility tool we provide to help interfacing |
| with the build system, please see the :doc:`llvm-build |
| <CommandGuide/llvm-build>` documentation. |
| |
| Component Overview |
| ================== |
| |
| As mentioned earlier, LLVM projects are organized into logical |
| *components*. Every component is typically grouped into its own |
| subdirectory. Generally, a component is organized around a coherent |
| group of sources which have some kind of clear API separation from other |
| parts of the code. |
| |
| LLVM primarily uses the following types of components: |
| |
| - *Libraries* - Library components define a distinct API which can be |
| independently linked into LLVM client applications. Libraries typically |
| have private and public header files, and may specify a link of required |
| libraries that they build on top of. |
| - *Build Tools* - Build tools are applications which are designed to be run |
| as part of the build process (typically to generate other source files). |
| Currently, LLVM uses one main build tool called :doc:`TableGen/index` |
| to generate a variety of source files. |
| - *Tools* - Command line applications which are built using the LLVM |
| component libraries. Most LLVM tools are small and are primarily |
| frontends to the library interfaces. |
| |
| Components are described using ``LLVMBuild.txt`` files in the directories |
| that define the component. See the `LLVMBuild Format Reference`_ section |
| for information on the exact format of these files. |
| |
| LLVMBuild Format Reference |
| ========================== |
| |
| LLVMBuild files are written in a simple variant of the INI or configuration |
| file format (`Wikipedia entry`_). The format defines a list of sections |
| each of which may contain some number of properties. A simple example of |
| the file format is below: |
| |
| .. _Wikipedia entry: http://en.wikipedia.org/wiki/INI_file |
| |
| .. code-block:: ini |
| |
| ; Comments start with a semi-colon. |
| |
| ; Sections are declared using square brackets. |
| [component_0] |
| |
| ; Properties are declared using '=' and are contained in the previous section. |
| ; |
| ; We support simple string and boolean scalar values and list values, where |
| ; items are separated by spaces. There is no support for quoting, and so |
| ; property values may not contain spaces. |
| property_name = property_value |
| list_property_name = value_1 value_2 ... value_n |
| boolean_property_name = 1 (or 0) |
| |
| LLVMBuild files are expected to define a strict set of sections and |
| properties. A typical component description file for a library |
| component would look like the following example: |
| |
| .. code-block:: ini |
| |
| [component_0] |
| type = Library |
| name = Linker |
| parent = Libraries |
| required_libraries = Archive BitReader Core Support TransformUtils |
| |
| A full description of the exact sections and properties which are |
| allowed follows. |
| |
| Each file may define exactly one common component, named ``common``. The |
| common component may define the following properties: |
| |
| - ``subdirectories`` **[optional]** |
| |
| If given, a list of the names of the subdirectories from the current |
| subpath to search for additional LLVMBuild files. |
| |
| Each file may define multiple components. Each component is described by a |
| section who name starts with ``component``. The remainder of the section |
| name is ignored, but each section name must be unique. Typically components |
| are just number in order for files with multiple components |
| (``component_0``, ``component_1``, and so on). |
| |
| .. warning:: |
| |
| Section names not matching this format (or the ``common`` section) are |
| currently unused and are disallowed. |
| |
| Every component is defined by the properties in the section. The exact |
| list of properties that are allowed depends on the component type. |
| Components **may not** define any properties other than those expected |
| by the component type. |
| |
| Every component must define the following properties: |
| |
| - ``type`` **[required]** |
| |
| The type of the component. Supported component types are detailed |
| below. Most components will define additional properties which may be |
| required or optional. |
| |
| - ``name`` **[required]** |
| |
| The name of the component. Names are required to be unique across the |
| entire project. |
| |
| - ``parent`` **[required]** |
| |
| The name of the logical parent of the component. Components are |
| organized into a logical tree to make it easier to navigate and |
| organize groups of components. The parents have no semantics as far |
| as the project build is concerned, however. Typically, the parent |
| will be the main component of the parent directory. |
| |
| Components may reference the root pseudo component using ``$ROOT`` to |
| indicate they should logically be grouped at the top-level. |
| |
| Components may define the following properties: |
| |
| - ``dependencies`` **[optional]** |
| |
| If specified, a list of names of components which *must* be built |
| prior to this one. This should only be exactly those components which |
| produce some tool or source code required for building the component. |
| |
| .. note:: |
| |
| ``Group`` and ``LibraryGroup`` components have no semantics for the |
| actual build, and are not allowed to specify dependencies. |
| |
| The following section lists the available component types, as well as |
| the properties which are associated with that component. |
| |
| - ``type = Group`` |
| |
| Group components exist purely to allow additional arbitrary structuring |
| of the logical components tree. For example, one might define a |
| ``Libraries`` group to hold all of the root library components. |
| |
| ``Group`` components have no additionally properties. |
| |
| - ``type = Library`` |
| |
| Library components define an individual library which should be built |
| from the source code in the component directory. |
| |
| Components with this type use the following properties: |
| |
| - ``library_name`` **[optional]** |
| |
| If given, the name to use for the actual library file on disk. If |
| not given, the name is derived from the component name itself. |
| |
| - ``required_libraries`` **[optional]** |
| |
| If given, a list of the names of ``Library`` or ``LibraryGroup`` |
| components which must also be linked in whenever this library is |
| used. That is, the link time dependencies for this component. When |
| tools are built, the build system will include the transitive closure |
| of all ``required_libraries`` for the components the tool needs. |
| |
| - ``add_to_library_groups`` **[optional]** |
| |
| If given, a list of the names of ``LibraryGroup`` components which |
| this component is also part of. This allows nesting groups of |
| components. For example, the ``X86`` target might define a library |
| group for all of the ``X86`` components. That library group might |
| then be included in the ``all-targets`` library group. |
| |
| - ``installed`` **[optional]** **[boolean]** |
| |
| Whether this library is installed. Libraries that are not installed |
| are only reported by ``llvm-config`` when it is run as part of a |
| development directory. |
| |
| - ``type = LibraryGroup`` |
| |
| ``LibraryGroup`` components are a mechanism to allow easy definition of |
| useful sets of related components. In particular, we use them to easily |
| specify things like "all targets", or "all assembly printers". |
| |
| Components with this type use the following properties: |
| |
| - ``required_libraries`` **[optional]** |
| |
| See the ``Library`` type for a description of this property. |
| |
| - ``add_to_library_groups`` **[optional]** |
| |
| See the ``Library`` type for a description of this property. |
| |
| - ``type = TargetGroup`` |
| |
| ``TargetGroup`` components are an extension of ``LibraryGroup``\s, |
| specifically for defining LLVM targets (which are handled specially in a |
| few places). |
| |
| The name of the component should always be the name of the target. |
| |
| Components with this type use the ``LibraryGroup`` properties in |
| addition to: |
| |
| - ``has_asmparser`` **[optional]** **[boolean]** |
| |
| Whether this target defines an assembly parser. |
| |
| - ``has_asmprinter`` **[optional]** **[boolean]** |
| |
| Whether this target defines an assembly printer. |
| |
| - ``has_disassembler`` **[optional]** **[boolean]** |
| |
| Whether this target defines a disassembler. |
| |
| - ``has_jit`` **[optional]** **[boolean]** |
| |
| Whether this target supports JIT compilation. |
| |
| - ``type = Tool`` |
| |
| ``Tool`` components define standalone command line tools which should be |
| built from the source code in the component directory and linked. |
| |
| Components with this type use the following properties: |
| |
| - ``required_libraries`` **[optional]** |
| |
| If given, a list of the names of ``Library`` or ``LibraryGroup`` |
| components which this tool is required to be linked with. |
| |
| .. note:: |
| |
| The values should be the component names, which may not always |
| match up with the actual library names on disk. |
| |
| Build systems are expected to properly include all of the libraries |
| required by the linked components (i.e., the transitive closure of |
| ``required_libraries``). |
| |
| Build systems are also expected to understand that those library |
| components must be built prior to linking -- they do not also need |
| to be listed under ``dependencies``. |
| |
| - ``type = BuildTool`` |
| |
| ``BuildTool`` components are like ``Tool`` components, except that the |
| tool is supposed to be built for the platform where the build is running |
| (instead of that platform being targeted). Build systems are expected |
| to handle the fact that required libraries may need to be built for |
| multiple platforms in order to be able to link this tool. |
| |
| ``BuildTool`` components currently use the exact same properties as |
| ``Tool`` components, the type distinction is only used to differentiate |
| what the tool is built for. |