[all-commits] [llvm/llvm-project] 6520b2: [DTLTO][LLVM] Integrated Distributed ThinLTO (DTLT...

[bd1976bris via All-commits]

  Branch: refs/heads/main
  Home:   https://github.com/llvm/llvm-project
  Commit: 6520b21ce010d0e2bf721fe41de7779010d48571
      https://github.com/llvm/llvm-project/commit/6520b21ce010d0e2bf721fe41de7779010d48571
  Author: bd1976bris <bd1976llvm at gmail.com>
  Date:   2025-05-23 (Fri, 23 May 2025)

  Changed paths:
    A llvm/docs/DTLTO.rst
    M llvm/docs/UserGuides.rst
    M llvm/include/llvm/LTO/LTO.h
    M llvm/include/llvm/Transforms/IPO/FunctionImport.h
    M llvm/lib/LTO/LTO.cpp
    M llvm/lib/LTO/ThinLTOCodeGenerator.cpp
    M llvm/lib/Transforms/IPO/FunctionImport.cpp
    A llvm/test/ThinLTO/X86/dtlto/dtlto.ll
    A llvm/test/ThinLTO/X86/dtlto/imports.ll
    A llvm/test/ThinLTO/X86/dtlto/json.ll
    A llvm/test/ThinLTO/X86/dtlto/summary.ll
    A llvm/test/ThinLTO/X86/dtlto/triple.ll
    M llvm/test/lit.cfg.py
    M llvm/tools/llvm-lto2/llvm-lto2.cpp
    A llvm/utils/dtlto/local.py
    A llvm/utils/dtlto/mock.py
    A llvm/utils/dtlto/validate.py

  Log Message:
  -----------
  [DTLTO][LLVM] Integrated Distributed ThinLTO (DTLTO) (#127749)

This patch adds initial support for Integrated Distributed ThinLTO
(DTLTO) in LLVM, which manages distribution internally during the
traditional link step. This enables compatibility with any build
system that supports in-process ThinLTO. In contrast, existing
approaches to distributed ThinLTO, which split the thin-link
(--thinlto-index-only), backend compilation, and final link into
separate steps, require build system support, e.g. Bazel.

This patch implements the core DTLTO mechanism, which enables
delegation of ThinLTO backend jobs to an external process (the
distributor). The distributor can then manage job distribution through
systems like Incredibuild. A generic JSON interface is used to
communicate with the distributor, allowing for the creation of new
distributors (and thus integration with different distribution
systems) without modifying LLVM.

Please see llvm/docs/dtlto.rst for more details.

RFC: https://discourse.llvm.org/t/rfc-integrated-distributed-thinlto/69641
Design Review: https://github.com/llvm/llvm-project/pull/126654



To unsubscribe from these emails, change your notification settings at https://github.com/llvm/llvm-project/settings/notifications