[all-commits] [llvm/llvm-project] 347b2e: [Offload] Lazily initialize platforms in the Offlo...

Joseph Huber via All-commits all-commits at lists.llvm.org
Tue Sep 29 05:59:16 PDT 2026


  Branch: refs/heads/main
  Home:   https://github.com/llvm/llvm-project
  Commit: 347b2ed7fd5aef25f45b0f2816b49833d1359dca
      https://github.com/llvm/llvm-project/commit/347b2ed7fd5aef25f45b0f2816b49833d1359dca
  Author: Joseph Huber <huberjn at outlook.com>
  Date:   2026-09-29 (Tue, 29 Sep 2026)

  Changed paths:
    M offload/liboffload/API/Common.td
    M offload/liboffload/src/OffloadImpl.cpp
    M offload/tools/offload-tblgen/EntryPointGen.cpp
    M offload/unittests/OffloadAPI/init/olInit.cpp

  Log Message:
  -----------
  [Offload] Lazily initialize platforms in the Offloading API (#227084)

Summary:
The Offloading library wraps around the underlying plugins. The problem
is that we currently initialize all plugins we find, even if they are
not needed for the program. This is very expensive for trivial uses, as
fully heterogenous usage is quite rare. In practice this means that you
will always pay a 200 ms penalty for having CUDA installed.

This patch changes the behavior to provide accessors into the plugins
and devices that allows them to be initialized lazily. We use a
once_flag, this should properly take a fast-path check while still
blocking on concurrent use.

Making full use of this will require a way to filter platforms more
specifically. I'm thinking of what this would look like as an API.
I'm thinking that we either have an extra iterate function that takes a
callback on the platform, or we just provide a helper to find all the
devices that can run a given image. Maybe both?

Fixes: #159636
Realnd of: https://github.com/llvm/llvm-project/pull/163272



To unsubscribe from these emails, change your notification settings at https://github.com/llvm/llvm-project/settings/notifications


More information about the All-commits mailing list