[llvm] Propagate the Buildkite pre-merge setup to GitHub Action (PR #81077)

Aiden Grossman via llvm-commits llvm-commits at lists.llvm.org
Wed Feb 7 22:26:26 PST 2024


https://github.com/boomanaiden154 commented:

Thanks for working on this!

A couple points:
* Are we able to limit this to testing on Windows for now so we can focus on getting back coverage there without taking up too many runners?
* We believe that we might end up throughput constrained with the 60 job limit. I'm working on collecting statistics on this so we have more reliable numbers. In the mean time, maybe we introduce something like this gradually (one subproject at a time) to ensure we don't hit throughput limits?
* It would be nice if we could combine this into a single job and select the targets to build as necessary to avoid the issue you mentioned on the Discourse thread. Maybe even an adaptation of the current shell script in `.ci` that selects stuff for Buildkite? This would probably be necessary in a separate job to not impact the release jobs, but that would be up to @tstellar.

As an aside, I'm working on setting up per-OS pipelines right now (with common stuff put into a separate action like `llvm-project-tests.yml`) and using optimized toolchains/containers to improve system throughput. I have put up https://github.com/llvm/llvm-project/pull/80951 for the time being as an initial version to start testing things out at scale. That's Linux/LLVM only currently though and the most basic configuration without most of the ideas implemented (other than using a well-optimized toolchain to pull buildtimes down significantly).

https://github.com/llvm/llvm-project/pull/81077


More information about the llvm-commits mailing list