<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
This is cool stuff.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Just wanted to share a very minor inconvenience: I wish I could hide/collapse the "Lint: Pre-merge checks" boxes, like you can with review comments. Looks like I can't do that at the moment, which makes some parts difficult to read.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks for working on this.<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> llvm-dev <llvm-dev-bounces@lists.llvm.org> on behalf of Russell Gallop via llvm-dev <llvm-dev@lists.llvm.org><br>
<b>Sent:</b> 06 February 2020 20:49<br>
<b>To:</b> Tom Stellard <tstellar@redhat.com><br>
<b>Cc:</b> llvm-dev <llvm-dev@lists.llvm.org><br>
<b>Subject:</b> Re: [llvm-dev] RFC: Using GitHub Actions for CI testing on the release/* branches</font>
<div> </div>
</div>
<div>
<div dir="ltr">> Does ninja all run the tests too?<br>
<div><br>
</div>
<div>No, it just builds everything.</div>
<div><br>
</div>
<div>Russ</div>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Thu, 6 Feb 2020 at 16:43, Tom Stellard <<a href="mailto:tstellar@redhat.com">tstellar@redhat.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
On 02/06/2020 08:41 AM, Russell Gallop wrote:<br>
> Hi Tom,<br>
> <br>
> Thank you for setting this up. It's very useful.<br>
> <br>
> One question about what this builds. It only builds "ninja check-all", not "ninja all"[1]. check-all isn't a strict superset of all so while this covers most things, this does miss building a few things such as:<br>
> bin/clang-offload-wrapper<br>
> bin/llvm-itanium-demangle-fuzzer<br>
> bin/llvm-microsoft-demangle-fuzzer<br>
> bin/llvm-PerfectShuffle<br>
> ...<br>
> lib/libclang.so<br>
> ...<br>
> <br>
> For completeness, should this do "ninja all", "ninja check-all" as most buildbot builders do?<br>
> <br>
<br>
Does ninja all run the tests too?<br>
<br>
-Tom<br>
<br>
> Thanks<br>
> Russ<br>
> <br>
> [1] <a href="https://github.com/llvm/actions/blob/master/build-test-llvm-project/main.js" rel="noreferrer" target="_blank">
https://github.com/llvm/actions/blob/master/build-test-llvm-project/main.js</a> <br>
> <br>
> On Fri, 13 Dec 2019 at 22:07, John Byrd via llvm-dev <<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a> <mailto:<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>>> wrote:<br>
> <br>
> > I think my concern is that LLVM could prove to be too big and require too many resources for github's infrastructure. How many patches go into LLVM a day, and how many build and test jobs does GitHub allow users to run concurrently before being throttled?<br>
> <br>
> Please, no one confuse "what should be LLVM's official CIs" with "what can we do to make it easier for individuals and small companies to experiment with small changes in their own forks."
<br>
> <br>
> Current usage limits for the free Github actions tier are:<br>
> <br>
> - You can execute up to 20 workflows concurrently per repository.<br>
> - You can execute up to 1000 API requests in an hour across all actions within a repository.<br>
> - Each job in a workflow can run for up to 6 hours of execution time.<br>
> - The number of jobs you can run concurrently across all repositories in your account depends on your GitHub plan.<br>
> - You can have a maximum concurrent set of 5 maximum concurrent MacOS jobs.<br>
> <br>
> So, this isn't enough juice to replace all the LLVM buildbots, but it is enough to have CI on *your personal fork* of LLVM. And having CI on everyone's personal fork, makes it that much more likely that your Phabricator patches will be correct the first
time.<br>
> <br>
> Best of all, if you don't like Github's CI, you can completely ignore it and proceed with your current workflow.<br>
> <br>
> On Thu, Dec 12, 2019 at 10:53 AM Reid Kleckner <<a href="mailto:rnk@google.com" target="_blank">rnk@google.com</a> <mailto:<a href="mailto:rnk@google.com" target="_blank">rnk@google.com</a>>> wrote:<br>
> <br>
> I think everyone agrees that LLVM needs better CI, automatic pre-commit testing of various platforms, etc. This is not rocket science, it is standard practice for 2019 software engineering.<br>
> <br>
> I think my concern is that LLVM could prove to be too big and require too many resources for github's infrastructure. How many patches go into LLVM a day, and how many build and test jobs does GitHub allow users to run concurrently before being throttled?<br>
> <br>
> You may have seen that Christian Kuhnel has been working on a pre-commit testing bot that integrates with Phab:<br>
> <a href="https://reviews.llvm.org/p/merge_guards_bot/" rel="noreferrer" target="_blank">https://reviews.llvm.org/p/merge_guards_bot/</a>
<br>
> <a href="https://github.com/google/llvm-premerge-checks/blob/master/docs/user_doc.md" rel="noreferrer" target="_blank">https://github.com/google/llvm-premerge-checks/blob/master/docs/user_doc.md</a><br>
> I hope that ends up being the way forward and suits Tom's original release testing goals.<br>
> <br>
> On Wed, Dec 11, 2019 at 11:43 PM John Byrd via llvm-dev <<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a> <mailto:<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>>> wrote:<br>
> <br>
> Please forgive the incorrect threading on this reply to Tom Stellard's RFC.<br>
> <br>
> > I would like to start using GitHub Actions[1] for CI testing on the release/*<br>
> > branches. As far as I know we don't have any buildbots listening to the<br>
> > release branches, and I think GitHub Actions are a good way for us to<br>
> > quickly bring-up some CI jobs there. <br>
> <br>
> Personally, I feel that Tom's proof of concept, is more important than we seem to be giving him credit for.<br>
> <br>
> As of this writing, the Github actions system permits all comers, six hours of CPU time per build platform. Due to this long CPU allotment, AFAIK, Github is one of the few CIs in town that lets anyone build and smoke llvm for free.<br>
> <br>
> Consider the workflow of someone who has never worked on llvm before. They will probably fork the monorepo on Github, in order to fix bugs or add a feature or such. At the moment they do this, they get a built-in workflow that will sanity-check
their builds on several important targets. Zero braining involved.<br>
> <br>
> Giving Joe Programmer a CI system that magically smoke tests llvm, out of the box, after he forks the repo, is a compelling reason to make something like Tom's system a standard part of llvm master.<br>
> <br>
> Concerns might be raised that llvm is "preferring" one CI system over another. Some thoughts about that. First, because the monorepo's on Github, you'll end up going to
<a href="http://github.com" rel="noreferrer" target="_blank">github.com</a> <<a href="http://github.com" rel="noreferrer" target="_blank">http://github.com</a>> anyway to get your first pull. Second, nothing about Github actions precludes supporting other
CI systems in the future.<br>
> <br>
> Thanks for your kind consideration.<br>
> <br>
> -- <br>
> ---<br>
> <br>
> John Byrd<br>
> Gigantic Software<br>
> 2321 E 4th Street<br>
> Suite C #429<br>
> Santa Ana, CA 92705-3862<br>
> <a href="http://www.giganticsoftware.com" rel="noreferrer" target="_blank">http://www.giganticsoftware.com</a><br>
> T: (949) 892-3526 <tel:%28949%29%20892-3526> F: (206) 309-0850 <tel:%28206%29%20309-0850><br>
> _______________________________________________<br>
> LLVM Developers mailing list<br>
> <a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a> <mailto:<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>><br>
> <a href="https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev" rel="noreferrer" target="_blank">https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br>
> <br>
> <br>
> <br>
> -- <br>
> ---<br>
> <br>
> John Byrd<br>
> Gigantic Software<br>
> 2321 E 4th Street<br>
> Suite C #429<br>
> Santa Ana, CA 92705-3862<br>
> <a href="http://www.giganticsoftware.com" rel="noreferrer" target="_blank">http://www.giganticsoftware.com</a><br>
> T: (949) 892-3526 F: (206) 309-0850<br>
> _______________________________________________<br>
> LLVM Developers mailing list<br>
> <a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a> <mailto:<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>><br>
> <a href="https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev" rel="noreferrer" target="_blank">https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br>
> <br>
<br>
</blockquote>
</div>
</div>
</body>
</html>