[llvm-dev] LLVM compile-time regression tracking?

[Nikita Popov via llvm-dev]

On Sat, Feb 8, 2020 at 2:17 PM Nikita Popov <nikita.ppv at gmail.com> wrote:

> Hi,
>
> Does the LLVM project perform any kind of tracking for commit-by-commit
> compile-time changes? It looks like LNT only tracks run-time performance
> (and to be honest I wasn't able to make heads or tails of the results even
> for that -- the interface was pretty unintuitive to me.)
>
> While it is "normal" that each new LLVM release regresses compile-time by
> 2-3%, LLVM 10 seems to be going for a new record here, with optimized
> builds regressing by around 5-15%, and that's already after mitigating the
> largest regression:
> https://perf.rust-lang.org/compare.html?start=58b834344fc7b9185e7a50db1ff24e5eb07dae5e&end=f9c17b2d9bd4ca61bb0eb8b226dd61aaf254156c
>
> It does not seem like these regressions are specific to Rust either, see
> for example https://bugs.llvm.org/show_bug.cgi?id=44408.
>
> The Rust project tracks compile-time results for each commit (see link
> above), and thanks to that can quickly spot and revert changes that
> negatively affect performance. I think it would be really great if
> something similar would exist for LLVM...
>

FTR I ended up writing a service for this myself. Pretty graphs available
at: http://llvm-compile-time-tracker.com/graphs.php.

We're on a downwards trend right now, let's keep it that way :)

Regards,
Nikita
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20200323/24bb48cd/attachment.html>