[llvm-dev] Benchmarks for LLVM-generated Binaries

[Sebastian Pop via llvm-dev]

On Wed, Sep 14, 2016 at 1:08 PM, Matthias Braun via llvm-dev
<llvm-dev at lists.llvm.org> wrote:
> However I do not think this should simply go into MultiSource: We currently
> have a number of additional plugins in the lit test runner such as measuring
> the runtime of the benchmark executable, determining code size, we still
> plan to add a mode to run benchmarks multiple times, we run the bechmark
> under perf (or iOS specific tools) to collect performance counters… Many of
> those are questionable measurements for a googlebenchmark executable which
> has varying runtime because it runs the test more/less often.
> We really should introduce a new benchmarking mode for this.

Some of the metrics reported by "-mllvm -stats" may be good indicators
of runtime performance.