[llvm-dev] Benchmarks for LLVM-generated Binaries
Sebastian Pop via llvm-dev
llvm-dev at lists.llvm.org
Thu Sep 15 06:39:17 PDT 2016
On Wed, Sep 14, 2016 at 1:08 PM, Matthias Braun via llvm-dev
<llvm-dev at lists.llvm.org> wrote:
> However I do not think this should simply go into MultiSource: We currently
> have a number of additional plugins in the lit test runner such as measuring
> the runtime of the benchmark executable, determining code size, we still
> plan to add a mode to run benchmarks multiple times, we run the bechmark
> under perf (or iOS specific tools) to collect performance counters… Many of
> those are questionable measurements for a googlebenchmark executable which
> has varying runtime because it runs the test more/less often.
> We really should introduce a new benchmarking mode for this.
Some of the metrics reported by "-mllvm -stats" may be good indicators
of runtime performance.
More information about the llvm-dev