[llvm-dev] Benchmarks for LLVM-generated Binaries

[Dean Michael Berris via llvm-dev]

Hi,

I've lately been wondering where benchmarks for LLVM-generated binaries are hosted, and whether they're tracked over time. I'm asking because I'm thinking of where to put some benchmarks I've written using the open source Google benchmarking library [0] to test certain costs of XRay-instrumented binaries, the XRay runtime, and other related measurements (effect of patching/unpatching of various-sized functions, etc.)

As I can certainly publish the numbers I get from the benchmarks, it's not as good as having the benchmarks available somewhere that others can run and verify for themselves (and scrutinise to improve accuracy).

I asked on IRC (#llvm) and Chandler suggested that I ask on the list too.

Questions:

- Is the test-suite repository the right place to put these generated-code benchmarks?
- Are there any objections to using a later version of the Google benchmarking library [0] in the test-suite?
- Are the docs on the Testing Infrastructure Guide still relevant and up-to-date, and is that a good starting point for exploration here?

Cheers

[0] https://github.com/google/benchmark
[1] http://llvm.org/docs/TestingGuide.html

-- Dean