[llvm-dev] Performance metrics with LLVM

[Tobias Grosser via llvm-dev]

Dear all, 

I wanted to gather LLVM statistics with lnt and found a nice flag, but
am unsure how such statistics can be made available in the LNT web
interface.

--cmake-define=TEST_SUITE_COLLECT_STATS=ON
 
which allows me to gather all the LLVM "-stats" output. On top of this I
see that the LNT cmake test-suite also dumps code-size statistics when
running, that look as follows:

size: 10848 
size..bss: 48 
size..comment: 218 
size..ctors: 16 
size..data: 4 
size..dtors: 16 
size..dynamic: 416 
size..dynsym: 168 
size..eh_frame: 172 
size..eh_frame_hdr: 44 

I can find all these statistics in a file called:

/scratch/leone/grosser/base/sandbox/test-2017-07-04_06-14-43/outputTd2xPU.json

but they do not appear in:

/scratch/leone/grosser/base/sandbox/test-2017-07-04_06-14-43/report.json

and in fact do not seem to be submitted to the LNT server.

Matthias added support for TEST_SUITE_COLLECT_STATS a while ago, but I
am unsure how it is expected to be used. A google search did not find
any relevant documentation. Is anybody using this feature today?

Best,
Tobias