[PATCH] D21593: test-suite: Remove lemon benchmark
Matthias Braun via llvm-commits
llvm-commits at lists.llvm.org
Tue Jun 21 19:27:42 PDT 2016
MatzeB created this revision.
MatzeB added reviewers: rengolin, cmatthews, kristof.beyls.
MatzeB added a subscriber: llvm-commits.
MatzeB set the repository for this revision to rL LLVM.
Herald added a subscriber: mcrosier.
This benchmark is unsuitable as a compiler benchmark:
- It forks itself hundreds of times per second (in order to reset to a
clean state after an iteration). This makes it more a test for the
operating system than of code produced by the compiler. This also
leads to performance noise depending on the OS.
- Profiling the code (of a single run without fork) shows 60-70% of the
time is spend in fputs and fputc which is just testing your libc and
OS again.
This test is often showing huge performance jumps for me and is a waste of
time when you have to check whether compiler changes have led to any (real)
regressions.
I hereby propose it for deletion from the test-suite.
Repository:
rL LLVM
http://reviews.llvm.org/D21593
Files:
MultiSource/Applications/CMakeLists.txt
MultiSource/Applications/Makefile
MultiSource/Applications/lemon/CMakeLists.txt
MultiSource/Applications/lemon/Makefile
MultiSource/Applications/lemon/README
MultiSource/Applications/lemon/copyright-release.html
MultiSource/Applications/lemon/ecmascript.y
MultiSource/Applications/lemon/example1.y
MultiSource/Applications/lemon/example2.y
MultiSource/Applications/lemon/example3.y
MultiSource/Applications/lemon/example4.y
MultiSource/Applications/lemon/example5.y
MultiSource/Applications/lemon/example_COPYING
MultiSource/Applications/lemon/lemon.c
MultiSource/Applications/lemon/lemon.reference_output
MultiSource/Applications/lemon/lempar.c
MultiSource/Applications/lemon/lighttpd_COPYING
MultiSource/Applications/lemon/lighttpd_configparser.y
MultiSource/Applications/lemon/lighttpd_mod_ssi_exprparser.y
MultiSource/Applications/lemon/parse.y
MultiSource/Applications/lemon/wireshark_COPYING
MultiSource/Applications/lemon/wireshark_dtd_grammar.lemon
MultiSource/Applications/lemon/wireshark_grammar.lemon
MultiSource/Applications/lemon/wireshark_mate_grammar.lemon
MultiSource/Applications/lemon/xapian_COPYING
MultiSource/Applications/lemon/xapian_queryparser.lemony
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D21593.61490.patch
Type: text/x-patch
Size: 405885 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20160622/78d232b8/attachment-0001.bin>
More information about the llvm-commits
mailing list