[PATCH] D21593: test-suite: Remove lemon benchmark

[Matthias Braun via llvm-commits]

MatzeB created this revision.
MatzeB added reviewers: rengolin, cmatthews, kristof.beyls.
MatzeB added a subscriber: llvm-commits.
MatzeB set the repository for this revision to rL LLVM.
Herald added a subscriber: mcrosier.

This benchmark is unsuitable as a compiler benchmark:

- It forks itself hundreds of times per second (in order to reset to a
  clean state after an iteration). This makes it more a test for the
  operating system than of code produced by the compiler. This also
  leads to performance noise depending on the OS.
- Profiling the code (of a single run without fork) shows 60-70% of the
  time is spend in fputs and fputc which is just testing your libc and
  OS again.

This test is often showing huge performance jumps for me and is a waste of
time when you have to check whether compiler changes have led to any (real)
regressions.

I hereby propose it for deletion from the test-suite.

Repository:
  rL LLVM

http://reviews.llvm.org/D21593

Files:
  MultiSource/Applications/CMakeLists.txt
  MultiSource/Applications/Makefile
  MultiSource/Applications/lemon/CMakeLists.txt
  MultiSource/Applications/lemon/Makefile
  MultiSource/Applications/lemon/README
  MultiSource/Applications/lemon/copyright-release.html
  MultiSource/Applications/lemon/ecmascript.y
  MultiSource/Applications/lemon/example1.y
  MultiSource/Applications/lemon/example2.y
  MultiSource/Applications/lemon/example3.y
  MultiSource/Applications/lemon/example4.y
  MultiSource/Applications/lemon/example5.y
  MultiSource/Applications/lemon/example_COPYING
  MultiSource/Applications/lemon/lemon.c
  MultiSource/Applications/lemon/lemon.reference_output
  MultiSource/Applications/lemon/lempar.c
  MultiSource/Applications/lemon/lighttpd_COPYING
  MultiSource/Applications/lemon/lighttpd_configparser.y
  MultiSource/Applications/lemon/lighttpd_mod_ssi_exprparser.y
  MultiSource/Applications/lemon/parse.y
  MultiSource/Applications/lemon/wireshark_COPYING
  MultiSource/Applications/lemon/wireshark_dtd_grammar.lemon
  MultiSource/Applications/lemon/wireshark_grammar.lemon
  MultiSource/Applications/lemon/wireshark_mate_grammar.lemon
  MultiSource/Applications/lemon/xapian_COPYING
  MultiSource/Applications/lemon/xapian_queryparser.lemony

-------------- next part --------------
A non-text attachment was scrubbed...
Name: D21593.61490.patch
Type: text/x-patch
Size: 405885 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20160622/78d232b8/attachment-0001.bin>