[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Oct 4 16:09:01 PDT 2013

http://llvm.org/perf/db_default/v4/nts/15977?compare_to=15973&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15977, Order: 191977, Start Time: 2013-10-04 21:16:40, End Time: 2013-10-04 23:11:57
      To: 15973, Order: 191971, Start Time: 2013-10-04 18:57:54, End Time: 2013-10-04 20:49:04
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 35 (51 on baseline)
Performance Improvements: 11 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1061 (1041 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2011-03-28-Bitfield: 87.29% (0.0181 => 0.0339, std.dev.: 0.0012)
  SingleSource/Regression/C++/EH/exception_spec_test: 72.35% (0.0340 => 0.0586, std.dev.: 0.0029)
  SingleSource/Regression/C++/EH/simple_throw: 71.11% (0.0180 => 0.0308, std.dev.: 0.0026)
  SingleSource/Regression/C++/pointer_method2: 63.26% (0.0264 => 0.0431, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/simple_rethrow: 54.04% (0.0235 => 0.0362, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 50.61% (0.2717 => 0.4092, std.dev.: 0.0295)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 42.82% (0.0836 => 0.1194, std.dev.: 0.0088)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.81% (1.4921 => 1.9070, std.dev.: 0.1259)
  MultiSource/Applications/kimwitu++/kc: 15.03% (18.7163 => 21.5301, std.dev.: 0.4239)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.53% (0.2757 => 0.3075, std.dev.: 0.0084)
  MultiSource/Applications/lemon/lemon: 11.35% (1.2163 => 1.3544, std.dev.: 0.0289)
  MultiSource/Applications/minisat/minisat: 9.54% (0.7561 => 0.8282, std.dev.: 0.0251)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.45% (2.7278 => 2.9857, std.dev.: 0.0843)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.67% (0.3935 => 0.4276, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.04% (6.1149 => 6.6065, std.dev.: 0.1469)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (6.7005 => 7.2103, std.dev.: 0.1211)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.2110 => 0.2244, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.01% (1.3197 => 1.3858, std.dev.: 0.0161)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 43.96% (0.0546 => 0.0786, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.31% (4.5717 => 6.2775, std.dev.: 0.2834)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.93% (0.0584 => 0.0788, std.dev.: 0.0059)
  MultiSource/Applications/minisat/minisat: 29.64% (6.3557 => 8.2396, std.dev.: 0.3954)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 27.34% (0.1701 => 0.2166, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.55% (28.5160 => 35.8032, std.dev.: 0.4268)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 20.93% (4.0594 => 4.9090, std.dev.: 0.3084)
  SingleSource/Benchmarks/Shootout/matrix: 17.34% (1.7979 => 2.1097, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 13.47% (21.7868 => 24.7208, std.dev.: 0.4879)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 11.74% (0.4003 => 0.4473, std.dev.: 0.0159)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.96% (5.9768 => 6.5718, std.dev.: 0.1260)
  MultiSource/Benchmarks/Bullet/bullet: 9.15% (7.0659 => 7.7127, std.dev.: 0.0844)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.76% (2.6533 => 2.8592, std.dev.: 0.0429)
  MultiSource/Applications/sgefa/sgefa: 6.83% (0.8357 => 0.8928, std.dev.: 0.0196)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.60% (3.9777 => 4.1606, std.dev.: 0.0448)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 2.77% (0.4696 => 0.4826, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.23% (5.3763 => 5.4426, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -24.88% (0.0820 => 0.0616, std.dev.: 0.0071)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -22.11% (0.1307 => 0.1018, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -13.07% (1.6880 => 1.4673, std.dev.: 0.0658)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -10.51% (1.4098 => 1.2617, std.dev.: 0.0531)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -9.73% (0.2560 => 0.2311, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -9.24% (1.6808 => 1.5255, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -8.73% (1.4698 => 1.3415, std.dev.: 0.0295)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.39% (18.7981 => 18.1608, std.dev.: 0.2114)
  SingleSource/Benchmarks/Misc/fp-convert: -3.28% (7.6097 => 7.3602, std.dev.: 0.0780)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.83% (4.3159 => 4.1936, std.dev.: 0.0367)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.03% (5.8504 => 5.7314, std.dev.: 0.0406)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1368 => 0.1357, std.dev.: 0.0179)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2011-03-28-Bitfield: 75.65% (0.0193 => 0.0339, std.dev.: 0.0012)
  SingleSource/Regression/C++/EH/simple_throw: 71.11% (0.0180 => 0.0308, std.dev.: 0.0026)
  SingleSource/Regression/C++/EH/exception_spec_test: 64.15% (0.0357 => 0.0586, std.dev.: 0.0029)
  SingleSource/Regression/C++/pointer_method2: 63.26% (0.0264 => 0.0431, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/simple_rethrow: 54.70% (0.0234 => 0.0362, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 50.66% (0.2716 => 0.4092, std.dev.: 0.0295)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 46.27% (4.9293 => 7.2103, std.dev.: 0.1211)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 45.61% (0.0820 => 0.1194, std.dev.: 0.0088)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.82% (1.4041 => 1.9070, std.dev.: 0.1259)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.69% (0.2335 => 0.3075, std.dev.: 0.0084)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.81% (1.6465 => 2.0879, std.dev.: 0.1162)
  SingleSource/Benchmarks/Misc/richards_benchmark: 18.26% (0.0772 => 0.0913, std.dev.: 0.0014)
  MultiSource/Applications/kimwitu++/kc: 17.26% (18.3608 => 21.5301, std.dev.: 0.4239)
  SingleSource/Benchmarks/Linpack/linpack-pc: 16.85% (0.2949 => 0.3446, std.dev.: 0.0088)
  MultiSource/Applications/lemon/lemon: 14.18% (1.1862 => 1.3544, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 13.68% (1.3365 => 1.5193, std.dev.: 0.0621)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.70% (2.6492 => 2.9857, std.dev.: 0.0843)
  MultiSource/Applications/minisat/minisat: 11.33% (0.7439 => 0.8282, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.87% (1.2499 => 1.3858, std.dev.: 0.0161)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.84% (24.6139 => 27.2830, std.dev.: 0.8507)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.59% (6.0284 => 6.6065, std.dev.: 0.1469)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.69% (0.3934 => 0.4276, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.46% (0.2069 => 0.2244, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.62% (1.3498 => 1.4527, std.dev.: 0.0374)
  MultiSource/Applications/oggenc/oggenc: 4.86% (5.3339 => 5.5933, std.dev.: 0.0804)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.41% (1.2932 => 1.3373, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.78% (1.2523 => 1.2746, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.54% (7.6426 => 12.4984, std.dev.: 0.0409)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 52.94% (0.0289 => 0.0442, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 38.03% (4.5479 => 6.2775, std.dev.: 0.2834)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 36.46% (0.0576 => 0.0786, std.dev.: 0.0078)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.01% (0.0588 => 0.0788, std.dev.: 0.0059)
  MultiSource/Applications/minisat/minisat: 31.29% (6.2760 => 8.2396, std.dev.: 0.3954)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 26.89% (0.1707 => 0.2166, std.dev.: 0.0042)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.72% (4.1004 => 4.9090, std.dev.: 0.3084)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.00% (0.2842 => 0.3382, std.dev.: 0.0197)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.62% (30.1838 => 35.8032, std.dev.: 0.4268)
  SingleSource/Benchmarks/Shootout/matrix: 18.46% (1.7809 => 2.1097, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.61% (0.3836 => 0.4473, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.86% (21.5217 => 24.7208, std.dev.: 0.4879)
  MultiSource/Benchmarks/Bullet/bullet: 9.66% (7.0333 => 7.7127, std.dev.: 0.0844)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.58% (6.1088 => 6.5718, std.dev.: 0.1260)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.57% (2.6579 => 2.8592, std.dev.: 0.0429)
  SingleSource/UnitTests/Vector/multiplies: 6.89% (0.5561 => 0.5944, std.dev.: 0.0019)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.60% (8.1346 => 8.6715, std.dev.: 0.0648)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.07% (6.5990 => 6.9336, std.dev.: 0.0861)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.82% (3.9691 => 4.1606, std.dev.: 0.0448)
  MultiSource/Applications/hexxagon/hexxagon: 3.01% (14.7810 => 15.2252, std.dev.: 0.1186)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.36% (8.8798 => 9.0008, std.dev.: 0.0241)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.35% (16.7972 => 17.0246, std.dev.: 0.0447)
  SingleSource/Benchmarks/Shootout/methcall: 1.10% (8.5434 => 8.6375, std.dev.: 0.0244)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.20% (0.5226 => 0.2446, std.dev.: 0.0659)
  MultiSource/Applications/sgefa/sgefa: -43.46% (1.5790 => 0.8928, std.dev.: 0.0196)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.11% (15.9508 => 13.2211, std.dev.: 0.3934)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.79% (20.8247 => 18.1608, std.dev.: 0.2114)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.64% (3.4956 => 3.1236, std.dev.: 0.0337)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.56% (57.2347 => 52.3365, std.dev.: 1.8306)
  MultiSource/Applications/oggenc/oggenc: -7.83% (0.1699 => 0.1566, std.dev.: 0.0029)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.74% (50.0284 => 46.1576, std.dev.: 0.2655)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.80% (4.3592 => 4.1936, std.dev.: 0.0367)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.25% (2.5938 => 2.5096, std.dev.: 0.0218)
  SingleSource/Benchmarks/Misc/fp-convert: -3.00% (7.5877 => 7.3602, std.dev.: 0.0780)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.62% (2.4471 => 2.3830, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.54% (17.1431 => 16.7079, std.dev.: 0.0290)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.42% (0.7474 => 0.7293, std.dev.: 0.0057)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.04% (89.7126 => 88.7832, std.dev.: 0.0220)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.67% (0.1348 => 0.1357, std.dev.: 0.0179)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131004/f695a6d8/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results