[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 10 18:44:51 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13286?compare_to=13283&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13286, Order: 186046, Start Time: 2013-07-10 23:59:46, End Time: 2013-07-11 01:46:10
      To: 13283, Order: 186035, Start Time: 2013-07-10 21:44:14, End Time: 2013-07-10 23:36:00
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 9 (46 on baseline)
Performance Improvements: 33 (56 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1005 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-03-NotTest: 52.24% (0.0201 => 0.0306, std.dev.: 0.0010)
  SingleSource/UnitTests/2002-05-02-CastTest2: 50.91% (0.0220 => 0.0332, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.56% (0.4404 => 0.4693, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary: 23.85% (0.0633 => 0.0784, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/heapsort: 19.59% (3.7005 => 4.4254, std.dev.: 0.0995)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 17.32% (3.6233 => 4.2510, std.dev.: 0.1431)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.24% (0.3339 => 0.3614, std.dev.: 0.0091)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.19% (2.6847 => 2.7435, std.dev.: 0.0128)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.33% (21.2212 => 21.5028, std.dev.: 0.1063)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.21% (0.0862 => 0.0524, std.dev.: 0.0017)
  MultiSource/Benchmarks/BitBench/five11/five11: -38.14% (0.1041 => 0.0644, std.dev.: 0.0003)
  SingleSource/Benchmarks/SmallPT/smallpt: -36.73% (0.2336 => 0.1478, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -30.73% (0.3964 => 0.2746, std.dev.: 0.0459)
  SingleSource/Benchmarks/Shootout/lists: -27.50% (0.1131 => 0.0820, std.dev.: 0.0084)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -19.29% (0.8424 => 0.6799, std.dev.: 0.0103)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -18.46% (1.4080 => 1.1481, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -17.87% (1.1063 => 0.9086, std.dev.: 0.0131)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -14.47% (0.4692 => 0.4013, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -13.43% (0.1124 => 0.0973, std.dev.: 0.0017)
  MultiSource/Applications/hbd/hbd: -13.21% (1.8893 => 1.6397, std.dev.: 0.0173)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.24% (2.9739 => 2.6695, std.dev.: 0.0412)
  MultiSource/Applications/hexxagon/hexxagon: -10.13% (1.2245 => 1.1005, std.dev.: 0.0050)
  MultiSource/Applications/sqlite3/sqlite3: -8.95% (18.4234 => 16.7736, std.dev.: 0.1706)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.75% (4.6378 => 4.2785, std.dev.: 0.0686)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.65% (2.0847 => 1.9460, std.dev.: 0.0488)
  MultiSource/Applications/kimwitu++/kc: -6.24% (20.7988 => 19.5013, std.dev.: 0.2152)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.07% (6.8846 => 6.4667, std.dev.: 0.0689)
  MultiSource/Applications/minisat/minisat: -4.23% (0.8151 => 0.7806, std.dev.: 0.0050)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.00% (1.2410 => 1.2038, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.35% (0.5966 => 0.5826, std.dev.: 0.0034)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.20% (1.2336 => 1.2065, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -16.90% (0.1598 => 0.1328, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -14.53% (0.2175 => 0.1859, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -12.98% (42.5047 => 36.9889, std.dev.: 1.8704)
  MultiSource/Applications/minisat/minisat: -12.94% (7.1174 => 6.1964, std.dev.: 0.0936)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -11.42% (0.3380 => 0.2994, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.6120 => 3.5057, std.dev.: 0.0292)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.59% (4.4606 => 4.3895, std.dev.: 0.0239)
  MultiSource/Applications/hexxagon/hexxagon: -1.30% (15.1147 => 14.9180, std.dev.: 0.0095)
  MultiSource/Benchmarks/Olden/tsp/tsp: -1.27% (1.4528 => 1.4344, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.15% (5.6790 => 5.6135, std.dev.: 0.0087)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.02% (12.1473 => 12.0239, std.dev.: 0.0314)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.59% (0.1427 => 0.1333, std.dev.: 0.0082)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest2: 54.42% (0.0215 => 0.0332, std.dev.: 0.0015)
  SingleSource/UnitTests/2002-05-03-NotTest: 52.24% (0.0201 => 0.0306, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.32% (0.4293 => 0.4693, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/methcall: 9.07% (0.2195 => 0.2394, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.89% (0.3410 => 0.3645, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.73% (0.2095 => 0.2236, std.dev.: 0.0045)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 6.59% (0.3765 => 0.4013, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 6.08% (0.3848 => 0.4082, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.13% (0.2513 => 0.2642, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.40% (0.3088 => 0.3224, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.07% (1.6299 => 1.6799, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.03% (1.3667 => 1.4081, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.99% (1.3832 => 1.4245, std.dev.: 0.0105)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.6254 => 0.6429, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.5014 => 1.5407, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.54% (0.7191 => 0.7374, std.dev.: 0.0041)
  MultiSource/Applications/hexxagon/hexxagon: 1.95% (1.0794 => 1.1005, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 47.57% (2.9988 => 4.4254, std.dev.: 0.0995)
  MultiSource/Applications/viterbi/viterbi: 35.69% (2.5688 => 3.4856, std.dev.: 0.0704)
  MultiSource/Applications/sgefa/sgefa: 29.97% (1.1695 => 1.5200, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/perlin: 26.64% (3.6271 => 4.5933, std.dev.: 0.0281)
  SingleSource/Benchmarks/Shootout-C++/ary: 23.85% (0.0633 => 0.0784, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.46% (3.5000 => 4.2510, std.dev.: 0.1431)
  SingleSource/Benchmarks/Misc/mandel: 17.13% (1.0293 => 1.2056, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.73% (6.1372 => 7.1640, std.dev.: 0.1818)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.00% (0.9806 => 1.1375, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.95% (5.2003 => 5.6135, std.dev.: 0.0087)
  MultiSource/Applications/lua/lua: 7.41% (28.2496 => 30.3425, std.dev.: 0.3466)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.18% (3.1853 => 3.3820, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.85% (3.2201 => 3.3764, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.69% (4.6639 => 4.8828, std.dev.: 0.0167)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.47% (1.2224 => 1.2771, std.dev.: 0.0153)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0264, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.33% (1.0571 => 1.1029, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/fbench: 4.32% (4.7508 => 4.9562, std.dev.: 0.0126)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.99% (0.3860 => 0.4014, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.74% (5.9362 => 6.1583, std.dev.: 0.0385)
  SingleSource/Benchmarks/Shootout-C++/ary3: 3.70% (2.0236 => 2.0985, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.59% (5.2788 => 5.4683, std.dev.: 0.0725)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.92% (5.5010 => 5.6617, std.dev.: 0.0487)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.68% (4.6379 => 4.7624, std.dev.: 0.0063)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.39% (34.3107 => 35.1291, std.dev.: 0.0497)
  MultiSource/Benchmarks/sim/sim: 2.32% (3.8805 => 3.9705, std.dev.: 0.0239)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (4.3727 => 4.4611, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.98% (5.6582 => 5.7704, std.dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.85% (1.7925 => 1.8257, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.41% (0.1113 => 0.0730, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.32% (0.0803 => 0.0680, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.86% (0.7918 => 0.6979, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.33% (0.1075 => 0.0964, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.97% (0.2006 => 0.1826, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.32% (0.1322 => 0.1212, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.23% (0.8025 => 0.7445, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.84% (1.7804 => 1.6587, std.dev.: 0.0246)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.97% (0.7381 => 0.6940, std.dev.: 0.0114)
  MultiSource/Applications/kimwitu++/kc: -3.39% (20.1855 => 19.5013, std.dev.: 0.2152)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.61% (1.2911 => 0.7281, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.30% (4.4050 => 2.7181, std.dev.: 0.0339)
  MultiSource/Benchmarks/Olden/mst/mst: -36.73% (0.2099 => 0.1328, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.59% (1.6105 => 1.2145, std.dev.: 0.0272)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.70% (9.1099 => 7.0418, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc/salsa20: -22.62% (10.3398 => 8.0007, std.dev.: 0.4689)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.08% (4.8986 => 3.8661, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.14% (5.7264 => 4.5732, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/hash: -19.04% (5.3656 => 4.3440, std.dev.: 0.1480)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.61% (6.2328 => 5.0728, std.dev.: 0.0278)
  MultiSource/Applications/minisat/minisat: -15.93% (7.3703 => 6.1964, std.dev.: 0.0936)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.24% (25.3677 => 21.5028, std.dev.: 0.1063)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.45% (0.1945 => 0.1664, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.66% (1.6613 => 1.4344, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.59% (1.6679 => 1.4413, std.dev.: 0.0189)
  SingleSource/Regression/C/uint64_to_float: -10.28% (1.6851 => 1.5119, std.dev.: 0.0159)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.07% (10.2418 => 9.2108, std.dev.: 0.3745)
  MultiSource/Applications/siod/siod: -9.62% (3.7240 => 3.3658, std.dev.: 0.0662)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.42% (3.5327 => 3.2000, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.28% (9.8728 => 9.0549, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.18% (4.5717 => 4.2435, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2103, std.dev.: 0.0426)
  MultiSource/Applications/sqlite3/sqlite3: -6.67% (4.6358 => 4.3268, std.dev.: 0.0622)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.12% (3.5939 => 3.3738, std.dev.: 0.0212)
  SingleSource/Benchmarks/Misc/flops: -5.76% (10.2170 => 9.6281, std.dev.: 0.1015)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.32% (6.3757 => 6.0364, std.dev.: 0.0347)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.80% (5.3184 => 5.0632, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.44% (4.5935 => 4.3895, std.dev.: 0.0239)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.39% (1.6535 => 1.5809, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.37% (1.4783 => 1.4137, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3276 => 5.1027, std.dev.: 0.0528)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.99% (1.3084 => 1.2562, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.79% (1.6440 => 1.5817, std.dev.: 0.0063)
  MultiSource/Applications/hexxagon/hexxagon: -3.74% (15.4979 => 14.9180, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/whetstone: -3.68% (3.5970 => 3.4646, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.95% (3.6122 => 3.5057, std.dev.: 0.0292)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.65% (3.8665 => 3.7640, std.dev.: 0.0044)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.59% (5.7342 => 5.5858, std.dev.: 0.0440)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.48% (48.3307 => 47.1324, std.dev.: 0.3515)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.24% (4.5094 => 4.4083, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/power/power: -2.20% (1.2558 => 1.2282, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.11% (4.2167 => 4.1276, std.dev.: 0.0338)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.43% (2.8573 => 2.8164, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.36% (5.9068 => 5.8267, std.dev.: 0.0294)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.31% (12.1841 => 12.0239, std.dev.: 0.0314)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.15% (9.6556 => 9.5442, std.dev.: 0.0154)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.49% (0.1441 => 0.1333, std.dev.: 0.0082)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130710/d489775a/attachment.html>


More information about the llvm-testresults mailing list