[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 12 14:18:37 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14339?compare_to=14336&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14339, Order: 188193, Start Time: 2013-08-12 19:25:14, End Time: 2013-08-12 21:20:34
      To: 14336, Order: 188182, Start Time: 2013-08-12 17:02:31, End Time: 2013-08-12 18:55:25
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 36 (49 on baseline)
Performance Improvements: 8 (37 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/simple: 73.53% (0.0238 => 0.0413, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/random: 62.45% (0.2306 => 0.3746, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/fbench: 55.47% (0.0759 => 0.1180, std.dev.: 0.0082)
  SingleSource/UnitTests/initp1: 50.39% (0.0508 => 0.0764, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 47.27% (0.0220 => 0.0324, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/constpool: 42.25% (9.1800 => 13.0583, std.dev.: 0.2922)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 23.44% (0.2159 => 0.2665, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc-C++/bigfib: 19.62% (0.7269 => 0.8695, std.dev.: 0.0278)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.19% (1.9226 => 2.2146, std.dev.: 0.0630)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.72% (2.6475 => 3.0373, std.dev.: 0.1134)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.13% (11.7545 => 13.4152, std.dev.: 0.0952)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 13.04% (0.5815 => 0.6573, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.9950 => 1.0985, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.42% (1.3829 => 1.5132, std.dev.: 0.0498)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 8.91% (0.3627 => 0.3950, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.72% (4.2569 => 4.6283, std.dev.: 0.1411)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 8.59% (0.1246 => 0.1353, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1454 => 0.1574, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.84% (5.7984 => 9.3264, std.dev.: 0.9917)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.05% (4.5537 => 6.6508, std.dev.: 0.4566)
  SingleSource/Benchmarks/Misc/pi: 44.81% (1.6489 => 2.3877, std.dev.: 0.0665)
  SingleSource/Benchmarks/Shootout-C++/fibo: 18.17% (4.1253 => 4.8749, std.dev.: 0.0665)
  SingleSource/Benchmarks/Misc/fp-convert: 16.89% (6.9180 => 8.0866, std.dev.: 0.0742)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.95% (9.8913 => 11.1719, std.dev.: 0.4762)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.76% (2.3214 => 2.5943, std.dev.: 0.0838)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.98% (2.9086 => 3.1989, std.dev.: 0.0638)
  SingleSource/Benchmarks/Misc/salsa20: 9.53% (8.2060 => 8.9880, std.dev.: 0.0325)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.41% (0.2189 => 0.2373, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.75% (16.0871 => 16.8516, std.dev.: 0.1252)
  SingleSource/Benchmarks/Misc/flops: 4.62% (9.4178 => 9.8528, std.dev.: 0.0507)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.17% (3.4775 => 3.5528, std.dev.: 0.0273)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.13% (5.8169 => 5.9410, std.dev.: 0.0391)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.02% (16.6547 => 16.9911, std.dev.: 0.0959)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.53% (3.2446 => 3.2944, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.40% (5.9304 => 6.0133, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/whetstone: 1.05% (3.5665 => 3.6041, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -38.72% (0.4600 => 0.2819, std.dev.: 0.0512)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -23.86% (0.3055 => 0.2326, std.dev.: 0.0193)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.86% (0.1155 => 0.1018, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.71% (1.7259 => 1.6792, std.dev.: 0.0115)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.61% (0.4583 => 0.4326, std.dev.: 0.0015)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.64% (1.2986 => 1.2383, std.dev.: 0.0228)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.76% (0.6679 => 0.6428, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.04% (5.3084 => 5.2530, std.dev.: 0.0121)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.08% (0.1297 => 0.1298, std.dev.: 0.0067)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/simple: 87.73% (0.0220 => 0.0413, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/random: 68.74% (0.2220 => 0.3746, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/fbench: 58.18% (0.0746 => 0.1180, std.dev.: 0.0082)
  SingleSource/UnitTests/initp1: 53.72% (0.0497 => 0.0764, std.dev.: 0.0060)
  SingleSource/UnitTests/Vector/constpool: 47.33% (8.8630 => 13.0583, std.dev.: 0.2922)
  MultiSource/Benchmarks/mafft/pairlocalalign: 23.60% (10.8541 => 13.4152, std.dev.: 0.0952)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 22.87% (0.2169 => 0.2665, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc-C++/bigfib: 19.37% (0.7284 => 0.8695, std.dev.: 0.0278)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 16.25% (0.5654 => 0.6573, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.09% (2.6390 => 3.0373, std.dev.: 0.1134)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.73% (49.1253 => 56.3612, std.dev.: 1.9773)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.65% (1.9317 => 2.2146, std.dev.: 0.0630)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.54% (0.9761 => 1.0985, std.dev.: 0.0106)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.00% (0.4125 => 0.4620, std.dev.: 0.0162)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 11.39% (0.3546 => 0.3950, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.61% (0.1423 => 0.1574, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.04% (4.2444 => 4.6283, std.dev.: 0.1411)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 70.35% (3.7285 => 6.3515, std.dev.: 0.0781)
  SingleSource/Benchmarks/Shootout/ary3: 60.36% (5.8158 => 9.3264, std.dev.: 0.9917)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.41% (2.8867 => 4.3131, std.dev.: 0.0281)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.12% (4.5517 => 6.6508, std.dev.: 0.4566)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 44.27% (2.9033 => 4.1885, std.dev.: 0.4856)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 25.55% (2.9428 => 3.6948, std.dev.: 0.1117)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.54% (1.5030 => 1.8868, std.dev.: 0.0188)
  SingleSource/Benchmarks/Shootout/hash: 25.46% (4.1846 => 5.2499, std.dev.: 0.3188)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.33% (0.0526 => 0.0654, std.dev.: 0.0002)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 22.29% (9.1355 => 11.1719, std.dev.: 0.4762)
  SingleSource/Benchmarks/Misc/pi: 20.38% (1.9835 => 2.3877, std.dev.: 0.0665)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.66% (14.9584 => 16.8516, std.dev.: 0.1252)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.32% (2.3304 => 2.5943, std.dev.: 0.0838)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.04% (7.0762 => 7.8571, std.dev.: 0.0149)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.81% (0.2161 => 0.2373, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.42% (5.4910 => 5.9533, std.dev.: 0.0451)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.40% (1.2557 => 1.3612, std.dev.: 0.0077)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.31% (48.3256 => 52.3412, std.dev.: 0.3147)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.19% (2.9568 => 3.1989, std.dev.: 0.0638)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.51% (3.4085 => 3.6645, std.dev.: 0.0241)
  MultiSource/Applications/siod/siod: 6.73% (3.3761 => 3.6032, std.dev.: 0.0534)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.12% (5.3042 => 5.6288, std.dev.: 0.1040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.70% (5.5008 => 5.8144, std.dev.: 0.0390)
  SingleSource/Benchmarks/Misc/ffbench: 4.36% (1.3679 => 1.4276, std.dev.: 0.0203)
  SingleSource/Benchmarks/Misc/whetstone: 4.29% (3.4559 => 3.6041, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.16% (4.3151 => 4.4945, std.dev.: 0.0108)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.62% (25.0200 => 25.9268, std.dev.: 0.0191)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.79% (16.5294 => 16.9911, std.dev.: 0.0959)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.78% (3.4566 => 3.5528, std.dev.: 0.0273)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.75% (5.8390 => 5.9410, std.dev.: 0.0391)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.49% (3.2461 => 3.2944, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.39% (5.9307 => 6.0133, std.dev.: 0.0080)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.53% (0.2237 => 0.1487, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.87% (0.1818 => 0.1384, std.dev.: 0.0047)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.25% (6.0938 => 4.7378, std.dev.: 0.1088)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.38% (0.1114 => 0.0887, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -20.00% (0.0675 => 0.0540, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/health/health: -18.41% (0.1993 => 0.1626, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -17.51% (0.3576 => 0.2950, std.dev.: 0.0079)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.48% (0.2367 => 0.2048, std.dev.: 0.0085)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.78% (0.1141 => 0.1018, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.06% (0.1947 => 0.1790, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/bh/bh: -5.61% (0.3603 => 0.3401, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.17% (2.1022 => 1.4260, std.dev.: 0.0097)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.02% (0.1189 => 0.0844, std.dev.: 0.0072)
  MultiSource/Applications/viterbi/viterbi: -27.22% (3.4923 => 2.5418, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.47% (6.9552 => 5.2530, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/perlin: -20.54% (4.5989 => 3.6542, std.dev.: 0.0191)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.53% (0.3557 => 0.3147, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.14% (6.2627 => 5.5648, std.dev.: 0.1562)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.34% (0.5173 => 0.4690, std.dev.: 0.0159)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.01% (3.5791 => 3.2925, std.dev.: 0.0889)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.06% (47.2250 => 44.3619, std.dev.: 0.3673)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -5.86% (0.2047 => 0.1927, std.dev.: 0.0045)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.82% (1.3148 => 1.2383, std.dev.: 0.0228)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.74% (0.3773 => 0.3594, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.34% (0.7355 => 0.7036, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/fbench: -3.80% (4.9602 => 4.7716, std.dev.: 0.0156)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.76% (1.1032 => 1.0617, std.dev.: 0.0130)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.56% (0.3479 => 0.3355, std.dev.: 0.0020)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.29% (0.7806 => 0.7549, std.dev.: 0.0063)
  MultiSource/Benchmarks/Olden/bh/bh: -2.56% (2.4879 => 2.4243, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.51% (5.2218 => 5.0907, std.dev.: 0.0408)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.41% (1.8144 => 1.7706, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/oourafft: -1.88% (3.7891 => 3.7178, std.dev.: 0.0246)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.74% (34.8438 => 34.2382, std.dev.: 0.1015)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.30% (1.6737 => 1.6519, std.dev.: 0.0067)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.29% (1.2012 => 1.1857, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.22% (2.1343 => 2.1083, std.dev.: 0.0051)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.81% (0.1378 => 0.1298, std.dev.: 0.0067)

Report Time: 0.87s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130812/60a749a5/attachment.html>


More information about the llvm-testresults mailing list