[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 3 19:10:32 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12021?compare_to=12017&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12021, Order: 183172, Start Time: 2013-06-04 00:29:31, End Time: 2013-06-04 02:11:12
      To: 12017, Order: 183155, Start Time: 2013-06-03 22:22:41, End Time: 2013-06-04 00:07:06
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (11 on baseline)
Performance Improvements: 14 (90 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1085 (1006 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.96% (1.4848 => 1.8109, std.dev.: 0.0398)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.15% (4.1226 => 4.8295, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.18% (14.7988 => 16.1575, std.dev.: 0.3868)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.95% (0.4272 => 0.4526, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.20% (1.0555 => 1.0998, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.92% (2.5026 => 2.6007, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.99% (5.0138 => 5.1635, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.07% (3.6168 => 3.6915, std.dev.: 0.0052)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.05% (0.2966 => 0.2846, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.03% (0.5518 => 0.5351, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.67% (1.8434 => 1.8126, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.36% (1.6856 => 1.6626, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.17% (1.4863 => 1.4689, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: -7.54% (0.8346 => 0.7717, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.58% (3.6017 => 3.3647, std.dev.: 0.0465)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.83% (0.7580 => 0.7214, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.33% (4.3051 => 4.1189, std.dev.: 0.0408)
  MultiSource/Benchmarks/sim/sim: -2.86% (3.9761 => 3.8622, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.14% (0.6020 => 0.5891, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/flops-7: -1.75% (1.7643 => 1.7334, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.35% (3.0219 => 2.9812, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout/ary3: -1.05% (5.8340 => 5.7729, std.dev.: 0.0162)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.41% (0.1473 => 0.1408, std.dev.: 0.0026)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 17.93% (1.1695 => 1.3792, std.dev.: 0.0015)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.56% (0.1455 => 0.1696, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.30% (1.2224 => 1.2872, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.04% (1.0571 => 1.0998, std.dev.: 0.0016)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (2.5366 => 2.6241, std.dev.: 0.0125)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.76% (2.5309 => 2.6007, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (4.3727 => 4.4795, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.20% (3.6122 => 3.6915, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.75% (3.9713 => 4.0407, std.dev.: 0.0234)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.14% (11.4990 => 11.6303, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.12% (9.8728 => 9.9833, std.dev.: 0.0157)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -37.20% (0.1113 => 0.0699, std.dev.: 0.0016)
  MultiSource/Applications/viterbi/viterbi: -27.23% (0.2431 => 0.1769, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.68% (0.0803 => 0.0661, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -16.47% (0.1075 => 0.0898, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/whetstone: -16.04% (0.1097 => 0.0921, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/constpool: -15.13% (10.3086 => 8.7492, std.dev.: 0.0659)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.55% (0.1151 => 0.0995, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.12% (0.1646 => 0.1430, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.76% (1.5932 => 1.4059, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.62% (0.2006 => 0.1773, std.dev.: 0.0001)
  MultiSource/Applications/JM/lencod/lencod: -11.37% (18.9387 => 16.7861, std.dev.: 0.1667)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.89% (0.1322 => 0.1178, std.dev.: 0.0003)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.17% (51.0211 => 45.8303, std.dev.: 0.1023)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.81% (0.2416 => 0.2179, std.dev.: 0.0040)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.69% (0.1527 => 0.1379, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.84% (5.4314 => 4.9510, std.dev.: 0.0600)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (0.1224 => 0.1120, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.43% (0.1886 => 0.1727, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.56% (15.9860 => 14.7779, std.dev.: 0.2432)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.55% (0.7381 => 0.6824, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.21% (0.2151 => 0.1996, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.13% (0.2117 => 0.1966, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/strcat: -7.06% (0.2309 => 0.2146, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/objinst: -6.80% (0.2397 => 0.2234, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.74% (0.4199 => 0.3916, std.dev.: 0.0023)
  MultiSource/Applications/oggenc/oggenc: -6.48% (5.9886 => 5.6004, std.dev.: 0.1182)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.47% (2.0439 => 1.9117, std.dev.: 0.0058)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.43% (1.6793 => 1.5713, std.dev.: 0.0239)
  MultiSource/Benchmarks/McCat/05-eks/eks: -6.09% (0.5698 => 0.5351, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2095 => 0.1973, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.63% (0.1828 => 0.1725, std.dev.: 0.0005)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -5.29% (0.5748 => 0.5444, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.12% (0.2951 => 0.2800, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.09% (0.4554 => 0.4322, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/wc: -4.98% (0.2429 => 0.2308, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.47% (0.4293 => 0.4101, std.dev.: 0.0039)
  SingleSource/Regression/C++/ofstream_ctor: -4.36% (0.2360 => 0.2257, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.20% (7.7211 => 7.3967, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -4.18% (0.3848 => 0.3687, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3378 => 0.3237, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/sieve: -3.53% (0.3088 => 0.2979, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.46% (0.3617 => 0.3492, std.dev.: 0.0023)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.04% (0.3853 => 0.3736, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -2.68% (0.4138 => 0.4027, std.dev.: 0.0002)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.55% (10.7257 => 10.4520, std.dev.: 0.0142)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.13% (0.4740 => 0.4639, std.dev.: 0.0013)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.78% (25.9348 => 25.4741, std.dev.: 0.1598)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.68% (1.8435 => 1.8126, std.dev.: 0.0020)
  MultiSource/Benchmarks/Bullet/bullet: -1.39% (35.5296 => 35.0354, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (1.7006 => 1.6790, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.18% (1.4771 => 1.4597, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.36% (1.2911 => 0.7313, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.49% (4.4050 => 3.2380, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.15% (6.2328 => 5.0394, std.dev.: 0.0174)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -18.15% (1.8291 => 1.4971, std.dev.: 0.0443)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.74% (3.5000 => 2.9141, std.dev.: 0.0684)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.43% (48.3307 => 40.3900, std.dev.: 1.4170)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.30% (25.3677 => 21.2325, std.dev.: 0.2328)
  SingleSource/Benchmarks/Misc/salsa20: -13.05% (10.3398 => 8.9902, std.dev.: 0.1751)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.58% (10.2418 => 9.0556, std.dev.: 0.1970)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.40% (0.3702 => 0.3317, std.dev.: 0.0127)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.36% (3.5327 => 3.2021, std.dev.: 0.0661)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.19% (32.4581 => 29.4743, std.dev.: 0.0916)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.16% (0.7941 => 0.7214, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.89% (3.2030 => 2.9823, std.dev.: 0.0106)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.63% (0.1945 => 0.1816, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.41% (0.2777 => 0.2599, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.40% (2.4808 => 2.3220, std.dev.: 0.0422)
  MultiSource/Applications/sqlite3/sqlite3: -6.18% (4.6358 => 4.3495, std.dev.: 0.0478)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (4.5717 => 4.3152, std.dev.: 0.0001)
  MultiSource/Benchmarks/Bullet/bullet: -4.25% (7.1938 => 6.8879, std.dev.: 0.0276)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.19% (3.5120 => 3.3647, std.dev.: 0.0465)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.13% (9.1099 => 8.7338, std.dev.: 0.0308)
  MultiSource/Applications/hexxagon/hexxagon: -4.11% (15.4979 => 14.8612, std.dev.: 0.0350)
  SingleSource/Benchmarks/Shootout/ary3: -3.98% (6.0122 => 5.7729, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.67% (1.6613 => 1.6004, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/flops-7: -3.63% (1.7987 => 1.7334, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/flops: -3.55% (10.2170 => 9.8546, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/lists1: -3.38% (0.6097 => 0.5891, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.75% (3.8665 => 3.7602, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.70% (4.2334 => 4.1189, std.dev.: 0.0408)
  SingleSource/Benchmarks/Shootout/hash: -2.55% (5.3656 => 5.2290, std.dev.: 0.0281)
  SingleSource/Benchmarks/Dhrystone/dry: -2.07% (0.5126 => 0.5020, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.01% (4.2167 => 4.1318, std.dev.: 0.0031)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.00% (94.2966 => 92.4063, std.dev.: 0.4420)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.80% (8.5243 => 8.3708, std.dev.: 0.0071)
  SingleSource/Benchmarks/McGill/chomp: -1.56% (1.0164 => 1.0005, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.40% (3.0234 => 2.9812, std.dev.: 0.0140)
  SingleSource/Benchmarks/Stanford/FloatMM: -1.32% (0.7884 => 0.7780, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/bh/bh: -1.08% (2.4435 => 2.4172, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.29% (0.1441 => 0.1408, std.dev.: 0.0026)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130603/8fc40367/attachment.html>


More information about the llvm-testresults mailing list