[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun May 26 19:14:53 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11762?compare_to=11759&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11762, Order: 182722, Start Time: 2013-05-27 00:34:52, End Time: 2013-05-27 02:15:24
      To: 11759, Order: 182720, Start Time: 2013-05-26 22:30:19, End Time: 2013-05-27 00:11:27
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (7 on baseline)
Performance Improvements: 6 (116 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (984 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (0.9383 => 0.9510, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.03% (1.1075 => 1.1189, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.31% (4.1186 => 4.8314, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.62% (2.1111 => 2.3986, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 9.66% (0.7911 => 0.8675, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.56% (0.8454 => 0.9093, std.dev.: 0.0114)
  MultiSource/Benchmarks/Olden/em3d/em3d: 3.18% (5.0109 => 5.1702, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.23% (5.1914 => 5.3073, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/constpool: -1.62% (9.0104 => 8.8640, std.dev.: 0.0447)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.88% (0.2976 => 0.2682, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.05% (0.4857 => 0.4709, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.10% (1.3218 => 1.2940, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -1.49% (2.9602 => 2.9161, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/heapsort: -1.44% (2.9179 => 2.8760, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.50% (0.1467 => 0.1445, std.dev.: 0.0012)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.21% (1.5862 => 1.6054, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 31.23% (1.8318 => 2.4039, std.dev.: 0.0695)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.38% (0.9806 => 1.0922, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.87% (0.8276 => 0.9093, std.dev.: 0.0114)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.88% (1.2224 => 1.2821, std.dev.: 0.0030)
  MultiSource/Applications/lua/lua: 3.38% (28.2496 => 29.2031, std.dev.: 0.0460)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.30% (88.2998 => 89.4505, std.dev.: 0.0204)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Threads/tls: -40.43% (0.0277 => 0.0165, std.dev.: 0.0031)
  MultiSource/Applications/viterbi/viterbi: -26.45% (0.2431 => 0.1788, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.56% (0.0803 => 0.0662, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/whetstone: -15.77% (0.1097 => 0.0924, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.90% (0.7918 => 0.6738, std.dev.: 0.0112)
  SingleSource/UnitTests/Vector/constpool: -14.01% (10.3086 => 8.8640, std.dev.: 0.0447)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.73% (0.1151 => 0.0993, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.37% (0.1646 => 0.1426, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.93% (0.1075 => 0.0936, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.03% (0.1322 => 0.1163, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.62% (1.5932 => 1.4080, std.dev.: 0.0119)
  MultiSource/Applications/JM/lencod/lencod: -10.82% (18.9387 => 16.8898, std.dev.: 0.0088)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.68% (0.8025 => 0.7168, std.dev.: 0.0074)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.52% (0.2006 => 0.1795, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.87% (5.1587 => 4.6496, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -9.36% (5.4314 => 4.9230, std.dev.: 0.0306)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.36% (1.7804 => 1.6138, std.dev.: 0.0107)
  MultiSource/Applications/aha/aha: -8.81% (0.1407 => 0.1283, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.24% (0.2416 => 0.2217, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.11% (0.1886 => 0.1733, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/09-vor/vor: -7.95% (0.3723 => 0.3427, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.93% (0.7381 => 0.6796, std.dev.: 0.0071)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.80% (1.0314 => 0.9510, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.59% (15.9860 => 14.7734, std.dev.: 0.0657)
  MultiSource/Applications/Burg/burg: -7.47% (1.5375 => 1.4227, std.dev.: 0.0115)
  MultiSource/Applications/lemon/lemon: -7.42% (1.3155 => 1.2179, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.96% (2.0439 => 1.9016, std.dev.: 0.0201)
  MultiSource/Applications/oggenc/oggenc: -6.39% (5.9886 => 5.6057, std.dev.: 0.0400)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.31% (0.1853 => 0.1736, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.10% (0.2753 => 0.2585, std.dev.: 0.0035)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.99% (1.6793 => 1.5787, std.dev.: 0.0059)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.79% (0.8649 => 0.8148, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.74% (0.4199 => 0.3958, std.dev.: 0.0022)
  MultiSource/Applications/kimwitu++/kc: -5.65% (20.1855 => 19.0445, std.dev.: 0.1349)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.53% (0.5698 => 0.5383, std.dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.37% (0.3853 => 0.3646, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.10% (0.2117 => 0.2009, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2309 => 0.2194, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.85% (0.3378 => 0.3214, std.dev.: 0.0056)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.83% (1.3686 => 1.3025, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2151 => 0.2048, std.dev.: 0.0015)
  MultiSource/Applications/SPASS/SPASS: -4.71% (17.6379 => 16.8079, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout-C++/objinst: -4.67% (0.2397 => 0.2285, std.dev.: 0.0018)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.65% (0.9964 => 0.9501, std.dev.: 0.0143)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.52% (0.4030 => 0.3848, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2961 => 0.2828, std.dev.: 0.0008)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.20% (0.2738 => 0.2623, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.98% (7.7211 => 7.4141, std.dev.: 0.0157)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.92% (0.5887 => 0.5656, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.74% (10.1602 => 9.7807, std.dev.: 0.0216)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.60% (0.4861 => 0.4686, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/ary2: -3.52% (0.2951 => 0.2847, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.45% (0.7191 => 0.6943, std.dev.: 0.0092)
  MultiSource/Applications/ClamAV/clamscan: -3.30% (17.3229 => 16.7521, std.dev.: 0.0614)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.01% (0.5748 => 0.5575, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.82% (0.4293 => 0.4172, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.62% (0.9957 => 0.9696, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.62% (0.8969 => 0.8734, std.dev.: 0.0084)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.62% (1.2006 => 1.1692, std.dev.: 0.0108)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.28% (0.7334 => 0.7167, std.dev.: 0.0008)
  MultiSource/Applications/sqlite3/sqlite3: -1.98% (16.9719 => 16.6365, std.dev.: 0.0294)
  MultiSource/Applications/d/make_dparser: -1.77% (3.7330 => 3.6669, std.dev.: 0.0049)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.67% (1.1954 => 1.1754, std.dev.: 0.0024)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.44% (25.9348 => 25.5610, std.dev.: 0.0830)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.33% (1.8435 => 1.8189, std.dev.: 0.0024)
  MultiSource/Applications/hbd/hbd: -1.06% (1.6386 => 1.6213, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.03% (1.7006 => 1.6830, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.36% (1.2911 => 0.7313, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/mst/mst: -37.26% (0.2099 => 0.1317, std.dev.: 0.0100)
  MultiSource/Applications/lemon/lemon: -32.52% (1.3499 => 0.9109, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.53% (4.4050 => 3.2364, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.91% (6.2328 => 4.6805, std.dev.: 0.1787)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.97% (0.8606 => 0.6715, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.46% (1.8291 => 1.5098, std.dev.: 0.0534)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.68% (3.5000 => 2.9161, std.dev.: 0.0060)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.96% (25.3677 => 21.3193, std.dev.: 0.3427)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -15.37% (1.0251 => 0.8675, std.dev.: 0.0029)
  MultiSource/Applications/minisat/minisat: -15.30% (7.3703 => 6.2425, std.dev.: 0.0167)
  SingleSource/Benchmarks/Misc/salsa20: -13.01% (10.3398 => 8.9949, std.dev.: 0.0054)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.24% (3.5327 => 3.1002, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.70% (0.3702 => 0.3306, std.dev.: 0.0102)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.44% (10.2418 => 9.1723, std.dev.: 0.2227)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.79% (0.2973 => 0.2682, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.22% (0.7941 => 0.7209, std.dev.: 0.0278)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.01% (32.4581 => 29.5351, std.dev.: 0.0767)
  MultiSource/Applications/SPASS/SPASS: -8.27% (8.8720 => 8.1387, std.dev.: 0.0954)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.17% (48.3307 => 44.3819, std.dev.: 0.0714)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.65% (3.2030 => 2.9581, std.dev.: 0.0363)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.3530 => 1.2584, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc/flops: -6.66% (10.2170 => 9.5366, std.dev.: 0.1499)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.48% (0.1945 => 0.1819, std.dev.: 0.0002)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -6.41% (4.1768 => 3.9089, std.dev.: 0.0591)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.62% (4.5717 => 4.3149, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.39% (2.8537 => 2.6998, std.dev.: 0.0389)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.26% (2.5366 => 2.4033, std.dev.: 0.0346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.85% (39.1740 => 37.2725, std.dev.: 0.1413)
  MultiSource/Benchmarks/FreeBench/neural/neural: -4.67% (0.3513 => 0.3349, std.dev.: 0.0029)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.64% (0.4480 => 0.4272, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.50% (0.2777 => 0.2652, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/heapsort: -4.09% (2.9988 => 2.8760, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout/ary3: -3.80% (6.0122 => 5.7836, std.dev.: 0.0058)
  MultiSource/Applications/sqlite3/sqlite3: -3.67% (4.6358 => 4.4657, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.44% (1.6613 => 1.6041, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.43% (0.3208 => 0.3098, std.dev.: 0.0041)
  MultiSource/Applications/JM/lencod/lencod: -3.18% (7.0353 => 6.8113, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.10% (62.4345 => 60.4978, std.dev.: 0.2731)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.75% (1.6679 => 1.6221, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout/hash: -2.67% (5.3656 => 5.2223, std.dev.: 0.0389)
  MultiSource/Benchmarks/llubenchmark/llu: -2.10% (2.0425 => 1.9996, std.dev.: 0.0129)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.06% (1.2579 => 1.2320, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.71% (4.6452 => 4.5659, std.dev.: 0.0189)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.60% (1.1291 => 1.1110, std.dev.: 0.0008)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.41% (12.1841 => 12.0121, std.dev.: 0.0186)
  MultiSource/Applications/aha/aha: -1.33% (3.6251 => 3.5770, std.dev.: 0.0136)
  MultiSource/Applications/viterbi/viterbi: -1.30% (2.5688 => 2.5355, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.10% (8.5243 => 8.4302, std.dev.: 0.0089)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1441 => 0.1445, std.dev.: 0.0012)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130526/eebef788/attachment.html>


More information about the llvm-testresults mailing list