[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu May 30 23:26:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11906?compare_to=11902&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11906, Order: 182984, Start Time: 2013-05-31 04:45:34, End Time: 2013-05-31 06:27:33
      To: 11902, Order: 182979, Start Time: 2013-05-31 02:38:00, End Time: 2013-05-31 04:25:19
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 9 (8 on baseline)
Performance Improvements: 39 (96 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1003 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 1.94% (0.5671 => 0.5781, std.dev.: 0.0021)
  MultiSource/Applications/spiff/spiff: 1.61% (0.9212 => 0.9360, std.dev.: 0.0005)
  MultiSource/Benchmarks/nbench/nbench: 1.01% (1.2828 => 1.2957, std.dev.: 0.0028)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/McGill/misr: 4.46% (0.3812 => 0.3982, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.75% (3.9821 => 4.0516, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.59% (1.6271 => 1.6529, std.dev.: 0.0028)
  MultiSource/Benchmarks/llubenchmark/llu: 1.47% (2.0007 => 2.0302, std.dev.: 0.0039)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.47% (5.5652 => 5.6468, std.dev.: 0.0298)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.15% (3.6118 => 3.6535, std.dev.: 0.0137)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/callargs: -36.68% (0.0319 => 0.0202, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/fp-convert: -25.76% (0.0427 => 0.0317, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/salsa20: -24.25% (0.0738 => 0.0559, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/ffbench: -21.63% (0.1008 => 0.0790, std.dev.: 0.0005)
  SingleSource/Benchmarks/Stanford/Towers: -18.76% (0.0613 => 0.0498, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: -7.81% (0.2433 => 0.2243, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.45% (0.2295 => 0.2124, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.20% (0.2209 => 0.2050, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/hello: -6.53% (0.2082 => 0.1946, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/ary2: -6.32% (0.3036 => 0.2844, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.2910 => 0.2754, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.75% (0.2335 => 0.2224, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.4397 => 0.4217, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.14% (0.8093 => 0.7839, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.09% (1.5134 => 1.4818, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.96% (1.5471 => 1.5168, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.32% (4.2612 => 4.2050, std.dev.: 0.0199)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -26.55% (7.8657 => 5.7772, std.dev.: 0.6825)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.71% (0.0558 => 0.0448, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/ary: -17.62% (0.0766 => 0.0631, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -17.08% (3.5193 => 2.9182, std.dev.: 0.2293)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.83% (0.0954 => 0.0803, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/salsa20: -12.64% (9.1496 => 7.9929, std.dev.: 0.4448)
  SingleSource/Benchmarks/Misc/flops-4: -7.91% (1.6644 => 1.5328, std.dev.: 0.0463)
  SingleSource/Benchmarks/Misc/ffbench: -5.88% (1.4420 => 1.3572, std.dev.: 0.0183)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.74% (0.8864 => 0.8355, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/flops-6: -3.89% (2.5324 => 2.4339, std.dev.: 0.0093)
  SingleSource/Benchmarks/McGill/chomp: -3.88% (1.0545 => 1.0136, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -3.76% (3.5487 => 3.4153, std.dev.: 0.0513)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.62% (4.7266 => 4.5556, std.dev.: 0.0423)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.52% (62.3435 => 60.1459, std.dev.: 0.8009)
  MultiSource/Applications/spiff/spiff: -2.96% (2.9383 => 2.8512, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/richards_benchmark: -2.65% (1.3833 => 1.3467, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout-C++/ary3: -2.30% (2.0682 => 2.0206, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/mandel-2: -1.39% (0.8425 => 0.8308, std.dev.: 0.0043)
  SingleSource/Regression/C/uint64_to_float: -1.37% (1.7044 => 1.6810, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/flops-3: -1.32% (2.0681 => 2.0409, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.24% (5.6278 => 5.5582, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.21% (3.2789 => 3.2393, std.dev.: 0.0003)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.15% (0.1481 => 0.1464, std.dev.: 0.0006)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: 28.38% (0.1455 => 0.1868, std.dev.: 0.0019)
  MultiSource/Applications/sgefa/sgefa: 17.94% (1.1695 => 1.3793, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/flops-7: 6.10% (1.7987 => 1.9084, std.dev.: 0.0318)
  SingleSource/Benchmarks/Shootout/methcall: 2.35% (8.3425 => 8.5385, std.dev.: 0.0637)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.02% (3.9713 => 4.0516, std.dev.: 0.0129)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.5939 => 3.6535, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.30% (5.7264 => 5.8008, std.dev.: 0.0036)
  SingleSource/Benchmarks/McGill/queens: 1.08% (1.6478 => 1.6656, std.dev.: 0.0062)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -25.46% (0.2431 => 0.1812, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.31% (0.0803 => 0.0664, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/whetstone: -15.22% (0.1097 => 0.0930, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/constpool: -14.56% (10.3086 => 8.8080, std.dev.: 0.1527)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.46% (0.7918 => 0.6852, std.dev.: 0.0262)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.60% (0.1151 => 0.1006, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.73% (0.1646 => 0.1453, std.dev.: 0.0004)
  MultiSource/Applications/aha/aha: -11.37% (0.1407 => 0.1247, std.dev.: 0.0039)
  MultiSource/Applications/JM/lencod/lencod: -11.10% (18.9387 => 16.8364, std.dev.: 0.0797)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.98% (0.1075 => 0.0957, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.53% (1.5932 => 1.4255, std.dev.: 0.0091)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.72% (0.2006 => 0.1811, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.47% (0.8025 => 0.7265, std.dev.: 0.0114)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.41% (5.1587 => 4.6734, std.dev.: 0.0109)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.71% (5.4314 => 4.9581, std.dev.: 0.0217)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.54% (1.7804 => 1.6283, std.dev.: 0.0214)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.17% (0.1886 => 0.1732, std.dev.: 0.0018)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.10% (1.0314 => 0.9479, std.dev.: 0.0057)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.00% (0.1674 => 0.1540, std.dev.: 0.0026)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.49% (0.1563 => 0.1446, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.12% (0.1432 => 0.1330, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.05% (15.9860 => 14.8583, std.dev.: 0.0172)
  MultiSource/Applications/lemon/lemon: -6.87% (1.3155 => 1.2251, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.87% (0.7381 => 0.6874, std.dev.: 0.0040)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.89% (0.8649 => 0.8140, std.dev.: 0.0055)
  MultiSource/Applications/oggenc/oggenc: -5.85% (5.9886 => 5.6383, std.dev.: 0.0282)
  MultiSource/Applications/Burg/burg: -5.71% (1.5375 => 1.4497, std.dev.: 0.0115)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.69% (0.4199 => 0.3960, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.61% (2.0439 => 1.9293, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2309 => 0.2180, std.dev.: 0.0015)
  MultiSource/Applications/kimwitu++/kc: -5.58% (20.1855 => 19.0591, std.dev.: 0.1830)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.53% (1.6793 => 1.5864, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.53% (0.1828 => 0.1727, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.28% (6.6236 => 6.2737, std.dev.: 0.0615)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.72% (0.2117 => 0.2017, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.70% (0.2151 => 0.2050, std.dev.: 0.0020)
  MultiSource/Applications/SPASS/SPASS: -4.39% (17.6379 => 16.8643, std.dev.: 0.0315)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.30% (0.2416 => 0.2312, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.13% (1.3686 => 1.3121, std.dev.: 0.0060)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.07% (0.5698 => 0.5466, std.dev.: 0.0055)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.91% (0.2738 => 0.2631, std.dev.: 0.0002)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.89% (0.3723 => 0.3578, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3853 => 0.3706, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.77% (7.7211 => 7.4297, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/ary2: -3.63% (0.2951 => 0.2844, std.dev.: 0.0017)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.13% (0.5748 => 0.5568, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.92% (0.9957 => 0.9666, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.78% (10.1602 => 9.8776, std.dev.: 0.0125)
  MultiSource/Applications/ClamAV/clamscan: -2.78% (17.3229 => 16.8412, std.dev.: 0.0180)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.47% (0.4861 => 0.4741, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -1.80% (0.5887 => 0.5781, std.dev.: 0.0021)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.75% (1.2006 => 1.1796, std.dev.: 0.0032)
  MultiSource/Applications/sqlite3/sqlite3: -1.73% (16.9719 => 16.6776, std.dev.: 0.0656)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.41% (1.1954 => 1.1785, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.14% (1.0292 => 1.0175, std.dev.: 0.0039)
  MultiSource/Applications/d/make_dparser: -1.10% (3.7330 => 3.6921, std.dev.: 0.0030)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.09% (1.2911 => 0.7218, std.dev.: 0.0051)
  MultiSource/Applications/lemon/lemon: -37.28% (1.3499 => 0.8467, std.dev.: 0.0330)
  MultiSource/Benchmarks/Olden/mst/mst: -36.54% (0.2099 => 0.1332, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2393, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.40% (1.0251 => 0.7647, std.dev.: 0.0640)
  SingleSource/Benchmarks/Misc/salsa20: -22.70% (10.3398 => 7.9929, std.dev.: 0.4448)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.91% (0.8606 => 0.6720, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.03% (6.2328 => 5.0467, std.dev.: 0.0060)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.97% (25.3677 => 21.3166, std.dev.: 0.3256)
  MultiSource/Applications/minisat/minisat: -14.90% (7.3703 => 6.2721, std.dev.: 0.2267)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -12.09% (1.8291 => 1.6079, std.dev.: 0.0539)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -11.30% (0.0920 => 0.0816, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.80% (0.3702 => 0.3302, std.dev.: 0.0132)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.51% (10.2418 => 9.1649, std.dev.: 0.3900)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.86% (32.4581 => 29.5839, std.dev.: 0.0489)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.26% (48.3307 => 44.3389, std.dev.: 0.0707)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.84% (2.4808 => 2.2862, std.dev.: 0.0639)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.82% (3.2030 => 2.9845, std.dev.: 0.0324)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.79% (0.1945 => 0.1813, std.dev.: 0.0018)
  MultiSource/Applications/sqlite3/sqlite3: -6.73% (4.6358 => 4.3237, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.71% (4.5717 => 4.2648, std.dev.: 0.1058)
  SingleSource/Benchmarks/Misc/flops: -6.65% (10.2170 => 9.5371, std.dev.: 0.1598)
  MultiSource/Applications/SPASS/SPASS: -6.22% (8.8720 => 8.3205, std.dev.: 0.0984)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.12% (0.2777 => 0.2607, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.7941 => 0.7519, std.dev.: 0.0160)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.09% (2.8537 => 2.7084, std.dev.: 0.0520)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.81% (2.5366 => 2.4145, std.dev.: 0.0317)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.28% (3.5327 => 3.3815, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.14% (0.2876 => 0.2757, std.dev.: 0.0042)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.96% (9.1099 => 8.7488, std.dev.: 0.0298)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.67% (62.4345 => 60.1459, std.dev.: 0.8009)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.46% (1.6613 => 1.6038, std.dev.: 0.0092)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.73% (0.6548 => 0.6369, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.69% (1.6679 => 1.6230, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout/hash: -2.36% (5.3656 => 5.2388, std.dev.: 0.0157)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.52% (5.7342 => 5.6468, std.dev.: 0.0298)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.48% (2.5408 => 2.5031, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.44% (2.8573 => 2.8161, std.dev.: 0.0015)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.35% (12.1841 => 12.0191, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/power/power: -1.02% (1.2558 => 1.2430, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1441 => 0.1464, std.dev.: 0.0006)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130531/6eb3411e/attachment.html>


More information about the llvm-testresults mailing list