[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu May 30 02:41:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11873?compare_to=11869&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11873, Order: 182914, Start Time: 2013-05-30 08:00:17, End Time: 2013-05-30 09:42:07
      To: 11869, Order: 182911, Start Time: 2013-05-30 05:55:06, End Time: 2013-05-30 07:39:27
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 7 (7 on baseline)
Performance Improvements: 6 (86 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1094 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/viterbi/viterbi: 6.39% (0.1722 => 0.1832, std.dev.: 0.0026)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.3937 => 1.4207, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 10.69% (1.7060 => 1.8883, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.13% (1.0554 => 1.0990, std.dev.: 0.0018)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.72% (8.9494 => 9.2821, std.dev.: 0.0360)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.55% (3.6451 => 3.7016, std.dev.: 0.0188)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.16% (51.3138 => 51.9082, std.dev.: 0.0153)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/constpool: -4.08% (9.1856 => 8.8105, std.dev.: 0.1265)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.08% (0.9883 => 0.9677, std.dev.: 0.0067)
  MultiSource/Benchmarks/Bullet/bullet: -1.88% (35.9009 => 35.2277, std.dev.: 0.0933)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.76% (22.0194 => 21.4109, std.dev.: 0.1569)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.59% (2.9977 => 2.9499, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.32% (4.3179 => 4.2610, std.dev.: 0.0212)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.55% (0.1467 => 0.1475, std.dev.: 0.0012)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.30% (1.6070 => 1.6279, std.dev.: 0.0077)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 17.84% (1.1695 => 1.3781, std.dev.: 0.0448)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.49% (0.1455 => 0.1695, std.dev.: 0.0083)
  MultiSource/Applications/lua/lua: 4.62% (28.2496 => 29.5558, std.dev.: 0.2943)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.96% (1.0571 => 1.0990, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.47% (3.6122 => 3.7016, std.dev.: 0.0188)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.07% (3.9713 => 4.0537, std.dev.: 0.0313)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.64% (0.2431 => 0.1832, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -18.68% (0.0803 => 0.0653, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/constpool: -14.53% (10.3086 => 8.8105, std.dev.: 0.1265)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.43% (0.7918 => 0.6934, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.34% (0.1151 => 0.1009, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.81% (0.1075 => 0.0948, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.66% (0.1646 => 0.1454, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.60% (1.5932 => 1.4084, std.dev.: 0.0164)
  MultiSource/Applications/JM/lencod/lencod: -10.61% (18.9387 => 16.9288, std.dev.: 0.0271)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.32% (0.2006 => 0.1799, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.21% (0.1322 => 0.1187, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.88% (5.1587 => 4.6490, std.dev.: 0.0222)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.03% (0.8025 => 0.7300, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.51% (1.7804 => 1.6289, std.dev.: 0.0083)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.41% (5.4314 => 4.9744, std.dev.: 0.0358)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.81% (1.0314 => 0.9508, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.53% (0.1886 => 0.1744, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.11% (15.9860 => 14.8491, std.dev.: 0.0385)
  MultiSource/Applications/lemon/lemon: -6.88% (1.3155 => 1.2250, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.87% (0.7381 => 0.6874, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.33% (0.2416 => 0.2263, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.29% (2.0439 => 1.9153, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/em3d/em3d: -6.00% (0.2117 => 0.1990, std.dev.: 0.0025)
  MultiSource/Applications/kimwitu++/kc: -5.69% (20.1855 => 19.0372, std.dev.: 0.0713)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.64% (0.1861 => 0.1756, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.41% (0.4199 => 0.3972, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.40% (0.3723 => 0.3522, std.dev.: 0.0018)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.38% (51.0211 => 48.2774, std.dev.: 0.0954)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.32% (1.6793 => 1.5900, std.dev.: 0.0072)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.5698 => 0.5404, std.dev.: 0.0033)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.72% (0.8649 => 0.8241, std.dev.: 0.0046)
  MultiSource/Applications/SPASS/SPASS: -4.50% (17.6379 => 16.8434, std.dev.: 0.0652)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.30% (0.5887 => 0.5634, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.25% (1.3686 => 1.3105, std.dev.: 0.0063)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.21% (0.2753 => 0.2637, std.dev.: 0.0008)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.72% (0.5748 => 0.5534, std.dev.: 0.0079)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.69% (0.2738 => 0.2637, std.dev.: 0.0007)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.50% (7.7211 => 7.4509, std.dev.: 0.0181)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.48% (0.2961 => 0.2858, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.46% (0.3378 => 0.3261, std.dev.: 0.0012)
  MultiSource/Applications/ClamAV/clamscan: -3.16% (17.3229 => 16.7754, std.dev.: 0.0694)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.09% (0.4861 => 0.4711, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/bh/bh: -2.97% (0.3429 => 0.3327, std.dev.: 0.0023)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.88% (0.9964 => 0.9677, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.60% (10.1602 => 9.8957, std.dev.: 0.0104)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.16% (10.7257 => 10.4945, std.dev.: 0.0486)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.08% (0.9957 => 0.9750, std.dev.: 0.0060)
  MultiSource/Applications/hbd/hbd: -1.31% (1.6386 => 1.6172, std.dev.: 0.0043)
  MultiSource/Benchmarks/MallocBench/gs/gs: -1.21% (4.7091 => 4.6519, std.dev.: 0.0193)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.16% (1.1954 => 1.1815, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.14% (0.8969 => 0.8867, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.06% (1.8435 => 1.8239, std.dev.: 0.0008)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.64% (1.2911 => 0.7277, std.dev.: 0.0017)
  MultiSource/Applications/lemon/lemon: -37.50% (1.3499 => 0.8437, std.dev.: 0.0098)
  MultiSource/Benchmarks/Olden/mst/mst: -36.54% (0.2099 => 0.1332, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.50% (4.4050 => 3.2376, std.dev.: 0.1431)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.72% (1.0251 => 0.7614, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.79% (6.2328 => 4.6875, std.dev.: 0.1684)
  SingleSource/Benchmarks/Misc/salsa20: -23.12% (10.3398 => 7.9494, std.dev.: 0.4918)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.83% (0.8606 => 0.6727, std.dev.: 0.0097)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.48% (1.8291 => 1.5094, std.dev.: 0.0541)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.01% (25.3677 => 21.3068, std.dev.: 0.2441)
  MultiSource/Applications/minisat/minisat: -14.73% (7.3703 => 6.2849, std.dev.: 0.0154)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.80% (0.3702 => 0.3302, std.dev.: 0.0142)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.37% (10.2418 => 9.2821, std.dev.: 0.0360)
  MultiSource/Applications/SPASS/SPASS: -8.62% (8.8720 => 8.1073, std.dev.: 0.1724)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.90% (3.2030 => 2.9499, std.dev.: 0.0157)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.86% (48.3307 => 44.5296, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/flops: -6.80% (10.2170 => 9.5219, std.dev.: 0.1750)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.80% (4.5717 => 4.2610, std.dev.: 0.0212)
  MultiSource/Applications/sqlite3/sqlite3: -6.77% (4.6358 => 4.3221, std.dev.: 0.0765)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.53% (0.1945 => 0.1818, std.dev.: 0.0017)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (1.3530 => 1.2647, std.dev.: 0.0255)
  SingleSource/Benchmarks/Shootout-C++/hash: -6.07% (0.7941 => 0.7459, std.dev.: 0.0168)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.98% (0.2777 => 0.2611, std.dev.: 0.0048)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.27% (0.2332 => 0.2209, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.12% (2.5366 => 2.4067, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.05% (2.4808 => 2.3554, std.dev.: 0.0341)
  MultiSource/Benchmarks/Bullet/bullet: -4.43% (7.1938 => 6.8749, std.dev.: 0.0366)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.25% (39.1740 => 37.5093, std.dev.: 0.5319)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.04% (9.1099 => 8.7420, std.dev.: 0.0200)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.37% (1.6613 => 1.6053, std.dev.: 0.0062)
  MultiSource/Benchmarks/llubenchmark/llu: -3.06% (2.0425 => 1.9800, std.dev.: 0.0233)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.65% (1.6679 => 1.6237, std.dev.: 0.0091)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.28% (12.1841 => 12.0279, std.dev.: 0.0547)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.09% (1.6105 => 1.5930, std.dev.: 0.0042)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1441 => 0.1475, std.dev.: 0.0012)

Report Time: 1.52s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130530/7f704de6/attachment.html>


More information about the llvm-testresults mailing list