[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 8 12:41:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14224?compare_to=14220&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14224, Order: 187991, Start Time: 2013-08-08 17:57:46, End Time: 2013-08-08 19:43:18
      To: 14220, Order: 187979, Start Time: 2013-08-08 15:36:37, End Time: 2013-08-08 17:31:04
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 7 (30 on baseline)
Performance Improvements: 37 (57 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1061 (1018 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 16.12% (6.9460 => 8.0654, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/salsa20: 9.06% (8.2264 => 8.9717, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.06% (4.4685 => 4.8288, std.dev.: 0.1237)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.02% (0.2864 => 0.2979, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.40% (12.8680 => 13.1762, std.dev.: 0.0068)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (45.2274 => 46.0505, std.dev.: 0.2197)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.25% (11.4668 => 11.6098, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -40.15% (0.1467 => 0.0878, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -39.81% (0.1437 => 0.0865, std.dev.: 0.0059)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -22.81% (0.3249 => 0.2508, std.dev.: 0.0041)
  MultiSource/Benchmarks/NPB-serial/is/is: -18.36% (0.1035 => 0.0845, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -18.04% (0.0643 => 0.0527, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -17.63% (0.2819 => 0.2322, std.dev.: 0.0023)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -17.55% (0.0644 => 0.0531, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.92% (1.7443 => 1.5015, std.dev.: 0.0067)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -13.73% (8.9360 => 7.7093, std.dev.: 0.4181)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.30% (0.1293 => 0.1121, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -8.91% (0.5915 => 0.5388, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -8.73% (1.5357 => 1.4017, std.dev.: 0.0504)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -7.27% (1.5259 => 1.4149, std.dev.: 0.0092)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.83% (2.8540 => 2.6592, std.dev.: 0.0138)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.42% (0.2460 => 0.2302, std.dev.: 0.0021)
  MultiSource/Applications/sqlite3/sqlite3: -6.30% (18.5639 => 17.3940, std.dev.: 0.4033)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.17% (1.4588 => 1.3980, std.dev.: 0.0212)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.99% (1.2022 => 1.1783, std.dev.: 0.0062)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.97% (1.6579 => 1.6252, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.90% (1.5310 => 1.5019, std.dev.: 0.0042)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.62% (5.2246 => 5.1400, std.dev.: 0.0217)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -25.08% (0.0893 => 0.0669, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -24.24% (0.2529 => 0.1916, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.17% (0.3806 => 0.2924, std.dev.: 0.0208)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -19.61% (46.7926 => 37.6151, std.dev.: 2.8163)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.42% (3.2106 => 2.9082, std.dev.: 0.0449)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.33% (2.8662 => 2.6847, std.dev.: 0.0356)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.84% (4.1936 => 3.9906, std.dev.: 0.0240)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.80% (2.6862 => 2.5841, std.dev.: 0.0376)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.89% (4.2767 => 4.1530, std.dev.: 0.0434)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.21% (4.6029 => 4.5013, std.dev.: 0.0369)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.18% (5.9951 => 5.8647, std.dev.: 0.0430)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.63% (3.5368 => 3.4792, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.20% (4.7726 => 4.7154, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (5.8581 => 5.7956, std.dev.: 0.0084)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.05% (3.8002 => 3.7603, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.02% (3.8091 => 3.7701, std.dev.: 0.0149)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -0.29% (0.1367 => 0.1363, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.16% (0.2765 => 0.2733, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0278 => 0.0278, std.dev.: 0.0001)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.84% (0.2813 => 0.2733, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.42% (0.0345 => 0.0278, std.dev.: 0.0001)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 37.98% (0.0466 => 0.0643, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/distray/distray: 19.07% (0.1033 => 0.1230, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (4.7710 => 4.8241, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.19% (3.7285 => 6.2336, std.dev.: 0.1506)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.96% (2.8867 => 4.3001, std.dev.: 0.0244)
  MultiSource/Benchmarks/FreeBench/neural/neural: 39.99% (0.3171 => 0.4439, std.dev.: 0.0316)
  SingleSource/Benchmarks/Shootout/hash: 27.84% (4.1846 => 5.3494, std.dev.: 0.2277)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.17% (0.6295 => 0.7313, std.dev.: 0.0339)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.20% (0.2679 => 0.2979, std.dev.: 0.0043)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.88% (7.0762 => 7.8461, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.26% (5.4910 => 5.9448, std.dev.: 0.0050)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.99% (48.3256 => 52.1884, std.dev.: 0.3674)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.90% (1.2557 => 1.3549, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.98% (5.3042 => 5.6214, std.dev.: 0.0442)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.67% (3.4085 => 3.6016, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8018, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.32% (4.3151 => 4.5015, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3655, std.dev.: 0.0652)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.61% (3.3384 => 3.4588, std.dev.: 0.0271)
  SingleSource/Benchmarks/Misc/whetstone: 3.52% (3.4559 => 3.5774, std.dev.: 0.0173)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.46% (25.0200 => 25.8847, std.dev.: 0.1185)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (6.1245 => 6.3354, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.95% (4.8739 => 5.0179, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.81% (3.3464 => 3.4406, std.dev.: 0.0344)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3465, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.70% (3.3877 => 3.4792, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.44% (12.8625 => 13.1762, std.dev.: 0.0068)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.36% (1.1618 => 1.1776, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.35% (3.0680 => 3.1095, std.dev.: 0.0159)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.71% (0.2237 => 0.1483, std.dev.: 0.0106)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -22.00% (0.1518 => 0.1184, std.dev.: 0.0041)
  MultiSource/Applications/hbd/hbd: -17.24% (2.0193 => 1.6711, std.dev.: 0.0184)
  MultiSource/Applications/hexxagon/hexxagon: -14.60% (1.3285 => 1.1345, std.dev.: 0.0051)
  MultiSource/Applications/JM/ldecod/ldecod: -11.75% (8.6720 => 7.6530, std.dev.: 0.1153)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.69% (0.9461 => 0.8355, std.dev.: 0.0252)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.27% (0.1870 => 0.1678, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.01% (0.3655 => 0.3289, std.dev.: 0.0085)
  MultiSource/Applications/sqlite3/sqlite3: -9.23% (19.1635 => 17.3940, std.dev.: 0.4033)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.23% (0.3073 => 0.2820, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.85% (0.2498 => 0.2302, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.46% (1.5345 => 1.4200, std.dev.: 0.0174)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.92% (1.7461 => 1.6252, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.61% (1.5815 => 1.4769, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.44% (1.5239 => 1.4257, std.dev.: 0.0087)
  MultiSource/Applications/Burg/burg: -6.42% (1.5733 => 1.4723, std.dev.: 0.0040)
  MultiSource/Applications/JM/lencod/lencod: -6.19% (18.5029 => 17.3575, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.29% (1.4940 => 1.4149, std.dev.: 0.0092)
  MultiSource/Applications/lemon/lemon: -4.58% (1.2976 => 1.2382, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.17% (1.4339 => 1.3741, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.99% (0.7189 => 0.6902, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.93% (5.2851 => 5.0776, std.dev.: 0.0227)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.88% (5.3476 => 5.1400, std.dev.: 0.0217)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.35% (1.5376 => 1.5015, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.52% (15.5498 => 15.3128, std.dev.: 0.0383)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.97% (1.4194 => 0.8805, std.dev.: 0.0907)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.24% (2.1022 => 1.4245, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.27% (0.0816 => 0.0569, std.dev.: 0.0004)
  MultiSource/Applications/viterbi/viterbi: -27.14% (3.4923 => 2.5444, std.dev.: 0.0222)
  MultiSource/Applications/JM/ldecod/ldecod: -25.49% (0.0859 => 0.0640, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2446, std.dev.: 0.3471)
  SingleSource/Benchmarks/Shootout-C++/ary2: -24.15% (0.0414 => 0.0314, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/perlin: -21.57% (4.5989 => 3.6070, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/mandel: -14.03% (1.1996 => 1.0313, std.dev.: 0.0112)
  MultiSource/Applications/obsequi/Obsequi: -13.27% (2.6081 => 2.2619, std.dev.: 0.1336)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.24% (0.3557 => 0.3086, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.78% (6.2627 => 5.4625, std.dev.: 0.1106)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.10% (0.0884 => 0.0777, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.45% (0.5173 => 0.4684, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.31% (1.7207 => 1.6293, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/fbench: -4.86% (4.9602 => 4.7189, std.dev.: 0.0300)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.83% (0.4969 => 0.4729, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.63% (0.2854 => 0.2722, std.dev.: 0.0024)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.47% (2.7049 => 2.5841, std.dev.: 0.0376)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.30% (2.8052 => 2.6847, std.dev.: 0.0356)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.24% (0.7355 => 0.7043, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.13% (1.1024 => 1.0569, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.68% (0.7806 => 0.7519, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.48% (6.0444 => 5.8340, std.dev.: 0.0340)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.14% (21.6864 => 21.0064, std.dev.: 0.1304)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9615, std.dev.: 0.0466)
  MultiSource/Applications/sgefa/sgefa: -2.91% (1.4030 => 1.3622, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0740, std.dev.: 0.0382)
  MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.3833 => 4.2638, std.dev.: 0.0266)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.49% (47.2250 => 46.0505, std.dev.: 0.2197)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1353, std.dev.: 0.0693)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7956, std.dev.: 0.0084)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.09% (0.1378 => 0.1363, std.dev.: 0.0009)

Report Time: 2.23s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130808/0c73379a/attachment.html>


More information about the llvm-testresults mailing list