[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 20 02:01:07 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14592?compare_to=14589&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14592, Order: 188746, Start Time: 2013-08-20 07:10:15, End Time: 2013-08-20 09:03:13
      To: 14589, Order: 188742, Start Time: 2013-08-20 04:57:07, End Time: 2013-08-20 06:48:37
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 26 (50 on baseline)
Performance Improvements: 18 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 58.71% (0.3916 => 0.6215, std.dev.: 0.0176)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 53.91% (0.1011 => 0.1556, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 47.71% (1.1466 => 1.6936, std.dev.: 0.0660)
  MultiSource/Benchmarks/McCat/09-vor/vor: 44.96% (0.3581 => 0.5191, std.dev.: 0.0197)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 42.64% (0.2500 => 0.3566, std.dev.: 0.0355)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 40.60% (0.7032 => 0.9887, std.dev.: 0.0892)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 38.25% (0.9005 => 1.2449, std.dev.: 0.0251)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.89% (1.5128 => 1.9045, std.dev.: 0.1355)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.48% (7.6555 => 9.2237, std.dev.: 0.3032)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.87% (1.5891 => 1.8731, std.dev.: 0.0110)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.13% (0.0998 => 0.1149, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.85% (0.3088 => 0.3423, std.dev.: 0.0034)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.83% (2.5246 => 2.7980, std.dev.: 0.0584)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.02% (0.3592 => 0.3916, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.15% (1.4204 => 1.5361, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.25% (1.4342 => 1.4665, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 110.75% (0.1330 => 0.2803, std.dev.: 0.0135)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 59.08% (0.8581 => 1.3651, std.dev.: 0.0301)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.91% (0.0856 => 0.1249, std.dev.: 0.0077)
  MultiSource/Benchmarks/McCat/08-main/main: 44.00% (0.0725 => 0.1044, std.dev.: 0.0017)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.62% (1.2273 => 1.5785, std.dev.: 0.0384)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.48% (90.7832 => 98.4846, std.dev.: 0.8482)
  SingleSource/Benchmarks/Misc/fp-convert: 8.09% (7.4555 => 8.0584, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.57% (5.0748 => 5.1545, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.46% (11.4223 => 11.5893, std.dev.: 0.0269)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.35% (3.7600 => 3.8106, std.dev.: 0.0087)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/BuiltinTypeInfo: -43.31% (0.0344 => 0.0195, std.dev.: 0.0022)
  SingleSource/Regression/C/casts: -37.16% (0.0654 => 0.0411, std.dev.: 0.0003)
  SingleSource/Regression/C/sumarray: -36.67% (0.0660 => 0.0418, std.dev.: 0.0016)
  SingleSource/Regression/C/callargs: -36.50% (0.0326 => 0.0207, std.dev.: 0.0012)
  SingleSource/Regression/C/DuffsDevice: -36.34% (0.0432 => 0.0275, std.dev.: 0.0041)
  SingleSource/UnitTests/initp1: -28.83% (0.0718 => 0.0511, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/constpool: -20.30% (11.0765 => 8.8285, std.dev.: 0.1547)
  SingleSource/Benchmarks/Dhrystone/fldry: -15.52% (0.0715 => 0.0604, std.dev.: 0.0028)
  SingleSource/Regression/C/bigstack: -13.96% (0.0781 => 0.0672, std.dev.: 0.0004)
  SingleSource/Regression/C++/ofstream_ctor: -8.04% (0.2598 => 0.2389, std.dev.: 0.0066)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.40% (0.1953 => 0.1828, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.34% (0.1940 => 0.1817, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -38.62% (2.4138 => 1.4816, std.dev.: 0.3445)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.33% (34.5673 => 29.2689, std.dev.: 0.4320)
  SingleSource/Benchmarks/Dhrystone/dry: -8.74% (0.5514 => 0.5032, std.dev.: 0.0035)
  SingleSource/Regression/C/uint64_to_float: -4.21% (1.5139 => 1.4502, std.dev.: 0.0200)
  SingleSource/Benchmarks/Misc/pi: -2.84% (2.5216 => 2.4500, std.dev.: 0.0269)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.28% (2.9610 => 2.9230, std.dev.: 0.0087)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.91% (0.1320 => 0.1308, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 60.47% (0.3873 => 0.6215, std.dev.: 0.0176)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 53.30% (0.1015 => 0.1556, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 50.05% (1.1287 => 1.6936, std.dev.: 0.0660)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 45.72% (0.6785 => 0.9887, std.dev.: 0.0892)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 45.08% (0.2458 => 0.3566, std.dev.: 0.0355)
  SingleSource/Regression/C/bigstack: 44.21% (0.0466 => 0.0672, std.dev.: 0.0004)
  MultiSource/Benchmarks/McCat/09-vor/vor: 41.44% (0.3670 => 0.5191, std.dev.: 0.0197)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 38.09% (0.9015 => 1.2449, std.dev.: 0.0251)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.86% (1.5376 => 1.9045, std.dev.: 0.1355)
  MultiSource/Benchmarks/FreeBench/distray/distray: 22.36% (0.1033 => 0.1264, std.dev.: 0.0042)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.73% (7.7035 => 9.2237, std.dev.: 0.3032)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.73% (1.6185 => 1.8731, std.dev.: 0.0110)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.09% (0.1016 => 0.1149, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3089 => 0.3423, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.66% (0.3604 => 0.3916, std.dev.: 0.0073)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.23% (3.7285 => 6.4215, std.dev.: 0.0555)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.57% (2.8867 => 4.2887, std.dev.: 0.0126)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.91% (0.0856 => 0.1249, std.dev.: 0.0077)
  MultiSource/Benchmarks/FreeBench/neural/neural: 34.75% (0.3171 => 0.4273, std.dev.: 0.0196)
  MultiSource/Benchmarks/McCat/08-main/main: 32.66% (0.0787 => 0.1044, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/mst/mst: 31.35% (0.2134 => 0.2803, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout/hash: 28.20% (4.1846 => 5.3648, std.dev.: 0.1324)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.66% (1.5030 => 1.8887, std.dev.: 0.0150)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 24.53% (1.0962 => 1.3651, std.dev.: 0.0301)
  SingleSource/Benchmarks/Misc/pi: 23.52% (1.9835 => 2.4500, std.dev.: 0.0269)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.06% (1.3148 => 1.5785, std.dev.: 0.0384)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.19% (0.6295 => 0.7314, std.dev.: 0.0127)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.85% (7.0762 => 7.8439, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.63% (5.4910 => 5.9647, std.dev.: 0.0403)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.48% (1.2557 => 1.3622, std.dev.: 0.0179)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.16% (48.3256 => 52.2706, std.dev.: 0.3012)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.11% (14.9584 => 16.1708, std.dev.: 0.4705)
  MultiSource/Applications/JM/lencod/lencod: 7.17% (7.1799 => 7.6950, std.dev.: 0.1745)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.17% (3.2027 => 3.4322, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.45% (3.4085 => 3.6284, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.25% (5.3042 => 5.6356, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.64% (5.5008 => 5.8108, std.dev.: 0.0909)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.14% (93.6732 => 98.4846, std.dev.: 0.8482)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.99% (3.3384 => 3.4717, std.dev.: 0.0334)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.33% (6.1245 => 6.3282, std.dev.: 0.0755)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.30% (3.3877 => 3.4995, std.dev.: 0.0217)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.29% (25.0200 => 25.8443, std.dev.: 0.0378)
  SingleSource/Benchmarks/Misc/whetstone: 2.93% (3.4559 => 3.5572, std.dev.: 0.0252)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.78% (3.5351 => 3.6332, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.75% (1.3104 => 1.3464, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.73% (4.8739 => 5.0071, std.dev.: 0.0451)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.14% (12.8625 => 13.1383, std.dev.: 0.0348)
  SingleSource/Benchmarks/Shootout/matrix: 1.81% (1.7358 => 1.7672, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.27% (4.9089 => 4.9711, std.dev.: 0.0093)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.20% (3.7653 => 3.8106, std.dev.: 0.0087)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hbd/hbd: -15.79% (2.0193 => 1.7005, std.dev.: 0.0168)
  MultiSource/Applications/hexxagon/hexxagon: -15.36% (1.3285 => 1.1245, std.dev.: 0.0118)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.62% (0.9461 => 0.8362, std.dev.: 0.0309)
  MultiSource/Applications/sgefa/sgefa: -11.60% (0.4809 => 0.4251, std.dev.: 0.0205)
  MultiSource/Applications/ClamAV/clamscan: -10.93% (19.4145 => 17.2932, std.dev.: 0.1283)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.77% (1.5239 => 1.4665, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.93% (1.4194 => 0.8952, std.dev.: 0.1600)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.11% (2.1022 => 1.4272, std.dev.: 0.0126)
  MultiSource/Applications/viterbi/viterbi: -27.49% (3.4923 => 2.5322, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.27% (6.9552 => 5.2670, std.dev.: 0.0350)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0121)
  SingleSource/Benchmarks/Misc/mandel: -13.59% (1.1996 => 1.0366, std.dev.: 0.0224)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.43% (0.2047 => 0.1854, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.10% (0.5173 => 0.4702, std.dev.: 0.0071)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.78% (3.5791 => 3.3364, std.dev.: 0.0341)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.72% (47.2250 => 44.5260, std.dev.: 0.4096)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.15% (1.7207 => 1.6320, std.dev.: 0.0341)
  SingleSource/Regression/C/uint64_to_float: -4.49% (1.5184 => 1.4502, std.dev.: 0.0200)
  SingleSource/Benchmarks/Misc/fbench: -4.34% (4.9602 => 4.7449, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.16% (1.1024 => 1.0565, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.10% (4.2062 => 4.0338, std.dev.: 0.0536)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.05% (0.7355 => 0.7057, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.96% (3.8119 => 3.6611, std.dev.: 0.0278)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.90% (1.1032 => 1.0602, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.26% (6.0444 => 5.8475, std.dev.: 0.0307)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.96% (2.7049 => 2.6247, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.69% (6.1482 => 5.9827, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.34% (8.6172 => 8.4154, std.dev.: 0.0206)
  MultiSource/Applications/sgefa/sgefa: -2.27% (1.4030 => 1.3711, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/oourafft: -2.27% (3.7891 => 3.7032, std.dev.: 0.0152)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.00% (34.8438 => 34.1462, std.dev.: 0.0342)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (16.5294 => 16.2954, std.dev.: 0.0851)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.29% (5.2218 => 5.1545, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.14% (2.9568 => 2.9230, std.dev.: 0.0087)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.08% (0.1378 => 0.1308, std.dev.: 0.0019)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130820/29d3b4dd/attachment.html>


More information about the llvm-testresults mailing list