[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 1 07:43:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15857?compare_to=15854&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15857, Order: 191740, Start Time: 2013-10-01 12:50:03, End Time: 2013-10-01 14:46:07
      To: 15854, Order: 191735, Start Time: 2013-10-01 10:33:07, End Time: 2013-10-01 12:22:36
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 53 (68 on baseline)
Performance Improvements: 7 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1047 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/perlin: 53.68% (0.0611 => 0.0939, std.dev.: 0.0052)
  SingleSource/UnitTests/Vector/simple: 52.40% (0.0229 => 0.0349, std.dev.: 0.0031)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.76% (0.0776 => 0.1069, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.59% (0.0716 => 0.0978, std.dev.: 0.0067)
  MultiSource/Applications/obsequi/Obsequi: 35.42% (1.1683 => 1.5821, std.dev.: 0.0291)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.35% (4.8961 => 6.2839, std.dev.: 0.5101)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.58% (1.1987 => 1.3855, std.dev.: 0.0374)
  MultiSource/Applications/kimwitu++/kc: 15.29% (18.6450 => 21.4952, std.dev.: 0.0799)
  MultiSource/Applications/SPASS/SPASS: 15.02% (16.4549 => 18.9264, std.dev.: 0.7770)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.69% (1.3452 => 1.5293, std.dev.: 0.0100)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.83% (1.0992 => 1.2402, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.71% (1.3222 => 1.4902, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.97% (1.3672 => 1.5309, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.85% (1.2982 => 1.4521, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.29% (1.3210 => 1.4702, std.dev.: 0.0350)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 10.97% (0.1704 => 0.1891, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (1.2850 => 1.4166, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.45% (1.2661 => 1.3858, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.06% (1.2841 => 1.3876, std.dev.: 0.0382)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 7.52% (0.5374 => 0.5778, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.81% (0.9310 => 0.9944, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.63% (1.4877 => 1.5864, std.dev.: 0.0357)
  MultiSource/Benchmarks/sim/sim: 5.99% (0.3773 => 0.3999, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2478 => 0.2619, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.48% (1.1150 => 1.1761, std.dev.: 0.0153)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 124.85% (0.1352 => 0.3040, std.dev.: 0.0165)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 104.93% (0.7417 => 1.5200, std.dev.: 0.0725)
  MultiSource/Benchmarks/McCat/09-vor/vor: 80.39% (0.1117 => 0.2015, std.dev.: 0.0063)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.35% (0.6621 => 1.0021, std.dev.: 0.0975)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 35.87% (1.3010 => 1.7677, std.dev.: 0.0487)
  MultiSource/Applications/JM/ldecod/ldecod: 33.84% (0.0662 => 0.0886, std.dev.: 0.0031)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.50% (2.3976 => 3.2007, std.dev.: 0.0437)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.09% (0.4229 => 0.5586, std.dev.: 0.0158)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 29.73% (2.4302 => 3.1527, std.dev.: 0.0656)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.55% (1.2357 => 1.5391, std.dev.: 0.0329)
  MultiSource/Benchmarks/llubenchmark/llu: 18.23% (1.9880 => 2.3505, std.dev.: 0.1378)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.27% (30.6778 => 35.3611, std.dev.: 0.6431)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.58% (0.1365 => 0.1564, std.dev.: 0.0041)
  MultiSource/Benchmarks/Bullet/bullet: 7.28% (7.2296 => 7.7559, std.dev.: 0.1066)
  MultiSource/Applications/lua/lua: 5.34% (28.8756 => 30.4189, std.dev.: 0.3317)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.79% (4.5847 => 4.8045, std.dev.: 0.0613)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.57% (5.9269 => 6.1383, std.dev.: 0.0338)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.43% (3.6392 => 3.7641, std.dev.: 0.0278)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.79% (2.8139 => 2.8925, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.60% (4.0163 => 4.1207, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/fp-convert: 2.59% (7.4273 => 7.6198, std.dev.: 0.0743)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.51% (5.0941 => 5.2220, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.19% (5.0370 => 5.1474, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.07% (4.4959 => 4.5888, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.03% (3.5826 => 3.6553, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.67% (5.2331 => 5.3205, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.60% (3.5397 => 3.5964, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc/flops-5: 1.12% (2.7893 => 2.8206, std.dev.: 0.0088)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-05-07-VarArgs: -29.76% (0.0410 => 0.0288, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/dt: -24.09% (0.0494 => 0.0375, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/sim/sim: -5.05% (4.0673 => 3.8619, std.dev.: 0.0123)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.17% (2.2128 => 2.1205, std.dev.: 0.0028)
  SingleSource/Regression/C/uint64_to_float: -3.29% (1.4363 => 1.3890, std.dev.: 0.0167)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.66% (1.6950 => 1.6499, std.dev.: 0.0130)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.21% (46.9573 => 46.3899, std.dev.: 0.0719)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.67% (0.1350 => 0.1359, std.dev.: 0.0101)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/perlin: 62.46% (0.0578 => 0.0939, std.dev.: 0.0052)
  SingleSource/UnitTests/Vector/simple: 52.40% (0.0229 => 0.0349, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 51.47% (0.0204 => 0.0309, std.dev.: 0.0032)
  SingleSource/UnitTests/Vector/constpool: 43.55% (8.8921 => 12.7650, std.dev.: 0.8596)
  MultiSource/Benchmarks/Olden/bisort/bisort: 40.72% (0.0695 => 0.0978, std.dev.: 0.0067)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 38.29% (0.0773 => 0.1069, std.dev.: 0.0048)
  MultiSource/Applications/obsequi/Obsequi: 36.97% (1.1551 => 1.5821, std.dev.: 0.0291)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 27.97% (4.9105 => 6.2839, std.dev.: 0.5101)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.11% (1.2948 => 1.5293, std.dev.: 0.0100)
  MultiSource/Applications/SPASS/SPASS: 17.09% (16.1646 => 18.9264, std.dev.: 0.7770)
  MultiSource/Applications/kimwitu++/kc: 17.07% (18.3608 => 21.4952, std.dev.: 0.0799)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.30% (1.0756 => 1.2402, std.dev.: 0.0072)
  SingleSource/Benchmarks/Stanford/Oscar: 15.01% (0.0673 => 0.0774, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.43% (0.1012 => 0.1158, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.35% (1.2116 => 1.3855, std.dev.: 0.0374)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 14.12% (0.1657 => 0.1891, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 13.76% (0.3263 => 0.3712, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.69% (1.2932 => 1.4702, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.58% (1.2201 => 1.3858, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 13.42% (1.3498 => 1.5309, std.dev.: 0.0253)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.97% (0.8802 => 0.9944, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.08% (1.2639 => 1.4166, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.02% (1.3303 => 1.4902, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.37% (1.2250 => 1.3643, std.dev.: 0.0492)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.12% (1.3068 => 1.4521, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout-C++/methcall: 11.08% (0.2031 => 0.2256, std.dev.: 0.0054)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.67% (24.6139 => 27.2413, std.dev.: 0.7827)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 10.25% (0.5241 => 0.5778, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.87% (1.2630 => 1.3876, std.dev.: 0.0382)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.66% (1.4599 => 1.5864, std.dev.: 0.0357)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.39% (1.0952 => 1.1761, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout-C++/lists: 7.18% (0.2577 => 0.2762, std.dev.: 0.0060)
  MultiSource/Benchmarks/sim/sim: 7.15% (0.3732 => 0.3999, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 120.77% (0.1377 => 0.3040, std.dev.: 0.0165)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 105.13% (0.7410 => 1.5200, std.dev.: 0.0725)
  MultiSource/Benchmarks/McCat/09-vor/vor: 76.75% (0.1140 => 0.2015, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.00% (7.6426 => 12.4575, std.dev.: 0.0274)
  MultiSource/Benchmarks/Olden/bisort/bisort: 50.76% (0.6647 => 1.0021, std.dev.: 0.0975)
  MultiSource/Applications/JM/ldecod/ldecod: 36.10% (0.0651 => 0.0886, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.73% (4.5479 => 6.1728, std.dev.: 0.3019)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 34.50% (1.3143 => 1.7677, std.dev.: 0.0487)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.31% (2.4010 => 3.2007, std.dev.: 0.0437)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.19% (0.4258 => 0.5586, std.dev.: 0.0158)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 27.37% (2.4753 => 3.1527, std.dev.: 0.0656)
  MultiSource/Applications/SPASS/SPASS: 26.43% (8.2311 => 10.4067, std.dev.: 0.8248)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.32% (1.3008 => 1.5391, std.dev.: 0.0329)
  MultiSource/Benchmarks/llubenchmark/llu: 18.18% (1.9889 => 2.3505, std.dev.: 0.1378)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.15% (30.1838 => 35.3611, std.dev.: 0.6431)
  MultiSource/Applications/obsequi/Obsequi: 16.04% (2.1884 => 2.5394, std.dev.: 0.0787)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.58% (0.1365 => 0.1564, std.dev.: 0.0041)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.29% (9.4586 => 10.4319, std.dev.: 0.3510)
  MultiSource/Benchmarks/Bullet/bullet: 10.27% (7.0333 => 7.7559, std.dev.: 0.1066)
  SingleSource/UnitTests/Vector/multiplies: 6.51% (0.5561 => 0.5923, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.09% (6.5990 => 6.9346, std.dev.: 0.0609)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.03% (4.5744 => 4.8045, std.dev.: 0.0613)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.93% (5.9061 => 6.1383, std.dev.: 0.0338)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.82% (3.9691 => 4.1207, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.41% (3.6401 => 3.7641, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (4.0596 => 4.1851, std.dev.: 0.0188)
  MultiSource/Applications/spiff/spiff: 3.08% (2.8194 => 2.9063, std.dev.: 0.0318)
  MultiSource/Applications/lua/lua: 3.04% (29.5202 => 30.4189, std.dev.: 0.3317)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.82% (3.5550 => 3.6553, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/power/power: 2.81% (1.2170 => 1.2512, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.67% (4.4696 => 4.5888, std.dev.: 0.0257)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.59% (2.4920 => 2.5566, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.43% (5.0980 => 5.2220, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.73% (1.0477 => 1.0658, std.dev.: 0.0063)
  SingleSource/Benchmarks/Misc/flops: 1.52% (9.4433 => 9.5864, std.dev.: 0.0306)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -46.79% (1.5790 => 0.8402, std.dev.: 0.0314)
  MultiSource/Benchmarks/FreeBench/neural/neural: -42.19% (0.5226 => 0.3021, std.dev.: 0.0323)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.95% (57.2347 => 43.5266, std.dev.: 3.2447)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.82% (15.9508 => 13.2681, std.dev.: 0.3036)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.27% (20.8247 => 18.4772, std.dev.: 0.5296)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.31% (3.4956 => 3.1352, std.dev.: 0.0124)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.27% (50.0284 => 46.3899, std.dev.: 0.0719)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.35% (3.0561 => 2.8925, std.dev.: 0.0075)
  SingleSource/Regression/C/uint64_to_float: -4.39% (1.4528 => 1.3890, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.53% (5.4473 => 5.2551, std.dev.: 0.0449)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.30% (2.5938 => 2.5082, std.dev.: 0.0111)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.71% (2.4471 => 2.3807, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.81% (5.2422 => 5.1474, std.dev.: 0.0215)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.24% (2.1472 => 2.1205, std.dev.: 0.0028)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.04% (89.7126 => 88.7801, std.dev.: 0.1743)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1348 => 0.1359, std.dev.: 0.0101)

Report Time: 1.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131001/ca1a66a9/attachment.html>


More information about the llvm-testresults mailing list