[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Nov 5 03:28:20 PST 2013


http://llvm.org/perf/db_default/v4/nts/17013?compare_to=17010&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 17013, Order: 194054, Start Time: 2013-11-05 09:38:05, End Time: 2013-11-05 11:31:54
      To: 17010, Order: 194048, Start Time: 2013-11-05 07:18:21, End Time: 2013-11-05 09:12:43
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 34 (54 on baseline)
Performance Improvements: 30 (17 on baseline)
Added Tests: 0 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1045 (1036 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 71.90% (0.0306 => 0.0526, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/constpool: 48.39% (9.1332 => 13.5530, std.dev.: 0.8564)
  SingleSource/Benchmarks/Misc/oourafft: 43.05% (0.2555 => 0.3655, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/richards_benchmark: 33.17% (0.0817 => 0.1088, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.36% (2.7587 => 3.2377, std.dev.: 0.0551)
  SingleSource/Benchmarks/Misc/ffbench: 14.99% (0.0794 => 0.0913, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.79% (0.9397 => 1.0693, std.dev.: 0.0432)
  SingleSource/Benchmarks/Misc/ReedSolomon: 12.92% (0.2214 => 0.2500, std.dev.: 0.0017)
  MultiSource/Applications/SPASS/SPASS: 9.99% (17.7843 => 19.5609, std.dev.: 0.6583)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 8.34% (0.1235 => 0.1338, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 52.98% (4.6890 => 7.1734, std.dev.: 0.1993)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 24.50% (41.0240 => 51.0748, std.dev.: 1.5137)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 20.86% (5.6476 => 6.8256, std.dev.: 0.4184)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 15.10% (0.1781 => 0.2050, std.dev.: 0.0070)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.06% (28.5181 => 32.2428, std.dev.: 1.0050)
  MultiSource/Benchmarks/Olden/em3d/em3d: 11.54% (4.6267 => 5.1608, std.dev.: 0.1383)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.63% (2.6715 => 2.9556, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (4.9860 => 5.4831, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc/salsa20: 8.00% (7.5418 => 8.1454, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc/ffbench: 6.04% (1.3926 => 1.4767, std.dev.: 0.0141)
  MultiSource/Applications/spiff/spiff: 6.01% (2.8210 => 2.9906, std.dev.: 0.0378)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.89% (3.9866 => 4.2213, std.dev.: 0.0100)
  MultiSource/Benchmarks/nbench/nbench: 5.19% (21.4006 => 22.5111, std.dev.: 0.3212)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.88% (0.3628 => 0.3805, std.dev.: 0.0039)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.22% (39.4774 => 41.1436, std.dev.: 0.1787)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.06% (23.4301 => 24.3805, std.dev.: 0.3034)
  SingleSource/Benchmarks/Misc/flops: 3.96% (9.2757 => 9.6429, std.dev.: 0.0134)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.18% (2.9609 => 3.0550, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.55% (4.1082 => 4.2129, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1544 => 3.2205, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.59% (6.6108 => 6.7162, std.dev.: 0.0316)
  SingleSource/Benchmarks/Shootout/methcall: 1.56% (8.5246 => 8.6578, std.dev.: 0.0196)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.31% (35.3554 => 35.8195, std.dev.: 0.0546)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.14% (6.5079 => 6.5821, std.dev.: 0.0210)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -40.96% (0.1377 => 0.0813, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -34.95% (0.1465 => 0.0953, std.dev.: 0.0177)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -27.36% (0.1418 => 0.1030, std.dev.: 0.0057)
  MultiSource/Benchmarks/NPB-serial/is/is: -21.49% (0.0977 => 0.0767, std.dev.: 0.0052)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -20.03% (0.0619 => 0.0495, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -15.17% (0.1997 => 0.1694, std.dev.: 0.0077)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -13.81% (0.0934 => 0.0805, std.dev.: 0.0010)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -12.92% (0.1161 => 0.1011, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -12.62% (0.1442 => 0.1260, std.dev.: 0.0005)
  MultiSource/Applications/d/make_dparser: -12.59% (4.1145 => 3.5966, std.dev.: 0.1691)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.87% (0.1095 => 0.0976, std.dev.: 0.0036)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.85% (0.1844 => 0.1644, std.dev.: 0.0035)
  MultiSource/Benchmarks/McCat/08-main/main: -10.55% (0.3251 => 0.2908, std.dev.: 0.0131)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.15% (0.3487 => 0.3133, std.dev.: 0.0126)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.67% (0.1200 => 0.1084, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.00% (0.2421 => 0.2203, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.60% (0.1488 => 0.1360, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.63% (5.2614 => 4.8598, std.dev.: 0.0607)
  MultiSource/Benchmarks/Olden/bh/bh: -6.09% (0.3482 => 0.3270, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/sieve: -5.69% (0.3181 => 0.3000, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -18.13% (1.5965 => 1.3070, std.dev.: 0.0273)
  SingleSource/Benchmarks/Shootout-C++/lists: -7.32% (17.0582 => 15.8089, std.dev.: 0.3601)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.62% (4.6222 => 4.4088, std.dev.: 0.0549)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.09% (2.7252 => 2.6137, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.99% (1.1672 => 1.1206, std.dev.: 0.0171)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.7509 => 1.7047, std.dev.: 0.0120)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.61% (4.9879 => 4.8575, std.dev.: 0.0400)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.59% (1.4380 => 1.4151, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/oourafft: -1.45% (3.7417 => 3.6873, std.dev.: 0.0072)
  SingleSource/Benchmarks/Misc/flops-7: -1.02% (1.7475 => 1.7296, std.dev.: 0.0033)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.31% (0.1451 => 0.1374, std.dev.: 0.0016)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 71.90% (0.0306 => 0.0526, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/oourafft: 59.33% (0.2294 => 0.3655, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/pi: 55.39% (0.0204 => 0.0317, std.dev.: 0.0032)
  SingleSource/UnitTests/Vector/constpool: 52.42% (8.8921 => 13.5530, std.dev.: 0.8564)
  SingleSource/Benchmarks/Misc/richards_benchmark: 40.93% (0.0772 => 0.1088, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.21% (2.6492 => 3.2377, std.dev.: 0.0551)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.48% (0.8802 => 1.0693, std.dev.: 0.0432)
  MultiSource/Applications/SPASS/SPASS: 21.01% (16.1646 => 19.5609, std.dev.: 0.6583)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 20.90% (0.3263 => 0.3945, std.dev.: 0.0244)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.30% (4.0397 => 4.8598, std.dev.: 0.0607)
  SingleSource/Benchmarks/Misc/ffbench: 16.31% (0.0785 => 0.0913, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.52% (0.2183 => 0.2500, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/whetstone: 13.73% (0.0874 => 0.0994, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 11.97% (0.1195 => 0.1338, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.08% (0.1237 => 0.1337, std.dev.: 0.0009)
  SingleSource/Benchmarks/McGill/chomp: 8.08% (0.2202 => 0.2380, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.63% (0.2840 => 0.3000, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.47% (0.3087 => 0.3256, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/ary: 4.57% (0.2474 => 0.2587, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.80% (0.4369 => 0.4535, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.38% (1.2932 => 1.3240, std.dev.: 0.0117)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 66.46% (4.1004 => 6.8256, std.dev.: 0.4184)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 57.73% (4.5479 => 7.1734, std.dev.: 0.1993)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 57.24% (4.4696 => 7.0281, std.dev.: 0.2030)
  SingleSource/Benchmarks/Shootout-C++/methcall: 47.29% (7.6426 => 11.2569, std.dev.: 0.1352)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.76% (2.8554 => 4.1621, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.19% (4.2391 => 5.7310, std.dev.: 0.2346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.93% (40.5588 => 51.0748, std.dev.: 1.5137)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 25.72% (1.1431 => 1.4371, std.dev.: 0.0454)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.88% (0.1754 => 0.2050, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.54% (3.0111 => 3.3585, std.dev.: 0.1067)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 11.20% (2.6579 => 2.9556, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.93% (4.9428 => 5.4831, std.dev.: 0.0195)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.42% (96.7834 => 104.9341, std.dev.: 1.3009)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.75% (6.1088 => 6.5821, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.34% (3.1730 => 3.4058, std.dev.: 0.0554)
  SingleSource/UnitTests/Vector/multiplies: 6.67% (0.5561 => 0.5932, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.35% (3.9691 => 4.2213, std.dev.: 0.0100)
  MultiSource/Applications/spiff/spiff: 6.07% (2.8194 => 2.9906, std.dev.: 0.0378)
  SingleSource/Benchmarks/Misc/ffbench: 5.25% (1.4030 => 1.4767, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc/salsa20: 4.48% (7.7964 => 8.1454, std.dev.: 0.0168)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.88% (23.4704 => 24.3805, std.dev.: 0.3034)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.78% (4.0596 => 4.2129, std.dev.: 0.0182)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.37% (89.7126 => 92.7322, std.dev.: 0.3371)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.03% (2.5368 => 2.6137, std.dev.: 0.0072)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.98% (39.9519 => 41.1436, std.dev.: 0.1787)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.23% (1.0477 => 1.0711, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/flops: 2.11% (9.4433 => 9.6429, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2205, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.72% (6.6028 => 6.7162, std.dev.: 0.0316)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.59% (35.2605 => 35.8195, std.dev.: 0.0546)
  MultiSource/Applications/hexxagon/hexxagon: 1.49% (14.7810 => 15.0005, std.dev.: 0.0742)
  SingleSource/Benchmarks/Shootout/methcall: 1.34% (8.5434 => 8.6578, std.dev.: 0.0196)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (1.6707 => 1.6883, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.17% (0.1483 => 0.1169, std.dev.: 0.0003)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.57% (57.2347 => 13.4129, std.dev.: 0.0448)
  MultiSource/Benchmarks/FreeBench/neural/neural: -50.82% (0.5226 => 0.2570, std.dev.: 0.0574)
  MultiSource/Applications/sgefa/sgefa: -42.90% (1.5790 => 0.9016, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -16.19% (4.0181 => 3.3674, std.dev.: 0.0810)
  SingleSource/Benchmarks/Shootout-C++/ary3: -14.02% (5.0002 => 4.2992, std.dev.: 0.0043)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.17% (20.8247 => 18.2907, std.dev.: 0.1765)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.48% (3.4956 => 3.1293, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (2.5938 => 2.4825, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.00% (3.9552 => 3.7969, std.dev.: 0.0534)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.48% (8.1346 => 7.8518, std.dev.: 0.0689)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.43% (1.7652 => 1.7047, std.dev.: 0.0120)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.00% (3.7874 => 3.6738, std.dev.: 0.0201)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.79% (4.3592 => 4.2375, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.28% (17.1431 => 16.7529, std.dev.: 0.0416)
  SingleSource/Benchmarks/Misc/oourafft: -1.63% (3.7484 => 3.6873, std.dev.: 0.0072)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.32% (2.4471 => 2.4148, std.dev.: 0.0047)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.93% (0.1348 => 0.1374, std.dev.: 0.0016)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131105/6fb02ed7/attachment.html>


More information about the llvm-testresults mailing list