[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 29 18:19:27 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13901?compare_to=13899&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13901, Order: 187387, Start Time: 2013-07-29 23:30:22, End Time: 2013-07-30 01:21:08
      To: 13899, Order: 187376, Start Time: 2013-07-29 21:14:25, End Time: 2013-07-29 23:07:16
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 6 (27 on baseline)
Performance Improvements: 16 (43 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1085 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 6.25% (0.2799 => 0.2974, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.7291 => 0.7743, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/flops-4: 6.07% (1.5371 => 1.6304, std.dev.: 0.0350)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.14% (11.3645 => 11.6078, std.dev.: 0.0444)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.01% (1.0704 => 1.0919, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.93% (1.5997 => 1.6306, std.dev.: 0.0115)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -18.95% (0.3372 => 0.2733, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -16.13% (1.5924 => 1.3356, std.dev.: 0.0934)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -15.68% (1.7533 => 1.4783, std.dev.: 0.0990)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.82% (1.6873 => 1.4541, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.52% (0.1879 => 0.1719, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.31% (0.3501 => 0.3210, std.dev.: 0.0049)
  MultiSource/Benchmarks/McCat/18-imp/imp: -3.93% (0.4117 => 0.3955, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.20% (0.6878 => 0.6727, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.75% (5.8525 => 5.7500, std.dev.: 0.0219)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.16% (0.9059 => 0.8954, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.08% (1.1393 => 1.1270, std.dev.: 0.0021)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: -24.09% (0.0494 => 0.0375, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.57% (3.4789 => 3.4242, std.dev.: 0.0189)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.56% (2.5436 => 2.5040, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.47% (1.3088 => 1.2895, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.03% (6.1799 => 6.1161, std.dev.: 0.0102)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.91% (0.1477 => 0.1375, std.dev.: 0.0032)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (0.9407 => 0.9514, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2880, std.dev.: 0.0264)
  MultiSource/Benchmarks/FreeBench/neural/neural: 39.99% (0.3171 => 0.4439, std.dev.: 0.0360)
  SingleSource/Benchmarks/Shootout/hash: 25.27% (4.1846 => 5.2422, std.dev.: 0.3244)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.10% (1.5030 => 1.8803, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.00% (0.6295 => 0.7743, std.dev.: 0.0158)
  MultiSource/Applications/siod/siod: 13.79% (3.3761 => 3.8417, std.dev.: 0.0636)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.54% (7.0762 => 8.0341, std.dev.: 0.0337)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.80% (0.1348 => 0.1507, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.38% (0.1678 => 0.1869, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.01% (0.2679 => 0.2974, std.dev.: 0.0055)
  MultiSource/Benchmarks/FreeBench/mason/mason: 8.93% (0.2799 => 0.3049, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.48% (5.4910 => 5.9568, std.dev.: 0.0751)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.98% (48.3256 => 52.1814, std.dev.: 0.0507)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4242, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.26% (3.4085 => 3.6218, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.94% (5.3042 => 5.6191, std.dev.: 0.0401)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.88% (3.3877 => 3.5869, std.dev.: 0.0578)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.51% (5.5008 => 5.8041, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.88% (5.1471 => 5.3983, std.dev.: 0.0460)
  SingleSource/Benchmarks/Misc/whetstone: 4.73% (3.4559 => 3.6193, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.06% (3.5351 => 3.6433, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.45% (12.8625 => 13.1774, std.dev.: 0.0409)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.19% (1.5956 => 1.6306, std.dev.: 0.0115)
  SingleSource/Benchmarks/Misc/flops: 1.59% (9.7664 => 9.9217, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.07% (5.0417 => 5.0954, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.02% (4.9089 => 4.9588, std.dev.: 0.0119)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.21% (0.2237 => 0.1427, std.dev.: 0.0307)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.18% (0.1072 => 0.0727, std.dev.: 0.0047)
  MultiSource/Benchmarks/MallocBench/gs/gs: -23.08% (6.0938 => 4.6872, std.dev.: 0.0265)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.63% (0.0675 => 0.0529, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.30% (0.1114 => 0.0899, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.15% (0.3576 => 0.2927, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.39% (0.2367 => 0.2050, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -12.18% (0.3655 => 0.3210, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.70% (6.1631 => 5.7500, std.dev.: 0.0219)
  MultiSource/Benchmarks/Olden/bh/bh: -6.66% (0.3603 => 0.3363, std.dev.: 0.0012)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.77% (0.4153 => 0.3955, std.dev.: 0.0029)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.22% (1.5376 => 1.4727, std.dev.: 0.0075)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.07% (10.3031 => 9.9871, std.dev.: 0.0251)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.62% (1.4932 => 1.4541, std.dev.: 0.0134)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.48% (0.5634 => 0.5494, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.25% (1.5544 => 1.5194, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.91% (0.7523 => 0.7379, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.99% (2.1022 => 1.4297, std.dev.: 0.0176)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.35% (0.1189 => 0.0840, std.dev.: 0.0010)
  MultiSource/Applications/viterbi/viterbi: -27.55% (3.4923 => 2.5302, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2423, std.dev.: 0.2205)
  MultiSource/Applications/JM/ldecod/ldecod: -24.56% (0.0859 => 0.0648, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/perlin: -21.43% (4.5989 => 3.6133, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/mandel: -14.33% (1.1996 => 1.0277, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.72% (6.2627 => 5.4036, std.dev.: 0.2260)
  MultiSource/Applications/sgefa/sgefa: -12.89% (1.4030 => 1.2222, std.dev.: 0.0135)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.37% (0.3557 => 0.3117, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.74% (0.5173 => 0.4669, std.dev.: 0.0179)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.09% (0.3773 => 0.3581, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.04% (3.8119 => 3.6198, std.dev.: 0.0284)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.98% (47.2250 => 44.8715, std.dev.: 0.1407)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.20% (0.3479 => 0.3333, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/fbench: -4.17% (4.9602 => 4.7534, std.dev.: 0.0119)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.12% (0.7355 => 0.7052, std.dev.: 0.0053)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.95% (1.3148 => 1.2629, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.85% (6.1482 => 5.9730, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.82% (5.2218 => 5.0747, std.dev.: 0.0498)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.80% (21.6864 => 21.0793, std.dev.: 0.2315)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.07% (2.7049 => 2.6489, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.93% (34.8438 => 34.1722, std.dev.: 0.0873)
  MultiSource/Benchmarks/Olden/bh/bh: -1.91% (2.4879 => 2.4403, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.59% (1.3104 => 1.2895, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (5.8810 => 5.8077, std.dev.: 0.0226)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.22% (0.1378 => 0.1375, std.dev.: 0.0032)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130729/5aa07cc9/attachment.html>


More information about the llvm-testresults mailing list