[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 14 22:31:50 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14425?compare_to=14421&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14425, Order: 188442, Start Time: 2013-08-15 03:49:00, End Time: 2013-08-15 05:33:51
      To: 14421, Order: 188440, Start Time: 2013-08-15 01:38:18, End Time: 2013-08-15 03:25:29
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 10 (33 on baseline)
Performance Improvements: 2 (82 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1095 (992 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (1.3660 => 1.3910, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.12% (1.4933 => 1.5100, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 9.65% (0.1928 => 0.2114, std.dev.: 0.0002)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.07% (0.4911 => 0.5160, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.00% (2.1177 => 2.2025, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (1.6462 => 1.7051, std.dev.: 0.0005)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (44.8073 => 46.1810, std.dev.: 0.0762)
  SingleSource/Benchmarks/Shootout/lists: 3.03% (7.1456 => 7.3620, std.dev.: 0.0415)
  SingleSource/Benchmarks/Shootout/hash: 2.35% (5.1555 => 5.2767, std.dev.: 0.0265)
  SingleSource/Benchmarks/Misc/pi: 1.31% (2.4882 => 2.5208, std.dev.: 0.0117)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.22% (2.5578 => 2.5265, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.76% (5.4572 => 5.3612, std.dev.: 0.0024)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.31% (0.1305 => 0.1309, std.dev.: 0.0059)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 38.84% (0.0466 => 0.0647, std.dev.: 0.0007)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.52% (0.1033 => 0.1214, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.13% (1.4932 => 1.5100, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.33% (3.7285 => 6.5000, std.dev.: 0.0359)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2882, std.dev.: 0.0360)
  SingleSource/Benchmarks/Misc/pi: 27.09% (1.9835 => 2.5208, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout/hash: 26.10% (4.1846 => 5.2767, std.dev.: 0.0265)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.97% (0.6295 => 0.7363, std.dev.: 0.0302)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 16.23% (2.9428 => 3.4203, std.dev.: 0.1574)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.46% (0.1678 => 0.1887, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.17% (14.9584 => 16.6295, std.dev.: 0.3542)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (7.0762 => 7.8294, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.14% (5.4910 => 5.9380, std.dev.: 0.0116)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1710, std.dev.: 0.0662)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3551, std.dev.: 0.0182)
  MultiSource/Applications/JM/lencod/lencod: 7.10% (7.1799 => 7.6899, std.dev.: 0.1795)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.89% (3.2027 => 3.4234, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.63% (3.4085 => 3.6003, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.49% (5.5008 => 5.8026, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.37% (4.3151 => 4.5038, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.16% (5.1471 => 5.3612, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/whetstone: 4.12% (3.4559 => 3.5982, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4612, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.35% (25.0200 => 25.8574, std.dev.: 0.0979)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.20% (2.1343 => 2.2025, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (12.8625 => 13.1909, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.88% (1.6737 => 1.7051, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/lists: 1.80% (7.2315 => 7.3620, std.dev.: 0.0415)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.67% (1.4398 => 1.4639, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.35% (1.2639 => 1.2810, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.28% (1.5957 => 1.6162, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.23% (3.0680 => 3.1057, std.dev.: 0.0041)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.64% (0.2237 => 0.1462, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.82% (0.1818 => 0.1385, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.11% (0.0675 => 0.0519, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.54% (0.1114 => 0.0874, std.dev.: 0.0088)
  MultiSource/Applications/obsequi/Obsequi: -19.09% (1.4685 => 1.1881, std.dev.: 0.1087)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.76% (0.1870 => 0.1650, std.dev.: 0.0018)
  MultiSource/Applications/JM/ldecod/ldecod: -11.68% (8.6720 => 7.6590, std.dev.: 0.0320)
  MultiSource/Applications/ClamAV/clamscan: -11.58% (19.4145 => 17.1654, std.dev.: 0.6364)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.37% (1.7797 => 1.5952, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.44% (0.3655 => 0.3310, std.dev.: 0.0066)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.62% (1.1012 => 1.0063, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.29% (1.4514 => 1.3456, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.19% (1.5345 => 1.4241, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.18% (1.5144 => 1.4056, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.05% (1.5426 => 1.4338, std.dev.: 0.0120)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.87% (1.7461 => 1.6261, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.40% (1.4794 => 1.3847, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.35% (1.5815 => 1.4811, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.30% (1.6226 => 1.5203, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.04% (1.5239 => 1.4318, std.dev.: 0.0135)
  MultiSource/Applications/JM/lencod/lencod: -5.99% (18.5029 => 17.3953, std.dev.: 0.2327)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.91% (2.6853 => 2.5265, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.85% (1.4333 => 1.3495, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.67% (1.5437 => 1.4562, std.dev.: 0.0018)
  MultiSource/Applications/oggenc/oggenc: -5.54% (6.1121 => 5.7732, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.42% (1.4853 => 1.4048, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.03% (1.5361 => 1.4589, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.97% (1.4339 => 1.3627, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.91% (1.4721 => 1.3998, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.79% (1.4940 => 1.4224, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.71% (1.4783 => 1.4086, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.69% (1.4166 => 1.3501, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (1.4506 => 1.3845, std.dev.: 0.0112)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.46% (5.3476 => 5.1090, std.dev.: 0.0660)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.44% (1.5629 => 1.4935, std.dev.: 0.0131)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.31% (27.6418 => 26.4510, std.dev.: 0.1202)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.13% (1.4947 => 1.4329, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.62% (1.5479 => 1.4919, std.dev.: 0.0119)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.45% (0.3309 => 0.3195, std.dev.: 0.0012)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -3.27% (49.1253 => 47.5192, std.dev.: 0.0247)
  MultiSource/Benchmarks/Bullet/bullet: -3.26% (37.4863 => 36.2643, std.dev.: 0.1050)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.99% (1.5357 => 1.4898, std.dev.: 0.0142)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.95% (0.7189 => 0.6977, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.45% (1.3649 => 1.3314, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.12% (1.6185 => 1.5842, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.33% (1.4732 => 1.4536, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.61% (1.4194 => 0.8855, std.dev.: 0.1696)
  MultiSource/Benchmarks/Olden/mst/mst: -36.83% (0.2134 => 0.1348, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.42% (2.1022 => 1.4207, std.dev.: 0.0131)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.00% (0.0816 => 0.0563, std.dev.: 0.0006)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.77% (0.1189 => 0.0835, std.dev.: 0.0026)
  MultiSource/Applications/viterbi/viterbi: -27.49% (3.4923 => 2.5322, std.dev.: 0.0052)
  MultiSource/Applications/JM/ldecod/ldecod: -25.15% (0.0859 => 0.0643, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.66% (6.9552 => 5.2400, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/perlin: -21.40% (4.5989 => 3.6146, std.dev.: 0.0396)
  SingleSource/Benchmarks/Misc/mandel: -14.30% (1.1996 => 1.0281, std.dev.: 0.0230)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.99% (0.3557 => 0.3166, std.dev.: 0.0145)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.86% (0.5173 => 0.4611, std.dev.: 0.0047)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.46% (0.0956 => 0.0856, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.57% (2.6094 => 2.3598, std.dev.: 0.0936)
  SingleSource/Benchmarks/Shootout/strcat: -9.04% (0.1593 => 0.1449, std.dev.: 0.0016)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.98% (3.5791 => 3.2936, std.dev.: 0.0440)
  SingleSource/Regression/C/uint64_to_float: -5.85% (1.5184 => 1.4296, std.dev.: 0.0338)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.29% (1.7207 => 1.6296, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.27% (0.3773 => 0.3574, std.dev.: 0.0055)
  MultiSource/Benchmarks/Bullet/bullet: -4.30% (7.2995 => 6.9853, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.17% (1.1024 => 1.0564, std.dev.: 0.0144)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.94% (21.6864 => 20.8316, std.dev.: 0.0730)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.49% (6.0444 => 5.8334, std.dev.: 0.0035)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.42% (2.7049 => 2.6125, std.dev.: 0.0292)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.30% (0.4783 => 0.4625, std.dev.: 0.0032)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.26% (93.6732 => 90.6235, std.dev.: 0.0598)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9616, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.90% (5.2218 => 5.0706, std.dev.: 0.0099)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.23% (29.8131 => 29.1471, std.dev.: 0.1322)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.21% (47.2250 => 46.1810, std.dev.: 0.0762)
  SingleSource/Benchmarks/Misc/oourafft: -2.19% (3.7891 => 3.7061, std.dev.: 0.0265)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.04% (34.8438 => 34.1322, std.dev.: 0.0740)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.62% (1.2012 => 1.1818, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.60% (5.0180 => 4.9379, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.57% (5.8810 => 5.7888, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.37% (4.9231 => 4.8558, std.dev.: 0.0005)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.01% (0.1378 => 0.1309, std.dev.: 0.0059)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130815/66af6174/attachment.html>


More information about the llvm-testresults mailing list