[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 29 16:05:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13899?compare_to=13895&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13899, Order: 187376, Start Time: 2013-07-29 21:14:25, End Time: 2013-07-29 23:07:16
      To: 13895, Order: 187364, Start Time: 2013-07-29 18:56:55, End Time: 2013-07-29 20:49:53
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 36 (51 on baseline)
Performance Improvements: 16 (31 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1055 (1025 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.45% (0.2346 => 0.2990, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 17.89% (1.3508 => 1.5924, std.dev.: 0.0836)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 14.41% (1.6856 => 1.9285, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 13.28% (1.3947 => 1.5799, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 13.19% (1.3568 => 1.5357, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.65% (1.4754 => 1.6620, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.41% (1.4406 => 1.6194, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.91% (1.3674 => 1.5302, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.52% (1.4476 => 1.6143, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.81% (1.3641 => 1.5115, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 10.66% (1.5399 => 1.7040, std.dev.: 0.0294)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.31% (47.4579 => 52.3489, std.dev.: 1.2040)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.22% (1.3979 => 1.5407, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.85% (1.6085 => 1.7670, std.dev.: 0.0481)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.66% (1.4614 => 1.6026, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.17% (1.3577 => 1.4822, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.16% (1.4384 => 1.5701, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.00% (1.5967 => 1.7404, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.87% (1.4491 => 1.5777, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.62% (1.4267 => 1.4784, std.dev.: 0.0183)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 51.07% (0.0327 => 0.0494, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.48% (29.1181 => 33.6265, std.dev.: 1.5464)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 9.10% (0.2099 => 0.2290, std.dev.: 0.0039)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 8.65% (0.4657 => 0.5060, std.dev.: 0.0085)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.74% (3.5492 => 3.6820, std.dev.: 0.0198)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (90.7923 => 94.1708, std.dev.: 0.9512)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.97% (3.4641 => 3.5671, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.33% (3.6205 => 3.7047, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.19% (4.9903 => 5.0994, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.73% (5.0812 => 5.1689, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/oourafft: 1.49% (3.7094 => 3.7648, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.46% (2.9378 => 2.9807, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.46% (5.7779 => 5.8622, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.30% (3.4344 => 3.4789, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.24% (4.9385 => 4.9998, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.19% (5.0290 => 5.0886, std.dev.: 0.0095)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -30.52% (0.3630 => 0.2522, std.dev.: 0.0299)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.52% (2.0481 => 1.4845, std.dev.: 0.0569)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -22.32% (0.0699 => 0.0543, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -20.72% (0.0975 => 0.0773, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -16.43% (0.8628 => 0.7210, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.37% (0.0793 => 0.0687, std.dev.: 0.0003)
  MultiSource/Benchmarks/BitBench/five11/five11: -13.28% (0.0768 => 0.0666, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -12.27% (0.0962 => 0.0844, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.15% (0.3750 => 0.3482, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.80% (0.6298 => 0.5870, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.71% (0.9408 => 0.9059, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.65% (1.6775 => 1.6498, std.dev.: 0.0079)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.39% (0.0421 => 0.0272, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -20.74% (0.1866 => 0.1479, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -9.23% (3.2729 => 2.9707, std.dev.: 0.0607)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.55% (4.2229 => 3.9886, std.dev.: 0.0896)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 11.22% (0.1328 => 0.1477, std.dev.: 0.0061)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.70% (0.2498 => 0.2990, std.dev.: 0.0119)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 15.87% (1.6643 => 1.9285, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.53% (1.5037 => 1.6620, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.11% (1.3993 => 1.5407, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.96% (1.3630 => 1.4988, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.40% (1.4037 => 1.5357, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.78% (1.4732 => 1.6026, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.38% (1.3946 => 1.5115, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.53% (1.6185 => 1.7404, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.32% (1.4721 => 1.5799, std.dev.: 0.0212)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.56% (49.1253 => 52.3489, std.dev.: 1.2040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.24% (1.3952 => 1.4822, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.04% (1.4947 => 1.5701, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.02% (1.6226 => 1.7040, std.dev.: 0.0294)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.25% (2.8867 => 4.2794, std.dev.: 0.0194)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.34% (0.3171 => 0.4482, std.dev.: 0.0349)
  SingleSource/Benchmarks/Stanford/Perm: 37.22% (0.0360 => 0.0494, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/hash: 26.93% (4.1846 => 5.3114, std.dev.: 0.3350)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.51% (1.5030 => 1.8864, std.dev.: 0.0231)
  MultiSource/Applications/siod/siod: 14.72% (3.3761 => 3.8729, std.dev.: 0.0533)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.96% (7.0762 => 7.9930, std.dev.: 0.0330)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.48% (14.9584 => 16.6752, std.dev.: 0.2012)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.65% (0.1678 => 0.1840, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.01% (5.4910 => 5.9860, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.62% (3.2027 => 3.4789, std.dev.: 0.0083)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0067)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (0.1348 => 0.1458, std.dev.: 0.0031)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.02% (48.3256 => 52.2032, std.dev.: 0.3860)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.48% (5.5008 => 5.9124, std.dev.: 0.1292)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.92% (3.4085 => 3.6444, std.dev.: 0.0271)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.85% (3.3384 => 3.5671, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.82% (5.3042 => 5.6659, std.dev.: 0.0183)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 6.60% (1.4327 => 1.5272, std.dev.: 0.0183)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (3.3877 => 3.6076, std.dev.: 0.0164)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 5.79% (0.4783 => 0.5060, std.dev.: 0.0085)
  MultiSource/Applications/spiff/spiff: 4.86% (2.7609 => 2.8950, std.dev.: 0.0517)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.80% (3.5351 => 3.7047, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.50% (4.3151 => 4.5094, std.dev.: 0.0258)
  SingleSource/Benchmarks/Misc/whetstone: 4.48% (3.4559 => 3.6108, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.41% (4.8739 => 5.0886, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.91% (12.8625 => 13.2362, std.dev.: 0.0327)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (3.5791 => 3.6820, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.46% (3.3464 => 3.4286, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.38% (4.9040 => 5.0208, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9196, std.dev.: 0.0483)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.56% (1.1618 => 1.1799, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.56% (4.4624 => 4.5318, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.31% (5.8390 => 5.9156, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.23% (3.0680 => 3.1057, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.15% (2.9467 => 2.9807, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.14% (5.0417 => 5.0994, std.dev.: 0.0134)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.12% (0.2237 => 0.1429, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/bisort/bisort: -34.14% (0.1072 => 0.0706, std.dev.: 0.0121)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.15% (0.0675 => 0.0512, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.17% (6.0938 => 4.7425, std.dev.: 0.5084)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.18% (0.1114 => 0.0878, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.12% (10.3031 => 10.0846, std.dev.: 0.0352)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.15% (1.5544 => 1.5366, std.dev.: 0.0018)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.42% (2.1022 => 1.4207, std.dev.: 0.0070)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.34% (0.1189 => 0.0852, std.dev.: 0.0001)
  MultiSource/Applications/viterbi/viterbi: -26.96% (3.4923 => 2.5507, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.36% (6.9552 => 5.2609, std.dev.: 0.0531)
  SingleSource/Benchmarks/Misc/perlin: -21.37% (4.5989 => 3.6162, std.dev.: 0.0467)
  SingleSource/Benchmarks/Misc/mandel: -12.69% (1.1996 => 1.0474, std.dev.: 0.0401)
  MultiSource/Applications/sgefa/sgefa: -12.57% (1.4030 => 1.2266, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.26% (0.3557 => 0.3121, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.05% (6.2627 => 5.5082, std.dev.: 0.0666)
  MultiSource/Applications/lua/lua: -7.28% (31.0707 => 28.8074, std.dev.: 0.7478)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.81% (47.2250 => 44.9542, std.dev.: 0.0651)
  SingleSource/Regression/C/uint64_to_float: -4.70% (1.5184 => 1.4470, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/fbench: -4.32% (4.9602 => 4.7457, std.dev.: 0.0166)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.24% (0.3773 => 0.3613, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.00% (0.7355 => 0.7061, std.dev.: 0.0111)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.49% (1.7207 => 1.6607, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.39% (2.8052 => 2.7102, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.88% (6.1482 => 5.9710, std.dev.: 0.0311)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.60% (2.7049 => 2.6345, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.45% (8.6172 => 8.4065, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.26% (6.0444 => 5.9077, std.dev.: 0.0163)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.83% (34.8438 => 34.2063, std.dev.: 0.0934)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.48% (1.5112 => 1.4889, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.01% (5.2218 => 5.1689, std.dev.: 0.0078)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.18% (0.1378 => 0.1477, std.dev.: 0.0061)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130729/1616bdce/attachment.html>


More information about the llvm-testresults mailing list