[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 31 05:24:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13953?compare_to=13950&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13953, Order: 187486, Start Time: 2013-07-31 10:32:49, End Time: 2013-07-31 12:25:55
      To: 13950, Order: 187483, Start Time: 2013-07-31 06:29:39, End Time: 2013-07-31 08:10:49
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 63 (60 on baseline)
Performance Improvements: 0 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1044 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 66.26% (0.1215 => 0.2020, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 61.30% (0.0951 => 0.1534, std.dev.: 0.0128)
  SingleSource/UnitTests/Vector/simple: 60.85% (0.0212 => 0.0341, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/constpool: 47.01% (8.9544 => 13.1638, std.dev.: 1.0309)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 45.74% (0.9770 => 1.4239, std.dev.: 0.0747)
  MultiSource/Applications/viterbi/viterbi: 42.87% (0.1815 => 0.2593, std.dev.: 0.0195)
  MultiSource/Applications/Burg/burg: 30.46% (1.4486 => 1.8899, std.dev.: 0.0580)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.03% (0.2237 => 0.2864, std.dev.: 0.0093)
  MultiSource/Applications/treecc/treecc: 24.96% (2.3241 => 2.9043, std.dev.: 0.0580)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.67% (1.4467 => 1.7747, std.dev.: 0.0755)
  MultiSource/Applications/SPASS/SPASS: 17.05% (17.0322 => 19.9363, std.dev.: 0.3002)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.71% (1.5820 => 1.8464, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.58% (1.4865 => 1.7329, std.dev.: 0.0046)
  MultiSource/Applications/ClamAV/clamscan: 16.18% (17.0402 => 19.7978, std.dev.: 0.7721)
  MultiSource/Applications/d/make_dparser: 14.53% (3.7310 => 4.2730, std.dev.: 0.1345)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.12% (1.4441 => 1.6480, std.dev.: 0.0195)
  MultiSource/Applications/oggenc/oggenc: 14.05% (5.7242 => 6.5282, std.dev.: 0.0648)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.90% (1.3622 => 1.5516, std.dev.: 0.0200)
  MultiSource/Applications/aha/aha: 13.84% (0.1286 => 0.1464, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 13.67% (1.4018 => 1.5934, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.55% (1.4518 => 1.6485, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.91% (1.3877 => 1.5668, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 12.68% (1.5896 => 1.7912, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.59% (1.3638 => 1.5355, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.80% (1.4847 => 1.6599, std.dev.: 0.0334)
  MultiSource/Applications/sqlite3/sqlite3: 11.78% (17.3383 => 19.3805, std.dev.: 0.4362)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.75% (1.3537 => 1.5127, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.73% (1.3959 => 1.5596, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.72% (1.4508 => 1.6209, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.63% (1.4227 => 1.5882, std.dev.: 0.0470)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.55% (1.4885 => 1.6604, std.dev.: 0.0467)
  MultiSource/Applications/SIBsim4/SIBsim4: 11.01% (1.6307 => 1.8103, std.dev.: 0.0501)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.95% (0.1461 => 0.1621, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.62% (10.0144 => 11.0780, std.dev.: 0.3225)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.40% (1.3659 => 1.5079, std.dev.: 0.0438)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.63% (25.9725 => 28.4733, std.dev.: 0.3740)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.76% (1.4403 => 1.5665, std.dev.: 0.0434)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.71% (0.3506 => 0.3636, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 70.69% (0.0406 => 0.0693, std.dev.: 0.0029)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 38.11% (2.3150 => 3.1972, std.dev.: 0.0790)
  MultiSource/Applications/SPASS/SPASS: 37.01% (8.3089 => 11.3844, std.dev.: 0.1696)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.54% (1.4780 => 1.8998, std.dev.: 0.0030)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.99% (28.9552 => 35.9023, std.dev.: 0.3075)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.07% (9.1533 => 10.8076, std.dev.: 0.2278)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 17.97% (0.7620 => 0.8989, std.dev.: 0.0417)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.46% (0.0630 => 0.0740, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.31% (4.1173 => 4.8298, std.dev.: 0.0079)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.87% (14.4534 => 16.3129, std.dev.: 0.2803)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.08% (3.2592 => 3.6528, std.dev.: 0.1189)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.35% (2.9666 => 3.1551, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.16% (5.0049 => 5.3134, std.dev.: 0.0089)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.77% (90.7833 => 95.1170, std.dev.: 0.5161)
  MultiSource/Benchmarks/Olden/em3d/em3d: 4.58% (4.9531 => 5.1799, std.dev.: 0.0194)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.39% (3.2097 => 3.3507, std.dev.: 0.0275)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.24% (2.4207 => 2.5234, std.dev.: 0.0249)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.19% (4.4312 => 4.6168, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/salsa20: 2.73% (8.7266 => 8.9648, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.95% (1.6069 => 1.6382, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.70% (5.0096 => 5.0946, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.58% (5.7762 => 5.8676, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.41% (5.8002 => 5.8822, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.20% (3.7397 => 3.7845, std.dev.: 0.0151)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.09% (12.2131 => 12.3463, std.dev.: 0.0175)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 24.53% (0.1325 => 0.1650, std.dev.: 0.0113)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 58.80% (0.0966 => 0.1534, std.dev.: 0.0128)
  SingleSource/UnitTests/Vector/simple: 55.00% (0.0220 => 0.0341, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/constpool: 48.53% (8.8630 => 13.1638, std.dev.: 1.0309)
  MultiSource/Applications/viterbi/viterbi: 36.12% (0.1905 => 0.2593, std.dev.: 0.0195)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.07% (0.1518 => 0.2020, std.dev.: 0.0008)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.30% (1.1012 => 1.4239, std.dev.: 0.0747)
  MultiSource/Applications/treecc/treecc: 22.80% (2.3651 => 2.9043, std.dev.: 0.0580)
  MultiSource/Applications/Burg/burg: 20.12% (1.5733 => 1.8899, std.dev.: 0.0580)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 18.85% (1.4932 => 1.7747, std.dev.: 0.0755)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.65% (0.2498 => 0.2864, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 14.08% (1.6185 => 1.8464, std.dev.: 0.0084)
  MultiSource/Applications/d/make_dparser: 13.28% (3.7722 => 4.2730, std.dev.: 0.1345)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.95% (1.5479 => 1.7329, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.73% (1.4750 => 1.6480, std.dev.: 0.0195)
  MultiSource/Applications/SPASS/SPASS: 11.31% (17.9111 => 19.9363, std.dev.: 0.3002)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.06% (1.3826 => 1.5355, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.98% (1.3630 => 1.5127, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.50% (1.4179 => 1.5668, std.dev.: 0.0257)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.60% (0.1479 => 0.1621, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.21% (1.4339 => 1.5516, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.12% (1.3946 => 1.5079, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.09% (1.5357 => 1.6599, std.dev.: 0.0334)
  MultiSource/Applications/oggenc/oggenc: 6.81% (6.1121 => 6.5282, std.dev.: 0.0648)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.79% (1.5437 => 1.6485, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.94% (1.4721 => 1.5596, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.52% (1.5361 => 1.6209, std.dev.: 0.0163)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 57.14% (0.0441 => 0.0693, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.27% (2.8867 => 4.2801, std.dev.: 0.0433)
  MultiSource/Benchmarks/FreeBench/neural/neural: 40.59% (0.3171 => 0.4458, std.dev.: 0.0425)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 28.96% (0.0366 => 0.0472, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.40% (1.5030 => 1.8998, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 24.13% (2.9428 => 3.6528, std.dev.: 0.1189)
  MultiSource/Applications/SPASS/SPASS: 23.45% (9.2220 => 11.3844, std.dev.: 0.1696)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.53% (2.6094 => 3.1972, std.dev.: 0.0790)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 20.42% (29.8131 => 35.9023, std.dev.: 0.3075)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.30% (9.1355 => 10.8076, std.dev.: 0.2278)
  MultiSource/Applications/siod/siod: 17.91% (3.3761 => 3.9809, std.dev.: 0.2264)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.01% (7.0762 => 7.9971, std.dev.: 0.0772)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.34% (5.4910 => 6.0038, std.dev.: 0.0619)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.06% (14.9584 => 16.3129, std.dev.: 0.2803)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3611, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.28% (2.3304 => 2.5234, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.51% (3.2027 => 3.4431, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.93% (5.5008 => 5.8822, std.dev.: 0.0262)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.77% (48.3256 => 51.5992, std.dev.: 0.5842)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.71% (2.9568 => 3.1551, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (3.4085 => 3.6120, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.83% (5.3042 => 5.6135, std.dev.: 0.0266)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (3.3877 => 3.5824, std.dev.: 0.0543)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.72% (4.3151 => 4.5619, std.dev.: 0.0874)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.18% (3.3384 => 3.5113, std.dev.: 0.0253)
  MultiSource/Applications/spiff/spiff: 4.95% (2.7609 => 2.8975, std.dev.: 0.0425)
  SingleSource/Benchmarks/Misc/whetstone: 4.51% (3.4559 => 3.6118, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3658, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.46% (4.4624 => 4.6168, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.66% (1.5957 => 1.6382, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.90% (4.9995 => 5.0946, std.dev.: 0.0311)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (93.6732 => 95.1170, std.dev.: 0.5161)
  SingleSource/Benchmarks/Misc/flops: 1.53% (9.7664 => 9.9156, std.dev.: 0.0371)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.48% (1.1618 => 1.1790, std.dev.: 0.0007)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.99% (0.2237 => 0.1432, std.dev.: 0.0129)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.04% (0.1947 => 0.1771, std.dev.: 0.0063)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -6.04% (0.2432 => 0.2285, std.dev.: 0.0018)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -90.99% (0.0111 => 0.0010, std.dev.: 0.0035)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.00% (2.1022 => 1.4295, std.dev.: 0.0091)
  MultiSource/Applications/viterbi/viterbi: -26.50% (3.4923 => 2.5669, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.38% (6.9552 => 5.2595, std.dev.: 0.0107)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0097)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -18.00% (1.0962 => 0.8989, std.dev.: 0.0417)
  MultiSource/Applications/obsequi/Obsequi: -14.58% (2.6081 => 2.2279, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/mandel: -14.49% (1.1996 => 1.0258, std.dev.: 0.0125)
  MultiSource/Applications/sgefa/sgefa: -12.66% (1.4030 => 1.2254, std.dev.: 0.0035)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.18% (47.2250 => 43.3597, std.dev.: 0.8238)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.38% (3.5791 => 3.3507, std.dev.: 0.0275)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.27% (1.7207 => 1.6300, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (3.8119 => 3.6331, std.dev.: 0.0536)
  SingleSource/Benchmarks/Misc/fbench: -4.46% (4.9602 => 4.7391, std.dev.: 0.0125)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.23% (0.7355 => 0.7044, std.dev.: 0.0008)
  SingleSource/Regression/C/uint64_to_float: -4.14% (1.5184 => 1.4555, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.00% (6.1482 => 5.9637, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.00% (6.0444 => 5.9238, std.dev.: 0.0396)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.94% (34.8438 => 34.1682, std.dev.: 0.0823)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.57% (1.2012 => 1.1824, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.54% (1.5112 => 1.4879, std.dev.: 0.0058)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.24% (1.3104 => 1.2942, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 19.74% (0.1378 => 0.1650, std.dev.: 0.0113)

Report Time: 1.41s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130731/16844b22/attachment.html>


More information about the llvm-testresults mailing list