[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 07:23:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14566?compare_to=14562&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14566, Order: 188668, Start Time: 2013-08-19 12:30:35, End Time: 2013-08-19 14:25:20
      To: 14562, Order: 188660, Start Time: 2013-08-19 09:55:16, End Time: 2013-08-19 11:45:07
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 39 (57 on baseline)
Performance Improvements: 2 (39 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1011 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 61.92% (0.1250 => 0.2024, std.dev.: 0.0084)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 44.63% (0.2299 => 0.3325, std.dev.: 0.0376)
  MultiSource/Applications/Burg/burg: 34.13% (1.4719 => 1.9742, std.dev.: 0.0378)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 26.73% (0.3958 => 0.5016, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.85% (1.4990 => 1.7666, std.dev.: 0.0209)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.66% (0.3530 => 0.4118, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.69% (1.5184 => 1.7566, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 12.83% (1.4887 => 1.6797, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 12.82% (1.4275 => 1.6105, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 12.55% (1.3662 => 1.5377, std.dev.: 0.0638)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.07% (1.3968 => 1.5654, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.89% (1.3321 => 1.4639, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.86% (1.5094 => 1.6582, std.dev.: 0.0339)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 9.61% (0.4245 => 0.4653, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.94% (1.4036 => 1.5291, std.dev.: 0.0291)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.92% (0.8016 => 0.8731, std.dev.: 0.0156)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.85% (0.2651 => 0.2859, std.dev.: 0.0036)
  MultiSource/Applications/oggenc/oggenc: 7.65% (5.7655 => 6.2068, std.dev.: 0.1333)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.62% (1.4077 => 1.5150, std.dev.: 0.0277)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 73.93% (5.7960 => 10.0812, std.dev.: 0.5683)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 65.28% (1.5068 => 2.4904, std.dev.: 0.0384)
  MultiSource/Applications/SPASS/SPASS: 27.74% (8.1264 => 10.3806, std.dev.: 0.3004)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.70% (2.6879 => 3.2442, std.dev.: 0.1813)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.61% (4.1363 => 4.8232, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.97% (40.3440 => 44.7697, std.dev.: 0.1027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 10.89% (0.2021 => 0.2241, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (4.8084 => 5.1653, std.dev.: 0.0080)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.17% (40.0219 => 42.4911, std.dev.: 0.0988)
  MultiSource/Benchmarks/nbench/nbench: 5.74% (21.0733 => 22.2839, std.dev.: 0.1594)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.59% (4.0001 => 4.2236, std.dev.: 0.0013)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.98% (0.6681 => 0.7014, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.75% (4.6587 => 4.8332, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc/mandel: 3.53% (1.0297 => 1.0660, std.dev.: 0.0090)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.13% (5.5857 => 5.7606, std.dev.: 0.0509)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.52% (5.0084 => 5.1346, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.84% (5.8005 => 5.9072, std.dev.: 0.0379)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.6114 => 1.6346, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/whetstone: 1.16% (3.5682 => 3.6095, std.dev.: 0.0132)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.04% (12.2383 => 12.3657, std.dev.: 0.0102)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/test1: -34.72% (0.2160 => 0.1410, std.dev.: 0.0079)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: -1.01% (8.6146 => 8.5273, std.dev.: 0.0163)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1309 => 0.1319, std.dev.: 0.0176)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 43.78% (0.0466 => 0.0670, std.dev.: 0.0042)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.33% (0.1518 => 0.2024, std.dev.: 0.0084)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 29.51% (0.3873 => 0.5016, std.dev.: 0.0294)
  MultiSource/Applications/Burg/burg: 25.48% (1.5733 => 1.9742, std.dev.: 0.0378)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.39% (0.1033 => 0.1223, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.39% (0.3508 => 0.4118, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 14.60% (1.5416 => 1.7666, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.20% (1.3952 => 1.5654, std.dev.: 0.0211)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.26% (0.4182 => 0.4653, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.38% (1.5357 => 1.6797, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.26% (1.6226 => 1.7566, std.dev.: 0.0125)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.95% (0.8088 => 0.8731, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.25% (1.3649 => 1.4639, std.dev.: 0.0144)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.77% (0.2703 => 0.2859, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 73.34% (5.8158 => 10.0812, std.dev.: 0.5683)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 69.22% (3.7285 => 6.3094, std.dev.: 0.2033)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 54.48% (1.6121 => 2.4904, std.dev.: 0.0384)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2886, std.dev.: 0.0341)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 43.53% (2.9033 => 4.1672, std.dev.: 0.4486)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.76% (0.3171 => 0.4305, std.dev.: 0.0393)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 29.68% (2.9428 => 3.8161, std.dev.: 0.3246)
  SingleSource/Benchmarks/Shootout/hash: 28.66% (4.1846 => 5.3837, std.dev.: 0.2733)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.13% (1.5030 => 1.8656, std.dev.: 0.0228)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 23.57% (0.0526 => 0.0650, std.dev.: 0.0035)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.19% (2.6992 => 3.2442, std.dev.: 0.1813)
  SingleSource/Benchmarks/Shootout-C++/hash: 17.93% (0.6295 => 0.7424, std.dev.: 0.0306)
  MultiSource/Applications/SPASS/SPASS: 12.56% (9.2220 => 10.3806, std.dev.: 0.3004)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.41% (9.1355 => 10.2696, std.dev.: 0.4273)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.17% (7.0762 => 7.9376, std.dev.: 0.0961)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.85% (14.9584 => 16.7309, std.dev.: 0.2139)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.53% (40.5028 => 44.7697, std.dev.: 0.1027)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.55% (5.4910 => 6.0154, std.dev.: 0.0559)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.38% (48.3256 => 52.3756, std.dev.: 0.3057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.01% (5.3042 => 5.7293, std.dev.: 0.0957)
  MultiSource/Benchmarks/FreeBench/mason/mason: 7.54% (0.2799 => 0.3010, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.39% (5.5008 => 5.9072, std.dev.: 0.0379)
  SingleSource/Benchmarks/Dhrystone/fldry: 6.30% (0.6598 => 0.7014, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.04% (4.3151 => 4.5756, std.dev.: 0.0697)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.03% (3.4085 => 3.6142, std.dev.: 0.0368)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.39% (4.0075 => 4.2236, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.32% (6.1245 => 6.4503, std.dev.: 0.1137)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.14% (1.5339 => 1.6128, std.dev.: 0.0122)
  SingleSource/Benchmarks/Misc/whetstone: 4.44% (3.4559 => 3.6095, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.92% (3.3384 => 3.4692, std.dev.: 0.0452)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.58% (41.0210 => 42.4911, std.dev.: 0.0988)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.43% (4.4624 => 4.6153, std.dev.: 0.0528)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.37% (25.0200 => 25.8627, std.dev.: 0.0487)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.24% (4.8739 => 5.0320, std.dev.: 0.0441)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.05% (1.5956 => 1.6443, std.dev.: 0.0103)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.99% (1.3104 => 1.3496, std.dev.: 0.0071)
  MultiSource/Applications/spiff/spiff: 2.91% (2.7609 => 2.8413, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.70% (4.9995 => 5.1346, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.52% (3.3464 => 3.4306, std.dev.: 0.0220)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.44% (1.5957 => 1.6346, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.05% (4.7360 => 4.8332, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.98% (4.9040 => 5.0011, std.dev.: 0.0316)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.96% (1.4398 => 1.4680, std.dev.: 0.0079)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.21% (0.2237 => 0.1494, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.32% (0.1072 => 0.0747, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.39% (0.1818 => 0.1411, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.78% (0.0675 => 0.0528, std.dev.: 0.0015)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.57% (1.5228 => 1.2095, std.dev.: 0.0239)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.56% (0.1114 => 0.0885, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/health/health: -19.92% (0.1993 => 0.1596, std.dev.: 0.0059)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -17.84% (0.3576 => 0.2938, std.dev.: 0.0026)
  MultiSource/Applications/lua/lua: -17.35% (5.3200 => 4.3971, std.dev.: 0.0532)
  MultiSource/Applications/hexxagon/hexxagon: -15.69% (1.3285 => 1.1201, std.dev.: 0.0802)
  MultiSource/Benchmarks/Olden/em3d/em3d: -13.10% (0.2367 => 0.2057, std.dev.: 0.0030)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.85% (1.3985 => 1.2188, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.56% (2.1022 => 1.4387, std.dev.: 0.0205)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.90% (0.0816 => 0.0572, std.dev.: 0.0004)
  MultiSource/Applications/viterbi/viterbi: -27.06% (3.4923 => 2.5474, std.dev.: 0.0212)
  MultiSource/Benchmarks/Olden/bisort/bisort: -26.24% (0.9545 => 0.7040, std.dev.: 0.0688)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2422, std.dev.: 0.0287)
  SingleSource/Benchmarks/Misc/perlin: -21.32% (4.5989 => 3.6185, std.dev.: 0.0130)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.10% (0.3557 => 0.3091, std.dev.: 0.0041)
  MultiSource/Applications/minisat/minisat: -12.99% (8.0162 => 6.9748, std.dev.: 0.2511)
  SingleSource/Benchmarks/Misc/mandel: -11.14% (1.1996 => 1.0660, std.dev.: 0.0090)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.99% (3.5791 => 3.2931, std.dev.: 0.1095)
  MultiSource/Benchmarks/Olden/health/health: -6.66% (0.3556 => 0.3319, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.62% (0.3773 => 0.3561, std.dev.: 0.0056)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6299, std.dev.: 0.0310)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.73% (47.2250 => 44.9936, std.dev.: 0.2284)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.61% (3.8119 => 3.6362, std.dev.: 0.0506)
  SingleSource/Benchmarks/Misc/fbench: -4.10% (4.9602 => 4.7570, std.dev.: 0.0267)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.08% (0.3479 => 0.3337, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.26% (0.4969 => 0.4807, std.dev.: 0.0063)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.09% (0.7806 => 0.7565, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.02% (6.0444 => 5.8617, std.dev.: 0.0505)
  MultiSource/Benchmarks/Olden/bh/bh: -2.77% (2.4879 => 2.4190, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.65% (5.2218 => 5.0834, std.dev.: 0.0455)
  MultiSource/Applications/sgefa/sgefa: -2.49% (1.4030 => 1.3681, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/oourafft: -1.98% (3.7891 => 3.7142, std.dev.: 0.0228)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.97% (8.6172 => 8.4477, std.dev.: 0.0153)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.46% (34.8438 => 34.3363, std.dev.: 0.0661)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.03% (5.8810 => 5.8203, std.dev.: 0.0145)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.28% (0.1378 => 0.1319, std.dev.: 0.0176)

Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130819/0c11677f/attachment.html>


More information about the llvm-testresults mailing list