[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 20:27:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16088?compare_to=16085&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16088, Order: 192151, Start Time: 2013-10-08 01:41:01, End Time: 2013-10-08 03:30:23
      To: 16085, Order: 192139, Start Time: 2013-10-07 23:22:55, End Time: 2013-10-08 01:15:49
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 15 (25 on baseline)
Performance Improvements: 47 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1045 (1067 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 11.19% (8.4280 => 9.3709, std.dev.: 0.0878)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 6.60% (0.4606 => 0.4910, std.dev.: 0.0084)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.02% (0.4367 => 0.4630, std.dev.: 0.0004)
  MultiSource/Applications/aha/aha: 4.86% (3.6002 => 3.7750, std.dev.: 0.0652)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.28% (97.4884 => 100.6867, std.dev.: 0.9478)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.70% (4.1706 => 4.2831, std.dev.: 0.0292)
  SingleSource/Benchmarks/Shootout/lists: 2.65% (7.1899 => 7.3803, std.dev.: 0.0564)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.50% (1.6539 => 1.6953, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.81% (3.1634 => 3.2206, std.dev.: 0.0011)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (45.6585 => 46.3971, std.dev.: 0.0421)
  MultiSource/Applications/viterbi/viterbi: 1.59% (2.6452 => 2.6873, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/mandel: 1.53% (1.0504 => 1.0665, std.dev.: 0.0003)
  SingleSource/Regression/C/uint64_to_float: 1.36% (1.4589 => 1.4787, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.24% (4.9334 => 4.9947, std.dev.: 0.0145)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.6958 => 6.7733, std.dev.: 0.0225)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -45.94% (0.0468 => 0.0253, std.dev.: 0.0010)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -45.19% (0.0270 => 0.0148, std.dev.: 0.0024)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -44.76% (0.0315 => 0.0174, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -43.42% (0.0281 => 0.0159, std.dev.: 0.0008)
  SingleSource/Regression/C/callargs: -40.95% (0.0315 => 0.0186, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hello: -38.68% (0.2903 => 0.1780, std.dev.: 0.0076)
  SingleSource/Regression/C++/EH/simple_throw: -38.06% (0.0289 => 0.0179, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/random: -30.07% (0.0459 => 0.0321, std.dev.: 0.0047)
  SingleSource/Regression/C/bigstack: -26.37% (0.0857 => 0.0631, std.dev.: 0.0012)
  MultiSource/Applications/sgefa/sgefa: -24.91% (0.5222 => 0.3921, std.dev.: 0.0221)
  MultiSource/Applications/aha/aha: -21.86% (0.1656 => 0.1294, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -20.55% (0.4443 => 0.3530, std.dev.: 0.0128)
  MultiSource/Applications/Burg/burg: -19.86% (1.7904 => 1.4349, std.dev.: 0.0669)
  MultiSource/Applications/JM/ldecod/ldecod: -17.58% (9.1660 => 7.5543, std.dev.: 0.2804)
  SingleSource/UnitTests/Vector/constpool: -17.24% (10.6454 => 8.8098, std.dev.: 0.2565)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -15.23% (1.4589 => 1.2367, std.dev.: 0.0322)
  SingleSource/Benchmarks/CoyoteBench/almabench: -14.24% (0.0892 => 0.0765, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.05% (0.6641 => 0.5907, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -9.90% (1.3978 => 1.2594, std.dev.: 0.0429)
  SingleSource/Benchmarks/Shootout-C++/ary: -9.84% (0.2744 => 0.2474, std.dev.: 0.0095)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -9.55% (0.1236 => 0.1118, std.dev.: 0.0003)
  MultiSource/Applications/SPASS/SPASS: -9.53% (18.3428 => 16.5943, std.dev.: 0.1075)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -9.40% (1.4844 => 1.3449, std.dev.: 0.0403)
  MultiSource/Applications/oggenc/oggenc: -9.32% (6.0228 => 5.4616, std.dev.: 0.0576)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -9.30% (1.4151 => 1.2835, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.76% (1.4224 => 1.2978, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -8.49% (1.4467 => 1.3239, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.37% (0.2580 => 0.2364, std.dev.: 0.0076)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -8.35% (0.4265 => 0.3909, std.dev.: 0.0059)
  MultiSource/Applications/viterbi/viterbi: -7.28% (0.2198 => 0.2038, std.dev.: 0.0059)
  SingleSource/Benchmarks/SmallPT/smallpt: -6.86% (0.1515 => 0.1411, std.dev.: 0.0021)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -6.69% (0.5636 => 0.5259, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3840 => 0.3654, std.dev.: 0.0071)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -37.22% (2.3532 => 1.4773, std.dev.: 0.1271)
  MultiSource/Applications/SPASS/SPASS: -23.60% (10.8513 => 8.2907, std.dev.: 0.2035)
  SingleSource/Benchmarks/Shootout-C++/ary: -22.18% (0.0487 => 0.0379, std.dev.: 0.0015)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.93% (0.1277 => 0.0997, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/ary3: -20.63% (5.9100 => 4.6908, std.dev.: 0.4536)
  MultiSource/Applications/JM/ldecod/ldecod: -17.39% (0.0811 => 0.0670, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -15.82% (4.1770 => 3.5163, std.dev.: 0.1694)
  MultiSource/Applications/sgefa/sgefa: -8.66% (0.9139 => 0.8348, std.dev.: 0.0139)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.85% (41.5696 => 39.5544, std.dev.: 0.6687)
  SingleSource/Benchmarks/Dhrystone/dry: -3.60% (0.5022 => 0.4841, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.01% (0.5413 => 0.5304, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.73% (3.6227 => 3.5600, std.dev.: 0.0239)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.16% (35.5166 => 35.1040, std.dev.: 0.1152)
  SingleSource/Benchmarks/Misc/dt: -1.03% (0.9898 => 0.9796, std.dev.: 0.0029)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -11.49% (0.1515 => 0.1341, std.dev.: 0.0235)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.94% (1.3499 => 1.3896, std.dev.: 0.0119)
  MultiSource/Applications/SPASS/SPASS: 2.66% (16.1646 => 16.5943, std.dev.: 0.1075)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.67% (1.2948 => 1.3164, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.94% (7.6426 => 12.4528, std.dev.: 0.1219)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.16% (1.1013 => 1.2132, std.dev.: 0.0110)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.41% (0.8273 => 0.8886, std.dev.: 0.0171)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.67% (8.1346 => 8.6770, std.dev.: 0.1062)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.77% (3.5550 => 3.7602, std.dev.: 0.0545)
  MultiSource/Applications/aha/aha: 5.65% (3.5731 => 3.7750, std.dev.: 0.0652)
  SingleSource/Benchmarks/McGill/misr: 4.85% (0.3771 => 0.3954, std.dev.: 0.0004)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.03% (96.7834 => 100.6867, std.dev.: 0.9478)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (0.2842 => 0.2953, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (0.5182 => 0.5304, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (2.4920 => 2.5453, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2206, std.dev.: 0.0011)
  SingleSource/Regression/C/uint64_to_float: 1.78% (1.4528 => 1.4787, std.dev.: 0.0031)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.65% (16.7972 => 17.0740, std.dev.: 0.0166)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (1.6707 => 1.6953, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/methcall: 1.42% (8.5434 => 8.6650, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.32% (1.0477 => 1.0615, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.29% (3.8582 => 3.9078, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (4.0596 => 4.1035, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout/fib2: 1.03% (3.5966 => 3.6338, std.dev.: 0.0099)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.05% (0.2571 => 0.2364, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.08% (0.5226 => 0.2400, std.dev.: 0.0022)
  MultiSource/Applications/sgefa/sgefa: -47.13% (1.5790 => 0.8348, std.dev.: 0.0139)
  SingleSource/Benchmarks/Linpack/linpack-pc: -25.04% (57.2347 => 42.9023, std.dev.: 2.4806)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.92% (15.9508 => 12.7727, std.dev.: 0.4413)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.35% (0.3304 => 0.2896, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.11% (4.0006 => 3.5163, std.dev.: 0.1694)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.05% (20.8247 => 18.5227, std.dev.: 0.1117)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.72% (3.4956 => 3.1558, std.dev.: 0.0291)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.26% (50.0284 => 46.3971, std.dev.: 0.0421)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.78% (3.7437 => 3.5272, std.dev.: 0.0718)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (2.5938 => 2.4919, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.79% (17.1431 => 16.6641, std.dev.: 0.1057)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.75% (4.3592 => 4.2831, std.dev.: 0.0292)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.37% (89.7126 => 88.4798, std.dev.: 0.2282)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.52% (0.1348 => 0.1341, std.dev.: 0.0235)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/c908787f/attachment.html>


More information about the llvm-testresults mailing list