[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 27 15:49:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16748?compare_to=16744&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16748, Order: 193507, Start Time: 2013-10-27 21:04:18, End Time: 2013-10-27 22:52:37
      To: 16744, Order: 193505, Start Time: 2013-10-27 18:55:15, End Time: 2013-10-27 20:42:05
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (54 on baseline)
Performance Improvements: 2 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1035 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.13% (1.0913 => 1.1036, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.05% (1.2457 => 1.2588, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.02% (1.2562 => 1.2690, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 17.77% (4.6271 => 5.4494, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 17.41% (1.8001 => 2.1135, std.dev.: 0.0018)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.33% (0.0908 => 0.1020, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.55% (1.3891 => 1.5078, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.25% (0.4385 => 0.4659, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.97% (5.0935 => 5.3977, std.dev.: 0.0541)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.55% (1.2818 => 1.3529, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.27% (3.6667 => 3.8598, std.dev.: 0.0070)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.24% (2.2594 => 2.3778, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.19% (3.5432 => 3.7271, std.dev.: 0.0009)
  MultiSource/Benchmarks/sim/sim: 4.72% (3.8915 => 4.0753, std.dev.: 0.0035)
  MultiSource/Applications/spiff/spiff: 4.26% (2.8460 => 2.9673, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc/flops: 3.73% (9.2709 => 9.6165, std.dev.: 0.0145)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.97% (2.1487 => 2.2126, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.57% (4.5072 => 4.6232, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.47% (5.2740 => 5.4042, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.34% (1.2680 => 1.2977, std.dev.: 0.0064)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.28% (2.9875 => 3.0556, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.96% (11.8186 => 12.0507, std.dev.: 0.0209)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.73% (2.3826 => 2.4239, std.dev.: 0.0004)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.28% (23.3767 => 23.6757, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.26% (6.5926 => 6.6757, std.dev.: 0.0081)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.5135 => 2.5397, std.dev.: 0.0008)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.70% (0.5884 => 0.5666, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.84% (1.2529 => 1.2298, std.dev.: 0.0052)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1375 => 0.1376, std.dev.: 0.0083)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.78% (0.3096 => 0.3213, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.61% (0.4624 => 0.4791, std.dev.: 0.0011)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.07% (0.8014 => 0.8260, std.dev.: 0.0057)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.9212 => 0.9454, std.dev.: 0.0062)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.12% (0.5705 => 0.5826, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.86% (1.3365 => 1.3613, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.82% (1.2007 => 1.2226, std.dev.: 0.0058)
  MultiSource/Applications/hbd/hbd: 1.77% (1.5696 => 1.5974, std.dev.: 0.0102)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.56% (1.1393 => 1.1571, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.54% (1.0756 => 1.0922, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.52% (14.4764 => 14.6961, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (9.7354 => 9.8642, std.dev.: 0.0131)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.26% (4.5883 => 4.6461, std.dev.: 0.0189)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.25% (7.2661 => 7.3568, std.dev.: 0.0155)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (1.4033 => 1.4198, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.36% (7.6426 => 12.3323, std.dev.: 0.0288)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.18% (2.8554 => 4.1740, std.dev.: 0.0575)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.90% (1.1431 => 1.5078, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/matrix: 18.68% (1.7809 => 2.1135, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.57% (3.5550 => 3.8598, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.36% (5.0288 => 5.4494, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.09% (1.2516 => 1.3529, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.66% (2.4753 => 2.6648, std.dev.: 0.0100)
  MultiSource/Benchmarks/sim/sim: 6.37% (3.8312 => 4.0753, std.dev.: 0.0035)
  SingleSource/Benchmarks/McGill/misr: 6.28% (0.3771 => 0.4008, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.88% (5.0980 => 5.3977, std.dev.: 0.0541)
  SingleSource/UnitTests/Vector/multiplies: 5.34% (0.5561 => 0.5858, std.dev.: 0.0061)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1013 => 1.1598, std.dev.: 0.0041)
  MultiSource/Applications/spiff/spiff: 5.25% (2.8194 => 2.9673, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.08% (3.1730 => 3.3341, std.dev.: 0.0593)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.57% (3.5642 => 3.7271, std.dev.: 0.0009)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.78% (2.5368 => 2.6326, std.dev.: 0.0323)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (0.2842 => 0.2947, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.44% (4.4696 => 4.6232, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 3.14% (0.7410 => 0.7643, std.dev.: 0.0039)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.05% (89.7126 => 92.4519, std.dev.: 0.4571)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.05% (2.1472 => 2.2126, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.77% (1.7652 => 1.8141, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.61% (4.0181 => 4.1230, std.dev.: 0.0144)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.52% (1.8519 => 1.8986, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.42% (11.7654 => 12.0507, std.dev.: 0.0209)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.42% (0.4549 => 0.4659, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.39% (5.4925 => 5.6239, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.10% (1.0477 => 1.0697, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2202, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.92% (5.3022 => 5.4042, std.dev.: 0.0009)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.91% (2.4920 => 2.5397, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/flops: 1.83% (9.4433 => 9.6165, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.74% (1.5940 => 1.6218, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (1.6707 => 1.6947, std.dev.: 0.0001)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.25% (16.7972 => 17.0078, std.dev.: 0.0607)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.21% (4.9459 => 5.0059, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.10% (6.6028 => 6.6757, std.dev.: 0.0081)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.81% (0.7184 => 0.6910, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.40% (0.5226 => 0.2383, std.dev.: 0.0051)
  MultiSource/Applications/sgefa/sgefa: -42.42% (1.5790 => 0.9092, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.75% (0.0400 => 0.0249, std.dev.: 0.0010)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.44% (57.2347 => 43.2437, std.dev.: 2.5127)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.06% (15.9508 => 12.9103, std.dev.: 0.1484)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.80% (50.0284 => 40.6227, std.dev.: 2.3446)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.04% (0.3304 => 0.2708, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/moments: -16.58% (0.1285 => 0.1072, std.dev.: 0.0041)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.93% (20.8247 => 18.5476, std.dev.: 0.0522)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.62% (3.4956 => 3.1242, std.dev.: 0.0467)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.20% (3.7437 => 3.3992, std.dev.: 0.0915)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.36% (8.1346 => 7.6176, std.dev.: 0.0233)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.54% (0.3501 => 0.3307, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.24% (0.3462 => 0.3350, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.99% (3.7874 => 3.6742, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc/oourafft: -2.74% (3.7484 => 3.6457, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.30% (17.1431 => 16.7488, std.dev.: 0.0243)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.08% (0.1348 => 0.1376, std.dev.: 0.0083)

Report Time: 1.02s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131027/c0510920/attachment.html>


More information about the llvm-testresults mailing list