[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 30 16:44:35 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16848?compare_to=16844&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16848, Order: 193714, Start Time: 2013-10-30 21:53:15, End Time: 2013-10-30 23:48:02
      To: 16844, Order: 193709, Start Time: 2013-10-30 19:40:22, End Time: 2013-10-30 21:31:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 51 (56 on baseline)
Performance Improvements: 4 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1052 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/viterbi/viterbi: 59.44% (0.2061 => 0.3286, std.dev.: 0.0369)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 50.66% (0.0527 => 0.0794, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 37.71% (0.0936 => 0.1289, std.dev.: 0.0075)
  MultiSource/Applications/hbd/hbd: 33.68% (1.6191 => 2.1644, std.dev.: 0.1183)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 29.81% (0.2412 => 0.3131, std.dev.: 0.0138)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 24.04% (1.1670 => 1.4475, std.dev.: 0.0778)
  MultiSource/Applications/ClamAV/clamscan: 23.85% (16.8115 => 20.8209, std.dev.: 0.2463)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 23.34% (1.2513 => 1.5434, std.dev.: 0.0359)
  MultiSource/Applications/lambda-0_1_3/lambda: 23.32% (0.8314 => 1.0253, std.dev.: 0.0160)
  MultiSource/Applications/hexxagon/hexxagon: 22.47% (1.0484 => 1.2840, std.dev.: 0.0824)
  MultiSource/Applications/sqlite3/sqlite3: 21.67% (16.4938 => 20.0688, std.dev.: 0.4399)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.98% (1.3528 => 1.6231, std.dev.: 0.0170)
  MultiSource/Applications/JM/ldecod/ldecod: 18.46% (7.7325 => 9.1596, std.dev.: 0.4108)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 16.60% (1.2695 => 1.4802, std.dev.: 0.0724)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 16.33% (1.3807 => 1.6062, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.11% (1.4777 => 1.7158, std.dev.: 0.0363)
  MultiSource/Applications/oggenc/oggenc: 15.97% (5.4525 => 6.3232, std.dev.: 0.1625)
  MultiSource/Applications/lemon/lemon: 15.42% (1.2253 => 1.4143, std.dev.: 0.0475)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 15.24% (1.2332 => 1.4212, std.dev.: 0.0344)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.19% (45.0708 => 51.9167, std.dev.: 1.0508)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.85% (1.2838 => 1.4745, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.81% (1.2760 => 1.4650, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.62% (1.3158 => 1.5082, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.14% (1.2119 => 1.3833, std.dev.: 0.0511)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.56% (1.3147 => 1.4930, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.08% (1.3393 => 1.5145, std.dev.: 0.0659)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.02% (1.3671 => 1.5178, std.dev.: 0.0380)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.07% (1.4743 => 1.5343, std.dev.: 0.0097)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 77.24% (0.0479 => 0.0849, std.dev.: 0.0023)
  MultiSource/Applications/lemon/lemon: 69.10% (0.8409 => 1.4220, std.dev.: 0.1071)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 56.21% (0.1014 => 0.1584, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.58% (2.1064 => 2.3714, std.dev.: 0.0196)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 10.60% (0.4583 => 0.5069, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (1.3974 => 1.5082, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.81% (3.9656 => 4.2752, std.dev.: 0.0933)
  MultiSource/Applications/JM/lencod/lencod: 7.50% (7.5914 => 8.1604, std.dev.: 0.0828)
  MultiSource/Applications/lua/lua: 7.11% (28.2924 => 30.3043, std.dev.: 0.5559)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.32% (4.1012 => 4.3603, std.dev.: 0.0339)
  MultiSource/Applications/sqlite3/sqlite3: 6.15% (4.3140 => 4.5791, std.dev.: 0.0556)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.93% (1.2908 => 1.3545, std.dev.: 0.0056)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.15% (0.3594 => 0.3743, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.15% (3.5636 => 3.6758, std.dev.: 0.0272)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.80% (3.5838 => 3.6484, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.77% (5.8241 => 5.9270, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.76% (5.0557 => 5.1446, std.dev.: 0.0258)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.73% (8.9065 => 9.0609, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.62% (5.9060 => 6.0017, std.dev.: 0.0103)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.39% (3.4335 => 3.4811, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.35% (5.9496 => 6.0298, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.17% (11.6964 => 11.8328, std.dev.: 0.0060)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.02% (7.6629 => 7.7414, std.dev.: 0.0088)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.48% (4.9558 => 4.7834, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.56% (3.6931 => 3.5986, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.09% (4.1395 => 4.0530, std.dev.: 0.0213)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.56% (2.4040 => 2.3665, std.dev.: 0.0096)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.81% (0.1396 => 0.1505, std.dev.: 0.0132)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/viterbi/viterbi: 66.30% (0.1976 => 0.3286, std.dev.: 0.0369)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 41.65% (0.0910 => 0.1289, std.dev.: 0.0075)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 41.28% (0.0562 => 0.0794, std.dev.: 0.0068)
  MultiSource/Applications/hbd/hbd: 37.90% (1.5696 => 2.1644, std.dev.: 0.1183)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 34.09% (0.2335 => 0.3131, std.dev.: 0.0138)
  MultiSource/Applications/lambda-0_1_3/lambda: 27.94% (0.8014 => 1.0253, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 27.01% (1.2152 => 1.5434, std.dev.: 0.0359)
  MultiSource/Applications/ClamAV/clamscan: 25.88% (16.5398 => 20.8209, std.dev.: 0.2463)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 25.00% (1.1580 => 1.4475, std.dev.: 0.0778)
  MultiSource/Applications/hexxagon/hexxagon: 24.95% (1.0276 => 1.2840, std.dev.: 0.0824)
  MultiSource/Applications/JM/ldecod/ldecod: 23.73% (7.4026 => 9.1596, std.dev.: 0.4108)
  MultiSource/Applications/sqlite3/sqlite3: 23.21% (16.2888 => 20.0688, std.dev.: 0.4399)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.25% (1.3498 => 1.6231, std.dev.: 0.0170)
  MultiSource/Applications/lemon/lemon: 19.23% (1.1862 => 1.4143, std.dev.: 0.0475)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.85% (1.3514 => 1.6062, std.dev.: 0.0136)
  MultiSource/Applications/oggenc/oggenc: 18.55% (5.3339 => 6.3232, std.dev.: 0.1625)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.53% (1.4599 => 1.7158, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.37% (1.2932 => 1.5178, std.dev.: 0.0380)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.24% (44.2807 => 51.9167, std.dev.: 1.0508)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 17.20% (1.2630 => 1.4802, std.dev.: 0.0724)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.66% (1.2639 => 1.4745, std.dev.: 0.0376)
  MultiSource/Benchmarks/PAQ8p/paq8p: 16.46% (2.5666 => 2.9891, std.dev.: 0.1429)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 16.16% (1.2235 => 1.4212, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 15.79% (1.2652 => 1.4650, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.21% (1.2007 => 1.3833, std.dev.: 0.0511)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 14.93% (1.3123 => 1.5082, std.dev.: 0.0252)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.53% (0.0709 => 0.0812, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.48% (1.3042 => 1.4930, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.85% (1.3303 => 1.5145, std.dev.: 0.0659)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.24% (1.6047 => 1.7209, std.dev.: 0.0283)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.05% (1.4746 => 1.5343, std.dev.: 0.0097)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 83.37% (0.0463 => 0.0849, std.dev.: 0.0023)
  MultiSource/Applications/lemon/lemon: 66.78% (0.8526 => 1.4220, std.dev.: 0.1071)
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.87% (7.6426 => 12.2948, std.dev.: 0.0354)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 59.36% (0.0994 => 0.1584, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.36% (2.8554 => 4.1793, std.dev.: 0.0452)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.94% (1.1431 => 1.5082, std.dev.: 0.0131)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.33% (2.1111 => 2.3714, std.dev.: 0.0196)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.22% (1.2516 => 1.3545, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (3.9856 => 4.2752, std.dev.: 0.0933)
  MultiSource/Applications/sqlite3/sqlite3: 7.16% (4.2733 => 4.5791, std.dev.: 0.0556)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.32% (4.1011 => 4.3603, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.76% (5.6951 => 5.9664, std.dev.: 0.0804)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.06% (5.3716 => 5.5897, std.dev.: 0.0546)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.60% (89.7126 => 92.9403, std.dev.: 0.7629)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.28% (3.5592 => 3.6758, std.dev.: 0.0272)
  MultiSource/Applications/hexxagon/hexxagon: 2.87% (14.7810 => 15.2054, std.dev.: 0.0314)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.83% (0.6563 => 0.6749, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.59% (5.0980 => 5.2302, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.39% (5.7884 => 5.9270, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.38% (5.0196 => 5.1391, std.dev.: 0.0284)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.24% (3.5683 => 3.6484, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.12% (5.8769 => 6.0017, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.10% (1.0477 => 1.0697, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.04% (8.8798 => 9.0609, std.dev.: 0.0204)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.92% (0.5226 => 0.2408, std.dev.: 0.0564)
  MultiSource/Applications/sgefa/sgefa: -42.68% (1.5790 => 0.9051, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -28.50% (0.0400 => 0.0286, std.dev.: 0.0004)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.14% (57.2347 => 43.9919, std.dev.: 4.3526)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.89% (0.3304 => 0.2713, std.dev.: 0.0102)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.41% (15.9508 => 13.3337, std.dev.: 0.3993)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.00% (20.8247 => 18.5344, std.dev.: 0.1006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.08% (3.4956 => 3.1783, std.dev.: 0.0055)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.78% (50.0284 => 45.6364, std.dev.: 0.1647)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.01% (3.7437 => 3.4811, std.dev.: 0.0173)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.83% (8.1346 => 7.7414, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.34% (5.0002 => 4.7834, std.dev.: 0.0323)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.04% (2.5938 => 2.4890, std.dev.: 0.0216)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.29% (2.4471 => 2.3665, std.dev.: 0.0096)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.22% (3.7874 => 3.6653, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.71% (17.1431 => 16.6788, std.dev.: 0.0873)
  MultiSource/Benchmarks/Olden/power/power: -2.66% (1.2170 => 1.1846, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.86% (5.2422 => 5.1446, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (4.3592 => 4.3016, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/oourafft: -1.24% (3.7484 => 3.7021, std.dev.: 0.0142)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 11.65% (0.1348 => 0.1505, std.dev.: 0.0132)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131030/5c3348de/attachment.html>


More information about the llvm-testresults mailing list