[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Aug 10 06:02:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14286?compare_to=14282&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14286, Order: 188136, Start Time: 2013-08-10 11:16:53, End Time: 2013-08-10 13:04:29
      To: 14282, Order: 188134, Start Time: 2013-08-10 08:08:14, End Time: 2013-08-10 09:49:51
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 10 (33 on baseline)
Performance Improvements: 3 (56 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1092 (1016 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 2.26% (0.9238 => 0.9447, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 44.26% (2.8933 => 4.1739, std.dev.: 0.4925)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.72% (1.4818 => 1.8925, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.64% (4.7058 => 5.1595, std.dev.: 0.0166)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (14.7469 => 15.8078, std.dev.: 0.3935)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.23% (5.0027 => 5.3144, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.28% (1.2909 => 1.3462, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.94% (6.2329 => 6.4782, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.35% (12.8608 => 13.1626, std.dev.: 0.0462)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.49% (2.7028 => 2.7432, std.dev.: 0.0080)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.33% (5.9801 => 5.2428, std.dev.: 0.2488)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.43% (2.4714 => 2.3124, std.dev.: 0.0211)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.88% (0.6675 => 0.6416, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 3.12% (0.1313 => 0.1354, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.29% (0.2740 => 0.2732, std.dev.: 0.0089)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.17% (0.0256 => 0.0253, std.dev.: 0.0091)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.88% (0.2813 => 0.2732, std.dev.: 0.0089)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.67% (0.0345 => 0.0253, std.dev.: 0.0091)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 43.13% (0.0466 => 0.0667, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.10% (0.1033 => 0.1220, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.9761 => 0.9942, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (2.6390 => 2.6727, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.75% (3.7285 => 6.4782, std.dev.: 0.0440)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2883, std.dev.: 0.0356)
  MultiSource/Benchmarks/FreeBench/neural/neural: 28.26% (0.3171 => 0.4067, std.dev.: 0.0270)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.91% (1.5030 => 1.8925, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.47% (0.6295 => 0.7269, std.dev.: 0.0216)
  MultiSource/Applications/JM/lencod/lencod: 11.61% (7.1799 => 8.0136, std.dev.: 0.2703)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.90% (7.0762 => 7.8472, std.dev.: 0.0772)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9477, std.dev.: 0.0118)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.00% (48.3256 => 52.1930, std.dev.: 0.3250)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4244, std.dev.: 0.0121)
  SingleSource/Benchmarks/McGill/chomp: 6.82% (1.0051 => 1.0736, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.62% (5.5008 => 5.8652, std.dev.: 0.0811)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.24% (5.3042 => 5.6350, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.69% (3.4085 => 3.6025, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4988, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3659, std.dev.: 0.0239)
  MultiSource/Applications/siod/siod: 4.01% (3.3761 => 3.5114, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/whetstone: 3.99% (3.4559 => 3.5937, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.42% (3.3384 => 3.4527, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (6.1245 => 6.3258, std.dev.: 0.0075)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.28% (25.0200 => 25.8399, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.02% (4.8739 => 5.0212, std.dev.: 0.0171)
  MultiSource/Applications/spiff/spiff: 3.00% (2.7609 => 2.8438, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.82% (3.3877 => 3.4833, std.dev.: 0.0053)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.73% (1.3104 => 1.3462, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.33% (12.8625 => 13.1626, std.dev.: 0.0462)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (3.3464 => 3.4075, std.dev.: 0.0177)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.40% (1.1618 => 1.1781, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.12% (4.9040 => 4.9588, std.dev.: 0.0167)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -32.81% (0.2237 => 0.1503, std.dev.: 0.0073)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.00% (1.5228 => 1.2182, std.dev.: 0.0105)
  MultiSource/Benchmarks/Olden/health/health: -18.82% (0.1993 => 0.1618, std.dev.: 0.0130)
  MultiSource/Applications/lua/lua: -16.43% (5.3200 => 4.4459, std.dev.: 0.0416)
  MultiSource/Applications/hexxagon/hexxagon: -15.60% (1.3285 => 1.1213, std.dev.: 0.0081)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.39% (1.3985 => 1.2112, std.dev.: 0.0070)
  MultiSource/Applications/sgefa/sgefa: -13.06% (0.4809 => 0.4181, std.dev.: 0.0027)
  MultiSource/Applications/JM/ldecod/ldecod: -11.89% (8.6720 => 7.6413, std.dev.: 0.0319)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.63% (0.7091 => 0.6266, std.dev.: 0.0020)
  MultiSource/Applications/ClamAV/clamscan: -11.54% (19.4145 => 17.1747, std.dev.: 0.0450)
  MultiSource/Applications/sqlite3/sqlite3: -9.52% (19.1635 => 17.3388, std.dev.: 0.5135)
  MultiSource/Applications/viterbi/viterbi: -7.19% (0.1905 => 0.1768, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.95% (1.5345 => 1.4279, std.dev.: 0.0127)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.77% (0.2498 => 0.2329, std.dev.: 0.0013)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.72% (1.7461 => 1.6287, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.72% (1.5426 => 1.4390, std.dev.: 0.0383)
  MultiSource/Applications/siod/siod: -6.48% (2.7150 => 2.5391, std.dev.: 0.0086)
  MultiSource/Applications/Burg/burg: -6.39% (1.5733 => 1.4728, std.dev.: 0.0059)
  MultiSource/Applications/JM/lencod/lencod: -6.09% (18.5029 => 17.3761, std.dev.: 0.0378)
  MultiSource/Applications/oggenc/oggenc: -5.58% (6.1121 => 5.7712, std.dev.: 0.0061)
  MultiSource/Applications/minisat/minisat: -4.45% (0.8278 => 0.7910, std.dev.: 0.0136)
  MultiSource/Applications/SPASS/SPASS: -3.90% (17.9111 => 17.2125, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.30% (1.5416 => 1.5062, std.dev.: 0.0120)
  MultiSource/Applications/spiff/spiff: -1.37% (0.9578 => 0.9447, std.dev.: 0.0035)
  MultiSource/Applications/d/make_dparser: -1.34% (3.7722 => 3.7218, std.dev.: 0.0123)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.40% (2.1022 => 1.4211, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.76% (0.0816 => 0.0565, std.dev.: 0.0059)
  MultiSource/Applications/viterbi/viterbi: -27.42% (3.4923 => 2.5346, std.dev.: 0.0313)
  MultiSource/Applications/JM/ldecod/ldecod: -25.03% (0.0859 => 0.0644, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2428, std.dev.: 0.2488)
  SingleSource/Benchmarks/Misc/perlin: -21.42% (4.5989 => 3.6137, std.dev.: 0.0027)
  MultiSource/Applications/minisat/minisat: -17.75% (8.0162 => 6.5934, std.dev.: 0.4378)
  SingleSource/Benchmarks/Misc/mandel: -14.05% (1.1996 => 1.0311, std.dev.: 0.0155)
  MultiSource/Applications/SPASS/SPASS: -13.17% (9.2220 => 8.0078, std.dev.: 0.3245)
  SingleSource/Benchmarks/Shootout/strcat: -8.47% (0.1593 => 0.1458, std.dev.: 0.0034)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (47.2250 => 44.3475, std.dev.: 0.9650)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.72% (0.3773 => 0.3557, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.76% (1.1024 => 1.0499, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/fbench: -4.49% (4.9602 => 4.7374, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.21% (0.7355 => 0.7045, std.dev.: 0.0006)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.81% (1.7207 => 1.6551, std.dev.: 0.0136)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.75% (0.7806 => 0.7513, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.75% (1.1032 => 1.0618, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8380, std.dev.: 0.0759)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.15% (21.6864 => 21.0029, std.dev.: 0.0280)
  MultiSource/Applications/sgefa/sgefa: -3.04% (1.4030 => 1.3603, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0698)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0742, std.dev.: 0.0471)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.26% (1.8144 => 1.7734, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.21% (2.8052 => 2.7432, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/oourafft: -2.09% (3.7891 => 3.7099, std.dev.: 0.0214)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1404, std.dev.: 0.0693)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.39% (5.0180 => 4.9480, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.34% (4.9231 => 4.8572, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.15% (2.9962 => 2.9617, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.04% (5.8810 => 5.8197, std.dev.: 0.0099)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.74% (0.1378 => 0.1354, std.dev.: 0.0007)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130810/c8a4fd34/attachment.html>


More information about the llvm-testresults mailing list