[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 9 18:21:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14269?compare_to=14266&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14269, Order: 188120, Start Time: 2013-08-09 23:32:07, End Time: 2013-08-10 01:23:26
      To: 14266, Order: 188101, Start Time: 2013-08-09 21:11:50, End Time: 2013-08-09 23:05:15
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 3 (25 on baseline)
Performance Improvements: 15 (20 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1087 (1060 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (0.3543 => 0.3729, std.dev.: 0.0023)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.77% (3.2924 => 3.4495, std.dev.: 0.0603)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.73% (0.2731 => 0.2833, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: -42.21% (0.0308 => 0.0178, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -27.06% (2.2778 => 1.6614, std.dev.: 0.1399)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -20.30% (0.1202 => 0.0958, std.dev.: 0.0028)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -18.93% (58.7904 => 47.6628, std.dev.: 3.2656)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.40% (1.6291 => 1.3620, std.dev.: 0.0697)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -15.99% (1.6100 => 1.3526, std.dev.: 0.0860)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -13.61% (0.1337 => 0.1155, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.58% (1.5418 => 1.3479, std.dev.: 0.0604)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -11.39% (0.4049 => 0.3588, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -9.99% (1.4954 => 1.3460, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.57% (1.5574 => 1.4862, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.89% (2.4637 => 2.3925, std.dev.: 0.0255)
  MultiSource/Applications/siod/siod: -2.06% (3.6072 => 3.5329, std.dev.: 0.0219)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (6.3873 => 6.3148, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/flops-6: -1.05% (2.4530 => 2.4272, std.dev.: 0.0086)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1329 => 0.1356, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.36% (0.2741 => 0.2731, std.dev.: 0.0097)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (0.0274 => 0.0279, std.dev.: 0.0051)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.92% (0.2813 => 0.2731, std.dev.: 0.0097)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0051)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 16.65% (0.1033 => 0.1205, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.55% (3.7285 => 6.4708, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.13% (2.8867 => 4.3050, std.dev.: 0.0224)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.19% (0.3171 => 0.4477, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc/pi: 26.81% (1.9835 => 2.5152, std.dev.: 0.0146)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.24% (1.5030 => 1.8823, std.dev.: 0.0122)
  SingleSource/Benchmarks/Shootout/hash: 23.98% (4.1846 => 5.1882, std.dev.: 0.1132)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.19% (0.6295 => 0.7314, std.dev.: 0.0355)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.12% (14.9584 => 16.9208, std.dev.: 0.2476)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.00% (7.0762 => 7.8547, std.dev.: 0.0638)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0266)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4242, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.99% (5.5008 => 5.8304, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0702)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.35% (3.4085 => 3.5908, std.dev.: 0.0686)
  MultiSource/Applications/siod/siod: 4.64% (3.3761 => 3.5329, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.29% (4.3151 => 4.5003, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3657, std.dev.: 0.0425)
  SingleSource/Benchmarks/Misc/whetstone: 3.85% (3.4559 => 3.5890, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.85% (3.3384 => 3.4668, std.dev.: 0.0427)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.30% (25.0200 => 25.8455, std.dev.: 0.1593)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.11% (6.1245 => 6.3148, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.99% (4.8739 => 5.0195, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (3.3464 => 3.4072, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.46% (3.0680 => 3.1128, std.dev.: 0.0147)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/sgefa/sgefa: -12.87% (0.4809 => 0.4190, std.dev.: 0.0120)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.48% (0.2498 => 0.2361, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.19% (1.4947 => 1.4320, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.99% (1.5479 => 1.4862, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.07% (2.1022 => 1.4280, std.dev.: 0.0063)
  MultiSource/Applications/viterbi/viterbi: -27.23% (3.4923 => 2.5413, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.66% (6.9552 => 5.2401, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/mandel: -14.44% (1.1996 => 1.0264, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.10% (6.2627 => 5.4424, std.dev.: 0.1169)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.36% (0.5173 => 0.4637, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.38% (0.2047 => 0.1896, std.dev.: 0.0032)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.90% (47.2250 => 44.4410, std.dev.: 0.8740)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.14% (3.8119 => 3.6158, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.93% (0.4969 => 0.4724, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/fbench: -4.44% (4.9602 => 4.7401, std.dev.: 0.0829)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.17% (0.7355 => 0.7048, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.44% (6.0444 => 5.8367, std.dev.: 0.0601)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.99% (34.8438 => 34.1489, std.dev.: 0.1740)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.44% (5.8810 => 5.7962, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.60% (0.1378 => 0.1356, std.dev.: 0.0226)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130809/50ab77ac/attachment.html>


More information about the llvm-testresults mailing list