[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 8 19:40:18 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14234?compare_to=14231&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14234, Order: 188034, Start Time: 2013-08-09 00:52:39, End Time: 2013-08-09 02:42:11
      To: 14231, Order: 188020, Start Time: 2013-08-08 22:32:59, End Time: 2013-08-09 00:26:03
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 7 (28 on baseline)
Performance Improvements: 29 (38 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1069 (1039 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 12.77% (1.7602 => 1.9849, std.dev.: 0.0862)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.38% (2.3370 => 2.5561, std.dev.: 0.0200)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 6.03% (0.2138 => 0.2267, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.61% (0.2713 => 0.2838, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.78% (4.0758 => 4.2297, std.dev.: 0.0522)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.37% (1.6225 => 1.6610, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.70% (12.9726 => 13.1932, std.dev.: 0.0213)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -32.62% (0.0512 => 0.0345, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/hash: -26.79% (0.0866 => 0.0634, std.dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/Perm: -24.79% (0.0472 => 0.0355, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/mandel: -18.23% (0.0620 => 0.0507, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -15.36% (0.7631 => 0.6459, std.dev.: 0.0304)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -15.30% (0.1000 => 0.0847, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc-C++/bigfib: -14.78% (0.8609 => 0.7337, std.dev.: 0.0369)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -14.27% (0.2783 => 0.2386, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -13.60% (0.1059 => 0.0915, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -12.85% (0.4492 => 0.3915, std.dev.: 0.0192)
  SingleSource/Benchmarks/Shootout-C++/moments: -12.78% (0.4796 => 0.4183, std.dev.: 0.0198)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -12.70% (0.0890 => 0.0777, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -12.45% (7.4475 => 6.5206, std.dev.: 0.3326)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -10.15% (0.1133 => 0.1018, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/oourafft: -7.87% (0.2593 => 0.2389, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.56% (0.3598 => 0.3326, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -39.32% (4.9525 => 3.0051, std.dev.: 0.6385)
  SingleSource/Benchmarks/Shootout-C++/ary3: -11.83% (2.3170 => 2.0429, std.dev.: 0.0899)
  SingleSource/Benchmarks/Shootout/strcat: -11.04% (0.1666 => 0.1482, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -10.08% (0.2332 => 0.2097, std.dev.: 0.0059)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -5.18% (2.4598 => 2.3323, std.dev.: 0.0441)
  SingleSource/Regression/C/uint64_to_float: -3.49% (1.4906 => 1.4386, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc/flops-4: -2.38% (1.6667 => 1.6270, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.10% (3.3120 => 3.2424, std.dev.: 0.0042)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.41% (1.5351 => 1.5135, std.dev.: 0.0034)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.38% (5.6446 => 5.5669, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (5.0193 => 4.9591, std.dev.: 0.0151)
  SingleSource/Benchmarks/McGill/queens: -1.09% (1.6730 => 1.6548, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.06% (1.3628 => 1.3483, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 10.86% (0.1345 => 0.1491, std.dev.: 0.0149)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.04% (0.2730 => 0.2729, std.dev.: 0.0099)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.37% (0.0273 => 0.0274, std.dev.: 0.0003)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.99% (0.2813 => 0.2729, std.dev.: 0.0099)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.58% (0.0345 => 0.0274, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 4.60% (0.2284 => 0.2389, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 69.14% (3.7285 => 6.3064, std.dev.: 0.1108)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2883, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout/hash: 28.33% (4.1846 => 5.3701, std.dev.: 0.2542)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.23% (1.5030 => 1.8822, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/hash: 17.55% (0.6295 => 0.7400, std.dev.: 0.0326)
  SingleSource/Benchmarks/Misc/flops-7: 14.54% (1.7330 => 1.9849, std.dev.: 0.0862)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (7.0762 => 7.8428, std.dev.: 0.0679)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9467, std.dev.: 0.0109)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.92% (48.3256 => 52.1519, std.dev.: 0.0630)
  MultiSource/Applications/JM/lencod/lencod: 7.16% (7.1799 => 7.6937, std.dev.: 0.1246)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4244, std.dev.: 0.0250)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.50% (0.2799 => 0.2981, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.37% (5.5008 => 5.7962, std.dev.: 0.0423)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (3.3877 => 3.5359, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/whetstone: 4.33% (3.4559 => 3.6057, std.dev.: 0.0482)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3651, std.dev.: 0.0514)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.54% (6.1245 => 6.3416, std.dev.: 0.0376)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.23% (25.0200 => 25.8281, std.dev.: 0.0936)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.06% (4.8739 => 5.0228, std.dev.: 0.0506)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.65% (1.3104 => 1.3451, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/matrix: 2.62% (1.7358 => 1.7813, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.57% (12.8625 => 13.1932, std.dev.: 0.0213)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.45% (3.5351 => 3.6218, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.11% (4.9040 => 4.9586, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.02% (4.9089 => 4.9591, std.dev.: 0.0151)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.30% (0.1518 => 0.1225, std.dev.: 0.0027)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.69% (0.7091 => 0.6191, std.dev.: 0.0092)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.75% (1.1012 => 1.0049, std.dev.: 0.0169)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.45% (0.1947 => 0.1802, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.30% (1.5345 => 1.4225, std.dev.: 0.0174)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.82% (1.7461 => 1.6271, std.dev.: 0.0308)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.02% (5.3476 => 5.1328, std.dev.: 0.0647)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.25% (10.3031 => 10.0714, std.dev.: 0.0609)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.99% (2.1022 => 1.4297, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.66% (0.0816 => 0.0574, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.93% (0.1189 => 0.0845, std.dev.: 0.0003)
  MultiSource/Applications/viterbi/viterbi: -27.38% (3.4923 => 2.5360, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.73% (6.9552 => 5.2350, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0343)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.62% (0.0956 => 0.0778, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.63% (6.2627 => 5.2209, std.dev.: 0.3758)
  SingleSource/Benchmarks/Misc/mandel: -13.96% (1.1996 => 1.0321, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.20% (0.5173 => 0.4697, std.dev.: 0.0132)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.08% (3.5791 => 3.2900, std.dev.: 0.0563)
  SingleSource/Benchmarks/Shootout/strcat: -6.97% (0.1593 => 0.1482, std.dev.: 0.0023)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.47% (47.2250 => 44.6416, std.dev.: 0.7698)
  SingleSource/Regression/C/uint64_to_float: -5.26% (1.5184 => 1.4386, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.68% (3.8119 => 3.6334, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc/fbench: -4.30% (4.9602 => 4.7471, std.dev.: 0.0769)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.27% (0.7355 => 0.7041, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.18% (1.1024 => 1.0563, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.47% (1.7207 => 1.6610, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9623, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.91% (5.2218 => 5.0697, std.dev.: 0.0261)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.84% (0.4783 => 0.4647, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/oourafft: -2.08% (3.7891 => 3.7102, std.dev.: 0.0224)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.04% (2.6094 => 2.5561, std.dev.: 0.0200)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1415, std.dev.: 0.1188)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.78% (5.6678 => 5.5669, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.55% (5.0180 => 4.9402, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7971, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.37% (4.9231 => 4.8557, std.dev.: 0.0158)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.35% (2.1343 => 2.1054, std.dev.: 0.0027)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 8.20% (0.1378 => 0.1491, std.dev.: 0.0149)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130808/c1d53b86/attachment.html>


More information about the llvm-testresults mailing list