[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 08:21:13 PST 2014


http://llvm.org/perf/db_default/v4/nts/20207?compare_to=20198&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20207, Order: 198940, Start Time: 2014-01-10 14:35:53, End Time: 2014-01-10 16:26:01
      To: 20198, Order: 198936, Start Time: 2014-01-10 12:25:14, End Time: 2014-01-10 14:09:24
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 21 (35 on baseline)
Performance Improvements: 8 (19 on baseline)
Unchanged Tests: 1081 (1056 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 71.33% (0.0143 => 0.0245, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 65.65% (0.3581 => 0.5932, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ary2: 59.50% (0.2580 => 0.4115, std.dev.: 0.0176)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 58.06% (0.0186 => 0.0294, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/fibo: 56.17% (0.1903 => 0.2972, std.dev.: 0.0091)
  SingleSource/Benchmarks/Dhrystone/dry: 55.83% (0.0566 => 0.0882, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/mandel-2: 51.64% (0.0335 => 0.0508, std.dev.: 0.0017)
  SingleSource/UnitTests/2002-05-02-CastTest: 49.02% (0.0255 => 0.0380, std.dev.: 0.0047)
  SingleSource/Regression/C/test_indvars: 48.92% (0.0278 => 0.0414, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-5: 48.29% (0.0321 => 0.0476, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/objinst: 43.34% (0.2116 => 0.3033, std.dev.: 0.0211)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.82% (0.3268 => 0.3491, std.dev.: 0.0023)
  MultiSource/Applications/siod/siod: 6.49% (2.5882 => 2.7562, std.dev.: 0.0426)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.74% (0.3317 => 0.3441, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 61.03% (2.8272 => 4.5526, std.dev.: 0.1445)
  SingleSource/Benchmarks/Stanford/Perm: 32.72% (0.0324 => 0.0430, std.dev.: 0.0016)
  SingleSource/Benchmarks/McGill/chomp: 11.31% (1.0736 => 1.1950, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.27% (5.0064 => 5.4205, std.dev.: 0.0197)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.62% (45.1347 => 48.5760, std.dev.: 0.2248)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.34% (2.8471 => 3.0562, std.dev.: 0.0104)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.83% (2.4375 => 2.4820, std.dev.: 0.0171)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -1.01% (1.2471 => 1.2345, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -28.49% (4.0175 => 2.8730, std.dev.: 0.1366)
  SingleSource/Benchmarks/Misc/ReedSolomon: -14.58% (9.7620 => 8.3391, std.dev.: 0.1026)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.18% (4.3479 => 4.2098, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/fp-convert: -2.51% (7.7377 => 7.5434, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.18% (5.6244 => 5.5016, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.10% (3.2210 => 3.1534, std.dev.: 0.0260)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (23.8375 => 23.4002, std.dev.: 0.1404)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/reversefile: 65.61% (0.3582 => 0.5932, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ary2: 59.62% (0.2578 => 0.4115, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/fibo: 56.50% (0.1899 => 0.2972, std.dev.: 0.0091)
  SingleSource/Benchmarks/Dhrystone/dry: 56.11% (0.0565 => 0.0882, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/mandel-2: 50.74% (0.0337 => 0.0508, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops-5: 49.22% (0.0319 => 0.0476, std.dev.: 0.0044)
  SingleSource/UnitTests/2002-05-02-CastTest: 47.86% (0.0257 => 0.0380, std.dev.: 0.0047)
  SingleSource/Regression/C/test_indvars: 47.86% (0.0280 => 0.0414, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/objinst: 43.27% (0.2117 => 0.3033, std.dev.: 0.0211)
  MultiSource/Applications/sqlite3/sqlite3: 40.65% (15.7419 => 22.1409, std.dev.: 1.3417)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.98% (0.3859 => 0.4900, std.dev.: 0.0297)
  MultiSource/Applications/lemon/lemon: 9.79% (1.2200 => 1.3394, std.dev.: 0.0406)
  SingleSource/Benchmarks/Shootout-C++/ary: 8.54% (0.2482 => 0.2694, std.dev.: 0.0081)
  MultiSource/Applications/siod/siod: 8.12% (2.5491 => 2.7562, std.dev.: 0.0426)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3261 => 0.3491, std.dev.: 0.0023)
  MultiSource/Applications/minisat/minisat: 1.82% (0.7533 => 0.7670, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 52.03% (2.9945 => 4.5526, std.dev.: 0.1445)
  SingleSource/Benchmarks/McGill/chomp: 18.33% (1.0099 => 1.1950, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.21% (5.9583 => 6.9837, std.dev.: 0.2356)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.23% (82.2592 => 92.3197, std.dev.: 0.3798)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.46% (3.3810 => 3.7007, std.dev.: 0.0177)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.72% (5.0320 => 5.4205, std.dev.: 0.0197)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (2.8568 => 3.0562, std.dev.: 0.0104)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.28% (1.9729 => 2.0770, std.dev.: 0.0095)
  MultiSource/Applications/siod/siod: 4.92% (3.4258 => 3.5944, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.55% (1.2463 => 1.2781, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.51% (1.5797 => 1.6194, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.51% (5.2486 => 5.3802, std.dev.: 0.0285)
  SingleSource/Benchmarks/Misc/fp-convert: 2.09% (7.3892 => 7.5434, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (11.7894 => 12.0145, std.dev.: 0.0525)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.51% (2.3882 => 2.4243, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.45% (3.1455 => 3.1911, std.dev.: 0.0039)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (1.6699 => 1.6937, std.dev.: 0.0003)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (3.4043 => 3.4519, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc/fbench: 1.07% (4.9225 => 4.9754, std.dev.: 0.0149)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.86% (0.1938 => 0.1650, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.60% (0.1774 => 0.1657, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.50% (0.2540 => 0.2375, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.46% (2.0207 => 1.9103, std.dev.: 0.0256)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.18% (1.1409 => 1.0818, std.dev.: 0.0044)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.11% (0.2758 => 0.2617, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.34% (0.2810 => 0.2688, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.80% (15.4053 => 14.8201, std.dev.: 0.1717)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.52% (1.1767 => 1.1470, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.4449 => 1.4090, std.dev.: 0.0037)
  MultiSource/Benchmarks/nbench/nbench: -2.39% (1.2647 => 1.2345, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.82% (1.6656 => 1.6353, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.87% (0.1035 => 0.0850, std.dev.: 0.0066)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.41% (2.8850 => 2.3828, std.dev.: 0.1658)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.75% (15.5356 => 12.9329, std.dev.: 0.2222)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.69% (50.9650 => 48.5760, std.dev.: 0.2248)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.89% (2.5559 => 2.4820, std.dev.: 0.0171)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.28% (6.0535 => 5.9157, std.dev.: 0.0224)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.45% (1.8409 => 1.8142, std.dev.: 0.0055)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/64c8452a/attachment.html>


More information about the llvm-testresults mailing list