[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 26 10:48:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15695?compare_to=15691&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15695, Order: 191432, Start Time: 2013-09-26 15:57:56, End Time: 2013-09-26 17:51:08
      To: 15691, Order: 191429, Start Time: 2013-09-26 13:48:44, End Time: 2013-09-26 15:34:02
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 38 (53 on baseline)
Performance Improvements: 6 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 76.51% (0.0498 => 0.0879, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 61.93% (0.1069 => 0.1731, std.dev.: 0.0151)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 57.71% (0.0506 => 0.0798, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 57.59% (0.3115 => 0.4909, std.dev.: 0.0268)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 55.58% (0.9784 => 1.5222, std.dev.: 0.1019)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 52.64% (0.1685 => 0.2572, std.dev.: 0.0154)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.19% (1.4243 => 2.1106, std.dev.: 0.0803)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 42.20% (1.4278 => 2.0304, std.dev.: 0.0478)
  MultiSource/Applications/treecc/treecc: 31.07% (2.2896 => 3.0009, std.dev.: 0.0628)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 27.21% (14.7276 => 18.7353, std.dev.: 0.2396)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.17% (1.9329 => 2.3421, std.dev.: 0.1082)
  MultiSource/Benchmarks/nbench/nbench: 17.55% (1.2797 => 1.5043, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 12.11% (1.2593 => 1.4118, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.85% (1.2351 => 1.3568, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.71% (1.2755 => 1.3993, std.dev.: 0.0157)
  MultiSource/Applications/SPASS/SPASS: 9.48% (16.6213 => 18.1978, std.dev.: 0.3578)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.77% (0.1288 => 0.1401, std.dev.: 0.0023)
  MultiSource/Applications/lua/lua: 2.34% (4.2895 => 4.3900, std.dev.: 0.0245)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.57% (0.0288 => 0.0425, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 42.77% (0.0346 => 0.0494, std.dev.: 0.0037)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 34.08% (0.0672 => 0.0901, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 31.10% (0.2916 => 0.3823, std.dev.: 0.0281)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.02% (1.4822 => 1.8827, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 20.81% (35.9120 => 43.3848, std.dev.: 2.3858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 20.01% (0.1704 => 0.2045, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout/matrix: 18.07% (1.7719 => 2.0920, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.06% (60.5080 => 71.4369, std.dev.: 2.1770)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 13.46% (21.6059 => 24.5145, std.dev.: 1.0083)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.64% (3.6375 => 3.8425, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.09% (6.7187 => 7.0607, std.dev.: 0.0348)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.57% (0.2624 => 0.2744, std.dev.: 0.0009)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.76% (39.4258 => 40.9091, std.dev.: 0.4733)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.69% (5.0935 => 5.2303, std.dev.: 0.0240)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.64% (2.4954 => 2.5613, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (3.1434 => 3.2188, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops: 2.26% (9.3568 => 9.5681, std.dev.: 0.0243)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.43% (4.2413 => 4.3020, std.dev.: 0.0108)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.28% (12.1779 => 12.3336, std.dev.: 0.0288)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -7.89% (0.8986 => 0.8277, std.dev.: 0.0072)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.22% (2.2129 => 2.1195, std.dev.: 0.0048)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.64% (18.7632 => 18.2674, std.dev.: 0.1735)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.24% (5.3820 => 5.2617, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.23% (5.6246 => 5.4989, std.dev.: 0.0354)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.86% (23.8197 => 23.3757, std.dev.: 0.0210)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.96% (0.1352 => 0.1392, std.dev.: 0.0081)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 73.03% (0.0508 => 0.0879, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 71.05% (0.1012 => 0.1731, std.dev.: 0.0151)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 60.33% (0.9494 => 1.5222, std.dev.: 0.1019)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 58.56% (0.3096 => 0.4909, std.dev.: 0.0268)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 56.07% (0.1648 => 0.2572, std.dev.: 0.0154)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.32% (1.4041 => 2.1106, std.dev.: 0.0803)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 44.69% (1.4033 => 2.0304, std.dev.: 0.0478)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 41.99% (0.0562 => 0.0798, std.dev.: 0.0073)
  MultiSource/Applications/treecc/treecc: 33.28% (2.2516 => 3.0009, std.dev.: 0.0628)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 29.42% (14.4764 => 18.7353, std.dev.: 0.2396)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.75% (1.8775 => 2.3421, std.dev.: 0.1082)
  MultiSource/Benchmarks/nbench/nbench: 20.50% (1.2484 => 1.5043, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 13.23% (1.2468 => 1.4118, std.dev.: 0.0424)
  MultiSource/Applications/SPASS/SPASS: 12.58% (16.1646 => 18.1978, std.dev.: 0.3578)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 11.72% (0.1254 => 0.1401, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.79% (1.2630 => 1.3993, std.dev.: 0.0157)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 9.01% (0.1387 => 0.1512, std.dev.: 0.0010)
  MultiSource/Applications/kimwitu++/kc: 8.59% (18.3608 => 19.9388, std.dev.: 0.5640)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.55% (1.2499 => 1.3568, std.dev.: 0.0172)
  MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.0276 => 1.0896, std.dev.: 0.0163)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.15% (1.1393 => 1.1980, std.dev.: 0.0171)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.10% (4.0397 => 4.2459, std.dev.: 0.0669)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.54% (2.6492 => 2.7695, std.dev.: 0.0380)
  MultiSource/Applications/lua/lua: 3.93% (4.2242 => 4.3900, std.dev.: 0.0245)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.62% (0.5046 => 0.5178, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.16% (7.6426 => 12.4697, std.dev.: 0.0925)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.06% (0.0289 => 0.0425, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 43.19% (0.0345 => 0.0494, std.dev.: 0.0037)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 38.19% (0.0652 => 0.0901, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 34.52% (0.2842 => 0.3823, std.dev.: 0.0281)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.95% (1.4830 => 1.8827, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.80% (0.1707 => 0.2045, std.dev.: 0.0089)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.92% (0.1374 => 0.1634, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.76% (36.8417 => 43.3848, std.dev.: 2.3858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 17.67% (60.7119 => 71.4369, std.dev.: 2.1770)
  SingleSource/Benchmarks/Shootout/matrix: 17.47% (1.7809 => 2.0920, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.15% (2.3084 => 2.6351, std.dev.: 0.1114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 13.91% (21.5217 => 24.5145, std.dev.: 1.0083)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.00% (6.5990 => 7.0607, std.dev.: 0.0348)
  SingleSource/UnitTests/Vector/multiplies: 6.28% (0.5561 => 0.5910, std.dev.: 0.0029)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.21% (8.1346 => 8.6396, std.dev.: 0.0680)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (1.1013 => 1.1672, std.dev.: 0.0243)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.56% (3.6401 => 3.8425, std.dev.: 0.0297)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.26% (0.2632 => 0.2744, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.62% (3.5683 => 3.6619, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.60% (5.0980 => 5.2303, std.dev.: 0.0240)
  MultiSource/Benchmarks/Olden/power/power: 2.44% (1.2170 => 1.2467, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.00% (3.8582 => 3.9355, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/flops: 1.32% (9.4433 => 9.5681, std.dev.: 0.0243)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.28% (16.7972 => 17.0117, std.dev.: 0.0366)
  SingleSource/Regression/C/uint64_to_float: 1.27% (1.4528 => 1.4712, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout/methcall: 1.11% (8.5434 => 8.6379, std.dev.: 0.0171)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.00% (12.2111 => 12.3336, std.dev.: 0.0288)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.48% (0.5226 => 0.2379, std.dev.: 0.0107)
  MultiSource/Applications/sgefa/sgefa: -46.99% (1.5790 => 0.8370, std.dev.: 0.0357)
  SingleSource/Benchmarks/Linpack/linpack-pc: -26.24% (57.2347 => 42.2141, std.dev.: 4.9344)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.23% (15.9508 => 13.2018, std.dev.: 0.3608)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.28% (20.8247 => 18.2674, std.dev.: 0.1735)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0098)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.92% (3.4956 => 3.2188, std.dev.: 0.0010)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.62% (50.0284 => 46.2167, std.dev.: 0.3216)
  MultiSource/Applications/oggenc/oggenc: -6.47% (0.1699 => 0.1589, std.dev.: 0.0034)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.49% (3.7437 => 3.5383, std.dev.: 0.0681)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.41% (5.4473 => 5.2617, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.30% (17.1431 => 16.7482, std.dev.: 0.0497)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.04% (2.5938 => 2.5410, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.31% (4.3592 => 4.3020, std.dev.: 0.0108)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.29% (2.1472 => 2.1195, std.dev.: 0.0048)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.07% (89.7126 => 88.7510, std.dev.: 0.1266)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.26% (0.1348 => 0.1392, std.dev.: 0.0081)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130926/1eb63c1c/attachment.html>


More information about the llvm-testresults mailing list