[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Oct 11 17:25:27 PDT 2013

http://llvm.org/perf/db_default/v4/nts/16230?compare_to=16226&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16230, Order: 192508, Start Time: 2013-10-11 22:37:47, End Time: 2013-10-12 00:28:30
      To: 16226, Order: 192487, Start Time: 2013-10-11 20:19:03, End Time: 2013-10-11 22:12:25
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (35 on baseline)
Performance Improvements: 63 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1022 (1055 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 31.33% (4.8111 => 6.3183, std.dev.: 0.3996)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.74% (1.2844 => 1.4480, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.64% (1.2206 => 1.3749, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.96% (1.2643 => 1.3902, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.77% (1.2404 => 1.3616, std.dev.: 0.0441)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.83% (0.2887 => 0.3142, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.64% (1.2808 => 1.3915, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.05% (1.2885 => 1.3794, std.dev.: 0.0228)
  MultiSource/Benchmarks/Olden/bh/bh: 6.92% (0.3297 => 0.3525, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.23% (1.1184 => 1.1881, std.dev.: 0.0173)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ks/ks: 33.73% (1.1392 => 1.5235, std.dev.: 0.0164)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.24% (2.4328 => 3.1685, std.dev.: 0.1416)
  MultiSource/Applications/minisat/minisat: 20.65% (7.3879 => 8.9132, std.dev.: 0.1441)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 12.71% (0.8325 => 0.9383, std.dev.: 0.0242)
  MultiSource/Applications/JM/lencod/lencod: 6.58% (7.8250 => 8.3402, std.dev.: 0.1952)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.36% (0.3735 => 0.3898, std.dev.: 0.0050)
  SingleSource/Regression/C/uint64_to_float: 3.22% (1.4348 => 1.4810, std.dev.: 0.0027)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.29% (18.5229 => 18.7618, std.dev.: 0.0425)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.17% (1.5947 => 1.6133, std.dev.: 0.0046)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.11% (6.7471 => 6.8219, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.06% (3.6056 => 3.6437, std.dev.: 0.0097)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1956 => 1.2077, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -66.67% (0.0279 => 0.0093, std.dev.: 0.0036)
  SingleSource/UnitTests/2002-04-17-PrintfChar: -52.25% (0.0222 => 0.0106, std.dev.: 0.0005)
  SingleSource/UnitTests/2002-05-02-ArgumentTest: -47.91% (0.0215 => 0.0112, std.dev.: 0.0007)
  SingleSource/UnitTests/SignlessTypes/cast-bug: -46.15% (0.0234 => 0.0126, std.dev.: 0.0003)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: -45.58% (0.0294 => 0.0160, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-04-22-Switch: -45.25% (0.0316 => 0.0173, std.dev.: 0.0006)
  SingleSource/Regression/C/compare: -45.09% (0.0397 => 0.0218, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -43.94% (0.0289 => 0.0162, std.dev.: 0.0006)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -43.82% (0.0938 => 0.0527, std.dev.: 0.0012)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -43.41% (0.0417 => 0.0236, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-05-14-AtExit: -43.29% (0.0365 => 0.0207, std.dev.: 0.0003)
  SingleSource/Regression/C/PR640: -43.23% (0.0384 => 0.0218, std.dev.: 0.0011)
  SingleSource/UnitTests/FloatPrecision: -43.20% (0.0294 => 0.0167, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -42.81% (0.0278 => 0.0159, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/div: -41.72% (0.0592 => 0.0345, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/simple: -41.58% (0.0392 => 0.0229, std.dev.: 0.0055)
  SingleSource/UnitTests/2005-11-29-LongSwitch: -40.86% (0.0279 => 0.0165, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/wc: -40.28% (0.3662 => 0.2187, std.dev.: 0.0118)
  SingleSource/UnitTests/byval-alignment: -40.26% (0.0308 => 0.0184, std.dev.: 0.0001)
  SingleSource/Regression/C/testtrace: -39.47% (0.0413 => 0.0250, std.dev.: 0.0003)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -38.72% (0.0266 => 0.0163, std.dev.: 0.0002)
  SingleSource/UnitTests/TestLoop: -38.19% (0.0309 => 0.0191, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-11-VaListArg: -37.84% (0.0481 => 0.0299, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/sumarray: -36.66% (0.0311 => 0.0197, std.dev.: 0.0033)
  SingleSource/UnitTests/initp1: -36.09% (0.0798 => 0.0510, std.dev.: 0.0078)
  SingleSource/Regression/C/callargs: -35.99% (0.0289 => 0.0185, std.dev.: 0.0010)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -35.74% (0.0291 => 0.0187, std.dev.: 0.0024)
  SingleSource/UnitTests/2002-12-13-MishaTest: -35.40% (0.0291 => 0.0188, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -32.61% (0.2481 => 0.1672, std.dev.: 0.0214)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -31.60% (0.0576 => 0.0394, std.dev.: 0.0035)
  SingleSource/UnitTests/Vector/constpool: -30.41% (13.6140 => 9.4740, std.dev.: 1.1332)
  SingleSource/Benchmarks/Shootout-C++/lists1: -29.51% (0.4429 => 0.3122, std.dev.: 0.0418)
  SingleSource/UnitTests/2002-05-02-CastTest: -29.11% (0.0371 => 0.0263, std.dev.: 0.0003)
  MultiSource/Applications/lambda-0_1_3/lambda: -28.74% (1.1643 => 0.8297, std.dev.: 0.0815)
  MultiSource/Applications/Burg/burg: -27.92% (1.9998 => 1.4415, std.dev.: 0.1493)
  SingleSource/UnitTests/vla: -26.30% (0.0616 => 0.0454, std.dev.: 0.0014)
  SingleSource/Regression/C/uint64_to_float: -25.92% (0.0544 => 0.0403, std.dev.: 0.0009)
  SingleSource/UnitTests/SignlessTypes/rem: -25.25% (0.1616 => 0.1208, std.dev.: 0.0023)
  SingleSource/Benchmarks/SmallPT/smallpt: -19.46% (0.1757 => 0.1415, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/Altivec/test1: -18.62% (0.1493 => 0.1215, std.dev.: 0.0070)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -17.58% (0.0603 => 0.0497, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/lists: -15.38% (0.3081 => 0.2607, std.dev.: 0.0179)
  MultiSource/Applications/d/make_dparser: -14.68% (4.2524 => 3.6282, std.dev.: 0.1985)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -11.91% (0.3981 => 0.3507, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout-C++/objinst: -11.90% (0.2378 => 0.2095, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -11.73% (0.2217 => 0.1957, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/hello: -10.74% (0.2030 => 0.1812, std.dev.: 0.0081)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.63% (0.5915 => 0.5286, std.dev.: 0.0160)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.41% (0.1845 => 0.1653, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.80% (0.2079 => 0.1896, std.dev.: 0.0008)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.65% (0.1581 => 0.1460, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.33% (1.4242 => 1.3910, std.dev.: 0.0110)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.60% (35.6962 => 28.6988, std.dev.: 1.8265)
  MultiSource/Benchmarks/nbench/nbench: -17.06% (23.9670 => 19.8792, std.dev.: 0.6473)
  SingleSource/Benchmarks/Shootout-C++/hash: -13.74% (0.8227 => 0.7097, std.dev.: 0.0183)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.40% (0.6500 => 0.5889, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -9.10% (0.1483 => 0.1348, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -7.19% (43.2699 => 40.1593, std.dev.: 0.4705)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.74% (0.3551 => 0.3347, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.51% (4.3745 => 4.2210, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.65% (5.1613 => 5.0763, std.dev.: 0.0285)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.25% (4.9312 => 4.8696, std.dev.: 0.0096)
  MultiSource/Applications/siod/siod: -1.01% (3.6783 => 3.6411, std.dev.: 0.0119)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.55% (0.1359 => 0.1338, std.dev.: 0.0335)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 37.70% (4.5883 => 6.3183, std.dev.: 0.3996)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.43% (1.2932 => 1.5186, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.51% (1.2007 => 1.3749, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.38% (1.2660 => 1.4480, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.66% (1.2086 => 1.3616, std.dev.: 0.0441)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.49% (1.4304 => 1.6090, std.dev.: 0.0479)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.13% (1.2630 => 1.4162, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.98% (1.3499 => 1.5116, std.dev.: 0.0576)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.66% (1.2639 => 1.4113, std.dev.: 0.0378)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.12% (1.2523 => 1.3915, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.81% (1.2553 => 1.3910, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.40% (1.2494 => 1.3794, std.dev.: 0.0228)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.36% (0.2847 => 0.3142, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.14% (1.2622 => 1.3902, std.dev.: 0.0128)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.67% (24.6139 => 26.7486, std.dev.: 0.6476)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.48% (1.0952 => 1.1881, std.dev.: 0.0173)
  MultiSource/Benchmarks/Olden/bh/bh: 7.08% (0.3292 => 0.3525, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.26% (0.6297 => 0.6439, std.dev.: 0.0055)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.69% (7.6426 => 12.5105, std.dev.: 0.0868)
  MultiSource/Applications/minisat/minisat: 42.02% (6.2760 => 8.9132, std.dev.: 0.1441)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 33.28% (1.1431 => 1.5235, std.dev.: 0.0164)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.00% (2.4753 => 3.1685, std.dev.: 0.1416)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 13.42% (0.8273 => 0.9383, std.dev.: 0.0242)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.66% (1.1013 => 1.2077, std.dev.: 0.0029)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.01% (8.1346 => 8.7052, std.dev.: 0.0150)
  SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0004)
  MultiSource/Applications/siod/siod: 3.12% (3.5310 => 3.6411, std.dev.: 0.0119)
  MultiSource/Applications/hexxagon/hexxagon: 2.43% (14.7810 => 15.1403, std.dev.: 0.0739)
  SingleSource/Regression/C/uint64_to_float: 1.94% (1.4528 => 1.4810, std.dev.: 0.0027)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.83% (2.4920 => 2.5376, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.37% (5.0196 => 5.0882, std.dev.: 0.0075)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.28% (16.7972 => 17.0124, std.dev.: 0.0515)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.27% (5.7884 => 5.8620, std.dev.: 0.0136)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8219, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.03% (1.0477 => 1.0585, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.57% (0.1483 => 0.1178, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.78% (0.5226 => 0.2363, std.dev.: 0.0633)
  MultiSource/Applications/sgefa/sgefa: -46.83% (1.5790 => 0.8395, std.dev.: 0.0284)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.96% (15.9508 => 13.2462, std.dev.: 0.1980)
  SingleSource/Benchmarks/Linpack/linpack-pc: -16.79% (57.2347 => 47.6241, std.dev.: 2.4069)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.26% (50.0284 => 44.8931, std.dev.: 0.6159)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.23% (3.4956 => 3.1381, std.dev.: 0.0374)
  MultiSource/Benchmarks/nbench/nbench: -10.16% (22.1263 => 19.8792, std.dev.: 0.6473)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.91% (20.8247 => 18.7618, std.dev.: 0.0425)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.09% (3.0561 => 2.8700, std.dev.: 0.0226)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.50% (2.5938 => 2.5030, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.16% (5.2422 => 5.0763, std.dev.: 0.0285)
  SingleSource/Benchmarks/Shootout/lists: -2.26% (7.3703 => 7.2038, std.dev.: 0.0341)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.70% (3.7874 => 3.7230, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.51% (3.9552 => 3.8955, std.dev.: 0.0201)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.22% (2.1472 => 2.1209, std.dev.: 0.0075)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.14% (89.7126 => 88.6872, std.dev.: 0.0868)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1348 => 0.1338, std.dev.: 0.0335)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131011/063aeb9c/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results