[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 11 19:33:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16233?compare_to=16230&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16233, Order: 192517, Start Time: 2013-10-12 00:50:40, End Time: 2013-10-12 02:36:27
      To: 16230, Order: 192508, Start Time: 2013-10-11 22:37:47, End Time: 2013-10-12 00:28:30
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (43 on baseline)
Performance Improvements: 24 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.27% (1.6494 => 2.6105, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.36% (2.8533 => 3.9479, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 31.61% (0.1509 => 0.1986, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/matrix: 19.52% (1.7671 => 2.1120, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (8.5231 => 9.8123, std.dev.: 0.0037)
  MultiSource/Applications/JM/lencod/lencod: 5.70% (8.3402 => 8.8153, std.dev.: 0.0211)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.84% (1.8133 => 1.9011, std.dev.: 0.0014)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.42% (1.2596 => 1.3153, std.dev.: 0.0184)
  SingleSource/Benchmarks/Shootout/lists: 4.16% (7.2038 => 7.5033, std.dev.: 0.0591)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.03% (97.4865 => 101.4157, std.dev.: 1.0751)
  MultiSource/Applications/spiff/spiff: 3.99% (2.8211 => 2.9338, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.70% (5.7834 => 5.9976, std.dev.: 0.0222)
  SingleSource/Benchmarks/Misc/fp-convert: 3.50% (7.5346 => 7.7980, std.dev.: 0.0409)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.48% (4.3952 => 4.5480, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.93% (6.7399 => 6.9371, std.dev.: 0.0754)
  SingleSource/Benchmarks/Shootout/methcall: 2.92% (8.3782 => 8.6226, std.dev.: 0.0418)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.55% (5.4736 => 5.6132, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.51% (4.0328 => 4.1341, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (3.1381 => 3.2167, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.32% (21.0719 => 21.5598, std.dev.: 0.0785)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.01% (2.3765 => 2.4242, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.00% (1.2619 => 1.2872, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.73% (1.6661 => 1.6950, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (2.5030 => 2.5412, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.20% (12.5105 => 12.6611, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout/random: 1.11% (2.4520 => 2.4793, std.dev.: 0.0001)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -22.62% (0.3502 => 0.2710, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.37% (1.5186 => 1.3156, std.dev.: 0.0726)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -11.60% (1.4130 => 1.2491, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.55% (1.3749 => 1.2161, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -11.31% (1.4162 => 1.2560, std.dev.: 0.0529)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.20% (0.1161 => 0.1031, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.19% (0.1875 => 0.1684, std.dev.: 0.0009)
  MultiSource/Applications/minisat/minisat: -9.98% (0.8425 => 0.7584, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -9.93% (1.3481 => 1.2142, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.86% (1.6090 => 1.4503, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -9.67% (1.5116 => 1.3654, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.05% (1.3699 => 1.2733, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.77% (1.3768 => 1.2973, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.32% (1.4005 => 1.3260, std.dev.: 0.0119)
  SingleSource/UnitTests/Vector/constpool: -5.16% (9.4740 => 8.9854, std.dev.: 0.1639)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.73% (1.3713 => 1.3064, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.6509 => 0.6366, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.68% (15.1013 => 14.8478, std.dev.: 0.0973)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (1.1155 => 1.0984, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -18.95% (0.0702 => 0.0569, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.59% (0.3619 => 0.3308, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.70% (6.0236 => 5.9213, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.41% (3.6107 => 3.5597, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.25% (5.0882 => 5.0244, std.dev.: 0.0164)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.35% (0.1338 => 0.1320, std.dev.: 0.0067)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/lencod/lencod: 4.87% (16.5902 => 17.3984, std.dev.: 0.1693)
  MultiSource/Applications/JM/ldecod/ldecod: 3.94% (7.4026 => 7.6940, std.dev.: 0.0577)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.56% (2.6492 => 2.7435, std.dev.: 0.0219)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.40% (1.5333 => 1.5854, std.dev.: 0.0130)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.13% (0.9212 => 0.9500, std.dev.: 0.0107)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.92% (1.9476 => 2.0045, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.63% (1.8775 => 1.9269, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.4764 => 14.8478, std.dev.: 0.0973)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.6297 => 0.6441, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6439 => 0.6576, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.12% (1.0756 => 1.0984, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.65% (0.8802 => 0.8947, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (6.0284 => 6.1086, std.dev.: 0.0291)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.66% (7.6426 => 12.6611, std.dev.: 0.0159)
  SingleSource/Benchmarks/Misc/pi: 57.51% (1.6574 => 2.6105, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.26% (2.8554 => 3.9479, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 32.05% (1.1431 => 1.5095, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/matrix: 18.59% (1.7809 => 2.1120, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.09% (8.5256 => 9.8123, std.dev.: 0.0037)
  MultiSource/Applications/JM/lencod/lencod: 7.79% (8.1785 => 8.8153, std.dev.: 0.0211)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0002)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.26% (8.1346 => 8.6440, std.dev.: 0.1827)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.15% (0.1871 => 0.1986, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.12% (6.5990 => 6.9371, std.dev.: 0.0754)
  SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.09% (1.2516 => 1.3153, std.dev.: 0.0184)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.79% (96.7834 => 101.4157, std.dev.: 1.0751)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.50% (5.3716 => 5.6132, std.dev.: 0.0223)
  MultiSource/Applications/spiff/spiff: 4.06% (2.8194 => 2.9338, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.84% (5.7757 => 5.9976, std.dev.: 0.0222)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.3836 => 0.3956, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.89% (4.0181 => 4.1341, std.dev.: 0.0056)
  MultiSource/Applications/siod/siod: 2.85% (3.5310 => 3.6315, std.dev.: 0.0035)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.81% (1.7652 => 1.8148, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/fp-convert: 2.77% (7.5877 => 7.7980, std.dev.: 0.0409)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.66% (1.8519 => 1.9011, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (3.1569 => 3.2221, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.73% (3.5683 => 3.6300, std.dev.: 0.0184)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.41% (1.0477 => 1.0625, std.dev.: 0.0014)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.18% (16.7972 => 16.9949, std.dev.: 0.0361)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8216, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.11% (0.1483 => 0.1170, std.dev.: 0.0025)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.45% (0.1195 => 0.1094, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.28% (0.2571 => 0.2358, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.45% (0.5226 => 0.2328, std.dev.: 0.0039)
  MultiSource/Applications/sgefa/sgefa: -46.76% (1.5790 => 0.8406, std.dev.: 0.0006)
  SingleSource/Benchmarks/Linpack/linpack-pc: -25.10% (57.2347 => 42.8662, std.dev.: 2.1190)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.69% (15.9508 => 12.9688, std.dev.: 0.2079)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.51% (50.0284 => 40.7659, std.dev.: 1.9229)
  SingleSource/Benchmarks/Shootout/heapsort: -17.25% (3.5900 => 2.9706, std.dev.: 0.0617)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.32% (20.8247 => 18.6759, std.dev.: 0.0634)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.96% (0.3304 => 0.2975, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.98% (3.4956 => 3.2167, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.52% (30.1838 => 28.5184, std.dev.: 0.4521)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.51% (0.3501 => 0.3308, std.dev.: 0.0002)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.04% (0.7474 => 0.7097, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/salsa20: -3.79% (7.7964 => 7.5011, std.dev.: 0.0670)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.34% (3.7437 => 3.6187, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.06% (17.1431 => 16.6187, std.dev.: 0.1299)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.68% (36.8417 => 35.8531, std.dev.: 0.3319)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.49% (1.1075 => 1.0799, std.dev.: 0.0106)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.03% (2.5938 => 2.5412, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.71% (3.7874 => 3.7228, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/ffbench: -1.17% (1.4030 => 1.3866, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.07% (4.9022 => 4.8496, std.dev.: 0.0029)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.08% (0.1348 => 0.1320, std.dev.: 0.0067)

Report Time: 1.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131011/3cc3953c/attachment.html>


More information about the llvm-testresults mailing list