[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 30 02:03:08 PST 2013


http://llvm.org/perf/db_default/v4/nts/19327?compare_to=19321&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19327, Order: 198206, Start Time: 2013-12-30 08:25:13, End Time: 2013-12-30 10:07:44
      To: 19321, Order: 198203, Start Time: 2013-12-30 06:16:04, End Time: 2013-12-30 08:02:40
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 25 (32 on baseline)
Performance Improvements: 28 (26 on baseline)
Unchanged Tests: 1057 (1052 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.42% (2.8621 => 4.0189, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 36.69% (0.1450 => 0.1982, std.dev.: 0.0183)
  SingleSource/Benchmarks/Shootout/sieve: 20.68% (6.7395 => 8.1332, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (4.5284 => 5.4505, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/matrix: 16.84% (1.8060 => 2.1101, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.07% (1.0389 => 1.1331, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.76% (8.5174 => 9.2638, std.dev.: 0.2441)
  SingleSource/Benchmarks/McGill/misr: 7.30% (0.3833 => 0.4113, std.dev.: 0.0021)
  MultiSource/Benchmarks/sim/sim: 5.15% (3.8289 => 4.0260, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.67% (0.4737 => 0.4958, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.33% (5.5804 => 5.8222, std.dev.: 0.0493)
  MultiSource/Applications/hexxagon/hexxagon: 4.11% (14.9884 => 15.6044, std.dev.: 0.0692)
  SingleSource/Benchmarks/Shootout/lists: 3.73% (7.1538 => 7.4208, std.dev.: 0.0449)
  SingleSource/Benchmarks/Misc/flops: 3.70% (9.2663 => 9.6088, std.dev.: 0.0020)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.19% (50.7509 => 52.3689, std.dev.: 0.1873)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.03% (2.4711 => 2.5460, std.dev.: 0.0054)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (1.2568 => 1.2947, std.dev.: 0.0118)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.79% (0.6347 => 0.6524, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.43% (3.7403 => 3.8311, std.dev.: 0.0023)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.63% (2.4369 => 2.4765, std.dev.: 0.0101)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.61% (18.6654 => 18.9659, std.dev.: 0.0231)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.56% (6.7460 => 6.8515, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.47% (3.1523 => 3.1986, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.23% (3.5382 => 3.5816, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.17% (5.0478 => 5.1070, std.dev.: 0.0009)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -31.81% (0.2911 => 0.1985, std.dev.: 0.0335)
  MultiSource/Benchmarks/Olden/bh/bh: -26.73% (0.4344 => 0.3183, std.dev.: 0.0052)
  MultiSource/Benchmarks/Olden/em3d/em3d: -26.17% (0.2644 => 0.1952, std.dev.: 0.0030)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -17.75% (0.4485 => 0.3689, std.dev.: 0.0080)
  MultiSource/Benchmarks/McCat/09-vor/vor: -14.29% (0.4262 => 0.3653, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/05-eks/eks: -8.31% (0.5561 => 0.5099, std.dev.: 0.0066)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.42% (0.2010 => 0.1881, std.dev.: 0.0001)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.18% (0.4128 => 0.3873, std.dev.: 0.0049)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.98% (1.1997 => 1.1400, std.dev.: 0.0150)
  MultiSource/Applications/siod/siod: -4.64% (2.7056 => 2.5800, std.dev.: 0.0393)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.44% (0.9100 => 0.8696, std.dev.: 0.0142)
  MultiSource/Benchmarks/McCat/08-main/main: -3.38% (0.3223 => 0.3114, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.13% (0.7057 => 0.6836, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.32% (0.6555 => 0.6403, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.56% (0.8392 => 0.8261, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.19% (5.5242 => 5.4584, std.dev.: 0.0116)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -46.69% (0.0347 => 0.0185, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/mst/mst: -40.47% (0.2251 => 0.1340, std.dev.: 0.0341)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.18% (4.9045 => 4.2580, std.dev.: 0.2505)
  MultiSource/Benchmarks/nbench/nbench: -11.87% (22.7466 => 20.0473, std.dev.: 0.6821)
  SingleSource/Benchmarks/Shootout/ary3: -8.20% (4.7491 => 4.3599, std.dev.: 0.1125)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -5.12% (2.8166 => 2.6725, std.dev.: 0.0390)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.31% (0.2828 => 0.2706, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.49% (1.5787 => 1.5236, std.dev.: 0.0087)
  MultiSource/Benchmarks/llubenchmark/llu: -2.62% (2.0184 => 1.9656, std.dev.: 0.0192)
  MultiSource/Benchmarks/Olden/bh/bh: -2.29% (2.4463 => 2.3902, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.82% (4.0338 => 3.9602, std.dev.: 0.0131)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.69% (9.6006 => 9.4381, std.dev.: 0.0375)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.63% (15.7419 => 21.9798, std.dev.: 1.0664)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.98% (0.3859 => 0.4900, std.dev.: 0.0067)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.23% (25.9661 => 27.3242, std.dev.: 0.3549)
  MultiSource/Benchmarks/McCat/08-main/main: 3.56% (0.3007 => 0.3114, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.15% (0.6412 => 0.6614, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.74% (0.8787 => 0.8940, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 55.82% (1.6685 => 2.5999, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.49% (2.8607 => 4.0189, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/sieve: 20.57% (6.7454 => 8.1332, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.17% (4.6123 => 5.4505, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/matrix: 17.49% (1.7960 => 2.1101, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.69% (5.9583 => 6.9527, std.dev.: 0.1456)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.74% (1.0232 => 1.1331, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.99% (0.1668 => 0.1818, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.97% (8.5010 => 9.2638, std.dev.: 0.2441)
  SingleSource/Benchmarks/Misc/fp-convert: 6.48% (7.3892 => 7.8683, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout/lists: 6.12% (6.9930 => 7.4208, std.dev.: 0.0449)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.45% (1.2278 => 1.2947, std.dev.: 0.0118)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.33% (3.4043 => 3.5517, std.dev.: 0.0362)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.20% (0.6261 => 0.6524, std.dev.: 0.0051)
  MultiSource/Applications/hexxagon/hexxagon: 4.04% (14.9989 => 15.6044, std.dev.: 0.0692)
  SingleSource/Benchmarks/Misc/flops: 3.68% (9.2673 => 9.6088, std.dev.: 0.0020)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (0.5112 => 0.5265, std.dev.: 0.0008)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (50.9650 => 52.3689, std.dev.: 0.1873)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.67% (3.7315 => 3.8311, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/oourafft: 2.03% (3.6501 => 3.7241, std.dev.: 0.0029)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.87% (18.6185 => 18.9659, std.dev.: 0.0231)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.74% (2.5025 => 2.5460, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.67% (11.7894 => 11.9864, std.dev.: 0.0665)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.39% (3.1547 => 3.1986, std.dev.: 0.0103)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.12% (6.7756 => 6.8515, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.03% (3.5451 => 3.5816, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.28% (0.1088 => 0.0987, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.91% (0.3247 => 0.2990, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.09% (5.8749 => 5.4584, std.dev.: 0.0116)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.03% (0.1523 => 0.1416, std.dev.: 0.0038)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.82% (0.1774 => 0.1653, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.26% (1.3676 => 1.2820, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.02% (0.2824 => 0.2654, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.04% (1.4277 => 1.3557, std.dev.: 0.0245)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.24% (1.1409 => 1.0925, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.19% (0.5322 => 0.5099, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.14% (1.2914 => 1.2379, std.dev.: 0.0160)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.12% (0.3714 => 0.3561, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.39% (1.3510 => 1.3052, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.30% (1.2544 => 1.2130, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.73% (1.2583 => 1.2239, std.dev.: 0.0127)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.93% (10.3096 => 10.1109, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.69% (1.2670 => 1.2456, std.dev.: 0.0053)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -38.75% (0.0369 => 0.0226, std.dev.: 0.0035)
  MultiSource/Benchmarks/nbench/nbench: -14.58% (23.4696 => 20.0473, std.dev.: 0.6821)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.82% (10.0217 => 9.4381, std.dev.: 0.0375)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -4.95% (4.0567 => 3.8560, std.dev.: 0.0691)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.11% (2.5559 => 2.4765, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.01% (6.0535 => 5.8710, std.dev.: 0.0610)
  MultiSource/Applications/sqlite3/sqlite3: -2.38% (4.2978 => 4.1957, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.31% (4.1462 => 4.0918, std.dev.: 0.0061)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131230/b2b85cbd/attachment.html>


More information about the llvm-testresults mailing list