[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Thu Dec 19 11:11:16 PST 2013

http://llvm.org/perf/db_default/v4/nts/18649?compare_to=18643&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18649, Order: 197698, Start Time: 2013-12-19 17:25:43, End Time: 2013-12-19 19:15:38
      To: 18643, Order: 197678, Start Time: 2013-12-19 15:09:49, End Time: 2013-12-19 16:58:59
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 42 (50 on baseline)
Performance Improvements: 17 (3 on baseline)
Unchanged Tests: 1051 (1057 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 61.65% (0.1987 => 0.3212, std.dev.: 0.0190)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 55.52% (0.1367 => 0.2126, std.dev.: 0.0090)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 48.34% (0.0784 => 0.1163, std.dev.: 0.0128)
  MultiSource/Benchmarks/Olden/tsp/tsp: 44.81% (0.1339 => 0.1939, std.dev.: 0.0213)
  MultiSource/Benchmarks/Olden/health/health: 44.12% (0.1530 => 0.2205, std.dev.: 0.0251)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 42.80% (0.2687 => 0.3837, std.dev.: 0.0125)
  MultiSource/Benchmarks/McCat/09-vor/vor: 39.70% (0.3715 => 0.5190, std.dev.: 0.0540)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.90% (0.1050 => 0.1448, std.dev.: 0.0139)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 37.12% (0.0862 => 0.1182, std.dev.: 0.0112)
  MultiSource/Benchmarks/McCat/05-eks/eks: 33.16% (0.5260 => 0.7004, std.dev.: 0.0536)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 32.63% (5.0953 => 6.7581, std.dev.: 0.1138)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 31.03% (5.1558 => 6.7559, std.dev.: 0.2260)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.51% (1.3993 => 1.8122, std.dev.: 0.0789)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.49% (1.6417 => 2.1095, std.dev.: 0.0664)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.37% (7.3700 => 8.7978, std.dev.: 0.1366)
  MultiSource/Benchmarks/Olden/bh/bh: 16.64% (0.3299 => 0.3848, std.dev.: 0.0182)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.10% (0.5348 => 0.5995, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C/football/football: 8.22% (1.0213 => 1.1053, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.69% (1.3030 => 1.3771, std.dev.: 0.0171)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.61% (10.3047 => 10.8826, std.dev.: 0.2203)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.24% (0.2861 => 0.3011, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.84% (0.3074 => 0.3192, std.dev.: 0.0006)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (46.7991 => 48.4902, std.dev.: 0.3205)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 80.78% (0.1457 => 0.2634, std.dev.: 0.0252)
  MultiSource/Benchmarks/McCat/09-vor/vor: 46.48% (0.1166 => 0.1708, std.dev.: 0.0192)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 44.83% (0.0484 => 0.0701, std.dev.: 0.0084)
  MultiSource/Benchmarks/Olden/bisort/bisort: 41.31% (0.6889 => 0.9735, std.dev.: 0.0210)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 37.92% (0.1002 => 0.1382, std.dev.: 0.0101)
  MultiSource/Benchmarks/FreeBench/neural/neural: 27.48% (0.4316 => 0.5502, std.dev.: 0.0232)
  MultiSource/Applications/lemon/lemon: 26.15% (0.8688 => 1.0960, std.dev.: 0.0619)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.94% (0.1366 => 0.1693, std.dev.: 0.0105)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.71% (14.0980 => 15.3258, std.dev.: 0.2086)
  SingleSource/Benchmarks/Shootout/lists: 5.19% (7.1377 => 7.5081, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.81% (4.5734 => 4.7934, std.dev.: 0.0782)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 4.59% (1.2441 => 1.3012, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.39% (5.9022 => 6.1021, std.dev.: 0.0539)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (1.6442 => 1.6950, std.dev.: 0.0149)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (39.3218 => 40.4324, std.dev.: 0.0590)
  SingleSource/Benchmarks/Misc/flops: 2.55% (9.2844 => 9.5208, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.06% (5.7082 => 5.8256, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.87% (5.0981 => 5.1936, std.dev.: 0.0354)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.52% (2.5936 => 2.6329, std.dev.: 0.0126)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -45.42% (0.0295 => 0.0161, std.dev.: 0.0030)
  SingleSource/Regression/C/compare: -44.67% (0.0403 => 0.0223, std.dev.: 0.0050)
  SingleSource/Regression/C/2008-01-07-LongDouble: -41.54% (0.0272 => 0.0159, std.dev.: 0.0031)
  SingleSource/Regression/C/sumarray2d: -34.25% (0.0508 => 0.0334, std.dev.: 0.0002)
  SingleSource/Benchmarks/Dhrystone/fldry: -16.80% (0.0732 => 0.0609, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -15.19% (0.2324 => 0.1971, std.dev.: 0.0060)
  MultiSource/Applications/JM/ldecod/ldecod: -12.42% (8.6941 => 7.6143, std.dev.: 0.3630)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.18% (0.0903 => 0.0802, std.dev.: 0.0029)
  SingleSource/Benchmarks/Linpack/linpack-pc: -11.02% (0.3448 => 0.3068, std.dev.: 0.0067)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -5.11% (0.5533 => 0.5250, std.dev.: 0.0046)
  MultiSource/Applications/JM/lencod/lencod: -2.13% (18.0212 => 17.6372, std.dev.: 0.1123)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/SignlessTypes/Large/cast: -70.00% (0.0170 => 0.0051, std.dev.: 0.0037)
  SingleSource/Benchmarks/Dhrystone/fldry: -10.90% (0.7579 => 0.6753, std.dev.: 0.0124)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.26% (0.6638 => 0.6355, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.80% (5.4123 => 5.2608, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.04% (3.2145 => 3.1490, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.17% (3.2023 => 3.1648, std.dev.: 0.0026)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 59.09% (0.2019 => 0.3212, std.dev.: 0.0190)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 52.62% (0.1393 => 0.2126, std.dev.: 0.0090)
  MultiSource/Applications/sqlite3/sqlite3: 49.77% (15.7419 => 23.5761, std.dev.: 0.2090)
  MultiSource/Benchmarks/McCat/09-vor/vor: 44.33% (0.3596 => 0.5190, std.dev.: 0.0540)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 43.76% (0.0809 => 0.1163, std.dev.: 0.0128)
  MultiSource/Benchmarks/Olden/health/health: 43.37% (0.1538 => 0.2205, std.dev.: 0.0251)
  MultiSource/Benchmarks/Olden/tsp/tsp: 40.61% (0.1379 => 0.1939, std.dev.: 0.0213)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 39.12% (0.2758 => 0.3837, std.dev.: 0.0125)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 37.92% (0.0857 => 0.1182, std.dev.: 0.0112)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 37.77% (0.1051 => 0.1448, std.dev.: 0.0139)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 33.63% (5.0556 => 6.7559, std.dev.: 0.2260)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 32.97% (5.0823 => 6.7581, std.dev.: 0.1138)
  MultiSource/Benchmarks/McCat/05-eks/eks: 31.60% (0.5322 => 0.7004, std.dev.: 0.0536)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.65% (1.6656 => 2.1095, std.dev.: 0.0664)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.42% (1.4449 => 1.8122, std.dev.: 0.0789)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.11% (7.5124 => 8.7978, std.dev.: 0.1366)
  MultiSource/Benchmarks/Olden/bh/bh: 17.00% (0.3289 => 0.3848, std.dev.: 0.0182)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.77% (0.5134 => 0.5995, std.dev.: 0.0099)
  MultiSource/Applications/lemon/lemon: 15.81% (1.2200 => 1.4129, std.dev.: 0.0536)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.48% (25.9661 => 29.2059, std.dev.: 0.4151)
  MultiSource/Benchmarks/Prolangs-C/football/football: 11.48% (0.9915 => 1.1053, std.dev.: 0.0223)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.95% (44.9186 => 48.4902, std.dev.: 0.3205)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.21% (1.2845 => 1.3771, std.dev.: 0.0171)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.56% (10.3096 => 10.8826, std.dev.: 0.2203)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (1.5198 => 1.5876, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.61% (0.2906 => 0.3011, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.94% (0.6322 => 0.6508, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.42% (1.3702 => 1.4034, std.dev.: 0.0117)
  MultiSource/Applications/JM/lencod/lencod: 1.97% (17.2968 => 17.6372, std.dev.: 0.1123)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 95.84% (0.1345 => 0.2634, std.dev.: 0.0252)
  MultiSource/Benchmarks/McCat/09-vor/vor: 46.74% (0.1164 => 0.1708, std.dev.: 0.0192)
  MultiSource/Benchmarks/Olden/bisort/bisort: 44.61% (0.6732 => 0.9735, std.dev.: 0.0210)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 40.45% (0.0984 => 0.1382, std.dev.: 0.0101)
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.38% (0.4220 => 0.5502, std.dev.: 0.0232)
  MultiSource/Applications/lemon/lemon: 26.97% (0.8632 => 1.0960, std.dev.: 0.0619)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.67% (0.1358 => 0.1693, std.dev.: 0.0105)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.16% (5.9583 => 7.0402, std.dev.: 0.0886)
  MultiSource/Applications/minisat/minisat: 15.90% (6.3881 => 7.4040, std.dev.: 0.3595)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.63% (1.2278 => 1.3952, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout/lists: 7.37% (6.9930 => 7.5081, std.dev.: 0.0222)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.73% (3.4043 => 3.5654, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.47% (4.5883 => 4.7934, std.dev.: 0.0782)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 4.41% (1.2463 => 1.3012, std.dev.: 0.0175)
  MultiSource/Applications/siod/siod: 4.37% (3.4258 => 3.5755, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.19% (5.9133 => 6.1021, std.dev.: 0.0539)
  SingleSource/Benchmarks/Misc/flops: 2.74% (9.2673 => 9.5208, std.dev.: 0.0554)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.10% (5.7060 => 5.8256, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.04% (1.8409 => 1.8784, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.57% (11.7894 => 11.9746, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.11% (5.9126 => 5.9783, std.dev.: 0.0149)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.51% (1.4113 => 1.3476, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.38% (1.3505 => 1.2913, std.dev.: 0.0201)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.81% (6.0535 => 5.8835, std.dev.: 0.0174)

Report Time: 2.10s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/0ba7b22b/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results