[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 4 19:37:11 PST 2014


http://llvm.org/perf/db_default/v4/nts/19705?compare_to=19692&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19705, Order: 198528, Start Time: 2014-01-05 01:35:42, End Time: 2014-01-05 03:41:54
      To: 19692, Order: 198515, Start Time: 2014-01-04 23:08:07, End Time: 2014-01-05 00:51:04
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 36 (42 on baseline)
Performance Improvements: 8 (5 on baseline)
Unchanged Tests: 1066 (1063 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/pointer_method2: 48.83% (0.0256 => 0.0381, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 47.47% (0.2212 => 0.3262, std.dev.: 0.0293)
  SingleSource/Benchmarks/Misc/mandel: 45.44% (0.0471 => 0.0685, std.dev.: 0.0052)
  MultiSource/Benchmarks/Olden/power/power: 39.69% (0.1406 => 0.1964, std.dev.: 0.0169)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 37.63% (0.1233 => 0.1697, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 27.41% (5.1292 => 6.5349, std.dev.: 0.0656)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.77% (0.0488 => 0.0604, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/health/health: 22.36% (0.1534 => 0.1877, std.dev.: 0.0080)
  MultiSource/Benchmarks/McCat/05-eks/eks: 19.06% (0.5237 => 0.6235, std.dev.: 0.0297)
  MultiSource/Benchmarks/Olden/bh/bh: 17.81% (0.3263 => 0.3844, std.dev.: 0.0148)
  MultiSource/Applications/SPASS/SPASS: 13.19% (16.5726 => 18.7584, std.dev.: 0.2844)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.44% (27.4722 => 30.3405, std.dev.: 0.5918)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.64% (44.6716 => 48.9766, std.dev.: 1.3556)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.32% (0.3403 => 0.3686, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.09% (1.2744 => 1.3647, std.dev.: 0.0197)
  MultiSource/Applications/minisat/minisat: 5.98% (0.7760 => 0.8224, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.59% (1.2670 => 1.3251, std.dev.: 0.0126)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 58.27% (0.7738 => 1.2247, std.dev.: 0.1100)
  MultiSource/Benchmarks/Olden/bisort/bisort: 41.90% (0.6706 => 0.9516, std.dev.: 0.0426)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.75% (1.4794 => 1.8751, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.77% (14.1154 => 16.7645, std.dev.: 0.1563)
  SingleSource/Benchmarks/Shootout/ary3: 16.17% (4.4564 => 5.1770, std.dev.: 0.2544)
  MultiSource/Applications/SPASS/SPASS: 11.94% (7.9251 => 8.8711, std.dev.: 0.2704)
  MultiSource/Benchmarks/Olden/health/health: 11.91% (0.3207 => 0.3589, std.dev.: 0.0135)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.03% (9.4959 => 10.1634, std.dev.: 0.1752)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.97% (0.4457 => 0.4723, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.16% (40.3360 => 42.4183, std.dev.: 0.2823)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.98% (1.5442 => 1.6211, std.dev.: 0.0237)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.75% (1.8082 => 1.8941, std.dev.: 0.0052)
  MultiSource/Applications/spiff/spiff: 4.08% (2.7972 => 2.9112, std.dev.: 0.0146)
  SingleSource/Benchmarks/Misc/flops: 3.76% (9.2675 => 9.6163, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.17% (3.9958 => 4.1226, std.dev.: 0.0486)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.11% (96.6835 => 99.6908, std.dev.: 0.9014)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (2.4746 => 2.5197, std.dev.: 0.0106)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.54% (2.8148 => 2.8582, std.dev.: 0.0140)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.25% (1.7592 => 1.7812, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/JM/lencod/lencod: -7.20% (8.6231 => 8.0023, std.dev.: 0.0561)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.87% (1.3442 => 1.2787, std.dev.: 0.0244)
  MultiSource/Applications/aha/aha: -4.27% (3.7426 => 3.5828, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.79% (5.2505 => 5.0515, std.dev.: 0.0218)
  SingleSource/Benchmarks/Shootout/lists: -2.83% (7.3522 => 7.1444, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.19% (6.6926 => 6.5462, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.12% (5.3586 => 5.2450, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.18% (3.5861 => 3.5439, std.dev.: 0.0075)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/pointer_method2: 48.25% (0.0257 => 0.0381, std.dev.: 0.0039)
  MultiSource/Applications/sqlite3/sqlite3: 47.16% (15.7419 => 23.1655, std.dev.: 0.3799)
  SingleSource/Benchmarks/Misc/mandel: 44.21% (0.0475 => 0.0685, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 43.01% (0.2281 => 0.3262, std.dev.: 0.0293)
  MultiSource/Benchmarks/Olden/power/power: 39.69% (0.1406 => 0.1964, std.dev.: 0.0169)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 30.34% (0.1302 => 0.1697, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.58% (5.0823 => 6.5349, std.dev.: 0.0656)
  MultiSource/Benchmarks/Olden/health/health: 22.04% (0.1538 => 0.1877, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 19.84% (0.0504 => 0.0604, std.dev.: 0.0017)
  MultiSource/Benchmarks/McCat/05-eks/eks: 17.16% (0.5322 => 0.6235, std.dev.: 0.0297)
  MultiSource/Benchmarks/Olden/bh/bh: 16.87% (0.3289 => 0.3844, std.dev.: 0.0148)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.85% (25.9661 => 30.3405, std.dev.: 0.5918)
  MultiSource/Applications/SPASS/SPASS: 12.21% (16.7177 => 18.7584, std.dev.: 0.2844)
  MultiSource/Applications/lemon/lemon: 11.25% (1.2200 => 1.3573, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.87% (0.3355 => 0.3686, std.dev.: 0.0035)
  MultiSource/Applications/minisat/minisat: 9.17% (0.7533 => 0.8224, std.dev.: 0.0149)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.03% (44.9186 => 48.9766, std.dev.: 1.3556)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6412 => 0.6815, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.37% (1.2952 => 1.3647, std.dev.: 0.0197)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.6322 => 0.6545, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 59.67% (0.7670 => 1.2247, std.dev.: 0.1100)
  MultiSource/Benchmarks/Olden/bisort/bisort: 41.35% (0.6732 => 0.9516, std.dev.: 0.0426)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.74% (1.4795 => 1.8751, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.66% (5.9583 => 6.9508, std.dev.: 0.1458)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.28% (82.2592 => 92.3644, std.dev.: 0.0821)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (3.3810 => 3.6587, std.dev.: 0.0186)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.34% (0.4400 => 0.4723, std.dev.: 0.0094)
  MultiSource/Applications/siod/siod: 6.79% (3.4258 => 3.6585, std.dev.: 0.0381)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.10% (1.5425 => 1.6211, std.dev.: 0.0237)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.60% (40.5530 => 42.4183, std.dev.: 0.2823)
  MultiSource/Applications/sgefa/sgefa: 3.90% (0.8745 => 0.9086, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/flops: 3.77% (9.2673 => 9.6163, std.dev.: 0.0109)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.62% (3.4043 => 3.5275, std.dev.: 0.0181)
  MultiSource/Applications/spiff/spiff: 3.49% (2.8130 => 2.9112, std.dev.: 0.0146)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.89% (1.8409 => 1.8941, std.dev.: 0.0052)
  MultiSource/Applications/sqlite3/sqlite3: 2.42% (4.2978 => 4.4016, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/fp-convert: 2.36% (7.3892 => 7.5636, std.dev.: 0.0083)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.31% (1.7409 => 1.7812, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/lists: 2.17% (6.9930 => 7.1444, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.01% (5.9126 => 6.0313, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.55% (11.7894 => 11.9718, std.dev.: 0.0240)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.22% (2.4894 => 2.5197, std.dev.: 0.0106)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -25.00% (0.0688 => 0.0516, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.41% (15.5356 => 12.9861, std.dev.: 0.1741)
  MultiSource/Benchmarks/sim/sim: -4.20% (4.0134 => 3.8448, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.34% (6.0535 => 5.8513, std.dev.: 0.0309)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.79% (2.5200 => 2.4749, std.dev.: 0.0089)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140104/d449af5a/attachment.html>


More information about the llvm-testresults mailing list