[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 19 13:28:05 PST 2013


http://llvm.org/perf/db_default/v4/nts/18656?compare_to=18649&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18656, Order: 197714, Start Time: 2013-12-19 19:40:59, End Time: 2013-12-19 21:32:28
      To: 18649, Order: 197698, Start Time: 2013-12-19 17:25:43, End Time: 2013-12-19 19:15:38
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 25 (39 on baseline)
Performance Improvements: 17 (11 on baseline)
Unchanged Tests: 1068 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 63.42% (0.0771 => 0.1260, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 62.37% (0.0659 => 0.1070, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 53.96% (0.0695 => 0.1070, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 48.61% (0.0718 => 0.1067, std.dev.: 0.0073)
  MultiSource/Applications/ClamAV/clamscan: 12.55% (17.1883 => 19.3454, std.dev.: 0.2421)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.75% (5.4254 => 5.9542, std.dev.: 0.0126)
  MultiSource/Applications/SPASS/SPASS: 7.74% (16.6674 => 17.9567, std.dev.: 0.1986)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.23% (4.2269 => 4.4902, std.dev.: 0.0784)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 47.60% (2.9357 => 4.3330, std.dev.: 0.0987)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.27% (2.0981 => 2.3976, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.85% (36.6541 => 41.3659, std.dev.: 0.0377)
  SingleSource/Benchmarks/Misc/salsa20: 9.03% (7.4823 => 8.1578, std.dev.: 0.1922)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.97% (1.1123 => 1.2121, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.79% (4.8023 => 5.2242, std.dev.: 0.0466)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.28% (2.2957 => 2.4399, std.dev.: 0.0370)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.84% (21.0182 => 22.2460, std.dev.: 0.2856)
  SingleSource/Benchmarks/Shootout/hash: 5.42% (5.1481 => 5.4271, std.dev.: 0.0304)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (15.3258 => 16.1008, std.dev.: 0.1466)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.66% (0.6970 => 0.7295, std.dev.: 0.0004)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.88% (5.4244 => 5.6348, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.26% (6.5639 => 6.7120, std.dev.: 0.0304)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.23% (1.6985 => 1.7363, std.dev.: 0.0041)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.02% (18.5825 => 18.9586, std.dev.: 0.0692)
  MultiSource/Applications/aha/aha: 1.49% (3.5702 => 3.6235, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout/methcall: 1.29% (8.5297 => 8.6394, std.dev.: 0.0150)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -38.29% (0.3212 => 0.1982, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -32.55% (0.2126 => 0.1434, std.dev.: 0.0207)
  MultiSource/Benchmarks/Olden/health/health: -28.03% (0.2205 => 0.1587, std.dev.: 0.0221)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -23.35% (6.7581 => 5.1798, std.dev.: 0.5624)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -23.04% (6.7559 => 5.1991, std.dev.: 0.4924)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -19.27% (0.2024 => 0.1634, std.dev.: 0.0090)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -18.37% (0.1448 => 0.1182, std.dev.: 0.0069)
  MultiSource/Benchmarks/McCat/05-eks/eks: -14.91% (0.7004 => 0.5960, std.dev.: 0.0340)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -12.47% (0.1235 => 0.1081, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.66% (11.1685 => 9.8663, std.dev.: 0.3473)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -10.89% (0.5995 => 0.5342, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.09% (1.4034 => 1.3319, std.dev.: 0.0113)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -31.04% (0.1382 => 0.0953, std.dev.: 0.0090)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -30.81% (0.0701 => 0.0485, std.dev.: 0.0076)
  MultiSource/Benchmarks/Olden/bh/bh: -6.32% (2.5692 => 2.4067, std.dev.: 0.0457)
  SingleSource/Benchmarks/Shootout/lists: -5.27% (7.5081 => 7.1126, std.dev.: 0.0822)
  MultiSource/Benchmarks/Olden/power/power: -2.17% (1.2056 => 1.1794, std.dev.: 0.0097)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 62.61% (0.0658 => 0.1070, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 60.31% (0.0786 => 0.1260, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 55.98% (0.0686 => 0.1070, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 47.99% (0.0721 => 0.1067, std.dev.: 0.0073)
  MultiSource/Applications/sqlite3/sqlite3: 43.95% (15.7419 => 22.6600, std.dev.: 0.9001)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 29.52% (0.3859 => 0.4998, std.dev.: 0.0317)
  MultiSource/Applications/ClamAV/clamscan: 14.02% (16.9661 => 19.3454, std.dev.: 0.2421)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.05% (25.9661 => 29.0961, std.dev.: 0.9772)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.93% (0.1080 => 0.1198, std.dev.: 0.0022)
  MultiSource/Applications/oggenc/oggenc: 8.74% (5.4968 => 5.9773, std.dev.: 0.1313)
  MultiSource/Applications/SPASS/SPASS: 7.41% (16.7177 => 17.9567, std.dev.: 0.1986)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.68% (2.5384 => 2.6827, std.dev.: 0.0296)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.38% (0.6412 => 0.6757, std.dev.: 0.0110)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.12% (4.2717 => 4.4902, std.dev.: 0.0784)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.5134 => 0.5342, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (5.8749 => 5.9542, std.dev.: 0.0126)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 46.92% (2.9492 => 4.3330, std.dev.: 0.0987)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.93% (5.9583 => 6.9673, std.dev.: 0.0832)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.01% (35.9684 => 41.3659, std.dev.: 0.0377)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.06% (2.1020 => 2.3976, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/ary3: 11.64% (4.6797 => 5.2242, std.dev.: 0.0466)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.44% (1.2278 => 1.3682, std.dev.: 0.0524)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.00% (1.1019 => 1.2121, std.dev.: 0.0148)
  SingleSource/Benchmarks/Shootout/strcat: 8.75% (0.1417 => 0.1541, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/salsa20: 7.41% (7.5947 => 8.1578, std.dev.: 0.1922)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.49% (10.0217 => 10.6719, std.dev.: 0.1190)
  MultiSource/Applications/siod/siod: 5.74% (3.4258 => 3.6225, std.dev.: 0.0371)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.13% (0.6939 => 0.7295, std.dev.: 0.0004)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.11% (3.4043 => 3.5783, std.dev.: 0.0474)
  SingleSource/Benchmarks/Shootout/hash: 4.58% (5.1896 => 5.4271, std.dev.: 0.0304)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.47% (2.3355 => 2.4399, std.dev.: 0.0370)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.64% (15.5356 => 16.1008, std.dev.: 0.1466)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.80% (6.5291 => 6.7120, std.dev.: 0.0304)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.46% (5.4994 => 5.6348, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.15% (5.9126 => 6.0395, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (11.7894 => 12.0141, std.dev.: 0.0702)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.83% (18.6185 => 18.9586, std.dev.: 0.0692)
  MultiSource/Applications/aha/aha: 1.66% (3.5645 => 3.6235, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.61% (1.7088 => 1.7363, std.dev.: 0.0041)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -23.69% (0.0688 => 0.0525, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.01% (1.3676 => 1.2854, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (1.2824 => 1.2119, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.09% (1.3505 => 1.2818, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (1.4113 => 1.3431, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.23% (1.3146 => 1.2590, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.07% (1.3157 => 1.2621, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.94% (1.4125 => 1.3569, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.16% (1.2544 => 1.2148, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.80% (1.3702 => 1.3319, std.dev.: 0.0113)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.45% (5.9456 => 5.5623, std.dev.: 0.1043)

Report Time: 1.92s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/e85b0251/attachment.html>


More information about the llvm-testresults mailing list