[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 2 17:52:44 PST 2013


http://llvm.org/perf/db_default/v4/nts/17849?compare_to=17843&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17849, Order: 196169, Start Time: 2013-12-03 00:07:22, End Time: 2013-12-03 01:56:48
      To: 17843, Order: 196155, Start Time: 2013-12-02 21:50:42, End Time: 2013-12-02 23:40:34
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 25 (40 on baseline)
Performance Improvements: 8 (9 on baseline)
Unchanged Tests: 1077 (1061 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 76.10% (0.0159 => 0.0280, std.dev.: 0.0013)
  SingleSource/UnitTests/2007-03-02-VaCopy: 71.34% (0.0164 => 0.0281, std.dev.: 0.0010)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 70.91% (0.0165 => 0.0282, std.dev.: 0.0013)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 65.33% (0.0225 => 0.0372, std.dev.: 0.0017)
  SingleSource/UnitTests/2006-01-23-UnionInit: 57.93% (0.0271 => 0.0428, std.dev.: 0.0034)
  SingleSource/UnitTests/2003-08-11-VaListArg: 56.07% (0.0321 => 0.0501, std.dev.: 0.0017)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 56.02% (0.0191 => 0.0298, std.dev.: 0.0020)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 54.51% (0.0266 => 0.0411, std.dev.: 0.0033)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 52.58% (0.0213 => 0.0325, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 45.47% (0.1049 => 0.1526, std.dev.: 0.0149)
  SingleSource/Benchmarks/Shootout/random: 42.70% (0.0363 => 0.0518, std.dev.: 0.0036)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 40.91% (0.0264 => 0.0372, std.dev.: 0.0016)
  SingleSource/Benchmarks/Stanford/FloatMM: 26.49% (0.0604 => 0.0764, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.32% (0.2268 => 0.2865, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.54% (1.3120 => 1.4109, std.dev.: 0.0168)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.60% (2.5584 => 2.6761, std.dev.: 0.0289)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.61% (2.3849 => 2.8287, std.dev.: 0.1673)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.59% (2.1114 => 2.3772, std.dev.: 0.0285)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.18% (37.6210 => 41.8253, std.dev.: 0.2582)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.58% (14.7037 => 15.9648, std.dev.: 0.1493)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.54% (4.5772 => 4.7849, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.16% (5.9136 => 6.1594, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc/ffbench: 2.82% (1.4162 => 1.4562, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.48% (2.3314 => 2.3893, std.dev.: 0.0076)
  MultiSource/Applications/viterbi/viterbi: 1.07% (2.6343 => 2.6625, std.dev.: 0.0060)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-3: -35.28% (0.0496 => 0.0321, std.dev.: 0.0009)
  MultiSource/Applications/obsequi/Obsequi: -24.02% (1.5498 => 1.1775, std.dev.: 0.1172)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -23.83% (0.1431 => 0.1090, std.dev.: 0.0116)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -21.55% (0.1397 => 0.1096, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/fibo: -7.50% (0.2079 => 0.1923, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.32% (0.4246 => 0.4105, std.dev.: 0.0027)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -18.51% (0.5193 => 0.4232, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.11% (5.9634 => 5.8973, std.dev.: 0.0199)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 80.61% (0.0165 => 0.0298, std.dev.: 0.0020)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 79.49% (0.0156 => 0.0280, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 75.64% (0.0234 => 0.0411, std.dev.: 0.0033)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 73.01% (0.0163 => 0.0282, std.dev.: 0.0013)
  SingleSource/Benchmarks/Stanford/FloatMM: 71.30% (0.0446 => 0.0764, std.dev.: 0.0022)
  SingleSource/UnitTests/2003-08-11-VaListArg: 69.83% (0.0295 => 0.0501, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/Towers: 69.53% (0.0512 => 0.0868, std.dev.: 0.0056)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 69.43% (0.0157 => 0.0266, std.dev.: 0.0007)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 68.33% (0.0221 => 0.0372, std.dev.: 0.0017)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 66.82% (0.0223 => 0.0372, std.dev.: 0.0016)
  SingleSource/UnitTests/2006-01-23-UnionInit: 56.78% (0.0273 => 0.0428, std.dev.: 0.0034)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 56.25% (0.0208 => 0.0325, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/random: 56.02% (0.0332 => 0.0518, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 52.60% (0.1000 => 0.1526, std.dev.: 0.0149)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 29.56% (0.6769 => 0.8770, std.dev.: 0.0558)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.22% (0.2252 => 0.2865, std.dev.: 0.0227)
  MultiSource/Applications/ClamAV/clamscan: 13.49% (16.9661 => 19.2556, std.dev.: 0.6326)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.58% (9.8425 => 10.8840, std.dev.: 0.3761)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.84% (1.2845 => 1.4109, std.dev.: 0.0168)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.62% (44.9186 => 47.8905, std.dev.: 0.6633)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2113 => 0.2249, std.dev.: 0.0009)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.13% (1.9834 => 2.1050, std.dev.: 0.0458)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.42% (2.5384 => 2.6761, std.dev.: 0.0289)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.37% (0.3971 => 0.4105, std.dev.: 0.0027)
  MultiSource/Benchmarks/nbench/nbench: 3.15% (1.2647 => 1.3045, std.dev.: 0.0152)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 57.77% (0.1345 => 0.2122, std.dev.: 0.0281)
  SingleSource/Benchmarks/Shootout/heapsort: 52.82% (2.9492 => 4.5069, std.dev.: 0.2723)
  MultiSource/Applications/minisat/minisat: 25.00% (6.3881 => 7.9852, std.dev.: 0.1555)
  MultiSource/Benchmarks/Olden/bisort/bisort: 23.96% (0.6732 => 0.8345, std.dev.: 0.0582)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.28% (35.9684 => 41.8253, std.dev.: 0.2582)
  MultiSource/Applications/lemon/lemon: 15.44% (0.8632 => 0.9965, std.dev.: 0.0293)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.09% (2.1020 => 2.3772, std.dev.: 0.0285)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.75% (4.6797 => 5.1361, std.dev.: 0.1037)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.28% (4.5883 => 4.7849, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.16% (5.9133 => 6.1594, std.dev.: 0.0184)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.69% (2.3043 => 2.3893, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/ffbench: 3.25% (1.4103 => 1.4562, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.82% (21.5962 => 22.2043, std.dev.: 0.2117)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.76% (15.5356 => 15.9648, std.dev.: 0.1493)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.55% (7.6931 => 7.8896, std.dev.: 0.0462)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.73% (0.1938 => 0.1672, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.25% (1.1409 => 1.0924, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.17% (1.4277 => 1.3825, std.dev.: 0.0085)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -26.31% (0.1973 => 0.1454, std.dev.: 0.0024)
  MultiSource/Benchmarks/nbench/nbench: -15.04% (23.4696 => 19.9395, std.dev.: 1.0858)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.27% (6.0535 => 5.8555, std.dev.: 0.0674)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.24% (3.6605 => 3.5785, std.dev.: 0.0190)
  MultiSource/Benchmarks/Olden/em3d/em3d: -1.89% (4.6123 => 4.5251, std.dev.: 0.0303)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.79% (7.9597 => 7.8176, std.dev.: 0.0478)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131202/1d47c864/attachment.html>


More information about the llvm-testresults mailing list