[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 01:34:31 PST 2014


http://llvm.org/perf/db_default/v4/nts/20182?compare_to=20174&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20182, Order: 198918, Start Time: 2014-01-10 07:52:26, End Time: 2014-01-10 09:39:19
      To: 20174, Order: 198916, Start Time: 2014-01-10 05:47:32, End Time: 2014-01-10 07:29:17
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 40 (41 on baseline)
Performance Improvements: 10 (10 on baseline)
Unchanged Tests: 1060 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 58.29% (0.0923 => 0.1461, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 43.93% (0.1211 => 0.1743, std.dev.: 0.0187)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 38.52% (0.9173 => 1.2706, std.dev.: 0.0133)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 37.04% (0.2654 => 0.3637, std.dev.: 0.0151)
  MultiSource/Benchmarks/Olden/em3d/em3d: 34.18% (0.1893 => 0.2540, std.dev.: 0.0246)
  MultiSource/Benchmarks/McCat/09-vor/vor: 25.82% (0.3571 => 0.4493, std.dev.: 0.0222)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.50% (0.6772 => 0.8296, std.dev.: 0.0515)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.49% (0.3332 => 0.3948, std.dev.: 0.0107)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.16% (5.4733 => 6.3032, std.dev.: 0.0673)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 12.32% (1.3041 => 1.4647, std.dev.: 0.0417)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.03% (5.4203 => 5.9099, std.dev.: 0.0147)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.47% (2.7640 => 2.9706, std.dev.: 0.0219)
  MultiSource/Applications/sqlite3/sqlite3: 7.45% (22.2431 => 23.9012, std.dev.: 0.1506)
  MultiSource/Applications/SPASS/SPASS: 6.63% (16.5992 => 17.7002, std.dev.: 0.2094)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.58% (4.2806 => 4.5194, std.dev.: 0.0213)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.6338 => 0.6640, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/ReedSolomon: 4.66% (0.2148 => 0.2248, std.dev.: 0.0018)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.42% (1.1380 => 1.1883, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.23% (0.2928 => 0.3052, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.84% (1.3476 => 1.3994, std.dev.: 0.0169)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.8277 => 0.8524, std.dev.: 0.0055)
  MultiSource/Applications/d/make_dparser: 1.55% (3.5616 => 3.6167, std.dev.: 0.0182)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 78.20% (0.1358 => 0.2420, std.dev.: 0.0153)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 58.57% (0.7705 => 1.2218, std.dev.: 0.0626)
  SingleSource/Benchmarks/Shootout/heapsort: 57.84% (2.8727 => 4.5343, std.dev.: 0.3196)
  MultiSource/Benchmarks/Olden/bisort/bisort: 36.06% (0.6709 => 0.9128, std.dev.: 0.0163)
  MultiSource/Applications/kimwitu++/kc: 27.71% (0.0433 => 0.0553, std.dev.: 0.0047)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 26.25% (1.2405 => 1.5661, std.dev.: 0.0335)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 15.06% (1.4471 => 1.6650, std.dev.: 0.0416)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.91% (1.3053 => 1.4607, std.dev.: 0.0486)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.35% (2.6649 => 2.9408, std.dev.: 0.0225)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.12% (2.8294 => 3.0591, std.dev.: 0.0068)
  MultiSource/Applications/obsequi/Obsequi: 7.96% (2.3001 => 2.4831, std.dev.: 0.0314)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.02% (1.8082 => 1.8990, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.08% (6.6081 => 6.8775, std.dev.: 0.0657)
  SingleSource/Benchmarks/Misc/flops: 3.78% (9.2665 => 9.6171, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.11% (3.9403 => 4.0630, std.dev.: 0.0359)
  SingleSource/Benchmarks/McGill/chomp: 2.52% (1.0747 => 1.1018, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (6.6275 => 6.7741, std.dev.: 0.0330)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.92% (1.6016 => 1.6324, std.dev.: 0.0042)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.63% (1.3497 => 1.3277, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -41.08% (0.5509 => 0.3246, std.dev.: 0.0811)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.55% (1.1358 => 1.0273, std.dev.: 0.0175)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.96% (1.5078 => 1.3727, std.dev.: 0.0020)
  SingleSource/Benchmarks/McGill/misr: -6.43% (0.4074 => 0.3812, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.05% (7.2380 => 6.9446, std.dev.: 0.0620)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.47% (4.3274 => 4.2207, std.dev.: 0.0195)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.72% (3.1951 => 3.1402, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/fib2: -1.55% (3.6507 => 3.5941, std.dev.: 0.0194)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.28% (3.8600 => 3.8104, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 57.78% (0.0926 => 0.1461, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 52.23% (0.1145 => 0.1743, std.dev.: 0.0187)
  MultiSource/Applications/sqlite3/sqlite3: 51.83% (15.7419 => 23.9012, std.dev.: 0.1506)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 43.48% (0.3859 => 0.5537, std.dev.: 0.0427)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 34.64% (0.9437 => 1.2706, std.dev.: 0.0133)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.79% (0.2824 => 0.3637, std.dev.: 0.0151)
  MultiSource/Benchmarks/McCat/09-vor/vor: 24.94% (0.3596 => 0.4493, std.dev.: 0.0222)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.50% (0.6942 => 0.8296, std.dev.: 0.0515)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.68% (0.3355 => 0.3948, std.dev.: 0.0107)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.71% (5.5433 => 6.3032, std.dev.: 0.0673)
  MultiSource/Applications/lemon/lemon: 10.52% (1.2200 => 1.3484, std.dev.: 0.0257)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.49% (1.3256 => 1.4647, std.dev.: 0.0417)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.7572 => 2.9706, std.dev.: 0.0219)
  MultiSource/Applications/SPASS/SPASS: 5.88% (16.7177 => 17.7002, std.dev.: 0.2094)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.80% (4.2717 => 4.5194, std.dev.: 0.0213)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.03% (0.6322 => 0.6640, std.dev.: 0.0041)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (1.5198 => 1.5887, std.dev.: 0.0194)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.65% (0.8224 => 0.8524, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.2945 => 0.3052, std.dev.: 0.0033)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 79.93% (0.1345 => 0.2420, std.dev.: 0.0153)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 59.30% (0.7670 => 1.2218, std.dev.: 0.0626)
  SingleSource/Benchmarks/Shootout/heapsort: 53.75% (2.9492 => 4.5343, std.dev.: 0.3196)
  MultiSource/Benchmarks/Olden/bisort/bisort: 35.59% (0.6732 => 0.9128, std.dev.: 0.0163)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.97% (1.2278 => 1.4607, std.dev.: 0.0486)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.55% (5.9583 => 6.9446, std.dev.: 0.0620)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 13.14% (1.4716 => 1.6650, std.dev.: 0.0416)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.37% (82.2592 => 92.4326, std.dev.: 0.0528)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.32% (2.6658 => 2.9408, std.dev.: 0.0225)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 9.25% (1.4335 => 1.5661, std.dev.: 0.0335)
  SingleSource/Benchmarks/McGill/chomp: 9.10% (1.0099 => 1.1018, std.dev.: 0.0056)
  MultiSource/Applications/obsequi/Obsequi: 7.68% (2.3061 => 2.4831, std.dev.: 0.0314)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.11% (6.4210 => 6.8775, std.dev.: 0.0657)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.08% (2.8568 => 3.0591, std.dev.: 0.0068)
  MultiSource/Applications/lua/lua: 5.16% (29.1357 => 30.6382, std.dev.: 0.2364)
  MultiSource/Applications/siod/siod: 4.98% (3.4258 => 3.5964, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc/flops: 3.77% (9.2673 => 9.6171, std.dev.: 0.0123)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.16% (1.8409 => 1.8990, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.11% (1.5986 => 1.6324, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.26% (4.4509 => 4.5068, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (3.5451 => 3.5861, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2463 => 1.2602, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.37% (1.3676 => 1.2805, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.13% (1.4277 => 1.3544, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.61% (1.3918 => 1.3277, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.16% (1.2724 => 1.2195, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.78% (15.5356 => 12.9281, std.dev.: 0.2696)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.41% (50.9650 => 46.1717, std.dev.: 1.5436)
  SingleSource/Benchmarks/McGill/misr: -5.39% (0.4029 => 0.3812, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.32% (6.0535 => 5.9133, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.58% (6.8826 => 6.7741, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.08% (4.1462 => 4.1013, std.dev.: 0.0016)

Report Time: 0.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/98b85f9a/attachment.html>


More information about the llvm-testresults mailing list