[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Nov 5 01:09:12 PST 2013


http://llvm.org/perf/db_default/v4/nts/17010?compare_to=17006&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 17010, Order: 194048, Start Time: 2013-11-05 07:18:21, End Time: 2013-11-05 09:12:43
      To: 17006, Order: 194043, Start Time: 2013-11-05 05:04:37, End Time: 2013-11-05 06:51:01
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (41 on baseline)
Performance Improvements: 4 (15 on baseline)
Added Tests: 0 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1079 (1051 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 72.12% (0.0800 => 0.1377, std.dev.: 0.0119)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 57.69% (0.3760 => 0.5929, std.dev.: 0.0359)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 56.27% (0.0670 => 0.1047, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 53.08% (0.0957 => 0.1465, std.dev.: 0.0097)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.97% (1.0968 => 1.5023, std.dev.: 0.1375)
  MultiSource/Applications/treecc/treecc: 28.93% (2.2565 => 2.9094, std.dev.: 0.2248)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 28.49% (5.4979 => 7.0643, std.dev.: 0.1274)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.58% (0.2821 => 0.3458, std.dev.: 0.0156)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.36% (1.9994 => 2.3864, std.dev.: 0.1363)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.03% (14.6284 => 16.9732, std.dev.: 0.8820)
  MultiSource/Applications/d/make_dparser: 15.88% (3.5506 => 4.1145, std.dev.: 0.0756)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.09% (0.8281 => 0.9034, std.dev.: 0.0261)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.62% (1.1607 => 1.1911, std.dev.: 0.0074)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 50.92% (3.7421 => 5.6476, std.dev.: 0.4163)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.37% (1.2437 => 1.5965, std.dev.: 0.0398)
  SingleSource/Benchmarks/Misc/flops: 17.89% (7.8678 => 9.2757, std.dev.: 0.1750)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.51% (2.1036 => 2.3878, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.82% (2.9193 => 3.2352, std.dev.: 0.1217)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 9.71% (60.8250 => 66.7327, std.dev.: 2.2361)
  SingleSource/Benchmarks/Shootout-C++/lists: 8.51% (15.7201 => 17.0582, std.dev.: 0.2655)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.95% (1.2545 => 1.3542, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.31% (3.9784 => 4.2691, std.dev.: 0.0272)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 5.41% (0.7140 => 0.7526, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.04% (3.6462 => 3.8299, std.dev.: 0.0569)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.96% (0.6876 => 0.7217, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.49% (1.7083 => 1.7509, std.dev.: 0.0072)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.18% (6.9895 => 6.6972, std.dev.: 0.1015)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.50% (12.0485 => 11.7475, std.dev.: 0.0915)
  SingleSource/Benchmarks/Shootout-C++/methcall: -2.42% (11.4722 => 11.1942, std.dev.: 0.0899)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.81% (2.5340 => 2.4882, std.dev.: 0.0123)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.14% (0.1380 => 0.1451, std.dev.: 0.0346)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 72.34% (0.0799 => 0.1377, std.dev.: 0.0119)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 60.99% (0.0910 => 0.1465, std.dev.: 0.0097)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 59.94% (0.3707 => 0.5929, std.dev.: 0.0359)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 54.20% (0.0679 => 0.1047, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 37.38% (1.0935 => 1.5023, std.dev.: 0.1375)
  MultiSource/Applications/treecc/treecc: 29.21% (2.2516 => 2.9094, std.dev.: 0.2248)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 28.41% (5.5014 => 7.0643, std.dev.: 0.1274)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 26.70% (6.0284 => 7.6377, std.dev.: 0.5363)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.53% (1.9476 => 2.3864, std.dev.: 0.1363)
  MultiSource/Applications/JM/lencod/lencod: 20.09% (16.5902 => 19.9225, std.dev.: 1.0922)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.94% (0.2883 => 0.3458, std.dev.: 0.0156)
  MultiSource/Applications/d/make_dparser: 17.68% (3.4962 => 4.1145, std.dev.: 0.0756)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.25% (14.4764 => 16.9732, std.dev.: 0.8820)
  SingleSource/Benchmarks/SmallPT/smallpt: 16.06% (0.1395 => 0.1619, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.73% (0.8233 => 0.9034, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 6.01% (0.3263 => 0.3459, std.dev.: 0.0017)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.41% (1.1393 => 1.1782, std.dev.: 0.0129)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.86% (1.1580 => 1.1911, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.72% (1.2007 => 1.2333, std.dev.: 0.0097)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 65.34% (4.4696 => 7.3902, std.dev.: 0.1242)
  SingleSource/Benchmarks/Shootout-C++/methcall: 46.47% (7.6426 => 11.1942, std.dev.: 0.0899)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.43% (2.8554 => 4.1813, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 40.98% (4.2391 => 5.9761, std.dev.: 0.1125)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 37.73% (4.1004 => 5.6476, std.dev.: 0.4163)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 25.24% (1.1431 => 1.4316, std.dev.: 0.0410)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.73% (1.3008 => 1.5965, std.dev.: 0.0398)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.33% (0.1488 => 0.1731, std.dev.: 0.0079)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.11% (2.1111 => 2.3878, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 9.92% (60.7119 => 66.7327, std.dev.: 2.2361)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.2516 => 1.3542, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.11% (3.9856 => 4.2691, std.dev.: 0.0272)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.79% (3.1730 => 3.3883, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0069)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.24% (96.7834 => 102.8250, std.dev.: 2.2608)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.98% (1.1013 => 1.1672, std.dev.: 0.0224)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.21% (3.6401 => 3.8299, std.dev.: 0.0569)
  SingleSource/Benchmarks/Shootout-C++/lists: 5.19% (16.2163 => 17.0582, std.dev.: 0.2655)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.13% (3.5550 => 3.7372, std.dev.: 0.0586)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.43% (5.3716 => 5.6093, std.dev.: 0.0423)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.25% (89.7126 => 92.6287, std.dev.: 0.1336)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.40% (16.7972 => 17.0325, std.dev.: 0.0846)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.54% (57.2347 => 13.4293, std.dev.: 0.1365)
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.53% (0.5226 => 0.2324, std.dev.: 0.0254)
  MultiSource/Applications/sgefa/sgefa: -42.17% (1.5790 => 0.9132, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -20.89% (4.0181 => 3.1787, std.dev.: 0.1674)
  SingleSource/Benchmarks/Shootout-C++/moments: -17.12% (0.1285 => 0.1065, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/ary3: -14.12% (5.0002 => 4.2943, std.dev.: 0.0478)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -13.82% (20.8247 => 17.9457, std.dev.: 0.3800)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.35% (0.3304 => 0.2995, std.dev.: 0.0100)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.43% (8.1346 => 7.7745, std.dev.: 0.1183)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.07% (2.5938 => 2.4882, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.62% (3.9552 => 3.8119, std.dev.: 0.0516)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.80% (4.3592 => 4.2371, std.dev.: 0.0325)
  MultiSource/Benchmarks/Olden/power/power: -2.65% (1.2170 => 1.1847, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.41% (17.1431 => 16.7293, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.42% (5.4473 => 5.3700, std.dev.: 0.0279)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 7.64% (0.1348 => 0.1451, std.dev.: 0.0346)

Report Time: 1.13s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131105/7b109183/attachment.html>


More information about the llvm-testresults mailing list