[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 16 02:54:25 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13471?compare_to=13468&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13471, Order: 186385, Start Time: 2013-07-16 08:09:56, End Time: 2013-07-16 09:55:52
      To: 13468, Order: 186383, Start Time: 2013-07-16 06:06:22, End Time: 2013-07-16 07:49:50
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 9 (41 on baseline)
Performance Improvements: 5 (81 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (985 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.45% (1.4642 => 1.8807, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc/fp-convert: 16.38% (6.9389 => 8.0755, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/salsa20: 8.68% (8.2624 => 8.9795, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.42% (4.8904 => 5.3022, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.41% (2.6613 => 2.7787, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.83% (4.0987 => 4.2557, std.dev.: 0.0209)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.89% (0.6377 => 0.6561, std.dev.: 0.0048)
  SingleSource/Benchmarks/McGill/chomp: 2.27% (1.0027 => 1.0255, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (4.4190 => 4.4684, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.27% (1.2099 => 1.1945, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.73% (0.1268 => 0.1132, std.dev.: 0.0042)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.00% (1.3093 => 1.2439, std.dev.: 0.0226)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.30% (1.2778 => 1.2356, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.39% (3.1644 => 3.0889, std.dev.: 0.0148)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.22% (0.1350 => 0.1320, std.dev.: 0.0247)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.95% (0.2721 => 0.2883, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.52% (0.2393 => 0.2525, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 5.13% (1.5862 => 1.6676, std.dev.: 0.0075)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 5.01% (0.2295 => 0.2410, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.39% (0.2937 => 0.3066, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.47% (0.3429 => 0.3548, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.93% (0.6254 => 0.6437, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.7059 => 0.7241, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.9599 => 0.9836, std.dev.: 0.0055)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 89.57% (0.1208 => 0.2290, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 61.54% (0.1750 => 0.2827, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: 35.43% (2.5688 => 3.4790, std.dev.: 0.1231)
  MultiSource/Applications/sgefa/sgefa: 30.21% (1.1695 => 1.5228, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.07% (9.8728 => 12.8415, std.dev.: 0.0310)
  SingleSource/Benchmarks/Misc/perlin: 26.79% (3.6271 => 4.5989, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/mandel: 16.35% (1.0293 => 1.1976, std.dev.: 0.0089)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.22% (0.1455 => 0.1691, std.dev.: 0.0083)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.89% (0.9806 => 1.1364, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.07% (5.2788 => 6.0213, std.dev.: 0.0643)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.66% (5.2561 => 5.8692, std.dev.: 0.0818)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.51% (4.6639 => 5.2007, std.dev.: 0.0816)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.50% (4.5094 => 4.9827, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.27% (2.9004 => 3.1984, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.51% (4.6379 => 5.0325, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.02% (3.1853 => 3.4089, std.dev.: 0.0349)
  MultiSource/Applications/lua/lua: 6.75% (28.2496 => 30.1557, std.dev.: 0.6802)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.74% (5.6582 => 5.9266, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/fbench: 4.48% (4.7508 => 4.9636, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.40% (3.2009 => 3.3417, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.03% (1.0571 => 1.0997, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 3.49% (2.8994 => 3.0007, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.19% (3.2201 => 3.3228, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.01% (5.9362 => 6.1149, std.dev.: 0.0332)
  MultiSource/Benchmarks/sim/sim: 2.45% (3.8805 => 3.9755, std.dev.: 0.0274)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.23% (2.7180 => 2.7787, std.dev.: 0.0091)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (4.3727 => 4.4684, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/methcall: 2.15% (8.3425 => 8.5217, std.dev.: 0.0259)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.02% (8.5243 => 8.6967, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.96% (4.2167 => 4.2992, std.dev.: 0.0074)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.71% (34.3107 => 34.8973, std.dev.: 0.1108)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.31% (1.7925 => 1.8160, std.dev.: 0.0034)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -37.38% (0.1113 => 0.0697, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -15.02% (1.6275 => 1.3830, std.dev.: 0.0439)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -14.62% (1.6804 => 1.4348, std.dev.: 0.0576)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -14.55% (1.7006 => 1.4531, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -14.51% (1.5984 => 1.3664, std.dev.: 0.0682)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -14.34% (1.5735 => 1.3479, std.dev.: 0.0670)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -14.27% (1.6292 => 1.3967, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -14.21% (1.5727 => 1.3492, std.dev.: 0.0683)
  SingleSource/Benchmarks/Misc/whetstone: -13.95% (0.1097 => 0.0944, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.45% (1.6563 => 1.4336, std.dev.: 0.0568)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.30% (1.6299 => 1.4131, std.dev.: 0.0497)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -13.29% (1.6881 => 1.4638, std.dev.: 0.0743)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -13.25% (1.7102 => 1.4836, std.dev.: 0.0674)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -13.24% (1.8435 => 1.5994, std.dev.: 0.0749)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -13.02% (1.6993 => 1.4780, std.dev.: 0.0236)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.97% (51.0211 => 46.9567, std.dev.: 1.1232)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.75% (0.7381 => 0.6809, std.dev.: 0.0143)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (0.1861 => 0.1735, std.dev.: 0.0020)
  MultiSource/Applications/lemon/lemon: -5.69% (1.3155 => 1.2407, std.dev.: 0.0134)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.21% (0.3723 => 0.3529, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.4199 => 0.3982, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.10% (0.2117 => 0.2009, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.11% (0.5698 => 0.5464, std.dev.: 0.0025)
  MultiSource/Applications/kimwitu++/kc: -4.01% (20.1855 => 19.3758, std.dev.: 0.2827)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.00% (0.2753 => 0.2643, std.dev.: 0.0022)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.62% (0.8649 => 0.8336, std.dev.: 0.0062)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.42% (1.2911 => 0.7305, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/matrix: -33.03% (4.3226 => 2.8950, std.dev.: 0.4913)
  MultiSource/Applications/lemon/lemon: -31.19% (1.3499 => 0.9289, std.dev.: 0.0738)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -29.88% (4.4050 => 3.0889, std.dev.: 0.0148)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.60% (1.6105 => 1.2143, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -23.65% (4.8986 => 3.7401, std.dev.: 0.0781)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.82% (9.1099 => 7.0309, std.dev.: 0.0261)
  SingleSource/Benchmarks/Shootout/hash: -21.52% (5.3656 => 4.2108, std.dev.: 0.2232)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -18.86% (1.8291 => 1.4841, std.dev.: 0.1297)
  SingleSource/Benchmarks/Shootout-C++/hash: -16.75% (0.7941 => 0.6611, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.70% (11.6227 => 9.6813, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.62% (5.5763 => 4.6494, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -15.96% (0.3860 => 0.3244, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.89% (6.2328 => 5.3047, std.dev.: 0.0256)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.45% (25.3677 => 21.7012, std.dev.: 0.1191)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.37% (5.7264 => 4.9037, std.dev.: 0.0308)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.29% (0.1945 => 0.1667, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/tsp/tsp: -14.01% (1.6613 => 1.4285, std.dev.: 0.0572)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.98% (1.6679 => 1.4348, std.dev.: 0.0097)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.26% (0.0920 => 0.0798, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/salsa20: -13.16% (10.3398 => 8.9795, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -10.77% (0.3267 => 0.2915, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.59% (0.2973 => 0.2688, std.dev.: 0.0090)
  MultiSource/Benchmarks/FreeBench/neural/neural: -9.51% (0.3513 => 0.3179, std.dev.: 0.0029)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.59% (10.2418 => 9.3625, std.dev.: 0.3380)
  SingleSource/Regression/C/uint64_to_float: -8.54% (1.6851 => 1.5412, std.dev.: 0.0206)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.06% (1.3530 => 1.2439, std.dev.: 0.0226)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -7.86% (2.5087 => 2.3116, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.81% (5.2003 => 4.8462, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.79% (4.5717 => 4.2614, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.74% (5.3184 => 4.9597, std.dev.: 0.0224)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.48% (16.4665 => 15.3994, std.dev.: 0.0928)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.26% (3.5939 => 3.3689, std.dev.: 0.0409)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.55% (1.4783 => 1.3962, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (5.5889 => 5.3022, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4445 => 0.4226, std.dev.: 0.0040)
  MultiSource/Applications/sqlite3/sqlite3: -4.90% (4.6358 => 4.4088, std.dev.: 0.0824)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.70% (4.5935 => 4.3778, std.dev.: 0.0508)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.23% (2.8537 => 2.7329, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.23% (1.6535 => 1.5836, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -4.14% (1.6440 => 1.5760, std.dev.: 0.0173)
  SingleSource/Benchmarks/Misc/whetstone: -4.08% (3.5970 => 3.4504, std.dev.: 0.0226)
  SingleSource/Benchmarks/Misc/flops: -4.01% (10.2170 => 9.8071, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.41% (5.3276 => 5.1459, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/sieve: -2.86% (8.0178 => 7.7883, std.dev.: 0.0618)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.6122 => 3.5116, std.dev.: 0.0155)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.70% (48.3307 => 47.0244, std.dev.: 0.0955)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.61% (3.8665 => 3.7654, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/bh/bh: -1.96% (2.4435 => 2.3956, std.dev.: 0.0154)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.77% (1.2579 => 1.2356, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.72% (4.9946 => 4.9087, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout/lists: -1.48% (7.2961 => 7.1883, std.dev.: 0.0324)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.48% (1.1791 => 1.1617, std.dev.: 0.0019)
  MultiSource/Applications/hexxagon/hexxagon: -1.18% (15.4979 => 15.3154, std.dev.: 0.0205)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.12% (5.7342 => 5.6700, std.dev.: 0.0032)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -8.40% (0.1441 => 0.1320, std.dev.: 0.0247)

Report Time: 1.15s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130716/961b6b17/attachment.html>


More information about the llvm-testresults mailing list