[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 21 10:09:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12614?compare_to=12610&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12614, Order: 184552, Start Time: 2013-06-21 15:22:38, End Time: 2013-06-21 17:10:20
      To: 12610, Order: 184543, Start Time: 2013-06-21 13:14:53, End Time: 2013-06-21 14:58:47
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 20 (29 on baseline)
Performance Improvements: 1 (46 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1086 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/factor: 60.68% (0.0351 => 0.0564, std.dev.: 0.0013)
  SingleSource/UnitTests/SignlessTypes/rem: 58.16% (0.1231 => 0.1947, std.dev.: 0.0009)
  SingleSource/UnitTests/SignlessTypes/shr: 46.75% (0.0338 => 0.0496, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout/sieve: 40.50% (0.0279 => 0.0392, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2050 => 0.2164, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.40% (0.7116 => 0.7358, std.dev.: 0.0087)
  MultiSource/Applications/oggenc/oggenc: 3.35% (5.6080 => 5.7957, std.dev.: 0.0585)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 56.04% (5.7989 => 9.0488, std.dev.: 0.7988)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.85% (4.5489 => 6.0433, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout-C++/strcat: 28.59% (0.0801 => 0.1030, std.dev.: 0.0014)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 22.67% (1.4684 => 1.8013, std.dev.: 0.1108)
  MultiSource/Benchmarks/nbench/nbench: 10.85% (19.9068 => 22.0657, std.dev.: 0.5991)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.84% (37.5327 => 41.2242, std.dev.: 1.0659)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.45% (5.1821 => 5.4643, std.dev.: 0.0597)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.41% (0.3881 => 0.4091, std.dev.: 0.0081)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.12% (49.0513 => 51.5608, std.dev.: 0.0492)
  MultiSource/Applications/lua/lua: 3.90% (28.1640 => 29.2612, std.dev.: 0.0588)
  MultiSource/Benchmarks/llubenchmark/llu: 1.97% (1.9743 => 2.0132, std.dev.: 0.0142)
  SingleSource/Benchmarks/Misc/flops-6: 1.34% (2.4333 => 2.4659, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/mandel: 1.20% (1.0229 => 1.0352, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: -1.06% (8.5922 => 8.5010, std.dev.: 0.0187)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.15% (0.1398 => 0.1354, std.dev.: 0.0058)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/rem: 55.39% (0.1253 => 0.1947, std.dev.: 0.0009)
  SingleSource/UnitTests/SignlessTypes/factor: 54.10% (0.0366 => 0.0564, std.dev.: 0.0013)
  SingleSource/UnitTests/SignlessTypes/shr: 41.71% (0.0350 => 0.0496, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout/sieve: 39.01% (0.0282 => 0.0392, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.7059 => 0.7358, std.dev.: 0.0087)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.5862 => 1.6301, std.dev.: 0.0149)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 50.51% (6.0122 => 9.0488, std.dev.: 0.7988)
  MultiSource/Applications/sgefa/sgefa: 33.56% (1.1695 => 1.5620, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.10% (4.6452 => 6.0433, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout-C++/strcat: 23.21% (0.0836 => 0.1030, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.40% (6.1372 => 7.2662, std.dev.: 0.1188)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.95% (5.2003 => 5.6138, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3829, std.dev.: 0.0214)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.98% (0.3860 => 0.4091, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.77% (2.9004 => 3.0388, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.72% (1.0571 => 1.1070, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.68% (3.2201 => 3.3707, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.64% (4.6639 => 4.8802, std.dev.: 0.0245)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.23% (94.2966 => 98.2840, std.dev.: 0.4900)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.72% (5.9362 => 6.1572, std.dev.: 0.0032)
  MultiSource/Applications/lua/lua: 3.58% (28.2496 => 29.2612, std.dev.: 0.0588)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.54% (5.2788 => 5.4658, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.05% (4.8966 => 5.0461, std.dev.: 0.0483)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.97% (5.5010 => 5.6645, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (4.3727 => 4.4657, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout/methcall: 1.90% (8.3425 => 8.5010, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.83% (5.6582 => 5.7620, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/flops-6: 1.27% (2.4350 => 2.4659, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.18% (11.4990 => 11.6344, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.75% (0.1113 => 0.0704, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/whetstone: -12.49% (0.1097 => 0.0960, std.dev.: 0.0018)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.68% (51.0211 => 46.0844, std.dev.: 1.8848)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (0.1861 => 0.1737, std.dev.: 0.0026)
  MultiSource/Benchmarks/McCat/09-vor/vor: -5.51% (0.3723 => 0.3518, std.dev.: 0.0046)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.22% (0.4199 => 0.3980, std.dev.: 0.0052)
  MultiSource/Benchmarks/McCat/05-eks/eks: -5.16% (0.5698 => 0.5404, std.dev.: 0.0066)
  MultiSource/Applications/kimwitu++/kc: -5.04% (20.1855 => 19.1684, std.dev.: 0.2844)
  MultiSource/Applications/oggenc/oggenc: -3.22% (5.9886 => 5.7957, std.dev.: 0.0585)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.16% (1.3686 => 1.3253, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.36% (1.2911 => 0.7313, std.dev.: 0.0100)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.10% (0.0393 => 0.0259, std.dev.: 0.0011)
  MultiSource/Applications/lemon/lemon: -30.85% (1.3499 => 0.9334, std.dev.: 0.0781)
  MultiSource/Benchmarks/FreeBench/neural/neural: -27.36% (0.3513 => 0.2552, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.95% (6.2328 => 4.7399, std.dev.: 0.0768)
  SingleSource/Benchmarks/Misc/flops: -20.72% (10.2170 => 8.0999, std.dev.: 0.7726)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.83% (25.3677 => 21.3509, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.08% (11.6227 => 9.9868, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc/salsa20: -12.94% (10.3398 => 9.0020, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.20% (7.0179 => 6.3022, std.dev.: 0.0108)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.38% (1.6679 => 1.5115, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.92% (4.5717 => 4.1640, std.dev.: 0.0694)
  MultiSource/Applications/siod/siod: -8.91% (3.7240 => 3.3921, std.dev.: 0.0365)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.83% (9.1099 => 8.3058, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.24% (0.2973 => 0.2728, std.dev.: 0.0043)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.90% (48.3307 => 44.5132, std.dev.: 0.7368)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.60% (9.8728 => 9.1228, std.dev.: 0.1496)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.44% (4.2167 => 3.9029, std.dev.: 0.0899)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.92% (3.5327 => 3.2883, std.dev.: 0.0676)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2108, std.dev.: 0.0499)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.48% (0.4445 => 0.4157, std.dev.: 0.0059)
  MultiSource/Applications/sqlite3/sqlite3: -4.90% (4.6358 => 4.4086, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (5.3184 => 5.0618, std.dev.: 0.0283)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.29% (0.9806 => 0.9385, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3276 => 5.1030, std.dev.: 0.0335)
  MultiSource/Benchmarks/Bullet/bullet: -3.59% (7.1938 => 6.9354, std.dev.: 0.0752)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.91% (6.3757 => 6.1903, std.dev.: 0.0417)
  SingleSource/Benchmarks/Shootout/sieve: -2.82% (8.0178 => 7.7919, std.dev.: 0.0139)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.66% (5.7342 => 5.5815, std.dev.: 0.0555)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.65% (3.8665 => 3.7639, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.23% (4.5094 => 4.4089, std.dev.: 0.0288)
  MultiSource/Applications/viterbi/viterbi: -1.36% (2.5688 => 2.5338, std.dev.: 0.0136)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.35% (12.1841 => 12.0192, std.dev.: 0.0501)
  MultiSource/Applications/hexxagon/hexxagon: -1.23% (15.4979 => 15.3068, std.dev.: 0.0539)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.19% (9.6556 => 9.5407, std.dev.: 0.0229)
  MultiSource/Benchmarks/sim/sim: -1.09% (3.8805 => 3.8382, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.04% (0.1441 => 0.1354, std.dev.: 0.0058)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130621/7af5ce58/attachment.html>


More information about the llvm-testresults mailing list