[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jul 7 01:37:06 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13163?compare_to=13160&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13163, Order: 185772, Start Time: 2013-07-07 06:53:07, End Time: 2013-07-07 08:38:22
      To: 13160, Order: 185770, Start Time: 2013-07-07 04:46:51, End Time: 2013-07-07 06:30:59
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (36 on baseline)
Performance Improvements: 1 (70 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1100 (1001 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.41% (1.1876 => 1.2044, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.81% (1.4589 => 1.8792, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.13% (4.6525 => 5.0775, std.dev.: 0.0385)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.65% (1.0553 => 1.1044, std.dev.: 0.0104)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 2.68% (3.9307 => 4.0362, std.dev.: 0.0392)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.29% (2.6667 => 2.7278, std.dev.: 0.0160)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.37% (2.4499 => 2.3429, std.dev.: 0.0103)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1346 => 0.1362, std.dev.: 0.0068)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/sumcol: 5.23% (0.2238 => 0.2355, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/random: 5.01% (0.2116 => 0.2222, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.73% (1.4131 => 1.4658, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.36% (0.3425 => 0.3540, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3290 => 0.3396, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.19% (0.4740 => 0.4891, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.54% (1.5612 => 1.6008, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.41% (1.6070 => 1.6457, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.32% (1.3833 => 1.4154, std.dev.: 0.0103)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.78% (2.5688 => 3.4879, std.dev.: 0.0041)
  MultiSource/Applications/sgefa/sgefa: 30.21% (1.1695 => 1.5228, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: 26.76% (3.6271 => 4.5978, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.63% (6.1372 => 7.2194, std.dev.: 0.1532)
  SingleSource/Benchmarks/Misc/mandel: 16.87% (1.0293 => 1.2029, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.91% (0.9806 => 1.1366, std.dev.: 0.0008)
  MultiSource/Applications/lua/lua: 8.38% (28.2496 => 30.6174, std.dev.: 0.2708)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.01% (5.2003 => 5.6168, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/strcat: 7.69% (0.1456 => 0.1568, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.35% (0.4572 => 0.4908, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (3.1853 => 3.3754, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.80% (3.2201 => 3.3747, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.66% (4.6639 => 4.8811, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.47% (1.0571 => 1.1044, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc/fbench: 4.24% (4.7508 => 4.9524, std.dev.: 0.0074)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.09% (2.8994 => 3.0181, std.dev.: 0.0054)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.75% (1.2224 => 1.2682, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.63% (5.2788 => 5.4702, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.96% (5.5010 => 5.6640, std.dev.: 0.0293)
  MultiSource/Benchmarks/sim/sim: 2.69% (3.8805 => 3.9850, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.61% (4.6379 => 4.7588, std.dev.: 0.0304)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.42% (4.3727 => 4.4786, std.dev.: 0.0092)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.28% (34.3107 => 35.0928, std.dev.: 0.0652)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.23% (1.0605 => 1.0842, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/methcall: 2.23% (8.3425 => 8.5283, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.89% (5.6582 => 5.7649, std.dev.: 0.0061)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.87% (1.7925 => 1.8260, std.dev.: 0.0083)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.06% (0.2431 => 0.1846, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.82% (0.0803 => 0.0676, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/whetstone: -14.59% (0.1097 => 0.0937, std.dev.: 0.0047)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.36% (0.1322 => 0.1185, std.dev.: 0.0049)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1861 => 0.1744, std.dev.: 0.0007)
  MultiSource/Applications/oggenc/oggenc: -5.50% (5.9886 => 5.6590, std.dev.: 0.0726)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (1.6793 => 1.5875, std.dev.: 0.0146)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.17% (0.4199 => 0.3982, std.dev.: 0.0028)
  MultiSource/Applications/Burg/burg: -4.85% (1.5375 => 1.4629, std.dev.: 0.0069)
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.14% (0.3723 => 0.3569, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.60% (0.5698 => 0.5493, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.05% (1.2911 => 0.7224, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.92% (4.4050 => 2.7348, std.dev.: 0.0036)
  MultiSource/Applications/lemon/lemon: -32.19% (1.3499 => 0.9154, std.dev.: 0.1177)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.57% (1.6105 => 1.2148, std.dev.: 0.0015)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.71% (9.1099 => 7.0409, std.dev.: 0.0995)
  SingleSource/Benchmarks/Shootout/hash: -21.97% (5.3656 => 4.1866, std.dev.: 0.1635)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.49% (0.8606 => 0.6757, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.81% (4.8986 => 3.8791, std.dev.: 0.0145)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.74% (0.7941 => 0.6294, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.24% (5.7264 => 4.5673, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.54% (6.2328 => 5.0775, std.dev.: 0.0385)
  MultiSource/Applications/minisat/minisat: -15.83% (7.3703 => 6.2034, std.dev.: 0.1528)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.63% (25.3677 => 21.4024, std.dev.: 0.0193)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.04% (0.1945 => 0.1672, std.dev.: 0.0063)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.57% (1.6679 => 1.4416, std.dev.: 0.0145)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.36% (1.6613 => 1.4393, std.dev.: 0.0143)
  SingleSource/Benchmarks/Misc/salsa20: -13.18% (10.3398 => 8.9767, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -10.39% (0.2973 => 0.2664, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/neural/neural: -10.02% (0.3513 => 0.3161, std.dev.: 0.0080)
  MultiSource/Applications/siod/siod: -9.99% (3.7240 => 3.3519, std.dev.: 0.0460)
  SingleSource/Regression/C/uint64_to_float: -9.16% (1.6851 => 1.5307, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.16% (9.8728 => 9.0672, std.dev.: 0.0124)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.72% (0.1542 => 0.1423, std.dev.: 0.0018)
  MultiSource/Applications/SPASS/SPASS: -7.32% (8.8720 => 8.2228, std.dev.: 0.0738)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.19% (4.5717 => 4.2428, std.dev.: 0.0036)
  MultiSource/Applications/sqlite3/sqlite3: -6.90% (4.6358 => 4.3161, std.dev.: 0.0638)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.67% (5.5889 => 5.2160, std.dev.: 0.0013)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.61% (0.4445 => 0.4151, std.dev.: 0.0024)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -6.61% (2.5087 => 2.3429, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.20% (3.5939 => 3.3711, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.96% (0.2332 => 0.2193, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.24% (1.4783 => 1.4008, std.dev.: 0.0221)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.01% (6.3757 => 6.0562, std.dev.: 0.0232)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.96% (3.5327 => 3.3576, std.dev.: 0.0490)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.71% (5.3184 => 5.0680, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.45% (1.3084 => 1.2502, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.41% (2.8537 => 2.7278, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.20% (5.3276 => 5.1039, std.dev.: 0.0284)
  SingleSource/Benchmarks/Misc/flops: -4.08% (10.2170 => 9.8000, std.dev.: 0.0441)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.99% (4.5935 => 4.4101, std.dev.: 0.0606)
  SingleSource/Benchmarks/Misc/whetstone: -3.80% (3.5970 => 3.4602, std.dev.: 0.0095)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.79% (0.6548 => 0.6300, std.dev.: 0.0065)
  MultiSource/Applications/hexxagon/hexxagon: -3.49% (15.4979 => 14.9564, std.dev.: 0.0399)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.37% (4.1768 => 4.0362, std.dev.: 0.0392)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.3208 => 0.3107, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.02% (3.6122 => 3.5031, std.dev.: 0.0257)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.00% (1.6440 => 1.5946, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7874, std.dev.: 0.0639)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.62% (3.8665 => 3.7653, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4094, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.90% (4.2167 => 4.1367, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.78% (5.9068 => 5.8017, std.dev.: 0.0391)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.76% (4.9946 => 4.9065, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/power/power: -1.55% (1.2558 => 1.2363, std.dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.49% (1.1791 => 1.1615, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.40% (2.8573 => 2.8172, std.dev.: 0.0135)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.33% (12.1841 => 12.0223, std.dev.: 0.0602)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.21% (9.6556 => 9.5383, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.04% (1.8989 => 1.8792, std.dev.: 0.0062)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.48% (0.1441 => 0.1362, std.dev.: 0.0068)

Report Time: 2.24s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130707/c480ec4e/attachment.html>


More information about the llvm-testresults mailing list