[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 8 19:50:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13216?compare_to=13212&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13216, Order: 185890, Start Time: 2013-07-09 01:01:03, End Time: 2013-07-09 02:51:42
      To: 13212, Order: 185873, Start Time: 2013-07-08 22:15:01, End Time: 2013-07-09 00:04:17
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 36 (57 on baseline)
Performance Improvements: 4 (44 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1006 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 47.39% (0.0306 => 0.0451, std.dev.: 0.0049)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 41.65% (0.0425 => 0.0602, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.58% (0.2275 => 0.2948, std.dev.: 0.0238)
  MultiSource/Applications/Burg/burg: 29.03% (1.4827 => 1.9131, std.dev.: 0.0951)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.78% (5.0140 => 6.1562, std.dev.: 0.3376)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.61% (4.2518 => 4.6603, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (6.4362 => 6.9996, std.dev.: 0.1022)
  MultiSource/Benchmarks/mafft/pairlocalalign: 8.18% (10.7746 => 11.6557, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.83% (1.4939 => 1.6109, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.13% (1.4177 => 1.5188, std.dev.: 0.0306)
  MultiSource/Applications/kimwitu++/kc: 6.90% (19.7891 => 21.1551, std.dev.: 0.2337)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.36% (1.8490 => 1.9666, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.19% (1.6745 => 1.7781, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.08% (1.6025 => 1.7000, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.23% (1.6472 => 1.7334, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2813 => 0.2960, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 4.85% (0.2290 => 0.2401, std.dev.: 0.0039)
  MultiSource/Applications/oggenc/oggenc: 4.54% (5.7222 => 5.9821, std.dev.: 0.0522)
  MultiSource/Applications/sqlite3/sqlite3: 4.50% (17.3364 => 18.1167, std.dev.: 0.1469)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.96% (1.5234 => 1.5837, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.66% (1.4671 => 1.5208, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.40% (0.3501 => 0.3620, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.31% (0.8016 => 0.8281, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 61.02% (5.7941 => 9.3295, std.dev.: 0.7508)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.84% (4.5446 => 5.9462, std.dev.: 0.1293)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 24.61% (3.9167 => 4.8805, std.dev.: 0.2237)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.99% (0.4461 => 0.5308, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.46% (3.5905 => 4.1455, std.dev.: 0.0152)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.70% (2.1103 => 2.4206, std.dev.: 0.0223)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.09% (14.6039 => 16.6622, std.dev.: 0.4417)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.12% (5.8998 => 6.2016, std.dev.: 0.0178)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.43% (90.6819 => 94.6957, std.dev.: 0.6995)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 4.28% (3.0242 => 3.1535, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.64% (3.9514 => 4.0951, std.dev.: 0.0534)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.36% (21.7606 => 22.4917, std.dev.: 0.1334)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.38% (2.3919 => 2.4249, std.dev.: 0.0071)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: -10.68% (0.1872 => 0.1672, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.26% (2.5273 => 2.3185, std.dev.: 0.0749)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.17% (0.6600 => 0.6325, std.dev.: 0.0023)
  MultiSource/Applications/aha/aha: -1.43% (3.6530 => 3.6006, std.dev.: 0.0030)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.20% (0.1330 => 0.1346, std.dev.: 0.0081)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 34.37% (0.0448 => 0.0602, std.dev.: 0.0042)
  MultiSource/Applications/Burg/burg: 24.43% (1.5375 => 1.9131, std.dev.: 0.0951)
  MultiSource/Applications/treecc/treecc: 13.91% (2.3237 => 2.6470, std.dev.: 0.0840)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.67% (4.1734 => 4.6603, std.dev.: 0.0136)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.97% (2.6076 => 2.8675, std.dev.: 0.0877)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.76% (1.3838 => 1.5188, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.09% (1.6299 => 1.7781, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.06% (1.4771 => 1.6109, std.dev.: 0.0131)
  MultiSource/Benchmarks/mafft/pairlocalalign: 8.67% (10.7257 => 11.6557, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.25% (1.6070 => 1.7395, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.09% (1.5727 => 1.7000, std.dev.: 0.0171)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.86% (0.2721 => 0.2935, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.75% (0.2747 => 0.2960, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.62% (1.4131 => 1.5208, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 7.62% (0.2231 => 0.2401, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.32% (1.4757 => 1.5837, std.dev.: 0.0196)
  MultiSource/Applications/SPASS/SPASS: 6.90% (17.6379 => 18.8541, std.dev.: 0.2137)
  MultiSource/Applications/sqlite3/sqlite3: 6.75% (16.9719 => 18.1167, std.dev.: 0.1469)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.68% (1.8435 => 1.9666, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.62% (1.4238 => 1.5181, std.dev.: 0.0208)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.59% (0.3113 => 0.3318, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.51% (1.6275 => 1.7334, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 6.35% (0.2206 => 0.2346, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.7791 => 0.8281, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.21% (1.4165 => 1.5045, std.dev.: 0.0339)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 5.69% (0.3425 => 0.3620, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.68% (6.6236 => 6.9996, std.dev.: 0.1022)
  MultiSource/Applications/kimwitu++/kc: 4.80% (20.1855 => 21.1551, std.dev.: 0.2337)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 55.18% (6.0122 => 9.3295, std.dev.: 0.7508)
  MultiSource/Applications/viterbi/viterbi: 35.49% (2.5688 => 3.4805, std.dev.: 0.0122)
  MultiSource/Applications/sgefa/sgefa: 30.59% (1.1695 => 1.5273, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.01% (4.6452 => 5.9462, std.dev.: 0.1293)
  SingleSource/Benchmarks/Misc/perlin: 26.91% (3.6271 => 4.6031, std.dev.: 0.0219)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.48% (0.4480 => 0.5308, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc/mandel: 17.94% (1.0293 => 1.2140, std.dev.: 0.0277)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.85% (4.1768 => 4.8805, std.dev.: 0.2237)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.9806 => 1.1396, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.28% (6.1372 => 7.0750, std.dev.: 0.0660)
  SingleSource/Benchmarks/Stanford/Puzzle: 14.91% (0.1455 => 0.1672, std.dev.: 0.0062)
  MultiSource/Applications/lua/lua: 11.49% (28.2496 => 31.4946, std.dev.: 0.2205)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.14% (5.2003 => 5.5718, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.35% (3.1853 => 3.3875, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.32% (4.6639 => 4.9121, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.05% (3.2201 => 3.3827, std.dev.: 0.0317)
  SingleSource/Benchmarks/Misc/fbench: 4.82% (4.7508 => 4.9797, std.dev.: 0.0109)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.76% (1.2224 => 1.2806, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.67% (21.4874 => 22.4917, std.dev.: 0.1334)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.63% (1.0571 => 1.1060, std.dev.: 0.0062)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.49% (1.0605 => 1.1081, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.47% (5.9362 => 6.2016, std.dev.: 0.0178)
  MultiSource/Benchmarks/sim/sim: 3.15% (3.8805 => 4.0027, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.10% (5.5010 => 5.6716, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.48% (4.6379 => 4.7530, std.dev.: 0.0260)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.36% (34.3107 => 35.1204, std.dev.: 0.0847)
  SingleSource/Benchmarks/Shootout/methcall: 2.26% (8.3425 => 8.5312, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.89% (5.6582 => 5.7654, std.dev.: 0.0319)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.16% (1.2957 => 1.3107, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.77% (0.1113 => 0.0726, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/whetstone: -12.40% (0.1097 => 0.0961, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.57% (0.2006 => 0.1834, std.dev.: 0.0016)
  MultiSource/Applications/JM/lencod/lencod: -4.99% (18.9387 => 17.9936, std.dev.: 0.2971)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.99% (1.2911 => 0.7360, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.17% (4.4050 => 2.7236, std.dev.: 0.0409)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.55% (1.6105 => 1.2151, std.dev.: 0.0194)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.64% (9.1099 => 7.0477, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.94% (4.8986 => 3.8726, std.dev.: 0.0667)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.35% (0.7941 => 0.6325, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout/hash: -20.26% (5.3656 => 4.2784, std.dev.: 0.1527)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.88% (5.7264 => 4.5879, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.42% (6.2328 => 5.0849, std.dev.: 0.0386)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.85% (25.3677 => 21.3476, std.dev.: 0.0269)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.04% (0.1945 => 0.1672, std.dev.: 0.0053)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.55% (1.6679 => 1.4419, std.dev.: 0.0222)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.22% (1.6613 => 1.4416, std.dev.: 0.0404)
  SingleSource/Benchmarks/Misc/salsa20: -13.10% (10.3398 => 8.9856, std.dev.: 0.0264)
  SingleSource/Regression/C/uint64_to_float: -10.27% (1.6851 => 1.5121, std.dev.: 0.0350)
  MultiSource/Applications/siod/siod: -8.67% (3.7240 => 3.4013, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.54% (9.8728 => 9.0293, std.dev.: 0.0242)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.24% (3.5327 => 3.2415, std.dev.: 0.0569)
  MultiSource/Applications/sqlite3/sqlite3: -7.53% (4.6358 => 4.2867, std.dev.: 0.0739)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.04% (4.5717 => 4.2498, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.48% (5.5889 => 5.2270, std.dev.: 0.0737)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.23% (3.5939 => 3.3700, std.dev.: 0.0398)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.92% (6.3757 => 6.0620, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.65% (5.3184 => 5.0711, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.36% (4.5935 => 4.3932, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.18% (5.3276 => 5.1049, std.dev.: 0.0164)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.08% (1.3084 => 1.2550, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.99% (2.8537 => 2.7399, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/flops: -3.87% (10.2170 => 9.8219, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/whetstone: -3.70% (3.5970 => 3.4639, std.dev.: 0.0154)
  MultiSource/Applications/hexxagon/hexxagon: -3.43% (15.4979 => 14.9658, std.dev.: 0.0351)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.42% (1.6535 => 1.5969, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.34% (2.5087 => 2.4249, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/sieve: -2.57% (8.0178 => 7.8117, std.dev.: 0.0438)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.57% (3.8665 => 3.7673, std.dev.: 0.0198)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.50% (48.3307 => 47.1202, std.dev.: 0.0438)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.97% (5.7342 => 5.6214, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.85% (4.5094 => 4.4261, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.69% (4.2167 => 4.1455, std.dev.: 0.0152)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.33% (1.6980 => 1.6755, std.dev.: 0.0077)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.59% (0.1441 => 0.1346, std.dev.: 0.0081)

Report Time: 1.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130708/46dfd6c7/attachment.html>


More information about the llvm-testresults mailing list