[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 31 14:30:02 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13966?compare_to=13963&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13966, Order: 187509, Start Time: 2013-07-31 19:45:04, End Time: 2013-07-31 21:31:47
      To: 13963, Order: 187502, Start Time: 2013-07-31 17:28:30, End Time: 2013-07-31 19:21:18
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 6 (27 on baseline)
Performance Improvements: 55 (52 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1046 (1028 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: 10.08% (0.1429 => 0.1573, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/em3d/em3d: 4.54% (4.9379 => 5.1619, std.dev.: 0.0339)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (0.6309 => 0.6507, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.89% (16.5059 => 16.9835, std.dev.: 0.1679)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.93% (2.5557 => 2.6050, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.14% (6.1072 => 6.1769, std.dev.: 0.0123)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/StructModifyTest: -65.24% (0.0164 => 0.0057, std.dev.: 0.0035)
  SingleSource/UnitTests/2003-08-11-VaListArg: -36.56% (0.0331 => 0.0210, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/flops-7: -36.17% (0.0459 => 0.0293, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Quicksort: -33.27% (0.0544 => 0.0363, std.dev.: 0.0024)
  MultiSource/Applications/viterbi/viterbi: -30.15% (0.2610 => 0.1823, std.dev.: 0.0223)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -28.67% (0.2400 => 0.1712, std.dev.: 0.0248)
  SingleSource/Benchmarks/Stanford/Queens: -23.83% (0.0596 => 0.0454, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/ary3: -22.51% (0.3736 => 0.2895, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout-C++/hello: -22.50% (0.2631 => 0.2039, std.dev.: 0.0107)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -20.10% (0.2890 => 0.2309, std.dev.: 0.0180)
  SingleSource/Benchmarks/Stanford/FloatMM: -18.08% (0.0553 => 0.0453, std.dev.: 0.0034)
  MultiSource/Applications/treecc/treecc: -16.81% (2.8289 => 2.3535, std.dev.: 0.0242)
  MultiSource/Applications/SPASS/SPASS: -15.18% (20.1840 => 17.1194, std.dev.: 0.6700)
  MultiSource/Applications/JM/ldecod/ldecod: -14.21% (8.9006 => 7.6359, std.dev.: 0.0949)
  MultiSource/Applications/JM/lencod/lencod: -13.83% (20.0217 => 17.2523, std.dev.: 1.0124)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -13.63% (0.0917 => 0.0792, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -12.49% (1.7355 => 1.5187, std.dev.: 0.0778)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.23% (1.5406 => 1.3522, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.04% (1.6062 => 1.4128, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -11.69% (0.0941 => 0.0831, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -11.62% (1.7011 => 1.5034, std.dev.: 0.0215)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -11.38% (0.2646 => 0.2345, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -11.34% (1.5371 => 1.3628, std.dev.: 0.0184)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -11.11% (5.3718 => 4.7751, std.dev.: 0.0438)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -10.98% (0.2468 => 0.2197, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.97% (1.5984 => 1.4230, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -10.93% (1.5276 => 1.3607, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -10.93% (1.7775 => 1.5833, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.91% (1.6661 => 1.4843, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -10.70% (1.6555 => 1.4784, std.dev.: 0.0456)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -10.67% (1.5641 => 1.3972, std.dev.: 0.0145)
  SingleSource/UnitTests/Vector/constpool: -10.08% (9.8285 => 8.8380, std.dev.: 0.1102)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -10.06% (0.2594 => 0.2333, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.06% (1.5587 => 1.4019, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.93% (1.6039 => 1.4446, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -9.51% (1.5068 => 1.3635, std.dev.: 0.0072)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -9.09% (0.1254 => 0.1140, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -9.03% (1.5447 => 1.4052, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -9.01% (0.2541 => 0.2312, std.dev.: 0.0070)
  MultiSource/Applications/d/make_dparser: -7.83% (4.0275 => 3.7123, std.dev.: 0.0532)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.63% (16.1769 => 15.1050, std.dev.: 0.1906)
  MultiSource/Applications/siod/siod: -4.09% (2.6280 => 2.5205, std.dev.: 0.0294)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.85% (1.5101 => 1.4671, std.dev.: 0.0070)
  MultiSource/Benchmarks/nbench/nbench: -2.82% (1.3434 => 1.3055, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -35.92% (0.0710 => 0.0455, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -25.88% (4.0677 => 3.0149, std.dev.: 0.3507)
  MultiSource/Applications/SPASS/SPASS: -25.42% (10.9979 => 8.2019, std.dev.: 0.7411)
  MultiSource/Applications/lua/lua: -5.62% (30.1103 => 28.4184, std.dev.: 0.4599)
  SingleSource/Benchmarks/Misc/mandel-2: -3.73% (0.8635 => 0.8313, std.dev.: 0.0097)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.83% (21.5587 => 20.9496, std.dev.: 0.1692)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.34% (21.9309 => 21.4174, std.dev.: 0.0958)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.73% (3.5222 => 3.4612, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.55% (5.8866 => 5.7953, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.24% (3.4457 => 3.4030, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.04% (3.7595 => 3.7203, std.dev.: 0.0037)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.11% (0.1381 => 0.1338, std.dev.: 0.0185)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.53% (2.8867 => 4.2876, std.dev.: 0.0226)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.54% (0.3171 => 0.4393, std.dev.: 0.0347)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.55% (0.6295 => 0.7274, std.dev.: 0.0377)
  SingleSource/Benchmarks/Shootout/nestedloop: 15.32% (0.1364 => 0.1573, std.dev.: 0.0030)
  MultiSource/Applications/siod/siod: 13.84% (3.3761 => 3.8432, std.dev.: 0.0616)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.54% (14.9584 => 16.9835, std.dev.: 0.1679)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.74% (7.0762 => 7.9776, std.dev.: 0.0436)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.1678 => 0.1838, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9474, std.dev.: 0.0746)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1715, std.dev.: 0.3030)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4238, std.dev.: 0.0370)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (3.3877 => 3.5884, std.dev.: 0.0520)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.82% (5.3042 => 5.6129, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.74% (3.4085 => 3.6040, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.42% (5.5008 => 5.7990, std.dev.: 0.0558)
  SingleSource/Benchmarks/Misc/whetstone: 4.35% (3.4559 => 3.6064, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (4.3151 => 4.5009, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.92% (3.5351 => 3.6738, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4612, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.94% (4.8739 => 5.0172, std.dev.: 0.0418)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.54% (12.8625 => 13.1891, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.69% (3.3464 => 3.4030, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (2.5636 => 2.6050, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.45% (5.0417 => 5.1146, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.10% (4.9040 => 4.9578, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.05% (3.0680 => 3.1003, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.66% (0.2237 => 0.1417, std.dev.: 0.0274)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.40% (0.1072 => 0.0714, std.dev.: 0.0133)
  MultiSource/Applications/obsequi/Obsequi: -19.54% (1.4685 => 1.1816, std.dev.: 0.0029)
  MultiSource/Applications/sgefa/sgefa: -13.77% (0.4809 => 0.4147, std.dev.: 0.0023)
  MultiSource/Applications/JM/ldecod/ldecod: -11.95% (8.6720 => 7.6359, std.dev.: 0.0949)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.21% (0.3655 => 0.3282, std.dev.: 0.0044)
  MultiSource/Applications/aha/aha: -7.64% (0.1401 => 0.1294, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.27% (1.5345 => 1.4230, std.dev.: 0.0156)
  MultiSource/Applications/siod/siod: -7.16% (2.7150 => 2.5205, std.dev.: 0.0294)
  MultiSource/Applications/Burg/burg: -6.70% (1.5733 => 1.4679, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.62% (1.4853 => 1.4019, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.44% (1.4940 => 1.4128, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.10% (1.4339 => 1.3607, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.09% (1.4721 => 1.3972, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.97% (1.4783 => 1.4049, std.dev.: 0.0220)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.59% (1.5376 => 1.4671, std.dev.: 0.0070)
  MultiSource/Benchmarks/nbench/nbench: -4.55% (1.3677 => 1.3055, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.51% (0.7189 => 0.6865, std.dev.: 0.0069)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.95% (5.3476 => 5.1365, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.23% (1.3946 => 1.3635, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.06% (1.4750 => 1.4446, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.38% (1.4932 => 1.4726, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4212, std.dev.: 0.0282)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.41% (0.0816 => 0.0576, std.dev.: 0.0002)
  MultiSource/Applications/viterbi/viterbi: -27.53% (3.4923 => 2.5309, std.dev.: 0.0680)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2410, std.dev.: 0.3437)
  MultiSource/Applications/JM/ldecod/ldecod: -24.33% (0.0859 => 0.0650, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/perlin: -21.42% (4.5989 => 3.6138, std.dev.: 0.0223)
  MultiSource/Applications/obsequi/Obsequi: -15.26% (2.6081 => 2.2100, std.dev.: 0.0684)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.85% (6.2627 => 5.3328, std.dev.: 0.2787)
  SingleSource/Benchmarks/Misc/mandel: -14.30% (1.1996 => 1.0281, std.dev.: 0.0415)
  MultiSource/Applications/sgefa/sgefa: -12.83% (1.4030 => 1.2230, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.70% (0.3557 => 0.3141, std.dev.: 0.0073)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.36% (3.5791 => 3.2083, std.dev.: 0.0813)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.61% (47.2250 => 42.6863, std.dev.: 1.1004)
  MultiSource/Applications/lua/lua: -8.54% (31.0707 => 28.4184, std.dev.: 0.4599)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6298, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.72% (3.8119 => 3.6320, std.dev.: 0.0482)
  SingleSource/Regression/C/uint64_to_float: -4.14% (1.5184 => 1.4555, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc/fbench: -4.04% (4.9602 => 4.7598, std.dev.: 0.0112)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.00% (2.7049 => 2.5967, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.43% (6.0444 => 5.8370, std.dev.: 0.0581)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.40% (21.6864 => 20.9496, std.dev.: 0.1692)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9617, std.dev.: 0.0576)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.90% (1.1024 => 1.0704, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.82% (5.2218 => 5.0748, std.dev.: 0.0310)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.44% (8.6172 => 8.4069, std.dev.: 0.0272)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.94% (34.8438 => 34.1679, std.dev.: 0.0844)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (5.8810 => 5.7953, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8567, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.30% (1.6737 => 1.6520, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.21% (2.1343 => 2.1085, std.dev.: 0.0097)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.90% (0.1378 => 0.1338, std.dev.: 0.0185)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130731/62838838/attachment.html>


More information about the llvm-testresults mailing list