[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 22 13:22:27 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14682?compare_to=14679&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14682, Order: 189033, Start Time: 2013-08-22 18:34:39, End Time: 2013-08-22 20:24:35
      To: 14679, Order: 189024, Start Time: 2013-08-22 16:21:27, End Time: 2013-08-22 18:11:48
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 8 (33 on baseline)
Performance Improvements: 27 (65 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1009 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.07% (1.4144 => 1.4295, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: 20.30% (3.3418 => 4.0201, std.dev.: 0.0910)
  SingleSource/Benchmarks/Shootout/nestedloop: 9.74% (0.1437 => 0.1577, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.81% (15.4559 => 16.6628, std.dev.: 0.0356)
  MultiSource/Benchmarks/nbench/nbench: 7.43% (19.2135 => 20.6419, std.dev.: 0.5345)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (3.2935 => 3.5018, std.dev.: 0.0539)
  MultiSource/Applications/viterbi/viterbi: 2.21% (2.5370 => 2.5931, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/pi: 2.09% (2.4843 => 2.5361, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: -39.76% (0.0420 => 0.0253, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/heapsort: -27.55% (0.0657 => 0.0476, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.94% (7.3299 => 6.5283, std.dev.: 0.2517)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -10.75% (0.4429 => 0.3953, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -10.29% (0.9019 => 0.8091, std.dev.: 0.0180)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.68% (4.7365 => 4.2780, std.dev.: 0.1038)
  SingleSource/Benchmarks/Shootout-C++/wc: -9.38% (0.2772 => 0.2512, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.19% (2.1229 => 1.9490, std.dev.: 0.0490)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -7.03% (0.3540 => 0.3291, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/moments: -6.62% (0.4592 => 0.4288, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/fibo: -5.80% (0.2260 => 0.2129, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.02% (1.0448 => 0.9923, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/lists1: -4.29% (0.3589 => 0.3435, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.38% (0.5038 => 0.4918, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -23.77% (5.9354 => 4.5243, std.dev.: 0.1136)
  SingleSource/Benchmarks/Shootout-C++/moments: -14.27% (0.1198 => 0.1027, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/hash: -9.45% (5.6976 => 5.1591, std.dev.: 0.0924)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.38% (0.5110 => 0.4886, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/health/health: -4.34% (0.3453 => 0.3303, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.74% (2.5446 => 2.4495, std.dev.: 0.0359)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -3.04% (0.3686 => 0.3574, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.97% (3.3109 => 3.2458, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.89% (4.1839 => 4.1049, std.dev.: 0.0291)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.43% (1.4485 => 1.4278, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.37% (3.5407 => 3.4921, std.dev.: 0.0063)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.34% (1.3645 => 1.3462, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (6.3995 => 6.3253, std.dev.: 0.0285)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.07% (0.1306 => 0.1292, std.dev.: 0.0217)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.52% (0.1033 => 0.1214, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/oourafft: 7.31% (0.2284 => 0.2451, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.4125 => 0.4288, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.9761 => 0.9923, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 69.04% (3.7285 => 6.3028, std.dev.: 0.1166)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.60% (2.8867 => 4.2897, std.dev.: 0.0356)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 36.61% (2.9428 => 4.0201, std.dev.: 0.0910)
  MultiSource/Benchmarks/FreeBench/neural/neural: 36.58% (0.3171 => 0.4331, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc/pi: 27.86% (1.9835 => 2.5361, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.49% (1.5030 => 1.8861, std.dev.: 0.0233)
  SingleSource/Benchmarks/Shootout/hash: 23.29% (4.1846 => 5.1591, std.dev.: 0.0924)
  SingleSource/Benchmarks/Shootout-C++/hash: 22.81% (0.6295 => 0.7731, std.dev.: 0.0326)
  SingleSource/Benchmarks/Shootout/nestedloop: 15.62% (0.1364 => 0.1577, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.39% (14.9584 => 16.6628, std.dev.: 0.0356)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.88% (7.0762 => 7.8459, std.dev.: 0.0120)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.65% (0.1678 => 0.1840, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.33% (5.4910 => 5.9483, std.dev.: 0.0248)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4237, std.dev.: 0.0004)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.78% (48.3256 => 51.6007, std.dev.: 0.6145)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.43% (0.2799 => 0.2979, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.52% (3.4085 => 3.5965, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8015, std.dev.: 0.0379)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.66% (1.5339 => 1.6054, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3655, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.14% (4.3151 => 4.4937, std.dev.: 0.0230)
  SingleSource/Benchmarks/Misc/whetstone: 3.99% (3.4559 => 3.5937, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.71% (3.3384 => 3.4624, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.28% (6.1245 => 6.3253, std.dev.: 0.0285)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.24% (25.0200 => 25.8296, std.dev.: 0.0159)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.08% (3.3877 => 3.4921, std.dev.: 0.0063)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.73% (1.3104 => 1.3462, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.29% (0.2237 => 0.1470, std.dev.: 0.0067)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.84% (0.1072 => 0.0720, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -24.06% (0.1114 => 0.0846, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.99% (0.1818 => 0.1400, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.48% (0.0675 => 0.0530, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.04% (6.0938 => 4.8115, std.dev.: 0.0929)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.59% (1.5228 => 1.2093, std.dev.: 0.0877)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.60% (0.3576 => 0.2911, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/health/health: -18.56% (0.1993 => 0.1623, std.dev.: 0.0048)
  MultiSource/Applications/obsequi/Obsequi: -17.84% (1.4685 => 1.2065, std.dev.: 0.0760)
  MultiSource/Applications/lua/lua: -16.92% (5.3200 => 4.4197, std.dev.: 0.2398)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.49% (1.3985 => 1.2098, std.dev.: 0.0726)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.57% (1.7797 => 1.6093, std.dev.: 0.0197)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.34% (0.1947 => 0.1804, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.74% (1.5345 => 1.4311, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.92% (1.5815 => 1.4879, std.dev.: 0.0288)
  MultiSource/Benchmarks/Olden/bh/bh: -5.61% (0.3603 => 0.3401, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.57% (1.5239 => 1.4390, std.dev.: 0.0149)
  MultiSource/Applications/JM/lencod/lencod: -5.03% (18.5029 => 17.5720, std.dev.: 0.0550)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.73% (1.5361 => 1.4634, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.34% (1.4506 => 1.3877, std.dev.: 0.0135)
  MultiSource/Applications/SPASS/SPASS: -3.89% (17.9111 => 17.2145, std.dev.: 0.1397)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.81% (1.5629 => 1.5033, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.76% (1.4853 => 1.4295, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.67% (1.4947 => 1.4399, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.98% (1.5479 => 1.5018, std.dev.: 0.0087)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.45% (1.3780 => 1.3442, std.dev.: 0.0098)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.66% (1.4194 => 0.8990, std.dev.: 0.0654)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.08% (2.1022 => 1.4278, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.84% (0.9545 => 0.6697, std.dev.: 0.0206)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.34% (0.1189 => 0.0852, std.dev.: 0.0007)
  MultiSource/Applications/viterbi/viterbi: -25.75% (3.4923 => 2.5931, std.dev.: 0.0046)
  MultiSource/Applications/JM/ldecod/ldecod: -24.80% (0.0859 => 0.0646, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.60% (6.9552 => 5.2439, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.0349)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -21.26% (1.0962 => 0.8632, std.dev.: 0.0658)
  MultiSource/Applications/obsequi/Obsequi: -18.65% (2.6081 => 2.1217, std.dev.: 0.0897)
  SingleSource/Benchmarks/Misc/mandel: -14.80% (1.1996 => 1.0221, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.86% (0.3557 => 0.3135, std.dev.: 0.0009)
  MultiSource/Applications/SPASS/SPASS: -10.77% (9.2220 => 8.2287, std.dev.: 0.2005)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.25% (0.5173 => 0.4643, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout/strcat: -8.66% (0.1593 => 0.1455, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/health/health: -7.11% (0.3556 => 0.3303, std.dev.: 0.0051)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.07% (47.2250 => 44.3571, std.dev.: 1.0053)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.27% (0.3773 => 0.3574, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.95% (3.8119 => 3.6233, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/fbench: -4.64% (4.9602 => 4.7301, std.dev.: 0.0633)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.63% (1.7207 => 1.6411, std.dev.: 0.0108)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.25% (0.3479 => 0.3331, std.dev.: 0.0023)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.14% (0.5097 => 0.4886, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.12% (1.1024 => 1.0570, std.dev.: 0.0169)
  SingleSource/Regression/C/uint64_to_float: -3.93% (1.5184 => 1.4588, std.dev.: 0.0160)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.88% (1.1032 => 1.0604, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.37% (6.0444 => 5.8409, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9612, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.80% (5.2218 => 5.0756, std.dev.: 0.0360)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4081, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.41% (4.2062 => 4.1049, std.dev.: 0.0291)
  MultiSource/Applications/sgefa/sgefa: -2.25% (1.4030 => 1.3714, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/oourafft: -2.14% (3.7891 => 3.7081, std.dev.: 0.0044)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1350, std.dev.: 0.1028)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.92% (1.8144 => 1.7795, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7970, std.dev.: 0.0320)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.19% (1.6737 => 1.6538, std.dev.: 0.0077)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.11% (2.7049 => 2.6748, std.dev.: 0.0104)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.24% (0.1378 => 0.1292, std.dev.: 0.0217)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130822/c5158665/attachment.html>


More information about the llvm-testresults mailing list