[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Nov 30 13:35:40 PST 2013


http://llvm.org/perf/db_default/v4/nts/17758?compare_to=17750&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17758, Order: 195976, Start Time: 2013-11-30 19:51:03, End Time: 2013-11-30 21:39:42
      To: 17750, Order: 195973, Start Time: 2013-11-30 15:56:02, End Time: 2013-11-30 17:35:07
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 37 (27 on baseline)
Performance Improvements: 14 (8 on baseline)
Unchanged Tests: 1059 (1075 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-19-DivTest: 110.45% (0.0134 => 0.0282, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-04-18-LoopBug: 86.00% (0.0150 => 0.0279, std.dev.: 0.0020)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 81.40% (0.0129 => 0.0234, std.dev.: 0.0013)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 74.21% (0.0190 => 0.0331, std.dev.: 0.0043)
  SingleSource/Regression/C/sumarray: 69.80% (0.0245 => 0.0416, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 67.77% (0.0484 => 0.0812, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/mandel-2: 58.26% (0.0333 => 0.0527, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/flops-4: 53.35% (0.0313 => 0.0480, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/ffbench: 13.75% (0.0771 => 0.0877, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.54% (0.1335 => 0.1449, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.39% (1.2775 => 1.3847, std.dev.: 0.0415)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.07% (0.2120 => 0.2291, std.dev.: 0.0007)
  MultiSource/Applications/SPASS/SPASS: 7.88% (16.3627 => 17.6517, std.dev.: 0.3870)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.27% (1.3283 => 1.4249, std.dev.: 0.0225)
  MultiSource/Applications/d/make_dparser: 7.06% (3.5402 => 3.7901, std.dev.: 0.0315)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.99% (1.9672 => 2.0654, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.98% (1.4615 => 1.5196, std.dev.: 0.0191)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 28.75% (2.8202 => 3.6309, std.dev.: 0.0152)
  MultiSource/Benchmarks/MallocBench/gs/gs: 15.38% (0.0741 => 0.0855, std.dev.: 0.0038)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.11% (9.3026 => 10.6149, std.dev.: 0.1959)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.11% (35.4980 => 40.1518, std.dev.: 0.8956)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.98% (2.1040 => 2.3770, std.dev.: 0.0125)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.77% (13.8133 => 15.1632, std.dev.: 0.4905)
  SingleSource/Benchmarks/Misc/salsa20: 8.92% (7.4996 => 8.1686, std.dev.: 0.0675)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.60% (3.8306 => 4.1601, std.dev.: 0.1081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.30% (60.6176 => 64.4371, std.dev.: 0.4277)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.95% (2.3135 => 2.4512, std.dev.: 0.0421)
  MultiSource/Benchmarks/Bullet/bullet: 5.36% (7.0210 => 7.3972, std.dev.: 0.0572)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.84% (4.1006 => 4.2989, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.61% (40.4368 => 42.2993, std.dev.: 0.3410)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.43% (5.9002 => 6.1613, std.dev.: 0.0054)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.09% (95.1754 => 99.0689, std.dev.: 1.3396)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2708 => 9.6272, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.70% (4.8183 => 4.9482, std.dev.: 0.0294)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (2.4750 => 2.5309, std.dev.: 0.0215)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.92% (0.6408 => 0.6531, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.38% (3.6125 => 3.6622, std.dev.: 0.0172)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -13.77% (2.1067 => 1.8167, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -7.38% (3.8609 => 3.5758, std.dev.: 0.0367)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.77% (0.3991 => 0.3721, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.86% (6.0902 => 5.8552, std.dev.: 0.0646)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.89% (3.8425 => 3.7314, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.81% (2.5472 => 2.4755, std.dev.: 0.0034)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.63% (52.0171 => 50.6489, std.dev.: 0.2786)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.46% (3.6678 => 3.5774, std.dev.: 0.0321)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.08% (5.3637 => 5.2519, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.91% (12.1424 => 11.9100, std.dev.: 0.0284)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.83% (23.8259 => 23.3905, std.dev.: 0.0883)
  MultiSource/Applications/viterbi/viterbi: -1.80% (2.6772 => 2.6291, std.dev.: 0.0167)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.32% (18.8711 => 18.6225, std.dev.: 0.0554)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.31% (3.1944 => 3.1525, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-19-DivTest: 79.62% (0.0157 => 0.0282, std.dev.: 0.0006)
  SingleSource/UnitTests/2008-04-18-LoopBug: 77.71% (0.0157 => 0.0279, std.dev.: 0.0020)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 75.13% (0.0189 => 0.0331, std.dev.: 0.0043)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 64.37% (0.0494 => 0.0812, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/mandel-2: 56.38% (0.0337 => 0.0527, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/flops-4: 54.34% (0.0311 => 0.0480, std.dev.: 0.0047)
  SingleSource/Regression/C/sumarray: 40.54% (0.0296 => 0.0416, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/ffbench: 13.45% (0.0773 => 0.0877, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.13% (1.9834 => 2.0654, std.dev.: 0.0283)
  MultiSource/Applications/d/make_dparser: 4.04% (3.6428 => 3.7901, std.dev.: 0.0315)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.25% (2.9945 => 3.6309, std.dev.: 0.0152)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.08% (2.1020 => 2.3770, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 11.63% (35.9684 => 40.1518, std.dev.: 0.8956)
  SingleSource/Benchmarks/Misc/salsa20: 7.56% (7.5947 => 8.1686, std.dev.: 0.0675)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.92% (10.0217 => 10.6149, std.dev.: 0.1959)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.50% (61.0792 => 64.4371, std.dev.: 0.4277)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.14% (1.1019 => 1.1585, std.dev.: 0.0160)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.95% (2.3355 => 2.4512, std.dev.: 0.0421)
  SingleSource/Benchmarks/Shootout/lists: 4.53% (6.9930 => 7.3095, std.dev.: 0.0842)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.31% (40.5530 => 42.2993, std.dev.: 0.3410)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.19% (5.9133 => 6.1613, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/flops: 3.88% (9.2673 => 9.6272, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.68% (4.1462 => 4.2989, std.dev.: 0.0040)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.5112 => 0.5261, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.57% (4.8243 => 4.9482, std.dev.: 0.0294)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.24% (0.6388 => 0.6531, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.33% (3.6142 => 3.6622, std.dev.: 0.0172)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.99% (0.6882 => 0.6470, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.10% (1.1409 => 1.0941, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.64% (1.3918 => 1.3551, std.dev.: 0.0093)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.84% (1.4335 => 1.3068, std.dev.: 0.0293)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.27% (0.3970 => 0.3721, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.27% (3.6605 => 3.5774, std.dev.: 0.0321)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.08% (2.5025 => 2.4755, std.dev.: 0.0034)

Report Time: 1.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131130/3b7aa0af/attachment.html>


More information about the llvm-testresults mailing list