[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 4 23:02:02 PST 2013


http://llvm.org/perf/db_default/v4/nts/17990?compare_to=17985&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17990, Order: 196464, Start Time: 2013-12-05 05:12:50, End Time: 2013-12-05 07:06:07
      To: 17985, Order: 196457, Start Time: 2013-12-05 03:01:59, End Time: 2013-12-05 04:47:41
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 41 (43 on baseline)
Performance Improvements: 3 (3 on baseline)
Unchanged Tests: 1066 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 62.35% (0.0858 => 0.1393, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 58.56% (0.0929 => 0.1473, std.dev.: 0.0068)
  MultiSource/Benchmarks/McCat/08-main/main: 49.41% (0.2955 => 0.4415, std.dev.: 0.0224)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 48.71% (0.2751 => 0.4091, std.dev.: 0.0069)
  SingleSource/UnitTests/SignlessTypes/factor: 45.11% (0.0348 => 0.0505, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 42.41% (0.1172 => 0.1669, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 41.39% (0.1737 => 0.2456, std.dev.: 0.0128)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 40.95% (0.1055 => 0.1487, std.dev.: 0.0152)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 39.64% (0.3196 => 0.4463, std.dev.: 0.0179)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.12% (0.1398 => 0.1875, std.dev.: 0.0176)
  MultiSource/Applications/spiff/spiff: 30.34% (0.8938 => 1.1650, std.dev.: 0.0303)
  MultiSource/Applications/hbd/hbd: 29.98% (1.5703 => 2.0411, std.dev.: 0.0342)
  MultiSource/Applications/treecc/treecc: 25.45% (2.2628 => 2.8387, std.dev.: 0.1343)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.56% (4.9622 => 6.1315, std.dev.: 0.0548)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 23.04% (1.9209 => 2.3635, std.dev.: 0.0430)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 21.53% (1.3534 => 1.6448, std.dev.: 0.0187)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.82% (15.0093 => 17.6834, std.dev.: 0.2999)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.00% (4.7579 => 5.4717, std.dev.: 0.2564)
  MultiSource/Applications/lambda-0_1_3/lambda: 14.53% (0.8391 => 0.9610, std.dev.: 0.0221)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.87% (0.0886 => 0.1000, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.81% (5.8495 => 6.1893, std.dev.: 0.0852)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.88% (1.3925 => 1.4605, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (0.4254 => 0.4438, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (1.3547 => 1.4105, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 48.77% (0.0486 => 0.0723, std.dev.: 0.0067)
  MultiSource/Applications/d/make_dparser: 45.83% (0.0384 => 0.0560, std.dev.: 0.0053)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.69% (1.3476 => 1.7207, std.dev.: 0.0419)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.59% (1.2469 => 1.4912, std.dev.: 0.0942)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.75% (0.0902 => 0.1026, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.39% (2.0962 => 2.3560, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.30% (2.6667 => 2.9148, std.dev.: 0.0461)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 7.91% (60.3164 => 65.0866, std.dev.: 1.4344)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.15% (40.5200 => 42.6067, std.dev.: 0.5962)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.99% (4.1028 => 4.3076, std.dev.: 0.0343)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.48% (21.4783 => 22.4398, std.dev.: 0.2469)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.69% (3.2950 => 3.3838, std.dev.: 0.0207)
  MultiSource/Benchmarks/Olden/power/power: 2.19% (1.1848 => 1.2108, std.dev.: 0.0080)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.05% (0.6386 => 0.6517, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/random: 1.75% (2.4359 => 2.4785, std.dev.: 0.0018)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (50.5879 => 51.3266, std.dev.: 0.2681)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.35% (15.6943 => 15.9066, std.dev.: 0.0707)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -26.66% (0.4396 => 0.3224, std.dev.: 0.0230)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -37.56% (2.6033 => 1.6256, std.dev.: 0.0155)
  MultiSource/Applications/aha/aha: -5.30% (3.7782 => 3.5780, std.dev.: 0.0430)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 61.79% (0.0861 => 0.1393, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 56.20% (0.0943 => 0.1473, std.dev.: 0.0068)
  SingleSource/UnitTests/SignlessTypes/factor: 48.53% (0.0340 => 0.0505, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/08-main/main: 46.82% (0.3007 => 0.4415, std.dev.: 0.0224)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 45.76% (0.1145 => 0.1669, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 45.59% (0.2810 => 0.4091, std.dev.: 0.0069)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 42.71% (0.1042 => 0.1487, std.dev.: 0.0152)
  MultiSource/Benchmarks/Olden/bh/bh: 35.85% (0.3289 => 0.4468, std.dev.: 0.0435)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.60% (0.1393 => 0.1875, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 31.19% (0.3402 => 0.4463, std.dev.: 0.0179)
  MultiSource/Applications/hbd/hbd: 30.46% (1.5646 => 2.0411, std.dev.: 0.0342)
  MultiSource/Applications/spiff/spiff: 29.19% (0.9018 => 1.1650, std.dev.: 0.0303)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.73% (0.1938 => 0.2456, std.dev.: 0.0128)
  MultiSource/Applications/treecc/treecc: 24.61% (2.2781 => 2.8387, std.dev.: 0.1343)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 24.08% (1.3256 => 1.6448, std.dev.: 0.0187)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.64% (5.0823 => 6.1315, std.dev.: 0.0548)
  MultiSource/Benchmarks/llubenchmark/llu: 19.89% (0.0528 => 0.0633, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/tsp/tsp: 17.26% (0.1379 => 0.1617, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.96% (2.0207 => 2.3635, std.dev.: 0.0430)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.69% (0.0857 => 0.1000, std.dev.: 0.0033)
  MultiSource/Applications/lambda-0_1_3/lambda: 15.35% (0.8331 => 0.9610, std.dev.: 0.0221)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.79% (15.4053 => 17.6834, std.dev.: 0.2999)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.45% (4.7807 => 5.4717, std.dev.: 0.2564)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.59% (1.3702 => 1.4605, std.dev.: 0.0172)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.35% (5.8749 => 6.1893, std.dev.: 0.0852)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.03% (0.4266 => 0.4438, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 97.55% (0.1345 => 0.2657, std.dev.: 0.0260)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 48.77% (0.0486 => 0.0723, std.dev.: 0.0067)
  MultiSource/Applications/d/make_dparser: 45.83% (0.0384 => 0.0560, std.dev.: 0.0053)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.45% (1.2278 => 1.4912, std.dev.: 0.0942)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 20.03% (1.4335 => 1.7207, std.dev.: 0.0419)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.08% (2.1020 => 2.3560, std.dev.: 0.0150)
  MultiSource/Benchmarks/McCat/09-vor/vor: 12.03% (0.1164 => 0.1304, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 9.34% (2.6658 => 2.9148, std.dev.: 0.0461)
  SingleSource/Benchmarks/Shootout/ary3: 9.02% (4.5977 => 5.0124, std.dev.: 0.1341)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.56% (61.0792 => 65.0866, std.dev.: 1.4344)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.06% (40.5530 => 42.6067, std.dev.: 0.5962)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.91% (21.5962 => 22.4398, std.dev.: 0.2469)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.89% (4.1462 => 4.3076, std.dev.: 0.0343)
  MultiSource/Benchmarks/Olden/power/power: 2.64% (1.1796 => 1.2108, std.dev.: 0.0080)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.42% (1.7409 => 1.7831, std.dev.: 0.0157)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.39% (15.5356 => 15.9066, std.dev.: 0.0707)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.02% (0.6388 => 0.6517, std.dev.: 0.0030)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.07% (0.5219 => 0.4850, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/pi: -2.57% (1.6685 => 1.6256, std.dev.: 0.0155)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.70% (3.6605 => 3.5984, std.dev.: 0.0220)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/a871c647/attachment.html>


More information about the llvm-testresults mailing list