[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 14 11:08:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16309?compare_to=16306&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16309, Order: 192599, Start Time: 2013-10-14 16:21:25, End Time: 2013-10-14 18:11:18
      To: 16306, Order: 192591, Start Time: 2013-10-14 14:08:02, End Time: 2013-10-14 15:58:11
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (24 on baseline)
Performance Improvements: 35 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1069 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: 6.12% (0.2205 => 0.2340, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.98% (1.4837 => 1.8098, std.dev.: 0.0406)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.89% (1.1022 => 1.2112, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.84% (6.7566 => 7.3539, std.dev.: 0.2277)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.65% (1.3895 => 1.5097, std.dev.: 0.0005)
  MultiSource/Benchmarks/sim/sim: 5.68% (3.8525 => 4.0714, std.dev.: 0.0045)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.63% (1.0195 => 1.0667, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.36% (0.7129 => 0.7440, std.dev.: 0.0030)
  MultiSource/Applications/hexxagon/hexxagon: 3.30% (15.1579 => 15.6586, std.dev.: 0.0560)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.78% (0.5722 => 0.5881, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.42% (0.6414 => 0.6569, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (3.1559 => 3.2211, std.dev.: 0.0029)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (2.5009 => 2.5429, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.56% (5.4954 => 5.5810, std.dev.: 0.0210)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -39.74% (0.1170 => 0.0705, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/gs/gs: -31.16% (6.7748 => 4.6635, std.dev.: 0.0737)
  MultiSource/Benchmarks/Olden/health/health: -25.14% (0.2033 => 0.1522, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -24.03% (13.0307 => 9.8991, std.dev.: 0.5006)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.30% (0.1116 => 0.0856, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.58% (0.9109 => 0.7143, std.dev.: 0.0124)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -20.79% (1.6593 => 1.3144, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -20.37% (0.0643 => 0.0512, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -20.11% (0.3580 => 0.2860, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/bisort/bisort: -17.51% (0.0891 => 0.0735, std.dev.: 0.0036)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -15.77% (6.5583 => 5.5242, std.dev.: 0.3496)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -15.22% (0.2667 => 0.2261, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.18% (0.1560 => 0.1370, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -9.64% (1.4305 => 1.2926, std.dev.: 0.0532)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -9.08% (0.1256 => 0.1142, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.17% (4.5461 => 4.1747, std.dev.: 0.1080)
  MultiSource/Benchmarks/Olden/power/power: -6.83% (0.1538 => 0.1433, std.dev.: 0.0016)
  MultiSource/Benchmarks/sim/sim: -6.09% (0.4023 => 0.3778, std.dev.: 0.0062)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -47.73% (1.4517 => 0.7588, std.dev.: 0.0560)
  MultiSource/Benchmarks/Olden/mst/mst: -42.73% (0.2366 => 0.1355, std.dev.: 0.0289)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -33.86% (0.0700 => 0.0463, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.63% (0.9915 => 0.6680, std.dev.: 0.0123)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -25.43% (0.0696 => 0.0519, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -21.43% (0.1227 => 0.0964, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -19.11% (74.5267 => 60.2856, std.dev.: 4.8167)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -18.10% (48.8732 => 40.0267, std.dev.: 2.6809)
  MultiSource/Benchmarks/llubenchmark/llu: -13.94% (2.3422 => 2.0158, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.87% (1.7287 => 1.5754, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -7.13% (0.4084 => 0.3793, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -6.77% (0.2793 => 0.2604, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -4.80% (4.1828 => 3.9819, std.dev.: 0.0505)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.48% (0.3549 => 0.3390, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/health/health: -2.97% (0.3496 => 0.3392, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.05% (0.7412 => 0.7260, std.dev.: 0.0052)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (1.8123 => 1.7884, std.dev.: 0.0087)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.57% (0.1463 => 0.1323, std.dev.: 0.0312)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: 7.19% (0.2183 => 0.2340, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.87% (0.4624 => 0.4849, std.dev.: 0.0052)
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.53% (0.5185 => 0.5368, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.2728 => 1.3144, std.dev.: 0.0048)
  MultiSource/Benchmarks/McCat/18-imp/imp: 3.06% (0.3885 => 0.4004, std.dev.: 0.0018)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.39% (7.6426 => 12.5639, std.dev.: 0.0568)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 32.07% (1.1431 => 1.5097, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 22.04% (1.4830 => 1.8098, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.15% (6.4425 => 7.3539, std.dev.: 0.2277)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.98% (1.1013 => 1.2112, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0038)
  MultiSource/Benchmarks/sim/sim: 6.27% (3.8312 => 4.0714, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.25% (8.1346 => 8.6433, std.dev.: 0.0460)
  MultiSource/Applications/hexxagon/hexxagon: 5.94% (14.7810 => 15.6586, std.dev.: 0.0560)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.25% (3.5642 => 3.7156, std.dev.: 0.0035)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.35% (5.3716 => 5.5514, std.dev.: 0.0462)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2464, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1569 => 3.2211, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.61% (5.4925 => 5.5810, std.dev.: 0.0210)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.39% (16.7972 => 17.0302, std.dev.: 0.0877)
  MultiSource/Benchmarks/llubenchmark/llu: 1.35% (1.9889 => 2.0158, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.31% (1.7652 => 1.7884, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout/methcall: 1.18% (8.5434 => 8.6439, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.13% (1.0477 => 1.0595, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.31% (0.1483 => 0.1167, std.dev.: 0.0118)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -57.40% (57.2347 => 24.3800, std.dev.: 12.2202)
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.34% (0.5226 => 0.2386, std.dev.: 0.0853)
  MultiSource/Applications/sgefa/sgefa: -47.06% (1.5790 => 0.8360, std.dev.: 0.0331)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.55% (50.0284 => 40.7493, std.dev.: 2.0162)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.23% (15.9508 => 13.0428, std.dev.: 0.3225)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.77% (20.8247 => 18.3727, std.dev.: 0.1531)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.37% (3.4956 => 3.1330, std.dev.: 0.0425)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.86% (0.7474 => 0.7260, std.dev.: 0.0052)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.69% (2.4471 => 2.3813, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.39% (17.1431 => 16.7339, std.dev.: 0.0778)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.96% (2.5938 => 2.5429, std.dev.: 0.0144)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.71% (3.7874 => 3.7228, std.dev.: 0.0020)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (89.7126 => 88.5820, std.dev.: 0.1551)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.85% (0.1348 => 0.1323, std.dev.: 0.0312)

Report Time: 1.03s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131014/0ec71785/attachment.html>


More information about the llvm-testresults mailing list