[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Nov 1 13:26:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16905?compare_to=16902&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16905, Order: 193874, Start Time: 2013-11-01 18:42:30, End Time: 2013-11-01 20:30:24
      To: 16902, Order: 193862, Start Time: 2013-11-01 16:21:39, End Time: 2013-11-01 18:13:56
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 18 (42 on baseline)
Performance Improvements: 21 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.18% (1.1535 => 1.1787, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.05% (0.1720 => 0.1996, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.81% (3.5785 => 3.8580, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.50% (3.3168 => 3.5323, std.dev.: 0.0018)
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.36% (47.1100 => 49.6339, std.dev.: 0.9334)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.35% (4.3954 => 4.5867, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.35% (5.0349 => 5.2537, std.dev.: 0.0019)
  MultiSource/Applications/sqlite3/sqlite3: 3.46% (4.2223 => 4.3682, std.dev.: 0.0148)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.15% (0.3688 => 0.3804, std.dev.: 0.0011)
  MultiSource/Applications/spiff/spiff: 3.11% (2.8515 => 2.9403, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/ffbench: 2.92% (1.3666 => 1.4065, std.dev.: 0.0151)
  SingleSource/Regression/C/uint64_to_float: 2.75% (1.4405 => 1.4801, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.71% (4.1885 => 4.3018, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/oourafft: 2.29% (3.6517 => 3.7354, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.27% (5.4999 => 5.6247, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.01% (0.6604 => 0.6737, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/random: 1.44% (2.4428 => 2.4779, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (3.1437 => 3.1836, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -17.30% (0.1231 => 0.1018, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.82% (1.4049 => 1.3231, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.80% (1.3544 => 1.2759, std.dev.: 0.0146)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -4.27% (1.5731 => 1.5060, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.06% (1.3470 => 1.2923, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.73% (1.2699 => 1.2352, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.63% (1.2499 => 1.2170, std.dev.: 0.0062)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.55% (25.9483 => 25.2858, std.dev.: 0.0933)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.42% (1.2297 => 1.1999, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.77% (1.2823 => 1.2596, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.52% (1.2780 => 1.2586, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.28% (1.1208 => 1.1064, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.13% (4.3234 => 4.1015, std.dev.: 0.0022)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.40% (9.8386 => 9.4058, std.dev.: 0.0854)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.06% (16.1768 => 15.6819, std.dev.: 0.1518)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.07% (3.6155 => 3.5407, std.dev.: 0.0221)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.02% (1.6894 => 1.6553, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/flops-4: -1.71% (1.7532 => 1.7232, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash: -1.59% (0.7601 => 0.7480, std.dev.: 0.0029)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.53% (2.5822 => 2.5426, std.dev.: 0.0034)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.25% (9.0178 => 8.9052, std.dev.: 0.0229)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1338 => 0.1305, std.dev.: 0.0009)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.2294 => 0.2563, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/health/health: 7.17% (0.1507 => 0.1615, std.dev.: 0.0011)
  MultiSource/Applications/viterbi/viterbi: 5.16% (0.1976 => 0.2078, std.dev.: 0.0014)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.2728 => 1.3268, std.dev.: 0.0191)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.8014 => 0.8339, std.dev.: 0.0063)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.95% (1.0756 => 1.1181, std.dev.: 0.0087)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.9212 => 0.9540, std.dev.: 0.0081)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.46% (1.1393 => 1.1787, std.dev.: 0.0045)
  MultiSource/Applications/minisat/minisat: 2.90% (0.7439 => 0.7655, std.dev.: 0.0065)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.73% (24.6139 => 25.2858, std.dev.: 0.0933)
  MultiSource/Applications/hbd/hbd: 2.69% (1.5696 => 1.6119, std.dev.: 0.0154)
  MultiSource/Benchmarks/Bullet/bullet: 2.60% (32.7552 => 33.6070, std.dev.: 0.0532)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.23% (44.2807 => 45.2688, std.dev.: 0.0800)
  MultiSource/Applications/ClamAV/clamscan: 2.06% (16.5398 => 16.8800, std.dev.: 0.1313)
  MultiSource/Applications/hexxagon/hexxagon: 1.91% (1.0276 => 1.0472, std.dev.: 0.0054)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.84% (9.9903 => 10.1746, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.81% (1.4792 => 1.5060, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.66% (9.7354 => 9.8970, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.08% (1.2630 => 1.2767, std.dev.: 0.0053)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.5333 => 1.5491, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.02% (1.0952 => 1.1064, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.01% (1.3235 => 1.3369, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.43% (7.6426 => 12.3376, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.59% (4.4696 => 6.9095, std.dev.: 0.2475)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.29% (2.8554 => 4.1772, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 40.59% (4.2391 => 5.9597, std.dev.: 0.1245)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 19.80% (1.1431 => 1.3694, std.dev.: 0.0654)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.52% (3.5550 => 3.8580, std.dev.: 0.0046)
  SingleSource/Benchmarks/McGill/misr: 7.96% (0.3771 => 0.4071, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (3.1730 => 3.3796, std.dev.: 0.0018)
  MultiSource/Applications/spiff/spiff: 4.29% (2.8194 => 2.9403, std.dev.: 0.0199)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.12% (5.3716 => 5.5931, std.dev.: 0.0403)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.14% (89.7126 => 92.5309, std.dev.: 0.3867)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.65% (0.6563 => 0.6737, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6247, std.dev.: 0.0040)
  MultiSource/Applications/sqlite3/sqlite3: 2.22% (4.2733 => 4.3682, std.dev.: 0.0148)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.22% (1.7652 => 1.8044, std.dev.: 0.0041)
  SingleSource/Regression/C/uint64_to_float: 1.88% (1.4528 => 1.4801, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.84% (3.1569 => 3.2150, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.27% (6.6028 => 6.6865, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/fib2: 1.09% (3.5966 => 3.6359, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -13.99% (0.1194 => 0.1027, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.23% (1.2622 => 1.2467, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.11% (1.3068 => 1.2923, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.05% (0.5226 => 0.2349, std.dev.: 0.0150)
  MultiSource/Applications/sgefa/sgefa: -42.58% (1.5790 => 0.9067, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.80% (15.9508 => 12.9528, std.dev.: 0.5305)
  SingleSource/Benchmarks/Shootout-C++/moments: -14.94% (0.1285 => 0.1093, std.dev.: 0.0020)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.28% (57.2347 => 49.6339, std.dev.: 0.9334)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.09% (4.0181 => 3.5323, std.dev.: 0.0018)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.58% (20.8247 => 18.6208, std.dev.: 0.0201)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.93% (3.4956 => 3.1836, std.dev.: 0.0017)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.18% (3.7437 => 3.4374, std.dev.: 0.0143)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.17% (8.1346 => 7.6329, std.dev.: 0.0132)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.20% (0.7474 => 0.7085, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.55% (5.0002 => 4.7727, std.dev.: 0.0664)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.30% (16.2163 => 15.6819, std.dev.: 0.1518)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.20% (3.7874 => 3.6661, std.dev.: 0.0103)
  MultiSource/Benchmarks/Olden/power/power: -2.97% (1.2170 => 1.1809, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.72% (2.4471 => 2.3805, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.60% (5.4473 => 5.3054, std.dev.: 0.0545)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.41% (2.5938 => 2.5312, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.12% (17.1431 => 16.7799, std.dev.: 0.0110)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (4.3592 => 4.3018, std.dev.: 0.0044)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1348 => 0.1305, std.dev.: 0.0009)

Report Time: 0.83s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131101/0e66eaf9/attachment.html>


More information about the llvm-testresults mailing list