[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 14 17:28:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12398?compare_to=12395&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12398, Order: 184016, Start Time: 2013-06-14 22:45:43, End Time: 2013-06-15 00:29:21
      To: 12395, Order: 183999, Start Time: 2013-06-14 20:29:43, End Time: 2013-06-14 22:20:57
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 3 (18 on baseline)
Performance Improvements: 64 (58 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1040 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 15.45% (6.9856 => 8.0650, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.30% (4.7571 => 4.9141, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.59% (3.2980 => 3.3834, std.dev.: 0.0124)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/DuffsDevice: -39.14% (0.0442 => 0.0269, std.dev.: 0.0016)
  SingleSource/Regression/C/testtrace: -38.89% (0.0414 => 0.0253, std.dev.: 0.0052)
  SingleSource/Regression/C/compare: -38.74% (0.0382 => 0.0234, std.dev.: 0.0033)
  SingleSource/Regression/C/bigstack: -37.98% (0.0732 => 0.0454, std.dev.: 0.0018)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -36.30% (0.0292 => 0.0186, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/dt: -34.43% (0.0578 => 0.0379, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -31.81% (0.1119 => 0.0763, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/nestedloop: -30.45% (0.0486 => 0.0338, std.dev.: 0.0006)
  SingleSource/Regression/C/test_indvars: -27.76% (0.0407 => 0.0294, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -27.31% (0.1062 => 0.0772, std.dev.: 0.0055)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -23.53% (0.1598 => 0.1222, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -19.54% (0.1612 => 0.1297, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -19.02% (0.0631 => 0.0511, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/ffbench: -12.89% (0.0908 => 0.0791, std.dev.: 0.0004)
  MultiSource/Applications/obsequi/Obsequi: -11.52% (1.3103 => 1.1594, std.dev.: 0.0531)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.34% (11.6295 => 10.4267, std.dev.: 0.0595)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.91% (0.1171 => 0.1055, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/health/health: -8.44% (0.1671 => 0.1530, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.17% (0.1445 => 0.1327, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.47% (0.2115 => 0.1957, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.22% (2.0539 => 1.9056, std.dev.: 0.0157)
  MultiSource/Applications/lemon/lemon: -6.49% (1.2980 => 1.2138, std.dev.: 0.0189)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -6.39% (0.2427 => 0.2272, std.dev.: 0.0028)
  MultiSource/Applications/JM/ldecod/ldecod: -6.22% (7.8853 => 7.3945, std.dev.: 0.0587)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.47% (0.8616 => 0.8145, std.dev.: 0.0090)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.99% (0.3044 => 0.2892, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.56% (0.4082 => 0.3896, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.17% (1.5669 => 1.5015, std.dev.: 0.0207)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.09% (0.8127 => 0.7795, std.dev.: 0.0109)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.99% (0.2958 => 0.2840, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.99% (0.9986 => 0.9588, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/moments: -3.84% (0.4267 => 0.4103, std.dev.: 0.0011)
  MultiSource/Benchmarks/sim/sim: -2.92% (0.3770 => 0.3660, std.dev.: 0.0026)
  MultiSource/Applications/ClamAV/clamscan: -2.85% (17.1668 => 16.6779, std.dev.: 0.1616)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.77% (2.6832 => 2.6090, std.dev.: 0.0259)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.57% (0.9948 => 0.9692, std.dev.: 0.0051)
  MultiSource/Applications/hbd/hbd: -2.33% (1.6660 => 1.6271, std.dev.: 0.0044)
  MultiSource/Applications/hexxagon/hexxagon: -2.28% (1.1204 => 1.0948, std.dev.: 0.0057)
  MultiSource/Applications/minisat/minisat: -2.27% (0.7827 => 0.7649, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.00% (0.5301 => 0.5195, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.13% (1.5747 => 1.5569, std.dev.: 0.0004)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -33.17% (0.1999 => 0.1336, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -31.68% (4.2941 => 2.9336, std.dev.: 0.1921)
  MultiSource/Benchmarks/Olden/bisort/bisort: -28.23% (0.9393 => 0.6741, std.dev.: 0.0198)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -21.37% (0.9728 => 0.7649, std.dev.: 0.0660)
  SingleSource/Benchmarks/Shootout-C++/ary: -17.47% (0.0767 => 0.0633, std.dev.: 0.0046)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.74% (0.0757 => 0.0653, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -12.02% (0.2154 => 0.1895, std.dev.: 0.0100)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.35% (0.3413 => 0.3094, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.88% (0.3894 => 0.3626, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.39% (17.0621 => 15.9724, std.dev.: 0.3542)
  MultiSource/Benchmarks/Olden/health/health: -6.36% (0.3520 => 0.3296, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.94% (4.3083 => 4.0522, std.dev.: 0.0823)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.32% (4.2234 => 3.9989, std.dev.: 0.0766)
  MultiSource/Applications/SPASS/SPASS: -5.12% (8.5598 => 8.1217, std.dev.: 0.1098)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.81% (1.6643 => 1.6009, std.dev.: 0.0114)
  MultiSource/Applications/sqlite3/sqlite3: -2.26% (4.4300 => 4.3298, std.dev.: 0.0355)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.12% (41.6156 => 40.7315, std.dev.: 0.3277)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.07% (1.5350 => 1.5033, std.dev.: 0.0110)
  SingleSource/Benchmarks/Misc/flops-8: -1.88% (2.5919 => 2.5433, std.dev.: 0.0085)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.81% (2.7338 => 2.6844, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout-C++/hash: -1.70% (0.7302 => 0.7178, std.dev.: 0.0027)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.48% (5.7043 => 5.6201, std.dev.: 0.0282)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.43% (1.4968 => 1.4754, std.dev.: 0.0064)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.75% (0.1432 => 0.1457, std.dev.: 0.0010)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.28% (0.2721 => 0.2892, std.dev.: 0.0007)
  MultiSource/Applications/hexxagon/hexxagon: 1.43% (1.0794 => 1.0948, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.28% (1.5372 => 1.5569, std.dev.: 0.0004)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.25% (6.1372 => 7.2573, std.dev.: 0.1631)
  MultiSource/Applications/sgefa/sgefa: 17.84% (1.1695 => 1.3781, std.dev.: 0.0053)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.49% (0.1455 => 0.1695, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.01% (5.2003 => 5.6166, std.dev.: 0.0850)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.22% (3.1853 => 3.3834, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.66% (3.2201 => 3.3703, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8810, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.72% (5.9362 => 6.1571, std.dev.: 0.0237)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.71% (1.2224 => 1.2678, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.56% (5.2788 => 5.4665, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.96% (5.5010 => 5.6637, std.dev.: 0.0415)
  SingleSource/Benchmarks/Shootout/methcall: 2.11% (8.3425 => 8.5185, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.87% (5.6582 => 5.7641, std.dev.: 0.0202)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (4.3727 => 4.4498, std.dev.: 0.0107)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.13% (11.4990 => 11.6292, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.94% (0.0803 => 0.0667, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/whetstone: -15.50% (0.1097 => 0.0927, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.91% (0.1646 => 0.1417, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.84% (0.1075 => 0.0937, std.dev.: 0.0051)
  MultiSource/Applications/JM/lencod/lencod: -11.56% (18.9387 => 16.7494, std.dev.: 0.1830)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.62% (0.2006 => 0.1793, std.dev.: 0.0038)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -9.28% (0.1563 => 0.1418, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: -7.73% (1.3155 => 1.2138, std.dev.: 0.0189)
  MultiSource/Benchmarks/Olden/em3d/em3d: -7.56% (0.2117 => 0.1957, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/18-imp/imp: -6.98% (0.4199 => 0.3906, std.dev.: 0.0098)
  MultiSource/Applications/oggenc/oggenc: -6.86% (5.9886 => 5.5777, std.dev.: 0.1432)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.15% (0.1853 => 0.1739, std.dev.: 0.0021)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.83% (0.8649 => 0.8145, std.dev.: 0.0090)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.95% (1.3686 => 1.3009, std.dev.: 0.0146)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.09% (0.2961 => 0.2840, std.dev.: 0.0027)
  MultiSource/Applications/ClamAV/clamscan: -3.72% (17.3229 => 16.6779, std.dev.: 0.1616)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.79% (10.7257 => 10.4267, std.dev.: 0.0595)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.66% (0.9957 => 0.9692, std.dev.: 0.0051)
  MultiSource/Applications/minisat/minisat: -2.49% (0.7844 => 0.7649, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.42% (0.4554 => 0.4444, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.39% (1.2911 => 0.7309, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/mst/mst: -36.35% (0.2099 => 0.1336, std.dev.: 0.0090)
  MultiSource/Applications/lemon/lemon: -36.23% (1.3499 => 0.8608, std.dev.: 0.0661)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.48% (4.4050 => 3.2386, std.dev.: 0.1426)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.80% (6.2328 => 4.6245, std.dev.: 0.2031)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -25.38% (1.0251 => 0.7649, std.dev.: 0.0660)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.67% (0.8606 => 0.6741, std.dev.: 0.0198)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.21% (25.3677 => 21.2563, std.dev.: 0.0600)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.18% (3.5000 => 2.9336, std.dev.: 0.1921)
  MultiSource/Applications/minisat/minisat: -15.36% (7.3703 => 6.2380, std.dev.: 0.4082)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.57% (0.0920 => 0.0786, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/salsa20: -13.04% (10.3398 => 8.9920, std.dev.: 0.0023)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.13% (48.3307 => 43.4372, std.dev.: 0.0882)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.87% (1.6679 => 1.5033, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.61% (0.7941 => 0.7178, std.dev.: 0.0027)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.23% (3.5327 => 3.2066, std.dev.: 0.0598)
  MultiSource/Applications/SPASS/SPASS: -8.46% (8.8720 => 8.1217, std.dev.: 0.1098)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.57% (3.2030 => 2.9606, std.dev.: 0.0375)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.84% (0.1945 => 0.1812, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.74% (5.5889 => 5.2120, std.dev.: 0.0054)
  MultiSource/Applications/sqlite3/sqlite3: -6.60% (4.6358 => 4.3298, std.dev.: 0.0355)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.31% (9.8728 => 9.2495, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.74% (4.5717 => 4.3092, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (5.3184 => 5.0643, std.dev.: 0.0736)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.23% (9.1099 => 8.7247, std.dev.: 0.0091)
  MultiSource/Applications/hexxagon/hexxagon: -4.07% (15.4979 => 14.8669, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.64% (1.6613 => 1.6009, std.dev.: 0.0114)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.55% (0.3208 => 0.3094, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/flops: -3.52% (10.2170 => 9.8569, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.44% (2.8537 => 2.7556, std.dev.: 0.0251)
  SingleSource/Benchmarks/Shootout/sieve: -2.88% (8.0178 => 7.7866, std.dev.: 0.0868)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.87% (3.8665 => 3.7554, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.31% (0.6097 => 0.5956, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.99% (4.2167 => 4.1327, std.dev.: 0.0055)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.99% (5.7342 => 5.6201, std.dev.: 0.0282)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.27% (51.8429 => 51.1864, std.dev.: 0.0931)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.24% (2.7180 => 2.6844, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.21% (9.6556 => 9.5390, std.dev.: 0.0334)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1441 => 0.1457, std.dev.: 0.0010)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130614/299ddc12/attachment.html>


More information about the llvm-testresults mailing list