[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 26 01:52:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13777?compare_to=13774&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13777, Order: 187190, Start Time: 2013-07-26 07:11:59, End Time: 2013-07-26 08:54:16
      To: 13774, Order: 187186, Start Time: 2013-07-26 05:03:36, End Time: 2013-07-26 06:50:54
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 8 (19 on baseline)
Performance Improvements: 15 (96 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1084 (992 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: 1.05% (1.1160 => 1.1277, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 12.59% (2.0859 => 2.3486, std.dev.: 0.0923)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.05% (1.1808 => 1.2759, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.28% (2.5351 => 2.6182, std.dev.: 0.0093)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.03% (0.4982 => 0.5133, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.00% (0.3603 => 0.3711, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/hash: 1.86% (4.1514 => 4.2285, std.dev.: 0.0260)
  MultiSource/Applications/SPASS/SPASS: 1.59% (8.0489 => 8.1772, std.dev.: 0.0364)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.33% (0.2984 => 0.2795, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.07% (0.1797 => 0.1688, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.06% (0.8565 => 0.8303, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.02% (1.5613 => 1.5142, std.dev.: 0.0176)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.12% (0.9697 => 0.9491, std.dev.: 0.0044)
  MultiSource/Applications/obsequi/Obsequi: -1.65% (1.2017 => 1.1819, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.24% (1.4222 => 1.4046, std.dev.: 0.0052)
  MultiSource/Applications/sqlite3/sqlite3: -1.22% (17.5555 => 17.3410, std.dev.: 0.0152)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.07% (1.3402 => 1.3258, std.dev.: 0.0042)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.00% (1.2145 => 1.2023, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.72% (0.1517 => 0.1415, std.dev.: 0.0033)
  MultiSource/Applications/lemon/lemon: -5.81% (0.9580 => 0.9023, std.dev.: 0.0178)
  MultiSource/Applications/siod/siod: -2.09% (3.9116 => 3.8300, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.99% (2.9845 => 2.9250, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.71% (4.0205 => 3.9517, std.dev.: 0.0237)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.42% (0.1366 => 0.1292, std.dev.: 0.0031)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.43% (2.8867 => 4.2848, std.dev.: 0.0390)
  SingleSource/Benchmarks/Misc/pi: 18.41% (1.9835 => 2.3486, std.dev.: 0.0923)
  MultiSource/Applications/siod/siod: 13.44% (3.3761 => 3.8300, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.13% (2.9428 => 3.3291, std.dev.: 0.1168)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.54% (14.9584 => 16.3855, std.dev.: 0.3986)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9469, std.dev.: 0.0203)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.02% (48.3256 => 52.2036, std.dev.: 0.3250)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.90% (1.2557 => 1.3549, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.65% (3.2027 => 3.4158, std.dev.: 0.0062)
  SingleSource/Benchmarks/McGill/chomp: 6.26% (1.0051 => 1.0680, std.dev.: 0.0076)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.22% (1.2012 => 1.2759, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.82% (5.3042 => 5.6130, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.65% (3.4085 => 3.6012, std.dev.: 0.0523)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8003, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.18% (5.1471 => 5.3620, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.3151 => 4.4951, std.dev.: 0.0296)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.73% (2.5240 => 2.6182, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4614, std.dev.: 0.0442)
  SingleSource/Benchmarks/Misc/ffbench: 1.20% (1.3679 => 1.3843, std.dev.: 0.0029)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -37.33% (0.2237 => 0.1402, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/bisort/bisort: -34.14% (0.1072 => 0.0706, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -28.74% (0.0675 => 0.0481, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/tsp/tsp: -26.62% (0.1818 => 0.1334, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -25.76% (0.1114 => 0.0827, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -24.37% (0.0439 => 0.0332, std.dev.: 0.0025)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.69% (6.0938 => 4.7114, std.dev.: 0.1710)
  MultiSource/Benchmarks/Olden/health/health: -22.38% (0.1993 => 0.1547, std.dev.: 0.0013)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.05% (1.5228 => 1.2023, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -20.44% (0.3576 => 0.2845, std.dev.: 0.0020)
  MultiSource/Applications/obsequi/Obsequi: -19.52% (1.4685 => 1.1819, std.dev.: 0.0028)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.91% (0.1518 => 0.1231, std.dev.: 0.0059)
  MultiSource/Applications/lua/lua: -17.84% (5.3200 => 4.3711, std.dev.: 0.0116)
  MultiSource/Applications/hbd/hbd: -17.68% (2.0193 => 1.6622, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.12% (0.2367 => 0.2009, std.dev.: 0.0007)
  MultiSource/Applications/hexxagon/hexxagon: -15.11% (1.3285 => 1.1277, std.dev.: 0.0019)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.00% (1.3985 => 1.2027, std.dev.: 0.0017)
  MultiSource/Applications/sgefa/sgefa: -13.79% (0.4809 => 0.4146, std.dev.: 0.0028)
  MultiSource/Applications/JM/ldecod/ldecod: -12.32% (8.6720 => 7.6033, std.dev.: 0.0116)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.24% (0.9461 => 0.8303, std.dev.: 0.0031)
  MultiSource/Applications/ClamAV/clamscan: -11.86% (19.4145 => 17.1113, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.39% (0.1141 => 0.1011, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.24% (0.3655 => 0.3244, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.67% (1.7797 => 1.5898, std.dev.: 0.0203)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -10.32% (0.1947 => 0.1746, std.dev.: 0.0018)
  MultiSource/Applications/sqlite3/sqlite3: -9.51% (19.1635 => 17.3410, std.dev.: 0.0152)
  MultiSource/Benchmarks/Olden/mst/mst: -9.28% (0.1454 => 0.1319, std.dev.: 0.0023)
  MultiSource/Applications/kimwitu++/kc: -7.98% (21.0770 => 19.3941, std.dev.: 0.0928)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.47% (1.7461 => 1.6156, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/bh/bh: -7.38% (0.3603 => 0.3337, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.35% (1.4514 => 1.3447, std.dev.: 0.0374)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -7.32% (0.2432 => 0.2254, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.20% (1.5144 => 1.4054, std.dev.: 0.0389)
  MultiSource/Applications/siod/siod: -7.13% (2.7150 => 2.5213, std.dev.: 0.0033)
  MultiSource/Applications/Burg/burg: -6.56% (1.5733 => 1.4701, std.dev.: 0.0069)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.40% (6.1631 => 5.7689, std.dev.: 0.0714)
  MultiSource/Applications/oggenc/oggenc: -6.34% (6.1121 => 5.7245, std.dev.: 0.0207)
  MultiSource/Applications/JM/lencod/lencod: -6.21% (18.5029 => 17.3533, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.03% (1.5239 => 1.4320, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.00% (1.5426 => 1.4501, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.93% (1.4794 => 1.3917, std.dev.: 0.0067)
  MultiSource/Applications/minisat/minisat: -5.86% (0.8278 => 0.7793, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.85% (1.4333 => 1.3494, std.dev.: 0.0170)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.61% (2.6853 => 2.5346, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.43% (1.4853 => 1.4046, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.39% (1.6226 => 1.5351, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.97% (1.4783 => 1.4048, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.94% (1.4339 => 1.3631, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.91% (1.4940 => 1.4207, std.dev.: 0.0080)
  MultiSource/Applications/lemon/lemon: -4.90% (1.2976 => 1.2340, std.dev.: 0.0049)
  MultiSource/Applications/SPASS/SPASS: -4.74% (17.9111 => 17.0624, std.dev.: 0.0518)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (1.4166 => 1.3514, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (1.4506 => 1.3844, std.dev.: 0.0142)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.38% (0.2923 => 0.2795, std.dev.: 0.0048)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.31% (0.4153 => 0.3974, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.94% (0.7189 => 0.6906, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.84% (1.5479 => 1.4885, std.dev.: 0.0153)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.79% (1.3780 => 1.3258, std.dev.: 0.0042)
  MultiSource/Benchmarks/McCat/09-vor/vor: -2.97% (0.3670 => 0.3561, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.05% (0.6480 => 0.6347, std.dev.: 0.0043)
  MultiSource/Applications/d/make_dparser: -1.35% (3.7722 => 3.7211, std.dev.: 0.0083)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.30% (0.8088 => 0.7983, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -37.96% (0.2134 => 0.1324, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: -36.43% (1.4194 => 0.9023, std.dev.: 0.0178)
  MultiSource/Benchmarks/MallocBench/gs/gs: -33.81% (0.1189 => 0.0787, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.42% (2.1022 => 1.4207, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.88% (0.0816 => 0.0564, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -29.71% (1.0962 => 0.7705, std.dev.: 0.0559)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.32% (0.9545 => 0.6746, std.dev.: 0.0093)
  MultiSource/Applications/JM/ldecod/ldecod: -24.91% (0.0859 => 0.0645, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.75% (6.9552 => 5.2335, std.dev.: 0.3361)
  MultiSource/Applications/minisat/minisat: -20.93% (8.0162 => 6.3382, std.dev.: 0.2296)
  MultiSource/Applications/obsequi/Obsequi: -14.80% (2.6081 => 2.2221, std.dev.: 0.0686)
  MultiSource/Applications/sgefa/sgefa: -12.85% (1.4030 => 1.2227, std.dev.: 0.0003)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.84% (47.2250 => 41.6353, std.dev.: 1.5451)
  MultiSource/Applications/SPASS/SPASS: -11.33% (9.2220 => 8.1772, std.dev.: 0.0364)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -10.18% (0.3557 => 0.3195, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -10.07% (1.6121 => 1.4497, std.dev.: 0.0624)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.48% (0.3649 => 0.3303, std.dev.: 0.0111)
  MultiSource/Benchmarks/Olden/health/health: -6.50% (0.3556 => 0.3325, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.02% (1.5339 => 1.4416, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.17% (1.7207 => 1.6317, std.dev.: 0.0147)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.31% (0.7355 => 0.7038, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/bh/bh: -4.10% (2.4879 => 2.3860, std.dev.: 0.0096)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.00% (0.5173 => 0.4966, std.dev.: 0.0044)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.77% (2.7049 => 2.6028, std.dev.: 0.0258)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.68% (2.8052 => 2.7021, std.dev.: 0.0249)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.44% (21.6864 => 20.9400, std.dev.: 0.0526)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.24% (5.2218 => 5.0525, std.dev.: 0.0120)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.09% (0.4783 => 0.4635, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.09% (1.1024 => 1.0683, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9618, std.dev.: 0.0150)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.53% (29.8131 => 29.0598, std.dev.: 0.0414)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.70% (4.0200 => 3.9517, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.46% (5.8810 => 5.7953, std.dev.: 0.0222)
  SingleSource/Benchmarks/Misc/oourafft: -1.36% (3.7891 => 3.7377, std.dev.: 0.0047)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.24% (0.1378 => 0.1292, std.dev.: 0.0031)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130726/e4eef623/attachment.html>


More information about the llvm-testresults mailing list