[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 4 17:23:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14087?compare_to=14083&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14087, Order: 187710, Start Time: 2013-08-04 22:40:50, End Time: 2013-08-05 00:25:19
      To: 14083, Order: 187709, Start Time: 2013-08-04 18:36:09, End Time: 2013-08-04 20:17:35
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 10 (36 on baseline)
Performance Improvements: 7 (62 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1088 (1007 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.13% (1.5859 => 1.6197, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.67% (1.4494 => 1.4736, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 17.69% (0.4382 => 0.5157, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.60% (1.1808 => 1.2823, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.80% (5.0032 => 5.2934, std.dev.: 0.0171)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (1.1145 => 1.1712, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.25% (4.6979 => 4.8038, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.18% (12.8547 => 13.1354, std.dev.: 0.0213)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.04% (1.6214 => 1.6545, std.dev.: 0.0062)
  MultiSource/Benchmarks/Bullet/bullet: 1.17% (7.0596 => 7.1424, std.dev.: 0.0104)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -12.27% (0.1549 => 0.1359, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/lists: -5.49% (7.6764 => 7.2550, std.dev.: 0.0850)
  SingleSource/Benchmarks/Shootout/sieve: -4.01% (8.1044 => 7.7798, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/methcall: -3.89% (8.9320 => 8.5845, std.dev.: 0.0038)
  MultiSource/Applications/SPASS/SPASS: -2.68% (8.3414 => 8.1182, std.dev.: 0.0803)
  SingleSource/Benchmarks/Misc/ffbench: -1.54% (1.4065 => 1.3849, std.dev.: 0.0060)
  SingleSource/Benchmarks/McGill/chomp: -1.37% (1.0827 => 1.0679, std.dev.: 0.0053)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -7.12% (0.1391 => 0.1292, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.11% (0.2709 => 0.2679, std.dev.: 0.0064)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.34% (0.0244 => 0.0279, std.dev.: 0.0091)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.76% (0.2813 => 0.2679, std.dev.: 0.0064)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0091)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 38.63% (0.0466 => 0.0646, std.dev.: 0.0021)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.10% (0.1033 => 0.1220, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/oourafft: 4.82% (0.2284 => 0.2394, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.12% (3.7285 => 6.2311, std.dev.: 0.1422)
  MultiSource/Benchmarks/FreeBench/neural/neural: 62.63% (0.3171 => 0.5157, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2878, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/hash: 23.29% (4.1846 => 5.1593, std.dev.: 0.2356)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.05% (0.0526 => 0.0642)
  SingleSource/Benchmarks/Misc/pi: 20.35% (1.9835 => 2.3871, std.dev.: 0.0720)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.44% (0.6295 => 0.7267, std.dev.: 0.0199)
  MultiSource/Applications/siod/siod: 13.75% (3.3761 => 3.8402, std.dev.: 0.0458)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.73% (7.0762 => 7.9769, std.dev.: 0.0255)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.41% (14.9584 => 16.2167, std.dev.: 0.3330)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9468, std.dev.: 0.0230)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.99% (48.3256 => 52.1855, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4238, std.dev.: 0.0063)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.75% (1.2012 => 1.2823, std.dev.: 0.0017)
  SingleSource/Benchmarks/McGill/chomp: 6.25% (1.0051 => 1.0679, std.dev.: 0.0053)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.07% (0.2799 => 0.2969, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.98% (5.3042 => 5.6216, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.73% (3.3877 => 3.5817, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.63% (3.4085 => 3.6005, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8019, std.dev.: 0.0710)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.12% (1.1142 => 1.1712, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/whetstone: 4.43% (3.4559 => 3.6091, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3651, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.22% (4.3151 => 4.4972, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4611, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.8739 => 5.0238, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.12% (12.8625 => 13.1354, std.dev.: 0.0213)
  SingleSource/Benchmarks/Shootout/matrix: 2.03% (1.7358 => 1.7710, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/methcall: 1.45% (8.4614 => 8.5845, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.43% (4.7360 => 4.8038, std.dev.: 0.0094)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.35% (1.1618 => 1.1775, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/ffbench: 1.24% (1.3679 => 1.3849, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.12% (4.9040 => 4.9588, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.86% (0.1818 => 0.1366, std.dev.: 0.0128)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.00% (1.5228 => 1.2030, std.dev.: 0.0085)
  MultiSource/Applications/obsequi/Obsequi: -18.88% (1.4685 => 1.1912, std.dev.: 0.0163)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.65% (0.1518 => 0.1250, std.dev.: 0.0029)
  MultiSource/Applications/lua/lua: -17.15% (5.3200 => 4.4074, std.dev.: 0.0221)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.88% (0.0773 => 0.0658, std.dev.: 0.0014)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.20% (1.3985 => 1.1999, std.dev.: 0.0072)
  MultiSource/Applications/sgefa/sgefa: -13.00% (0.4809 => 0.4184, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.82% (0.7091 => 0.6182, std.dev.: 0.0039)
  MultiSource/Applications/ClamAV/clamscan: -11.85% (19.4145 => 17.1139, std.dev.: 0.0568)
  MultiSource/Applications/JM/ldecod/ldecod: -11.44% (8.6720 => 7.6797, std.dev.: 0.0310)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.16% (0.9461 => 0.8405, std.dev.: 0.0370)
  MultiSource/Applications/sqlite3/sqlite3: -9.11% (19.1635 => 17.4171, std.dev.: 0.3592)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.73% (0.2498 => 0.2305, std.dev.: 0.0033)
  MultiSource/Applications/siod/siod: -6.58% (2.7150 => 2.5363, std.dev.: 0.0328)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.47% (1.7461 => 1.6331, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.21% (1.5239 => 1.4293, std.dev.: 0.0310)
  MultiSource/Applications/Burg/burg: -5.78% (1.5733 => 1.4823, std.dev.: 0.0063)
  MultiSource/Applications/oggenc/oggenc: -5.78% (6.1121 => 5.7586, std.dev.: 0.0328)
  MultiSource/Applications/JM/lencod/lencod: -5.59% (18.5029 => 17.4685, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.24% (1.4339 => 1.3587, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.93% (1.4721 => 1.3995, std.dev.: 0.0210)
  MultiSource/Applications/minisat/minisat: -4.89% (0.8278 => 0.7873, std.dev.: 0.0084)
  MultiSource/Applications/SPASS/SPASS: -4.46% (17.9111 => 17.1119, std.dev.: 0.1240)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.18% (1.4940 => 1.4315, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.75% (1.5416 => 1.4992, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.14% (1.4037 => 1.3737, std.dev.: 0.0103)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -45.57% (0.0316 => 0.0172, std.dev.: 0.0034)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.20% (2.1022 => 1.4252, std.dev.: 0.0018)
  MultiSource/Applications/viterbi/viterbi: -27.64% (3.4923 => 2.5271, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2406, std.dev.: 0.0029)
  MultiSource/Applications/JM/ldecod/ldecod: -23.86% (0.0859 => 0.0654, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/perlin: -21.50% (4.5989 => 3.6102, std.dev.: 0.0032)
  MultiSource/Applications/minisat/minisat: -20.18% (8.0162 => 6.3986, std.dev.: 0.2804)
  MultiSource/Applications/obsequi/Obsequi: -15.66% (2.6081 => 2.1996, std.dev.: 0.0604)
  SingleSource/Benchmarks/Misc/mandel: -14.39% (1.1996 => 1.0270, std.dev.: 0.0008)
  MultiSource/Applications/sgefa/sgefa: -13.16% (1.4030 => 1.2184, std.dev.: 0.0032)
  MultiSource/Applications/SPASS/SPASS: -11.97% (9.2220 => 8.1182, std.dev.: 0.0803)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.36% (6.2627 => 5.5511, std.dev.: 0.1783)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.72% (47.2250 => 42.1612, std.dev.: 1.3538)
  SingleSource/Benchmarks/Shootout/strcat: -10.61% (0.1593 => 0.1424, std.dev.: 0.0047)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.17% (3.5791 => 3.2150, std.dev.: 0.0682)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.92% (3.9978 => 3.6014, std.dev.: 0.0491)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.31% (0.4969 => 0.4705, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.64% (0.7355 => 0.7014, std.dev.: 0.0024)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.37% (21.6864 => 20.7392, std.dev.: 0.3421)
  SingleSource/Benchmarks/Misc/fbench: -4.26% (4.9602 => 4.7488, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.85% (1.7207 => 1.6545, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8383, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9613, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.91% (1.1024 => 1.0703, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0739, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.43% (2.8052 => 2.7371, std.dev.: 0.0175)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.33% (8.6172 => 8.4160, std.dev.: 0.0056)
  MultiSource/Benchmarks/Bullet/bullet: -2.15% (7.2995 => 7.1424, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc/oourafft: -2.05% (3.7891 => 3.7115, std.dev.: 0.0004)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.94% (34.8438 => 34.1688, std.dev.: 0.0342)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.85% (4.5517 => 4.4673, std.dev.: 0.0174)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.77% (3.2461 => 3.1888, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.48% (5.8810 => 5.7941, std.dev.: 0.0233)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.23% (1.3104 => 1.2943, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.18% (16.5294 => 16.3351, std.dev.: 0.0214)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.24% (0.1378 => 0.1292, std.dev.: 0.0050)

Report Time: 1.05s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130804/6bf5d129/attachment.html>


More information about the llvm-testresults mailing list