[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Aug 9 22:36:39 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14275?compare_to=14272&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14275, Order: 188128, Start Time: 2013-08-10 03:54:01, End Time: 2013-08-10 05:38:33
To: 14272, Order: 188126, Start Time: 2013-08-10 01:48:15, End Time: 2013-08-10 03:32:56
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 11 (37 on baseline)
Performance Improvements: 2 (79 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1092 (989 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Applications/sgefa/sgefa: 2.81% (0.4128 => 0.4244, std.dev.: 0.0025)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.74% (0.6193 => 0.6301, std.dev.: 0.0006)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/matrix: 18.77% (1.7689 => 2.1010, std.dev.: 0.0032)
SingleSource/Benchmarks/Shootout/nestedloop: 15.79% (0.1381 => 0.1599, std.dev.: 0.0003)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.36% (0.8327 => 0.8940, std.dev.: 0.0020)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (0.4891 => 0.5146, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/EH/except: 4.80% (0.4688 => 0.4913, std.dev.: 0.0042)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.96% (0.4323 => 0.4494, std.dev.: 0.0023)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (2.5605 => 2.6320, std.dev.: 0.0011)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.62% (1.2639 => 1.2844, std.dev.: 0.0028)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.61% (4.5063 => 4.5787, std.dev.: 0.0067)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.10% (1.3883 => 1.3730, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.59% (4.4871 => 4.4156, std.dev.: 0.0274)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: -2.57% (0.1361 => 0.1326, std.dev.: 0.0230)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (0.2687 => 0.2747, std.dev.: 0.0291)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.57% (0.0254 => 0.0217, std.dev.: 0.0091)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.35% (0.2813 => 0.2747, std.dev.: 0.0291)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.10% (0.0345 => 0.0217, std.dev.: 0.0091)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/bigstack: 42.49% (0.0466 => 0.0664, std.dev.: 0.0003)
SingleSource/Benchmarks/Misc/oourafft: 4.38% (0.2284 => 0.2384, std.dev.: 0.0003)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 72.84% (3.7285 => 6.4443, std.dev.: 0.0924)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.41% (2.8867 => 4.2842, std.dev.: 0.0398)
SingleSource/Benchmarks/Shootout/hash: 25.89% (4.1846 => 5.2681, std.dev.: 0.1360)
SingleSource/Benchmarks/Shootout/matrix: 21.04% (1.7358 => 2.1010, std.dev.: 0.0032)
SingleSource/Benchmarks/Shootout/nestedloop: 17.23% (0.1364 => 0.1599, std.dev.: 0.0003)
SingleSource/Benchmarks/Shootout-C++/hash: 16.06% (0.6295 => 0.7306, std.dev.: 0.0206)
SingleSource/Benchmarks/Shootout-C++/ackermann: 12.56% (2.9428 => 3.3125, std.dev.: 0.1009)
MultiSource/Applications/lambda-0_1_3/lambda: 10.85% (7.0762 => 7.8443, std.dev.: 0.0435)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (14.9584 => 16.5441, std.dev.: 0.3090)
MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9469, std.dev.: 0.0651)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.28% (48.3256 => 52.3272, std.dev.: 0.2811)
SingleSource/Benchmarks/McGill/chomp: 7.08% (1.0051 => 1.0763, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.87% (3.2027 => 3.4228, std.dev.: 0.0011)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6228, std.dev.: 0.0056)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.84% (0.4246 => 0.4494, std.dev.: 0.0023)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.62% (3.4085 => 3.5999, std.dev.: 0.0366)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8015, std.dev.: 0.0176)
MultiSource/Applications/siod/siod: 4.46% (3.3761 => 3.5268, std.dev.: 0.0442)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.23% (5.1471 => 5.3650, std.dev.: 0.0750)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.13% (4.3151 => 4.4934, std.dev.: 0.0045)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.80% (3.3384 => 3.4653, std.dev.: 0.0422)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.31% (6.1245 => 6.3272, std.dev.: 0.0307)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8390, std.dev.: 0.0070)
SingleSource/Benchmarks/Misc/whetstone: 2.96% (3.4559 => 3.5581, std.dev.: 0.0182)
MultiSource/Applications/spiff/spiff: 2.93% (2.7609 => 2.8418, std.dev.: 0.0029)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.83% (3.3877 => 3.4837, std.dev.: 0.0274)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.78% (1.3104 => 1.3468, std.dev.: 0.0012)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (2.5636 => 2.6320, std.dev.: 0.0011)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.61% (4.4624 => 4.5787, std.dev.: 0.0067)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (4.8739 => 4.9867, std.dev.: 0.0165)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.11% (12.8625 => 13.1345, std.dev.: 0.0211)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (3.3464 => 3.4071, std.dev.: 0.0011)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.62% (1.2639 => 1.2844, std.dev.: 0.0028)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.08% (1.1618 => 1.1743, std.dev.: 0.0015)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -34.38% (0.2237 => 0.1468, std.dev.: 0.0137)
MultiSource/Benchmarks/Olden/tsp/tsp: -22.83% (0.1818 => 0.1403, std.dev.: 0.0140)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.30% (1.5228 => 1.2136, std.dev.: 0.0835)
MultiSource/Applications/obsequi/Obsequi: -19.01% (1.4685 => 1.1894, std.dev.: 0.0080)
MultiSource/Applications/lua/lua: -17.33% (5.3200 => 4.3983, std.dev.: 0.1840)
MultiSource/Applications/hbd/hbd: -17.31% (2.0193 => 1.6698, std.dev.: 0.0963)
MultiSource/Benchmarks/Olden/em3d/em3d: -14.11% (0.2367 => 0.2033, std.dev.: 0.0043)
MultiSource/Applications/sgefa/sgefa: -11.75% (0.4809 => 0.4244, std.dev.: 0.0025)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.14% (0.7091 => 0.6301, std.dev.: 0.0006)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.46% (1.7797 => 1.5936, std.dev.: 0.0697)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.64% (1.1012 => 0.9950, std.dev.: 0.0158)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.13% (1.4514 => 1.3479, std.dev.: 0.0019)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.97% (0.2498 => 0.2324, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.96% (1.5426 => 1.4352, std.dev.: 0.0090)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.94% (1.5144 => 1.4093, std.dev.: 0.0024)
MultiSource/Applications/SIBsim4/SIBsim4: -6.50% (1.7461 => 1.6326, std.dev.: 0.0082)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.33% (1.4794 => 1.3858, std.dev.: 0.0113)
MultiSource/Applications/siod/siod: -6.25% (2.7150 => 2.5454, std.dev.: 0.0288)
MultiSource/Applications/Burg/burg: -5.95% (1.5733 => 1.4797, std.dev.: 0.0102)
MultiSource/Applications/JM/lencod/lencod: -5.89% (18.5029 => 17.4126, std.dev.: 0.1797)
MultiSource/Benchmarks/PAQ8p/paq8p: -5.71% (2.6853 => 2.5319, std.dev.: 0.0142)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (1.4333 => 1.3522, std.dev.: 0.0114)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.49% (1.5437 => 1.4589, std.dev.: 0.0134)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.29% (1.4853 => 1.4068, std.dev.: 0.0080)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.05% (1.5361 => 1.4585, std.dev.: 0.0070)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.85% (1.4339 => 1.3643, std.dev.: 0.0136)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.84% (1.4721 => 1.4009, std.dev.: 0.0066)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.81% (1.4166 => 1.3484, std.dev.: 0.0121)
MultiSource/Benchmarks/Olden/bh/bh: -4.77% (0.3603 => 0.3431, std.dev.: 0.0003)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.44% (27.6418 => 26.4149, std.dev.: 0.1136)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.88% (1.4947 => 1.4367, std.dev.: 0.0068)
MultiSource/Benchmarks/McCat/18-imp/imp: -3.76% (0.4153 => 0.3997, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.58% (1.5479 => 1.4925, std.dev.: 0.0157)
MultiSource/Applications/SPASS/SPASS: -3.46% (17.9111 => 17.2916, std.dev.: 0.1648)
MultiSource/Benchmarks/Bullet/bullet: -3.13% (37.4863 => 36.3119, std.dev.: 0.0691)
MultiSource/Benchmarks/7zip/7zip-benchmark: -2.60% (49.1253 => 47.8466, std.dev.: 0.1894)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.30% (1.3649 => 1.3335, std.dev.: 0.0011)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.87% (1.3946 => 1.3685, std.dev.: 0.0069)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.59% (1.3952 => 1.3730, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -38.26% (1.4194 => 0.8764, std.dev.: 0.1356)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -37.66% (0.0316 => 0.0197, std.dev.: 0.0035)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.42% (2.1022 => 1.4207, std.dev.: 0.0036)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.17% (0.0816 => 0.0578, std.dev.: 0.0074)
MultiSource/Benchmarks/MallocBench/gs/gs: -28.17% (0.1189 => 0.0854, std.dev.: 0.0028)
MultiSource/Applications/viterbi/viterbi: -27.08% (3.4923 => 2.5465, std.dev.: 0.0188)
MultiSource/Applications/JM/ldecod/ldecod: -25.61% (0.0859 => 0.0639, std.dev.: 0.0043)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2422, std.dev.: 0.0067)
SingleSource/Benchmarks/Misc/perlin: -21.50% (4.5989 => 3.6101, std.dev.: 0.0028)
MultiSource/Applications/obsequi/Obsequi: -18.73% (2.6081 => 2.1196, std.dev.: 0.1698)
SingleSource/Benchmarks/Misc/mandel: -14.53% (1.1996 => 1.0253, std.dev.: 0.0030)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.00% (0.3557 => 0.3130, std.dev.: 0.0059)
SingleSource/Benchmarks/Shootout/strcat: -9.98% (0.1593 => 0.1434, std.dev.: 0.0033)
SingleSource/Benchmarks/CoyoteBench/fftbench: -9.53% (1.6121 => 1.4585, std.dev.: 0.0214)
MultiSource/Applications/SIBsim4/SIBsim4: -8.09% (3.5791 => 3.2896, std.dev.: 0.0257)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.27% (1.7207 => 1.6300, std.dev.: 0.0162)
MultiSource/Applications/lua/lua: -4.88% (31.0707 => 29.5531, std.dev.: 0.1293)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.88% (3.8119 => 3.6260, std.dev.: 0.0028)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.74% (0.3773 => 0.3594, std.dev.: 0.0039)
SingleSource/Benchmarks/Misc/fbench: -4.74% (4.9602 => 4.7250, std.dev.: 0.0098)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.71% (1.1024 => 1.0505, std.dev.: 0.0049)
MultiSource/Benchmarks/Bullet/bullet: -4.65% (7.2995 => 6.9602, std.dev.: 0.0565)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.47% (0.7355 => 0.7026, std.dev.: 0.0017)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.43% (6.0444 => 5.8370, std.dev.: 0.0304)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.41% (21.6864 => 20.9478, std.dev.: 0.0942)
SingleSource/Benchmarks/Stanford/FloatMM: -3.34% (0.7806 => 0.7545, std.dev.: 0.0052)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0002)
MultiSource/Benchmarks/Olden/bh/bh: -2.91% (2.4879 => 2.4155, std.dev.: 0.0068)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.84% (5.2218 => 5.0737, std.dev.: 0.0083)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (41.0210 => 39.9474, std.dev.: 0.3871)
MultiSource/Applications/sgefa/sgefa: -2.35% (1.4030 => 1.3700, std.dev.: 0.0019)
MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.21% (2.7049 => 2.6452, std.dev.: 0.0187)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.20% (29.8131 => 29.1571, std.dev.: 0.0908)
SingleSource/Benchmarks/Misc/oourafft: -2.16% (3.7891 => 3.7071, std.dev.: 0.0012)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1379, std.dev.: 0.0011)
MultiSource/Benchmarks/mafft/pairlocalalign: -1.60% (47.2250 => 46.4712, std.dev.: 0.1601)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.59% (5.0180 => 4.9382, std.dev.: 0.0051)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.56% (5.8810 => 5.7890, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout/heapsort: -1.53% (2.9123 => 2.8678, std.dev.: 0.0085)
SingleSource/Benchmarks/Shootout-C++/lists: -1.38% (16.5294 => 16.3006, std.dev.: 0.0233)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -3.77% (0.1378 => 0.1326, std.dev.: 0.0230)
Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130810/4af24e1e/attachment.html>
More information about the llvm-testresults
mailing list