[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Aug 8 08:11:52 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14216?compare_to=14213&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14216, Order: 187977, Start Time: 2013-08-08 13:30:04, End Time: 2013-08-08 15:13:45
To: 14213, Order: 187974, Start Time: 2013-08-08 11:23:04, End Time: 2013-08-08 13:08:47
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 14 (37 on baseline)
Performance Improvements: 1 (79 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1090 (989 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/Vector/constpool: 3.80% (8.6837 => 9.0136, std.dev.: 0.0100)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.6854 => 0.6961, std.dev.: 0.0026)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.11% (1.4799 => 1.4964, std.dev.: 0.0024)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.77% (4.6446 => 5.4700, std.dev.: 0.0033)
SingleSource/Benchmarks/Misc/lowercase: 6.78% (0.7777 => 0.8304, std.dev.: 0.0018)
SingleSource/Benchmarks/Linpack/linpack-pc: 6.35% (49.0574 => 52.1736, std.dev.: 0.3151)
SingleSource/Benchmarks/Stanford/Puzzle: 5.71% (0.1838 => 0.1943, std.dev.: 0.0000)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.33% (3.0998 => 3.2651, std.dev.: 0.0034)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.09% (4.8561 => 5.1034, std.dev.: 0.0210)
MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (44.8791 => 46.4774, std.dev.: 0.1394)
SingleSource/Benchmarks/McGill/queens: 1.55% (1.6563 => 1.6819, std.dev.: 0.0016)
SingleSource/Benchmarks/Shootout-C++/methcall: 1.39% (11.4240 => 11.5824, std.dev.: 0.0412)
SingleSource/Benchmarks/Stanford/FloatMM: 1.37% (0.7514 => 0.7617, std.dev.: 0.0025)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (4.4208 => 4.4756, std.dev.: 0.0056)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.27% (4.5473 => 4.4894, std.dev.: 0.0018)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: -3.16% (0.1360 => 0.1317, std.dev.: 0.0008)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.81% (0.2727 => 0.2749, std.dev.: 0.0209)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0278 => 0.0278, std.dev.: 0.0068)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.28% (0.2813 => 0.2749, std.dev.: 0.0209)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.42% (0.0345 => 0.0278, std.dev.: 0.0068)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/bigstack: 37.55% (0.0466 => 0.0641, std.dev.: 0.0008)
MultiSource/Benchmarks/FreeBench/distray/distray: 17.62% (0.1033 => 0.1215, std.dev.: 0.0006)
SingleSource/UnitTests/Vector/constpool: 1.70% (8.8630 => 9.0136, std.dev.: 0.0100)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.14% (3.7285 => 6.2320, std.dev.: 0.0105)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2880, std.dev.: 0.0374)
MultiSource/Benchmarks/FreeBench/neural/neural: 32.07% (0.3171 => 0.4188, std.dev.: 0.0103)
SingleSource/Benchmarks/Shootout/hash: 23.75% (4.1846 => 5.1784, std.dev.: 0.0593)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.44% (4.6576 => 5.4700, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout-C++/hash: 15.90% (0.6295 => 0.7296, std.dev.: 0.0208)
SingleSource/Benchmarks/Stanford/Puzzle: 13.56% (0.1711 => 0.1943, std.dev.: 0.0000)
MultiSource/Applications/JM/lencod/lencod: 12.66% (7.1799 => 8.0889, std.dev.: 0.2369)
MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (7.0762 => 7.8388, std.dev.: 0.0062)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.30% (0.1678 => 0.1834, std.dev.: 0.0021)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.36% (5.4910 => 5.9500, std.dev.: 0.0216)
SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1736, std.dev.: 0.3151)
MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3551, std.dev.: 0.0054)
SingleSource/Benchmarks/McGill/chomp: 7.89% (1.0051 => 1.0844, std.dev.: 0.0022)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.88% (3.2027 => 3.4230, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.42% (3.0680 => 3.2651, std.dev.: 0.0034)
SingleSource/Benchmarks/McGill/misr: 6.18% (0.3674 => 0.3901, std.dev.: 0.0001)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6229, std.dev.: 0.0131)
SingleSource/Benchmarks/Misc/lowercase: 5.80% (0.7849 => 0.8304, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.79% (3.4085 => 3.6058, std.dev.: 0.0333)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.63% (5.5008 => 5.8104, std.dev.: 0.1029)
MultiSource/Benchmarks/FreeBench/mason/mason: 4.97% (0.2799 => 0.2938, std.dev.: 0.0047)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3661, std.dev.: 0.0714)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.3151 => 4.4983, std.dev.: 0.0129)
SingleSource/Benchmarks/Misc/whetstone: 3.79% (3.4559 => 3.5868, std.dev.: 0.0058)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.68% (3.3384 => 3.4611, std.dev.: 0.0020)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.66% (4.9231 => 5.1034, std.dev.: 0.0210)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8386, std.dev.: 0.1592)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.02% (4.8739 => 5.0209, std.dev.: 0.0123)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.81% (3.3877 => 3.4828, std.dev.: 0.0261)
SingleSource/Benchmarks/Shootout/matrix: 2.05% (1.7358 => 1.7714, std.dev.: 0.0035)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.80% (12.8625 => 13.0944, std.dev.: 0.0378)
SingleSource/Benchmarks/McGill/queens: 1.71% (1.6536 => 1.6819, std.dev.: 0.0016)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.34% (1.1618 => 1.1774, std.dev.: 0.0009)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -33.88% (0.2237 => 0.1479, std.dev.: 0.0119)
MultiSource/Benchmarks/Olden/bisort/bisort: -30.60% (0.1072 => 0.0744, std.dev.: 0.0032)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -26.42% (0.0439 => 0.0323, std.dev.: 0.0014)
MultiSource/Benchmarks/MallocBench/gs/gs: -21.90% (6.0938 => 4.7592, std.dev.: 0.1736)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.54% (0.1114 => 0.0874, std.dev.: 0.0062)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.62% (1.5228 => 1.2088, std.dev.: 0.0146)
MultiSource/Benchmarks/Olden/health/health: -20.42% (0.1993 => 0.1586, std.dev.: 0.0129)
MultiSource/Applications/obsequi/Obsequi: -19.13% (1.4685 => 1.1876, std.dev.: 0.0017)
MultiSource/Applications/lua/lua: -17.53% (5.3200 => 4.3873, std.dev.: 0.0234)
MultiSource/Applications/hbd/hbd: -17.24% (2.0193 => 1.6711, std.dev.: 0.0035)
MultiSource/Applications/hexxagon/hexxagon: -16.28% (1.3285 => 1.1122, std.dev.: 0.0073)
MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.46% (1.3985 => 1.2102, std.dev.: 0.0238)
MultiSource/Applications/sgefa/sgefa: -13.18% (0.4809 => 0.4175, std.dev.: 0.0145)
MultiSource/Applications/ClamAV/clamscan: -11.67% (19.4145 => 17.1494, std.dev.: 0.1014)
MultiSource/Applications/lambda-0_1_3/lambda: -11.50% (0.9461 => 0.8373, std.dev.: 0.0011)
MultiSource/Applications/sqlite3/sqlite3: -9.77% (19.1635 => 17.2917, std.dev.: 0.1531)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.49% (0.3655 => 0.3308, std.dev.: 0.0034)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.24% (1.5144 => 1.4048, std.dev.: 0.0168)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.21% (1.5426 => 1.4314, std.dev.: 0.0153)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.62% (1.4794 => 1.3815, std.dev.: 0.0157)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.17% (1.5345 => 1.4398, std.dev.: 0.0201)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (1.4333 => 1.3475, std.dev.: 0.0250)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.87% (1.5239 => 1.4345, std.dev.: 0.0180)
MultiSource/Benchmarks/Olden/bh/bh: -5.80% (0.3603 => 0.3394, std.dev.: 0.0034)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.70% (1.5437 => 1.4557, std.dev.: 0.0153)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.48% (1.6226 => 1.5337, std.dev.: 0.0196)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.38% (1.5815 => 1.4964, std.dev.: 0.0024)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.32% (27.6418 => 26.1710, std.dev.: 0.1197)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.15% (1.4166 => 1.3436, std.dev.: 0.0149)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -4.94% (0.2226 => 0.2116, std.dev.: 0.0043)
MultiSource/Applications/lemon/lemon: -4.84% (1.2976 => 1.2348, std.dev.: 0.0080)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.52% (1.4940 => 1.4264, std.dev.: 0.0043)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.02% (1.5479 => 1.4856, std.dev.: 0.0132)
MultiSource/Benchmarks/Bullet/bullet: -3.78% (37.4863 => 36.0686, std.dev.: 0.2173)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.67% (1.5629 => 1.5056, std.dev.: 0.0094)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.56% (1.4783 => 1.4256, std.dev.: 0.0112)
MultiSource/Benchmarks/7zip/7zip-benchmark: -3.54% (49.1253 => 47.3858, std.dev.: 0.0668)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.7189 => 0.6961, std.dev.: 0.0026)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.12% (1.4947 => 1.4481, std.dev.: 0.0069)
MultiSource/Benchmarks/McCat/18-imp/imp: -2.89% (0.4153 => 0.4033, std.dev.: 0.0005)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.40% (10.3031 => 10.0558, std.dev.: 0.0897)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode: -49.05% (0.0316 => 0.0161, std.dev.: 0.0040)
MultiSource/Applications/lemon/lemon: -37.66% (1.4194 => 0.8848, std.dev.: 0.0280)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.40% (2.1022 => 1.4210, std.dev.: 0.0037)
MultiSource/Benchmarks/MallocBench/gs/gs: -31.03% (0.1189 => 0.0820, std.dev.: 0.0055)
MultiSource/Benchmarks/Olden/bisort/bisort: -29.57% (0.9545 => 0.6723, std.dev.: 0.0921)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.04% (0.0816 => 0.0579, std.dev.: 0.0001)
MultiSource/Applications/viterbi/viterbi: -26.46% (3.4923 => 2.5683, std.dev.: 0.0120)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2408, std.dev.: 0.3381)
MultiSource/Applications/JM/ldecod/ldecod: -24.33% (0.0859 => 0.0650, std.dev.: 0.0017)
SingleSource/Benchmarks/Misc/perlin: -21.54% (4.5989 => 3.6081, std.dev.: 0.0026)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.80% (0.0884 => 0.0709, std.dev.: 0.0032)
MultiSource/Applications/obsequi/Obsequi: -18.59% (2.6081 => 2.1233, std.dev.: 0.0684)
SingleSource/Benchmarks/Misc/pi: -16.83% (1.9835 => 1.6497, std.dev.: 0.0066)
SingleSource/Benchmarks/Misc/mandel: -14.60% (1.1996 => 1.0244, std.dev.: 0.0029)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.00% (0.3557 => 0.3130, std.dev.: 0.0088)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.74% (0.5173 => 0.4721, std.dev.: 0.0125)
MultiSource/Benchmarks/McCat/09-vor/vor: -8.55% (0.1181 => 0.1080, std.dev.: 0.0020)
SingleSource/Benchmarks/Shootout-C++/EH/except: -5.82% (0.4969 => 0.4680, std.dev.: 0.0046)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.33% (1.7207 => 1.6290, std.dev.: 0.0239)
SingleSource/Regression/C/uint64_to_float: -5.14% (1.5184 => 1.4404, std.dev.: 0.0045)
MultiSource/Applications/lua/lua: -5.07% (31.0707 => 29.4965, std.dev.: 0.2125)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.80% (0.7355 => 0.7002, std.dev.: 0.0028)
MultiSource/Benchmarks/Bullet/bullet: -4.61% (7.2995 => 6.9633, std.dev.: 0.0681)
MultiSource/Benchmarks/PAQ8p/paq8p: -4.07% (93.6732 => 89.8562, std.dev.: 1.2086)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.07% (1.1024 => 1.0575, std.dev.: 0.0089)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.04% (2.8052 => 2.6920, std.dev.: 0.0235)
SingleSource/Benchmarks/Misc/fbench: -3.87% (4.9602 => 4.7680, std.dev.: 0.0014)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.19% (21.6864 => 20.9954, std.dev.: 0.0891)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.17% (5.2218 => 5.0563, std.dev.: 0.0206)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9617, std.dev.: 0.0165)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.59% (29.8131 => 29.0423, std.dev.: 0.0914)
SingleSource/Benchmarks/Stanford/FloatMM: -2.42% (0.7806 => 0.7617, std.dev.: 0.0025)
SingleSource/Benchmarks/Misc/oourafft: -2.14% (3.7891 => 3.7080, std.dev.: 0.0002)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1384, std.dev.: 0.0209)
MultiSource/Benchmarks/mafft/pairlocalalign: -1.58% (47.2250 => 46.4774, std.dev.: 0.1394)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.48% (5.8810 => 5.7939, std.dev.: 0.0295)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.37% (4.5517 => 4.4894, std.dev.: 0.0018)
SingleSource/Benchmarks/Shootout-C++/lists: -1.10% (16.5294 => 16.3472, std.dev.: 0.0469)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -4.43% (0.1378 => 0.1317, std.dev.: 0.0008)
Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130808/53e9bdee/attachment.html>
More information about the llvm-testresults
mailing list