[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Sep 11 16:42:53 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15203?compare_to=15200&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15203, Order: 190547, Start Time: 2013-09-11 21:50:51, End Time: 2013-09-11 23:45:25
To: 15200, Order: 190540, Start Time: 2013-09-11 19:31:44, End Time: 2013-09-11 21:25:15
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 62 (69 on baseline)
Performance Improvements: 14 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1031 (1036 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/NP/np: 87.84% (0.0222 => 0.0417, std.dev.: 0.0005)
SingleSource/Benchmarks/Stanford/Queens: 80.09% (0.0447 => 0.0805, std.dev.: 0.0026)
SingleSource/Regression/C/compare: 70.27% (0.0222 => 0.0378, std.dev.: 0.0018)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 66.33% (0.0986 => 0.1640, std.dev.: 0.0100)
SingleSource/Benchmarks/Stanford/Oscar: 62.72% (0.0692 => 0.1126, std.dev.: 0.0096)
SingleSource/Benchmarks/Stanford/IntMM: 51.79% (0.0502 => 0.0762, std.dev.: 0.0038)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.05% (1.1409 => 1.6206, std.dev.: 0.1695)
MultiSource/Benchmarks/Olden/power/power: 34.33% (0.1401 => 0.1882, std.dev.: 0.0174)
MultiSource/Applications/hbd/hbd: 33.92% (1.5935 => 2.1340, std.dev.: 0.1688)
MultiSource/Benchmarks/McCat/18-imp/imp: 30.94% (0.3882 => 0.5083, std.dev.: 0.0132)
MultiSource/Applications/lua/lua: 28.32% (4.1885 => 5.3747, std.dev.: 0.2220)
MultiSource/Benchmarks/Prolangs-C++/city/city: 25.52% (1.4963 => 1.8782, std.dev.: 0.1323)
MultiSource/Benchmarks/Olden/tsp/tsp: 22.31% (0.1327 => 0.1623, std.dev.: 0.0092)
MultiSource/Applications/treecc/treecc: 22.10% (2.3039 => 2.8131, std.dev.: 0.0909)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.06% (1.2102 => 1.4409, std.dev.: 0.0109)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.68% (1.3289 => 1.5771, std.dev.: 0.0819)
MultiSource/Applications/kimwitu++/kc: 13.99% (18.5763 => 21.1751, std.dev.: 0.1431)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.79% (24.9541 => 28.1463, std.dev.: 0.2766)
MultiSource/Benchmarks/PAQ8p/paq8p: 11.96% (2.5328 => 2.8356, std.dev.: 0.0249)
MultiSource/Applications/lambda-0_1_3/lambda: 11.91% (0.8646 => 0.9676, std.dev.: 0.0315)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.62% (1.3235 => 1.4773, std.dev.: 0.0448)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.55% (1.2207 => 1.3495, std.dev.: 0.0211)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.38% (1.3508 => 1.4910, std.dev.: 0.0524)
SingleSource/Benchmarks/McGill/chomp: 10.36% (0.2192 => 0.2419, std.dev.: 0.0021)
SingleSource/Benchmarks/Shootout-C++/reversefile: 10.06% (0.3519 => 0.3873, std.dev.: 0.0040)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 9.97% (1.2205 => 1.3422, std.dev.: 0.0470)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.63% (1.2539 => 1.3747, std.dev.: 0.0412)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.54% (1.2720 => 1.3933, std.dev.: 0.0401)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.28% (0.1993 => 0.2178, std.dev.: 0.0014)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.72% (1.4661 => 1.5940, std.dev.: 0.0089)
MultiSource/Benchmarks/Prolangs-C++/office/office: 8.71% (0.2135 => 0.2321, std.dev.: 0.0036)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.33% (0.3025 => 0.3277, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.67% (1.2502 => 1.3461, std.dev.: 0.0341)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.52% (1.2246 => 1.3167, std.dev.: 0.0356)
SingleSource/Benchmarks/Misc/oourafft: 7.08% (0.2316 => 0.2480, std.dev.: 0.0018)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.87% (4.2250 => 4.5154, std.dev.: 0.0193)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 122.18% (0.1443 => 0.3206, std.dev.: 0.0121)
SingleSource/Benchmarks/Stanford/Perm: 45.06% (0.0344 => 0.0499, std.dev.: 0.0006)
SingleSource/Benchmarks/Stanford/Quicksort: 42.40% (0.0250 => 0.0356, std.dev.: 0.0036)
MultiSource/Applications/minisat/minisat: 39.23% (6.4061 => 8.9192, std.dev.: 0.1881)
SingleSource/Benchmarks/Stanford/Queens: 38.62% (0.0334 => 0.0463, std.dev.: 0.0006)
MultiSource/Applications/lemon/lemon: 29.92% (1.0926 => 1.4195, std.dev.: 0.0672)
SingleSource/Benchmarks/Shootout-C++/heapsort: 27.89% (3.6971 => 4.7282, std.dev.: 0.1081)
MultiSource/Benchmarks/Olden/bisort/bisort: 22.24% (0.8309 => 1.0157, std.dev.: 0.0162)
MultiSource/Applications/obsequi/Obsequi: 20.92% (2.1968 => 2.6563, std.dev.: 0.0383)
SingleSource/Benchmarks/Shootout-C++/ackermann: 17.63% (3.7539 => 4.4159, std.dev.: 0.1765)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.76% (0.0918 => 0.1026, std.dev.: 0.0004)
MultiSource/Benchmarks/Olden/tsp/tsp: 11.20% (1.5735 => 1.7498, std.dev.: 0.0445)
SingleSource/Benchmarks/McGill/chomp: 9.49% (1.0226 => 1.1196, std.dev.: 0.0351)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.16% (94.5420 => 100.3664, std.dev.: 1.2718)
SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (7.6484 => 8.1027, std.dev.: 0.0298)
MultiSource/Applications/SIBsim4/SIBsim4: 5.88% (3.5994 => 3.8111, std.dev.: 0.0324)
MultiSource/Applications/sqlite3/sqlite3: 5.11% (4.3738 => 4.5972, std.dev.: 0.0191)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.09% (5.9025 => 6.2032, std.dev.: 0.0359)
MultiSource/Applications/lua/lua: 4.40% (29.5730 => 30.8733, std.dev.: 0.3390)
MultiSource/Benchmarks/Olden/bh/bh: 4.35% (2.4114 => 2.5163, std.dev.: 0.0225)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.42% (5.0947 => 5.2688, std.dev.: 0.0469)
MultiSource/Benchmarks/Olden/em3d/em3d: 3.09% (5.0255 => 5.1809, std.dev.: 0.0243)
MultiSource/Benchmarks/Prolangs-C++/life/life: 2.48% (2.5260 => 2.5887, std.dev.: 0.0196)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.45% (5.6953 => 5.8349, std.dev.: 0.0337)
SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (4.0723 => 4.1385, std.dev.: 0.0120)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.52% (5.7838 => 5.8720, std.dev.: 0.0104)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -41.14% (0.2805 => 0.1651, std.dev.: 0.0119)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -40.36% (0.1261 => 0.0752, std.dev.: 0.0068)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -29.13% (0.4446 => 0.3151, std.dev.: 0.0054)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -20.30% (5.7495 => 4.5823, std.dev.: 0.3246)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -19.50% (2.3487 => 1.8908, std.dev.: 0.1497)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -15.64% (5.6948 => 4.8039, std.dev.: 0.3433)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -11.56% (1.4600 => 1.2912, std.dev.: 0.0603)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -20.40% (48.8838 => 38.9119, std.dev.: 2.0480)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.30% (36.3434 => 31.5103, std.dev.: 1.7452)
SingleSource/Benchmarks/Linpack/linpack-pc: -5.43% (58.7081 => 55.5206, std.dev.: 0.8689)
MultiSource/Applications/aha/aha: -4.59% (3.7759 => 3.6025, std.dev.: 0.0341)
SingleSource/Benchmarks/Misc/pi: -4.58% (1.7180 => 1.6393, std.dev.: 0.0267)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.45% (3.8367 => 3.6659, std.dev.: 0.0492)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.06% (5.9871 => 5.9239, std.dev.: 0.0214)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 7.56% (0.1350 => 0.1452, std.dev.: 0.0279)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/NP/np: 96.70% (0.0212 => 0.0417, std.dev.: 0.0005)
SingleSource/Benchmarks/Stanford/Queens: 83.79% (0.0438 => 0.0805, std.dev.: 0.0026)
SingleSource/Benchmarks/Stanford/IntMM: 71.24% (0.0445 => 0.0762, std.dev.: 0.0038)
SingleSource/Benchmarks/Stanford/Oscar: 67.31% (0.0673 => 0.1126, std.dev.: 0.0096)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 67.01% (0.0982 => 0.1640, std.dev.: 0.0100)
SingleSource/Regression/C/compare: 54.29% (0.0245 => 0.0378, std.dev.: 0.0018)
SingleSource/UnitTests/2002-05-02-CastTest: 47.60% (0.0250 => 0.0369, std.dev.: 0.0045)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.25% (1.1393 => 1.6206, std.dev.: 0.1695)
MultiSource/Applications/hbd/hbd: 35.96% (1.5696 => 2.1340, std.dev.: 0.1688)
MultiSource/Benchmarks/Olden/power/power: 34.62% (0.1398 => 0.1882, std.dev.: 0.0174)
MultiSource/Benchmarks/McCat/18-imp/imp: 30.84% (0.3885 => 0.5083, std.dev.: 0.0132)
MultiSource/Applications/lua/lua: 27.24% (4.2242 => 5.3747, std.dev.: 0.2220)
MultiSource/Benchmarks/Prolangs-C++/city/city: 26.97% (1.4792 => 1.8782, std.dev.: 0.1323)
MultiSource/Benchmarks/Olden/tsp/tsp: 25.13% (0.1297 => 0.1623, std.dev.: 0.0092)
MultiSource/Applications/treecc/treecc: 24.94% (2.2516 => 2.8131, std.dev.: 0.0909)
MultiSource/Applications/lambda-0_1_3/lambda: 20.74% (0.8014 => 0.9676, std.dev.: 0.0315)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.78% (1.3278 => 1.5771, std.dev.: 0.0819)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.57% (1.2152 => 1.4409, std.dev.: 0.0109)
SingleSource/Benchmarks/Shootout-C++/ackermann: 16.48% (0.1905 => 0.2219, std.dev.: 0.0106)
MultiSource/Applications/kimwitu++/kc: 15.33% (18.3608 => 21.1751, std.dev.: 0.1431)
MultiSource/Applications/sqlite3/sqlite3: 14.49% (16.2888 => 18.6493, std.dev.: 0.8205)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.35% (24.6139 => 28.1463, std.dev.: 0.2766)
SingleSource/Benchmarks/Misc/richards_benchmark: 13.86% (0.0772 => 0.0879, std.dev.: 0.0017)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.16% (1.9476 => 2.1844, std.dev.: 0.0423)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.78% (4.0397 => 4.5154, std.dev.: 0.0193)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.69% (0.1950 => 0.2178, std.dev.: 0.0014)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.66% (1.2086 => 1.3495, std.dev.: 0.0211)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 11.62% (1.3235 => 1.4773, std.dev.: 0.0448)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.86% (0.2956 => 0.3277, std.dev.: 0.0077)
MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (2.5666 => 2.8356, std.dev.: 0.0249)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 10.33% (1.3514 => 1.4910, std.dev.: 0.0524)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.33% (1.2201 => 1.3461, std.dev.: 0.0341)
SingleSource/Benchmarks/Shootout-C++/hash: 10.30% (0.3971 => 0.4380, std.dev.: 0.0137)
SingleSource/Benchmarks/McGill/chomp: 9.85% (0.2202 => 0.2419, std.dev.: 0.0021)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 9.77% (1.2523 => 1.3747, std.dev.: 0.0412)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.75% (1.2695 => 1.3933, std.dev.: 0.0401)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.66% (1.2007 => 1.3167, std.dev.: 0.0356)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.19% (1.4599 => 1.5940, std.dev.: 0.0089)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.09% (0.8802 => 0.9602, std.dev.: 0.0095)
SingleSource/Benchmarks/Misc/oourafft: 8.11% (0.2294 => 0.2480, std.dev.: 0.0018)
MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.2149 => 0.2321, std.dev.: 0.0036)
SingleSource/Benchmarks/Shootout-C++/reversefile: 7.67% (0.3597 => 0.3873, std.dev.: 0.0040)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.04% (0.3837 => 0.4107, std.dev.: 0.0100)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 132.82% (0.1377 => 0.3206, std.dev.: 0.0121)
SingleSource/Benchmarks/Stanford/Queens: 92.12% (0.0241 => 0.0463, std.dev.: 0.0006)
MultiSource/Applications/lemon/lemon: 66.49% (0.8526 => 1.4195, std.dev.: 0.0672)
SingleSource/Benchmarks/Shootout-C++/heapsort: 57.03% (3.0111 => 4.7282, std.dev.: 0.1081)
SingleSource/Benchmarks/Stanford/Perm: 55.94% (0.0320 => 0.0499, std.dev.: 0.0006)
MultiSource/Benchmarks/Olden/bisort/bisort: 52.81% (0.6647 => 1.0157, std.dev.: 0.0162)
MultiSource/Applications/minisat/minisat: 42.12% (6.2760 => 8.9192, std.dev.: 0.1881)
MultiSource/Applications/obsequi/Obsequi: 21.38% (2.1884 => 2.6563, std.dev.: 0.0383)
MultiSource/Benchmarks/Olden/tsp/tsp: 12.51% (1.5553 => 1.7498, std.dev.: 0.0445)
SingleSource/Benchmarks/McGill/chomp: 10.19% (1.0161 => 1.1196, std.dev.: 0.0351)
MultiSource/Applications/sqlite3/sqlite3: 7.58% (4.2733 => 4.5972, std.dev.: 0.0191)
SingleSource/Benchmarks/Shootout-C++/methcall: 6.02% (7.6426 => 8.1027, std.dev.: 0.0298)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.76% (2.9372 => 3.1064, std.dev.: 0.0362)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.03% (5.9061 => 6.2032, std.dev.: 0.0359)
MultiSource/Benchmarks/Olden/bh/bh: 5.03% (2.3959 => 2.5163, std.dev.: 0.0225)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.94% (4.5744 => 4.8004, std.dev.: 0.0285)
MultiSource/Applications/lua/lua: 4.58% (29.5202 => 30.8733, std.dev.: 0.3390)
MultiSource/Benchmarks/PAQ8p/paq8p: 3.70% (96.7834 => 100.3664, std.dev.: 1.2718)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.35% (5.0980 => 5.2688, std.dev.: 0.0469)
MultiSource/Benchmarks/Olden/em3d/em3d: 3.02% (5.0288 => 5.1809, std.dev.: 0.0243)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.45% (5.6951 => 5.8349, std.dev.: 0.0337)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.19% (3.5683 => 3.6463, std.dev.: 0.0284)
SingleSource/Benchmarks/Misc/himenobmtxpa: 1.94% (4.0596 => 4.1385, std.dev.: 0.0120)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.65% (2.4920 => 2.5332, std.dev.: 0.0098)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.44% (5.7884 => 5.8720, std.dev.: 0.0104)
SingleSource/Benchmarks/McGill/queens: 1.08% (1.7452 => 1.7640, std.dev.: 0.0064)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout/lists: -2.28% (7.3703 => 7.2021, std.dev.: 0.0164)
SingleSource/Benchmarks/Shootout/sieve: -2.23% (7.2254 => 7.0644, std.dev.: 0.0410)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 7.72% (0.1348 => 0.1452, std.dev.: 0.0279)
Report Time: 0.35s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130911/8b7f2866/attachment.html>
More information about the llvm-testresults
mailing list