[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Oct 8 18:40:15 PDT 2013
http://llvm.org/perf/db_default/v4/nts/16121?compare_to=16118&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 16121, Order: 192247, Start Time: 2013-10-08 23:50:16, End Time: 2013-10-09 01:43:14
To: 16118, Order: 192232, Start Time: 2013-10-08 21:31:18, End Time: 2013-10-08 23:24:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 45 (63 on baseline)
Performance Improvements: 19 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1043 (1028 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/15-trie/trie: 45.09% (0.0723 => 0.1049, std.dev.: 0.0057)
MultiSource/Applications/hbd/hbd: 35.76% (1.6024 => 2.1754, std.dev.: 0.1133)
MultiSource/Applications/ClamAV/clamscan: 25.52% (17.0507 => 21.4013, std.dev.: 0.5921)
MultiSource/Applications/JM/ldecod/ldecod: 19.83% (7.7164 => 9.2464, std.dev.: 0.3144)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.99% (0.3008 => 0.3519, std.dev.: 0.0146)
MultiSource/Applications/JM/lencod/lencod: 13.42% (17.4049 => 19.7402, std.dev.: 0.7988)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.01% (1.4011 => 1.5834, std.dev.: 0.0450)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 12.69% (1.2846 => 1.4476, std.dev.: 0.0027)
MultiSource/Applications/oggenc/oggenc: 10.92% (5.4863 => 6.0852, std.dev.: 0.0845)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.37% (1.3195 => 1.4563, std.dev.: 0.0528)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 10.10% (1.2718 => 1.4002, std.dev.: 0.0289)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.52% (1.3171 => 1.4425, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.36% (1.3103 => 1.4329, std.dev.: 0.0163)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.98% (1.2774 => 1.3921, std.dev.: 0.0342)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.37% (1.3583 => 1.4720, std.dev.: 0.0148)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.84% (0.1645 => 0.1774, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.43% (1.2365 => 1.3284, std.dev.: 0.0124)
MultiSource/Benchmarks/PAQ8p/paq8p: 6.69% (2.7031 => 2.8840, std.dev.: 0.0304)
MultiSource/Applications/lemon/lemon: 5.33% (1.2808 => 1.3491, std.dev.: 0.0077)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (0.9882 => 1.0002, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 60.64% (0.2068 => 0.3322, std.dev.: 0.0116)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 47.17% (0.1342 => 0.1975, std.dev.: 0.0107)
MultiSource/Applications/oggenc/oggenc: 34.13% (0.1626 => 0.2181, std.dev.: 0.0091)
MultiSource/Applications/minisat/minisat: 30.62% (6.7168 => 8.7732, std.dev.: 0.1711)
MultiSource/Applications/SPASS/SPASS: 26.46% (8.4772 => 10.7199, std.dev.: 0.1663)
MultiSource/Applications/obsequi/Obsequi: 11.43% (2.3729 => 2.6442, std.dev.: 0.0210)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.36% (1.4275 => 1.5611, std.dev.: 0.0359)
MultiSource/Applications/JM/lencod/lencod: 4.69% (7.5937 => 7.9495, std.dev.: 0.0134)
MultiSource/Applications/SIBsim4/SIBsim4: 3.40% (3.5285 => 3.6484, std.dev.: 0.0305)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.07% (2.1232 => 2.1884, std.dev.: 0.0134)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (3.1279 => 3.2162, std.dev.: 0.0052)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.65% (5.0295 => 5.1630, std.dev.: 0.0109)
SingleSource/Benchmarks/Shootout-C++/lists: 2.63% (15.8479 => 16.2654, std.dev.: 0.0854)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.61% (0.4524 => 0.4642, std.dev.: 0.0016)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.15% (5.7180 => 5.8412, std.dev.: 0.0392)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.09% (2.5050 => 2.5574, std.dev.: 0.0193)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.04% (1.6460 => 1.6795, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.92% (5.7725 => 5.8832, std.dev.: 0.0204)
SingleSource/Benchmarks/Shootout-C++/methcall: 1.86% (12.2704 => 12.4989, std.dev.: 0.0488)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.80% (6.7015 => 6.8218, std.dev.: 0.0038)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.75% (1.0471 => 1.0654, std.dev.: 0.0032)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.54% (3.5693 => 3.6241, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.51% (4.9341 => 5.0088, std.dev.: 0.0253)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.21% (3.7810 => 3.8266, std.dev.: 0.0059)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.11% (5.3172 => 5.3760, std.dev.: 0.0181)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -38.68% (0.0967 => 0.0593, std.dev.: 0.0137)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -29.87% (0.1386 => 0.0972, std.dev.: 0.0048)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -24.58% (6.8004 => 5.1287, std.dev.: 0.1649)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -22.37% (0.4131 => 0.3207, std.dev.: 0.0208)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -21.59% (0.2098 => 0.1645, std.dev.: 0.0069)
MultiSource/Benchmarks/mafft/pairlocalalign: -14.11% (12.0783 => 10.3741, std.dev.: 0.2652)
MultiSource/Benchmarks/7zip/7zip-benchmark: -12.59% (54.7680 => 47.8712, std.dev.: 1.5802)
MultiSource/Applications/aha/aha: -10.32% (0.1521 => 0.1364, std.dev.: 0.0053)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -10.07% (0.5699 => 0.5125, std.dev.: 0.0173)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.34% (0.1220 => 0.1106, std.dev.: 0.0043)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.18% (2.0608 => 1.9541, std.dev.: 0.0317)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -16.93% (0.0691 => 0.0574, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -16.82% (0.1849 => 0.1538, std.dev.: 0.0006)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.80% (0.2107 => 0.1753, std.dev.: 0.0075)
MultiSource/Benchmarks/7zip/7zip-benchmark: -13.89% (11.4306 => 9.8431, std.dev.: 0.2023)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.82% (2.9646 => 2.6736, std.dev.: 0.0421)
MultiSource/Benchmarks/Bullet/bullet: -3.26% (7.3760 => 7.1354, std.dev.: 0.0099)
MultiSource/Benchmarks/Prolangs-C++/life/life: -2.82% (2.5809 => 2.5082, std.dev.: 0.0184)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.82% (3.6122 => 3.5466, std.dev.: 0.0241)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 10.14% (0.1361 => 0.1499, std.dev.: 0.0316)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/15-trie/trie: 70.02% (0.0617 => 0.1049, std.dev.: 0.0057)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 59.86% (0.1333 => 0.2131, std.dev.: 0.0216)
MultiSource/Applications/hbd/hbd: 38.60% (1.5696 => 2.1754, std.dev.: 0.1133)
MultiSource/Applications/ClamAV/clamscan: 29.39% (16.5398 => 21.4013, std.dev.: 0.5921)
MultiSource/Applications/JM/ldecod/ldecod: 24.91% (7.4026 => 9.2464, std.dev.: 0.3144)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.01% (0.2908 => 0.3519, std.dev.: 0.0146)
MultiSource/Applications/JM/lencod/lencod: 18.99% (16.5902 => 19.7402, std.dev.: 0.7988)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.32% (1.2235 => 1.4476, std.dev.: 0.0027)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.17% (1.3514 => 1.5834, std.dev.: 0.0450)
MultiSource/Applications/sqlite3/sqlite3: 16.50% (16.2888 => 18.9771, std.dev.: 0.5872)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.78% (0.1597 => 0.1833, std.dev.: 0.0068)
MultiSource/Applications/SPASS/SPASS: 14.46% (16.1646 => 18.5027, std.dev.: 0.7790)
MultiSource/Applications/oggenc/oggenc: 14.09% (5.3339 => 6.0852, std.dev.: 0.0845)
MultiSource/Applications/lemon/lemon: 13.73% (1.1862 => 1.3491, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.74% (1.2086 => 1.3626, std.dev.: 0.0484)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.72% (1.3249 => 1.4934, std.dev.: 0.0476)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.61% (1.2932 => 1.4563, std.dev.: 0.0528)
MultiSource/Benchmarks/PAQ8p/paq8p: 12.37% (2.5666 => 2.8840, std.dev.: 0.0304)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.07% (1.2494 => 1.4002, std.dev.: 0.0289)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.92% (1.3498 => 1.5107, std.dev.: 0.0002)
MultiSource/Applications/kimwitu++/kc: 11.58% (18.3608 => 20.4868, std.dev.: 0.7077)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.12% (1.2981 => 1.4425, std.dev.: 0.0015)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.01% (0.1598 => 0.1774, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.92% (1.2550 => 1.3921, std.dev.: 0.0342)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.67% (1.2948 => 1.4329, std.dev.: 0.0163)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.65% (1.3303 => 1.4720, std.dev.: 0.0148)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.64% (1.2007 => 1.3284, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.39% (1.2250 => 1.3523, std.dev.: 0.0421)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.23% (1.3499 => 1.4745, std.dev.: 0.0385)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.15% (1.0756 => 1.1740, std.dev.: 0.0194)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.92% (1.3042 => 1.3945, std.dev.: 0.0315)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.2601 => 0.2746, std.dev.: 0.0006)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.9494 => 1.0002, std.dev.: 0.0038)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 141.25% (0.1377 => 0.3322, std.dev.: 0.0116)
SingleSource/Benchmarks/Shootout-C++/methcall: 63.54% (7.6426 => 12.4989, std.dev.: 0.0488)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 44.69% (0.1365 => 0.1975, std.dev.: 0.0107)
MultiSource/Applications/minisat/minisat: 39.79% (6.2760 => 8.7732, std.dev.: 0.1711)
MultiSource/Applications/SPASS/SPASS: 30.24% (8.2311 => 10.7199, std.dev.: 0.1663)
MultiSource/Applications/oggenc/oggenc: 28.37% (0.1699 => 0.2181, std.dev.: 0.0091)
MultiSource/Applications/obsequi/Obsequi: 20.83% (2.1884 => 2.6442, std.dev.: 0.0210)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.01% (1.3008 => 1.5611, std.dev.: 0.0359)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.89% (2.3084 => 2.5136, std.dev.: 0.0539)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.01% (2.4753 => 2.6736, std.dev.: 0.0421)
MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (8.1346 => 8.6860, std.dev.: 0.0287)
SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0043)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.67% (0.1871 => 0.1977, std.dev.: 0.0006)
MultiSource/Applications/lua/lua: 4.83% (29.5202 => 30.9469, std.dev.: 0.1297)
MultiSource/Applications/siod/siod: 3.73% (3.5310 => 3.6626, std.dev.: 0.0348)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.92% (3.5683 => 3.6725, std.dev.: 0.0346)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.86% (5.0196 => 5.1630, std.dev.: 0.0109)
MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.7810 => 15.1928, std.dev.: 0.0113)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.62% (2.4920 => 2.5574, std.dev.: 0.0193)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.57% (5.6951 => 5.8412, std.dev.: 0.0392)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.45% (5.0980 => 5.2227, std.dev.: 0.0325)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.92% (2.1472 => 2.1884, std.dev.: 0.0134)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.83% (3.5590 => 3.6241, std.dev.: 0.0077)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.69% (1.0477 => 1.0654, std.dev.: 0.0032)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.64% (5.7884 => 5.8832, std.dev.: 0.0204)
MultiSource/Benchmarks/Bullet/bullet: 1.45% (7.0333 => 7.1354, std.dev.: 0.0099)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.39% (5.3022 => 5.3760, std.dev.: 0.0181)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8218, std.dev.: 0.0038)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.16% (8.8798 => 8.9830, std.dev.: 0.0306)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.04% (3.7874 => 3.8266, std.dev.: 0.0059)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -54.42% (0.5226 => 0.2382, std.dev.: 0.0400)
MultiSource/Applications/sgefa/sgefa: -46.81% (1.5790 => 0.8398, std.dev.: 0.0302)
SingleSource/Benchmarks/Linpack/linpack-pc: -21.79% (57.2347 => 44.7616, std.dev.: 3.6939)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.89% (15.9508 => 13.5754, std.dev.: 0.3418)
SingleSource/UnitTests/Vectorizer/gcc-loops: -11.39% (20.8247 => 18.4534, std.dev.: 0.1763)
MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.3304 => 0.2980, std.dev.: 0.0105)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.99% (3.4956 => 3.2162, std.dev.: 0.0052)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.93% (0.7474 => 0.7180, std.dev.: 0.0064)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.82% (4.3592 => 4.1926, std.dev.: 0.0577)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.32% (2.5938 => 2.5076, std.dev.: 0.0168)
MultiSource/Applications/JM/lencod/lencod: -2.80% (8.1785 => 7.9495, std.dev.: 0.0134)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.70% (17.1431 => 16.6798, std.dev.: 0.0258)
MultiSource/Applications/SIBsim4/SIBsim4: -2.55% (3.7437 => 3.6484, std.dev.: 0.0305)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.23% (2.4471 => 2.3925, std.dev.: 0.0166)
MultiSource/Benchmarks/SciMark2-C/scimark2: -1.20% (89.7126 => 88.6388, std.dev.: 0.1276)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.01% (6.0038 => 5.9431, std.dev.: 0.0181)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 11.20% (0.1348 => 0.1499, std.dev.: 0.0316)
Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/c2c2af0e/attachment.html>
More information about the llvm-testresults
mailing list