[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Jun 21 18:56:09 PDT 2013
http://llvm.org/perf/db_default/v4/nts/12628?compare_to=12624&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13
Comparing:
Run: 12628, Order: 184607, Start Time: 2013-06-22 00:05:26, End Time: 2013-06-22 01:57:07
To: 12624, Order: 184596, Start Time: 2013-06-21 21:51:18, End Time: 2013-06-21 23:41:54
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
===============
Tests Summary
===============
Performance Regressions: 42 (70 on baseline)
Performance Improvements: 9 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1056 (1004 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/2003-05-23-TransparentUnion: 76.43% (0.0157 => 0.0277, std.dev.: 0.0006)
SingleSource/Regression/C++/EH/inlined_cleanup: 71.51% (0.0186 => 0.0319, std.dev.: 0.0011)
SingleSource/Regression/C++/EH/simple_throw: 71.43% (0.0168 => 0.0288, std.dev.: 0.0020)
SingleSource/Regression/C++/EH/recursive-throw: 65.61% (0.0253 => 0.0419, std.dev.: 0.0009)
SingleSource/Regression/C/2004-03-15-IndirectGoto: 62.50% (0.0176 => 0.0286, std.dev.: 0.0004)
SingleSource/Regression/C/sumarray2d: 60.82% (0.0439 => 0.0706, std.dev.: 0.0032)
SingleSource/Benchmarks/Shootout/methcall: 58.16% (0.0380 => 0.0601, std.dev.: 0.0011)
SingleSource/Regression/C++/EH/ConditionalExpr: 53.25% (0.0231 => 0.0354, std.dev.: 0.0031)
SingleSource/UnitTests/SignlessTypes/factor: 48.29% (0.0350 => 0.0519, std.dev.: 0.0009)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 46.80% (0.0797 => 0.1170, std.dev.: 0.0035)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 46.68% (0.1009 => 0.1480, std.dev.: 0.0030)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 38.34% (0.0519 => 0.0718, std.dev.: 0.0049)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 37.78% (0.0270 => 0.0372, std.dev.: 0.0039)
SingleSource/Regression/C/test_indvars: 34.55% (0.0301 => 0.0405, std.dev.: 0.0010)
MultiSource/Applications/sgefa/sgefa: 22.88% (0.4218 => 0.5183, std.dev.: 0.0201)
MultiSource/Applications/JM/lencod/lencod: 13.10% (17.0090 => 19.2376, std.dev.: 0.7372)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.89% (5.6491 => 6.3209, std.dev.: 0.1568)
MultiSource/Applications/SPASS/SPASS: 9.08% (17.2793 => 18.8477, std.dev.: 0.2683)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.17% (1.4802 => 1.5568, std.dev.: 0.0167)
MultiSource/Applications/siod/siod: 5.10% (2.5667 => 2.6977, std.dev.: 0.0423)
MultiSource/Applications/kimwitu++/kc: 4.34% (19.3222 => 20.1600, std.dev.: 0.1527)
SingleSource/Benchmarks/Shootout-C++/sieve: 3.34% (0.3087 => 0.3190, std.dev.: 0.0016)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.74% (0.5301 => 0.5446, std.dev.: 0.0044)
MultiSource/Benchmarks/McCat/05-eks/eks: 1.85% (0.5395 => 0.5495, std.dev.: 0.0021)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 78.13% (5.7775 => 10.2917, std.dev.: 0.2697)
SingleSource/Benchmarks/Shootout/heapsort: 55.74% (2.8997 => 4.5161, std.dev.: 0.3654)
MultiSource/Applications/d/make_dparser: 47.68% (0.0388 => 0.0573, std.dev.: 0.0018)
MultiSource/Applications/JM/ldecod/ldecod: 37.09% (0.0666 => 0.0913, std.dev.: 0.0079)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.78% (4.5662 => 5.7433, std.dev.: 0.2308)
MultiSource/Benchmarks/Fhourstones/fhourstones: 14.64% (1.3196 => 1.5128, std.dev.: 0.0539)
SingleSource/Benchmarks/Misc/salsa20: 12.65% (7.9552 => 8.9619, std.dev.: 0.0227)
SingleSource/Benchmarks/CoyoteBench/fftbench: 11.64% (1.9106 => 2.1329, std.dev.: 0.0451)
SingleSource/Benchmarks/Shootout/strcat: 9.92% (0.1452 => 0.1596, std.dev.: 0.0037)
SingleSource/Benchmarks/Shootout/hash: 7.59% (5.2407 => 5.6386, std.dev.: 0.0310)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.05% (4.4934 => 4.8104, std.dev.: 0.0081)
SingleSource/Benchmarks/Misc/himenobmtxpa: 6.16% (4.0491 => 4.2986, std.dev.: 0.0578)
MultiSource/Benchmarks/7zip/7zip-benchmark: 4.15% (11.7472 => 12.2350, std.dev.: 0.0330)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.01% (4.6243 => 4.7174, std.dev.: 0.0166)
MultiSource/Applications/JM/lencod/lencod: 1.59% (7.0410 => 7.1531, std.dev.: 0.0224)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.23% (5.3791 => 5.4455, std.dev.: 0.0213)
SingleSource/Benchmarks/McGill/queens: 1.23% (1.6464 => 1.6666, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.05% (1.8744 => 1.8940, std.dev.: 0.0056)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Applications/treecc/treecc: -6.89% (3.1216 => 2.9066, std.dev.: 0.0736)
MultiSource/Applications/oggenc/oggenc: -3.48% (6.1929 => 5.9775, std.dev.: 0.0580)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.83% (1.6354 => 1.6054, std.dev.: 0.0052)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.72% (27.1341 => 26.6677, std.dev.: 0.0510)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -9.62% (0.1559 => 0.1409, std.dev.: 0.0036)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.60% (2.8679 => 2.8220, std.dev.: 0.0115)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.60% (3.0632 => 3.0142, std.dev.: 0.0151)
SingleSource/Benchmarks/Shootout/matrix: -1.54% (1.7578 => 1.7307, std.dev.: 0.0069)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.05% (4.0760 => 4.0334, std.dev.: 0.0069)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -2.31% (0.1344 => 0.1313, std.dev.: 0.0370)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/EH/inlined_cleanup: 65.28% (0.0193 => 0.0319, std.dev.: 0.0011)
SingleSource/Benchmarks/Shootout/methcall: 64.21% (0.0366 => 0.0601, std.dev.: 0.0011)
SingleSource/Regression/C/2003-05-23-TransparentUnion: 63.91% (0.0169 => 0.0277, std.dev.: 0.0006)
SingleSource/Regression/C/2004-03-15-IndirectGoto: 63.43% (0.0175 => 0.0286, std.dev.: 0.0004)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 58.54% (0.0738 => 0.1170, std.dev.: 0.0035)
SingleSource/Regression/C/sumarray2d: 56.19% (0.0452 => 0.0706, std.dev.: 0.0032)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 55.79% (0.0950 => 0.1480, std.dev.: 0.0030)
SingleSource/Regression/C++/EH/ConditionalExpr: 51.93% (0.0233 => 0.0354, std.dev.: 0.0031)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 44.19% (0.0258 => 0.0372, std.dev.: 0.0039)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 42.46% (0.0504 => 0.0718, std.dev.: 0.0049)
SingleSource/UnitTests/SignlessTypes/factor: 41.80% (0.0366 => 0.0519, std.dev.: 0.0009)
SingleSource/Regression/C/test_indvars: 33.66% (0.0303 => 0.0405, std.dev.: 0.0010)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 30.65% (0.0930 => 0.1215, std.dev.: 0.0091)
MultiSource/Applications/sgefa/sgefa: 25.34% (0.4135 => 0.5183, std.dev.: 0.0201)
MultiSource/Applications/treecc/treecc: 25.08% (2.3237 => 2.9066, std.dev.: 0.0736)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.77% (5.4314 => 6.3420, std.dev.: 0.3097)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.03% (5.6424 => 6.3209, std.dev.: 0.1568)
MultiSource/Applications/JM/ldecod/ldecod: 11.69% (7.4648 => 8.3375, std.dev.: 0.2584)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.72% (1.4991 => 1.6298, std.dev.: 0.0276)
MultiSource/Applications/siod/siod: 8.15% (2.4944 => 2.6977, std.dev.: 0.0423)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.00% (1.3833 => 1.4939, std.dev.: 0.0343)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.80% (1.4131 => 1.5233, std.dev.: 0.0224)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.63% (1.3667 => 1.4710, std.dev.: 0.0256)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.48% (1.5108 => 1.6238, std.dev.: 0.0263)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.48% (1.4485 => 1.5568, std.dev.: 0.0167)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.09% (1.5959 => 1.7090, std.dev.: 0.0318)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.03% (1.4999 => 1.6054, std.dev.: 0.0052)
MultiSource/Applications/SPASS/SPASS: 6.86% (17.6379 => 18.8477, std.dev.: 0.2683)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.33% (1.4081 => 1.4972, std.dev.: 0.0315)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.70% (1.4238 => 1.5050, std.dev.: 0.0162)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.81% (0.5196 => 0.5446, std.dev.: 0.0044)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.64% (1.5984 => 1.6725, std.dev.: 0.0219)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.49% (1.5806 => 1.6358, std.dev.: 0.0193)
SingleSource/Benchmarks/Shootout-C++/sieve: 3.30% (0.3088 => 0.3190, std.dev.: 0.0016)
SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.3425 => 0.3531, std.dev.: 0.0017)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.83% (25.9348 => 26.6677, std.dev.: 0.0510)
MultiSource/Applications/hexxagon/hexxagon: 2.72% (1.0794 => 1.1088, std.dev.: 0.0099)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 71.18% (6.0122 => 10.2917, std.dev.: 0.2697)
SingleSource/Benchmarks/Shootout/heapsort: 50.60% (2.9988 => 4.5161, std.dev.: 0.3654)
MultiSource/Applications/d/make_dparser: 46.55% (0.0391 => 0.0573, std.dev.: 0.0018)
MultiSource/Applications/sgefa/sgefa: 37.61% (1.1695 => 1.6094, std.dev.: 0.0052)
MultiSource/Applications/JM/ldecod/ldecod: 36.47% (0.0669 => 0.0913, std.dev.: 0.0079)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.73% (16.4665 => 20.7036, std.dev.: 0.6920)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.64% (4.6452 => 5.7433, std.dev.: 0.2308)
MultiSource/Benchmarks/7zip/7zip-benchmark: 19.46% (10.2418 => 12.2350, std.dev.: 0.0330)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.80% (6.1372 => 7.1685, std.dev.: 0.0807)
SingleSource/Benchmarks/CoyoteBench/fftbench: 16.61% (1.8291 => 2.1329, std.dev.: 0.0451)
MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (1.3530 => 1.5128, std.dev.: 0.0539)
SingleSource/Benchmarks/Shootout/strcat: 9.62% (0.1456 => 0.1596, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.12% (5.2003 => 5.6228, std.dev.: 0.0308)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.45% (3.1853 => 3.3906, std.dev.: 0.0069)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.52% (94.2966 => 99.5052, std.dev.: 1.2003)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.45% (4.6639 => 4.9183, std.dev.: 0.0305)
SingleSource/Benchmarks/Shootout/hash: 5.09% (5.3656 => 5.6386, std.dev.: 0.0310)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.98% (3.2201 => 3.3804, std.dev.: 0.0345)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.15% (4.8986 => 5.1019, std.dev.: 0.0271)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.92% (2.9004 => 3.0142, std.dev.: 0.0151)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.55% (5.2788 => 5.4664, std.dev.: 0.0713)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.23% (4.8966 => 5.0546, std.dev.: 0.0152)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.04% (5.5010 => 5.6680, std.dev.: 0.0361)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.70% (4.5935 => 4.7174, std.dev.: 0.0166)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.62% (40.6198 => 41.6842, std.dev.: 0.3050)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.43% (3.9713 => 4.0677, std.dev.: 0.0098)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (1.7925 => 1.8267, std.dev.: 0.0123)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.81% (4.3727 => 4.4520, std.dev.: 0.0152)
MultiSource/Applications/JM/lencod/lencod: 1.67% (7.0353 => 7.1531, std.dev.: 0.0224)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.66% (5.6582 => 5.7522, std.dev.: 0.0342)
SingleSource/Benchmarks/Shootout/methcall: 1.27% (8.3425 => 8.4486, std.dev.: 0.0295)
SingleSource/Benchmarks/Shootout-C++/methcall: 1.26% (11.4990 => 11.6437, std.dev.: 0.0160)
SingleSource/Benchmarks/McGill/queens: 1.14% (1.6478 => 1.6666, std.dev.: 0.0038)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/McCat/18-imp/imp: -4.60% (0.4199 => 0.4006, std.dev.: 0.0031)
MultiSource/Applications/lemon/lemon: -4.10% (1.3155 => 1.2616, std.dev.: 0.0188)
MultiSource/Benchmarks/McCat/05-eks/eks: -3.56% (0.5698 => 0.5495, std.dev.: 0.0021)
MultiSource/Benchmarks/McCat/09-vor/vor: -3.04% (0.3723 => 0.3610, std.dev.: 0.0009)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.13% (1.2911 => 0.7342, std.dev.: 0.0117)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.78% (4.4050 => 3.2252, std.dev.: 0.0179)
MultiSource/Benchmarks/FreeBench/neural/neural: -25.28% (0.3513 => 0.2625, std.dev.: 0.0128)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -22.82% (6.2328 => 4.8104, std.dev.: 0.0081)
SingleSource/UnitTests/Vectorizer/gcc-loops: -16.08% (25.3677 => 21.2876, std.dev.: 0.1789)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.83% (11.6227 => 10.0149, std.dev.: 0.0009)
SingleSource/Benchmarks/Misc/salsa20: -13.33% (10.3398 => 8.9619, std.dev.: 0.0227)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -12.97% (0.1542 => 0.1342, std.dev.: 0.0062)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.26% (7.0179 => 6.2982, std.dev.: 0.0121)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.33% (1.6679 => 1.5123, std.dev.: 0.0028)
MultiSource/Applications/lambda-0_1_3/lambda: -8.96% (9.1099 => 8.2940, std.dev.: 0.0068)
SingleSource/Benchmarks/Shootout-C++/hash: -7.56% (0.7941 => 0.7341, std.dev.: 0.0174)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.39% (48.3307 => 44.7580, std.dev.: 0.2217)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.94% (0.1945 => 0.1810, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.50% (5.5889 => 5.2254, std.dev.: 0.0268)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.30% (0.4445 => 0.4165, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.02% (9.8728 => 9.2780, std.dev.: 0.0227)
MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (3.5327 => 3.3428, std.dev.: 0.0388)
MultiSource/Applications/sqlite3/sqlite3: -4.59% (4.6358 => 4.4231, std.dev.: 0.0584)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (4.2167 => 4.0334, std.dev.: 0.0069)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.10% (5.3276 => 5.1090, std.dev.: 0.0472)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.04% (0.9806 => 0.9410, std.dev.: 0.0066)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.89% (5.3184 => 5.1113, std.dev.: 0.0181)
SingleSource/Benchmarks/Misc/flops: -3.81% (10.2170 => 9.8281, std.dev.: 0.0517)
SingleSource/Benchmarks/Shootout/sieve: -2.83% (8.0178 => 7.7906, std.dev.: 0.0175)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.40% (6.3757 => 6.2230, std.dev.: 0.0453)
MultiSource/Benchmarks/BitBench/five11/five11: -2.12% (5.7342 => 5.6124, std.dev.: 0.0259)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.24% (2.8573 => 2.8220, std.dev.: 0.0115)
MultiSource/Applications/hexxagon/hexxagon: -1.09% (15.4979 => 15.3293, std.dev.: 0.0371)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -8.88% (0.1441 => 0.1313, std.dev.: 0.0370)
Report Time: 1.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130621/ed4d14ee/attachment.html>
More information about the llvm-testresults
mailing list