[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Jul 17 13:13:41 PDT 2013
http://llvm.org/perf/db_default/v4/nts/13525?compare_to=13521&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13
Comparing:
Run: 13525, Order: 186522, Start Time: 2013-07-17 18:23:03, End Time: 2013-07-17 20:15:09
To: 13521, Order: 186512, Start Time: 2013-07-17 15:36:40, End Time: 2013-07-17 17:38:50
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
===============
Tests Summary
===============
Performance Regressions: 37 (54 on baseline)
Performance Improvements: 4 (49 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1004 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/15-trie/trie: 57.55% (0.0636 => 0.1002, std.dev.: 0.0048)
SingleSource/UnitTests/SignlessTypes/shr: 39.58% (0.0336 => 0.0469, std.dev.: 0.0037)
MultiSource/Applications/treecc/treecc: 38.08% (2.3349 => 3.2241, std.dev.: 0.1151)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.75% (0.1777 => 0.2359, std.dev.: 0.0133)
MultiSource/Applications/spiff/spiff: 32.10% (0.9386 => 1.2399, std.dev.: 0.0746)
MultiSource/Benchmarks/McCat/09-vor/vor: 23.14% (0.3665 => 0.4513, std.dev.: 0.0284)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.65% (0.3324 => 0.3977, std.dev.: 0.0164)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.95% (1.9675 => 2.3009, std.dev.: 0.1023)
MultiSource/Applications/d/make_dparser: 14.07% (3.7171 => 4.2401, std.dev.: 0.0887)
MultiSource/Applications/JM/lencod/lencod: 10.22% (17.4931 => 19.2810, std.dev.: 0.3101)
MultiSource/Applications/JM/ldecod/ldecod: 9.91% (7.6748 => 8.4354, std.dev.: 0.2154)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.47% (1.5268 => 1.6408, std.dev.: 0.0047)
MultiSource/Applications/sqlite3/sqlite3: 7.12% (16.7192 => 17.9091, std.dev.: 0.2307)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.28% (1.3421 => 1.4264, std.dev.: 0.0254)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.71% (1.5385 => 1.5956, std.dev.: 0.0198)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.34% (1.4398 => 1.4879, std.dev.: 0.0109)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.33% (1.4793 => 1.5137, std.dev.: 0.0131)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/ary3: 62.79% (5.8001 => 9.4419, std.dev.: 0.8762)
SingleSource/Benchmarks/CoyoteBench/lpbench: 31.79% (3.6510 => 4.8117, std.dev.: 0.0421)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.77% (4.6567 => 5.9966, std.dev.: 0.0773)
SingleSource/Benchmarks/CoyoteBench/fftbench: 27.28% (1.6084 => 2.0472, std.dev.: 0.1111)
MultiSource/Benchmarks/Fhourstones/fhourstones: 19.40% (1.2335 => 1.4728, std.dev.: 0.0906)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.26% (2.1076 => 2.4082, std.dev.: 0.0182)
SingleSource/Benchmarks/Shootout-C++/ackermann: 13.82% (3.1364 => 3.5698, std.dev.: 0.1238)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.87% (37.3299 => 41.0149, std.dev.: 1.4282)
SingleSource/Benchmarks/Shootout/hash: 6.97% (4.1655 => 4.4558, std.dev.: 0.0670)
SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (2.0428 => 2.1666, std.dev.: 0.0104)
MultiSource/Benchmarks/Bullet/bullet: 4.90% (7.0361 => 7.3811, std.dev.: 0.0997)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.85% (15.0926 => 15.8242, std.dev.: 0.1077)
SingleSource/Benchmarks/Misc/flops-7: 4.76% (1.7336 => 1.8161, std.dev.: 0.0078)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.65% (40.5983 => 42.4843, std.dev.: 0.0666)
MultiSource/Benchmarks/Olden/em3d/em3d: 3.36% (5.0062 => 5.1744, std.dev.: 0.0040)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.24% (2.6703 => 2.7568, std.dev.: 0.0124)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.10% (3.9217 => 4.0434, std.dev.: 0.0426)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.79% (5.2604 => 5.3548, std.dev.: 0.0051)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.59% (4.3971 => 4.4669, std.dev.: 0.0269)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.17% (3.7852 => 3.8293, std.dev.: 0.0085)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -10.23% (1.5534 => 1.3945, std.dev.: 0.0556)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.76% (1.5068 => 1.4049, std.dev.: 0.0284)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (95.7402 => 93.6378, std.dev.: 0.5853)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.59% (5.0646 => 4.9843, std.dev.: 0.0254)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 5.50% (0.1363 => 0.1438, std.dev.: 0.0182)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/McCat/15-trie/trie: 58.29% (0.0633 => 0.1002, std.dev.: 0.0048)
MultiSource/Applications/treecc/treecc: 38.75% (2.3237 => 3.2241, std.dev.: 0.1151)
SingleSource/UnitTests/SignlessTypes/shr: 34.00% (0.0350 => 0.0469, std.dev.: 0.0037)
MultiSource/Applications/spiff/spiff: 32.40% (0.9365 => 1.2399, std.dev.: 0.0746)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.08% (0.1886 => 0.2359, std.dev.: 0.0133)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.04% (0.5982 => 0.7420, std.dev.: 0.0239)
MultiSource/Benchmarks/McCat/09-vor/vor: 21.22% (0.3723 => 0.4513, std.dev.: 0.0284)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.73% (0.3378 => 0.3977, std.dev.: 0.0164)
MultiSource/Applications/d/make_dparser: 13.58% (3.7330 => 4.2401, std.dev.: 0.0887)
MultiSource/Applications/JM/ldecod/ldecod: 13.00% (7.4648 => 8.4354, std.dev.: 0.2154)
SingleSource/Benchmarks/Shootout-C++/EH/except: 11.15% (0.2206 => 0.2452, std.dev.: 0.0074)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.45% (1.4991 => 1.6408, std.dev.: 0.0047)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.00% (0.2721 => 0.2966, std.dev.: 0.0061)
MultiSource/Applications/siod/siod: 8.54% (2.4944 => 2.7073, std.dev.: 0.0757)
SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.7059 => 0.7600, std.dev.: 0.0167)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.27% (1.5372 => 1.6336, std.dev.: 0.0186)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.5196 => 0.5520, std.dev.: 0.0110)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.61% (1.5108 => 1.5956, std.dev.: 0.0198)
MultiSource/Applications/sqlite3/sqlite3: 5.52% (16.9719 => 17.9091, std.dev.: 0.2307)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.77% (1.4202 => 1.4879, std.dev.: 0.0109)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.50% (1.4485 => 1.5137, std.dev.: 0.0131)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.38% (0.4293 => 0.4438, std.dev.: 0.0056)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 87.33% (0.1208 => 0.2263, std.dev.: 0.0048)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 57.26% (0.1750 => 0.2752, std.dev.: 0.0041)
SingleSource/Benchmarks/Shootout/ary3: 57.05% (6.0122 => 9.4419, std.dev.: 0.8762)
MultiSource/Applications/viterbi/viterbi: 35.95% (2.5688 => 3.4923, std.dev.: 0.0339)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.20% (9.8728 => 12.8548, std.dev.: 0.0497)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.09% (4.6452 => 5.9966, std.dev.: 0.0773)
SingleSource/Benchmarks/Misc/perlin: 26.65% (3.6271 => 4.5936, std.dev.: 0.0091)
MultiSource/Applications/sgefa/sgefa: 19.54% (1.1695 => 1.3980, std.dev.: 0.0026)
SingleSource/Benchmarks/Misc/mandel: 16.99% (1.0293 => 1.2042, std.dev.: 0.0025)
SingleSource/Benchmarks/CoyoteBench/lpbench: 15.20% (4.1768 => 4.8117, std.dev.: 0.0421)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.29% (5.2788 => 6.0330, std.dev.: 0.0181)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.05% (5.2561 => 5.8893, std.dev.: 0.0181)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.83% (4.6639 => 5.2158, std.dev.: 0.1580)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.53% (4.5094 => 4.9843, std.dev.: 0.0254)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.31% (2.9004 => 3.1993, std.dev.: 0.0153)
MultiSource/Applications/lua/lua: 9.69% (28.2496 => 30.9868, std.dev.: 0.4326)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.88% (4.6379 => 5.0499, std.dev.: 0.0089)
SingleSource/Benchmarks/Shootout/strcat: 8.86% (0.1456 => 0.1585, std.dev.: 0.0027)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.11% (3.1853 => 3.4119, std.dev.: 0.0502)
SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (2.0236 => 2.1666, std.dev.: 0.0104)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.52% (3.6291 => 3.8293, std.dev.: 0.0085)
SingleSource/Benchmarks/Misc/fbench: 4.88% (4.7508 => 4.9827, std.dev.: 0.0080)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.82% (5.6582 => 5.9307, std.dev.: 0.0173)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.59% (40.6198 => 42.4843, std.dev.: 0.0666)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.43% (3.2009 => 3.3426, std.dev.: 0.0455)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.73% (1.0571 => 1.0965, std.dev.: 0.0081)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.37% (3.2201 => 3.3287, std.dev.: 0.0222)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.36% (5.9362 => 6.1354, std.dev.: 0.0209)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (39.9248 => 41.0098, std.dev.: 0.2259)
SingleSource/Benchmarks/CoyoteBench/almabench: 1.89% (34.3107 => 34.9590, std.dev.: 0.0288)
SingleSource/Benchmarks/Shootout/methcall: 1.86% (8.3425 => 8.4978, std.dev.: 0.0189)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.37% (2.9023 => 2.9421, std.dev.: 0.0118)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.22% (0.1113 => 0.0721, std.dev.: 0.0052)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -12.17% (1.5735 => 1.3820, std.dev.: 0.0293)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.01% (1.6804 => 1.4785, std.dev.: 0.0623)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -11.96% (1.5806 => 1.3916, std.dev.: 0.0648)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -11.62% (1.7006 => 1.5030, std.dev.: 0.0252)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -10.76% (1.6073 => 1.4344, std.dev.: 0.0418)
SingleSource/Benchmarks/Misc/whetstone: -10.57% (0.1097 => 0.0981, std.dev.: 0.0031)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -10.52% (1.6563 => 1.4820, std.dev.: 0.0344)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -10.05% (1.6881 => 1.5184, std.dev.: 0.0267)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.63% (1.5612 => 1.4264, std.dev.: 0.0254)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.08% (0.2006 => 0.1844, std.dev.: 0.0039)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.78% (1.6726 => 1.5425, std.dev.: 0.0170)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.11% (1.7102 => 1.5886, std.dev.: 0.0350)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.27% (1.2911 => 0.7325, std.dev.: 0.0114)
SingleSource/Benchmarks/Shootout-C++/matrix: -32.91% (4.3226 => 2.9001, std.dev.: 0.0311)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -29.95% (4.4050 => 3.0857, std.dev.: 0.0211)
MultiSource/Benchmarks/Ptrdist/ks/ks: -24.48% (1.6105 => 1.2163, std.dev.: 0.0247)
MultiSource/Applications/lambda-0_1_3/lambda: -22.42% (9.1099 => 7.0679, std.dev.: 0.0268)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.32% (4.8986 => 3.8054, std.dev.: 0.1693)
SingleSource/Benchmarks/Shootout-C++/hash: -20.25% (0.7941 => 0.6333, std.dev.: 0.0346)
SingleSource/Benchmarks/Shootout/hash: -16.96% (5.3656 => 4.4558, std.dev.: 0.0670)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.72% (11.6227 => 9.6793, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.63% (5.5763 => 4.6491, std.dev.: 0.0538)
SingleSource/UnitTests/Vectorizer/gcc-loops: -14.48% (25.3677 => 21.6951, std.dev.: 0.1152)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.19% (0.1945 => 0.1669, std.dev.: 0.0100)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.09% (6.2328 => 5.3548, std.dev.: 0.0051)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.49% (5.7264 => 4.9539, std.dev.: 0.0217)
SingleSource/Benchmarks/Misc/salsa20: -13.10% (10.3398 => 8.9856, std.dev.: 0.0120)
SingleSource/Regression/C/uint64_to_float: -10.59% (1.6851 => 1.5066, std.dev.: 0.0544)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.39% (5.2003 => 4.8679, std.dev.: 0.0268)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.30% (4.5717 => 4.2838, std.dev.: 0.0121)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.26% (5.3184 => 4.9857, std.dev.: 0.1045)
SingleSource/Benchmarks/Shootout-C++/hash2: -5.59% (3.5939 => 3.3930, std.dev.: 0.0334)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.90% (1.3084 => 1.2443, std.dev.: 0.0084)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.74% (5.5889 => 5.3241, std.dev.: 0.0410)
MultiSource/Applications/sqlite3/sqlite3: -4.72% (4.6358 => 4.4169, std.dev.: 0.0677)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.57% (1.6535 => 1.5779, std.dev.: 0.0168)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.47% (7.0179 => 6.7044, std.dev.: 0.0718)
SingleSource/Benchmarks/Misc/flops: -4.24% (10.2170 => 9.7834, std.dev.: 0.0086)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.05% (1.4783 => 1.4184, std.dev.: 0.0101)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.98% (0.4445 => 0.4268, std.dev.: 0.0023)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.90% (16.4665 => 15.8242, std.dev.: 0.1077)
SingleSource/Benchmarks/Misc/whetstone: -3.66% (3.5970 => 3.4655, std.dev.: 0.0054)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.40% (2.8537 => 2.7568, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.31% (5.3276 => 5.1510, std.dev.: 0.0056)
SingleSource/Benchmarks/Shootout/sieve: -2.84% (8.0178 => 7.7903, std.dev.: 0.0117)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.76% (4.5935 => 4.4669, std.dev.: 0.0269)
MultiSource/Benchmarks/mafft/pairlocalalign: -2.37% (48.3307 => 47.1872, std.dev.: 0.0783)
SingleSource/Benchmarks/Shootout/lists: -1.09% (7.2961 => 7.2164, std.dev.: 0.0308)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1441 => 0.1438, std.dev.: 0.0182)
Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130717/27f44a57/attachment.html>
More information about the llvm-testresults
mailing list