[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Aug 14 11:06:39 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14406?compare_to=14402&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14406, Order: 188377, Start Time: 2013-08-14 16:04:08, End Time: 2013-08-14 18:08:39
To: 14402, Order: 188368, Start Time: 2013-08-14 13:47:25, End Time: 2013-08-14 15:38:27
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
Performance Regressions: 66 (74 on baseline)
Performance Improvements: 0 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1041 (1016 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 170.08% (0.0127 => 0.0343, std.dev.: 0.0024)
SingleSource/Regression/C/2008-01-07-LongDouble: 116.80% (0.0125 => 0.0271, std.dev.: 0.0025)
SingleSource/UnitTests/2005-05-12-Int64ToFP: 86.47% (0.0170 => 0.0317, std.dev.: 0.0012)
SingleSource/UnitTests/2003-05-31-CastToBool: 80.93% (0.0257 => 0.0465, std.dev.: 0.0024)
SingleSource/Regression/C/PR491: 80.77% (0.0156 => 0.0282, std.dev.: 0.0014)
SingleSource/Benchmarks/BenchmarkGame/recursive: 78.57% (0.0280 => 0.0500, std.dev.: 0.0078)
SingleSource/UnitTests/2006-12-01-float_varg: 75.69% (0.0144 => 0.0253, std.dev.: 0.0030)
SingleSource/Regression/C++/EH/ConditionalExpr: 75.53% (0.0237 => 0.0416, std.dev.: 0.0028)
SingleSource/Regression/C++/EH/throw_rethrow_test: 74.42% (0.0258 => 0.0450, std.dev.: 0.0038)
SingleSource/UnitTests/2002-05-02-CastTest: 73.95% (0.0261 => 0.0454, std.dev.: 0.0058)
SingleSource/Regression/C++/2003-05-14-array-init: 71.24% (0.0153 => 0.0262, std.dev.: 0.0015)
SingleSource/UnitTests/2007-04-10-BitfieldTest: 69.76% (0.0205 => 0.0348, std.dev.: 0.0026)
SingleSource/UnitTests/vla: 67.60% (0.0463 => 0.0776, std.dev.: 0.0112)
SingleSource/UnitTests/TestLoop: 65.59% (0.0186 => 0.0308, std.dev.: 0.0039)
SingleSource/UnitTests/2002-12-13-MishaTest: 65.00% (0.0200 => 0.0330, std.dev.: 0.0014)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 64.63% (0.0164 => 0.0270, std.dev.: 0.0022)
SingleSource/UnitTests/2002-05-03-NotTest: 64.50% (0.0200 => 0.0329, std.dev.: 0.0023)
SingleSource/Regression/C++/EH/recursive-throw: 63.60% (0.0272 => 0.0445, std.dev.: 0.0028)
SingleSource/UnitTests/2003-05-14-AtExit: 61.97% (0.0213 => 0.0345, std.dev.: 0.0040)
SingleSource/Regression/C++/EH/exception_spec_test: 59.09% (0.0352 => 0.0560, std.dev.: 0.0063)
SingleSource/Benchmarks/Shootout/strcat: 57.86% (0.0299 => 0.0472, std.dev.: 0.0050)
SingleSource/Benchmarks/CoyoteBench/almabench: 54.17% (0.0779 => 0.1201, std.dev.: 0.0151)
SingleSource/Benchmarks/Shootout/methcall: 51.49% (0.0369 => 0.0559, std.dev.: 0.0027)
MultiSource/Applications/Burg/burg: 51.35% (1.4664 => 2.2194, std.dev.: 0.0874)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 49.20% (0.0250 => 0.0373, std.dev.: 0.0031)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 48.43% (0.1018 => 0.1511, std.dev.: 0.0078)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 46.59% (0.9941 => 1.4573, std.dev.: 0.0395)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 42.41% (0.0771 => 0.1098, std.dev.: 0.0092)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 41.90% (0.0525 => 0.0745, std.dev.: 0.0053)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 41.16% (0.2801 => 0.3954, std.dev.: 0.0404)
SingleSource/Benchmarks/Shootout/lists: 39.70% (0.0811 => 0.1133, std.dev.: 0.0046)
SingleSource/Benchmarks/Dhrystone/fldry: 36.99% (0.0611 => 0.0837, std.dev.: 0.0078)
SingleSource/Regression/C/test_indvars: 36.96% (0.0303 => 0.0415, std.dev.: 0.0035)
MultiSource/Applications/hbd/hbd: 36.17% (1.6927 => 2.3050, std.dev.: 0.1740)
MultiSource/Applications/spiff/spiff: 32.60% (0.9371 => 1.2426, std.dev.: 0.1056)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.02% (0.2767 => 0.3570, std.dev.: 0.0182)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.39% (4.2747 => 5.3174, std.dev.: 0.3670)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 22.61% (1.0181 => 1.2483, std.dev.: 0.0719)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 19.99% (0.1466 => 0.1759, std.dev.: 0.0092)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.67% (1.4512 => 1.6350, std.dev.: 0.0141)
MultiSource/Applications/siod/siod: 12.34% (2.5346 => 2.8473, std.dev.: 0.0625)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.85% (0.1644 => 0.1806, std.dev.: 0.0058)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 77.54% (2.8975 => 5.1441, std.dev.: 0.6022)
SingleSource/Benchmarks/Shootout/ary3: 65.01% (5.7818 => 9.5407, std.dev.: 0.8605)
SingleSource/Benchmarks/Shootout-C++/heapsort: 61.55% (2.9449 => 4.7574, std.dev.: 0.3934)
MultiSource/Applications/lemon/lemon: 55.57% (0.9038 => 1.4060, std.dev.: 0.0713)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.82% (0.1265 => 0.1579, std.dev.: 0.0034)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 24.25% (36.7447 => 45.6544, std.dev.: 1.5765)
SingleSource/Benchmarks/Shootout-C++/fibo: 16.72% (4.1338 => 4.8251, std.dev.: 0.0096)
SingleSource/Benchmarks/Misc/fp-convert: 16.32% (6.9203 => 8.0499, std.dev.: 0.0399)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.66% (2.4316 => 2.6421, std.dev.: 0.0522)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.27% (2.9611 => 3.1765, std.dev.: 0.0444)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.21% (5.9603 => 6.2708, std.dev.: 0.0923)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.12% (1.2919 => 1.3581, std.dev.: 0.0051)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.14% (2.5899 => 2.6971, std.dev.: 0.0107)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.02% (5.8063 => 6.0400, std.dev.: 0.0540)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.85% (0.2725 => 0.2830, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.31% (6.2939 => 6.5024, std.dev.: 0.0412)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.51% (16.3941 => 16.8049, std.dev.: 0.1459)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.82% (1.6306 => 1.6603, std.dev.: 0.0044)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.44% (9.7250 => 9.8652, std.dev.: 0.0239)
SingleSource/Benchmarks/Shootout-C++/methcall: 1.44% (11.5367 => 11.7025, std.dev.: 0.0481)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.37% (3.7618 => 3.8134, std.dev.: 0.0095)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.32% (5.4131 => 5.4846, std.dev.: 0.0098)
MultiSource/Benchmarks/NPB-serial/is/is: 1.22% (12.2133 => 12.3627, std.dev.: 0.0088)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.20% (5.0647 => 5.1255, std.dev.: 0.0107)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 5.50% (0.1327 => 0.1400, std.dev.: 0.0245)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/2008-04-20-LoopBug2: 234.72% (0.0072 => 0.0241, std.dev.: 0.0026)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 110.56% (0.0142 => 0.0299, std.dev.: 0.0054)
SingleSource/UnitTests/2002-05-02-CastTest3: 108.33% (0.0096 => 0.0200, std.dev.: 0.0002)
SingleSource/UnitTests/2005-05-12-Int64ToFP: 93.29% (0.0164 => 0.0317, std.dev.: 0.0012)
SingleSource/Regression/C/bigstack: 88.41% (0.0466 => 0.0878, std.dev.: 0.0091)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 83.42% (0.0187 => 0.0343, std.dev.: 0.0024)
SingleSource/Regression/C/PR491: 81.94% (0.0155 => 0.0282, std.dev.: 0.0014)
SingleSource/Regression/C++/EH/ConditionalExpr: 80.09% (0.0231 => 0.0416, std.dev.: 0.0028)
SingleSource/UnitTests/2002-05-03-NotTest: 77.84% (0.0185 => 0.0329, std.dev.: 0.0023)
SingleSource/Regression/C++/2003-05-14-array-init: 77.03% (0.0148 => 0.0262, std.dev.: 0.0015)
SingleSource/Regression/C/2008-01-07-LongDouble: 75.97% (0.0154 => 0.0271, std.dev.: 0.0025)
SingleSource/Regression/C++/EH/throw_rethrow_test: 75.10% (0.0257 => 0.0450, std.dev.: 0.0038)
SingleSource/Regression/C++/EH/recursive-throw: 73.83% (0.0256 => 0.0445, std.dev.: 0.0028)
SingleSource/UnitTests/vla: 73.60% (0.0447 => 0.0776, std.dev.: 0.0112)
SingleSource/UnitTests/2003-05-31-CastToBool: 72.86% (0.0269 => 0.0465, std.dev.: 0.0024)
SingleSource/UnitTests/2003-05-14-AtExit: 72.50% (0.0200 => 0.0345, std.dev.: 0.0040)
SingleSource/UnitTests/2007-04-10-BitfieldTest: 72.28% (0.0202 => 0.0348, std.dev.: 0.0026)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 70.89% (0.0158 => 0.0270, std.dev.: 0.0022)
SingleSource/UnitTests/TestLoop: 68.31% (0.0183 => 0.0308, std.dev.: 0.0039)
SingleSource/UnitTests/2006-12-01-float_varg: 67.55% (0.0151 => 0.0253, std.dev.: 0.0030)
SingleSource/UnitTests/2002-05-02-CastTest: 67.53% (0.0271 => 0.0454, std.dev.: 0.0058)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: 62.88% (0.0229 => 0.0373, std.dev.: 0.0031)
SingleSource/UnitTests/2002-12-13-MishaTest: 62.56% (0.0203 => 0.0330, std.dev.: 0.0014)
SingleSource/Regression/C++/EH/exception_spec_test: 62.32% (0.0345 => 0.0560, std.dev.: 0.0063)
SingleSource/Benchmarks/Shootout/strcat: 61.64% (0.0292 => 0.0472, std.dev.: 0.0050)
SingleSource/Benchmarks/Shootout/methcall: 54.42% (0.0362 => 0.0559, std.dev.: 0.0027)
SingleSource/Regression/C/badidx: 51.61% (0.0279 => 0.0423, std.dev.: 0.0056)
SingleSource/Benchmarks/CoyoteBench/almabench: 51.26% (0.0794 => 0.1201, std.dev.: 0.0151)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 47.56% (0.1024 => 0.1511, std.dev.: 0.0078)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 42.18% (0.0524 => 0.0745, std.dev.: 0.0053)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 41.68% (0.0775 => 0.1098, std.dev.: 0.0092)
MultiSource/Applications/Burg/burg: 41.07% (1.5733 => 2.2194, std.dev.: 0.0874)
SingleSource/Benchmarks/Shootout/lists: 40.05% (0.0809 => 0.1133, std.dev.: 0.0046)
SingleSource/Regression/C/test_indvars: 37.87% (0.0301 => 0.0415, std.dev.: 0.0035)
SingleSource/Benchmarks/Dhrystone/fldry: 37.66% (0.0608 => 0.0837, std.dev.: 0.0078)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.34% (1.1012 => 1.4573, std.dev.: 0.0395)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 31.20% (0.2721 => 0.3570, std.dev.: 0.0182)
MultiSource/Applications/spiff/spiff: 29.73% (0.9578 => 1.2426, std.dev.: 0.1056)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 25.57% (0.9941 => 1.2483, std.dev.: 0.0719)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.28% (4.2444 => 5.3174, std.dev.: 0.3670)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.93% (0.1479 => 0.1759, std.dev.: 0.0092)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.85% (1.4750 => 1.6350, std.dev.: 0.0141)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 76.63% (2.9123 => 5.1441, std.dev.: 0.6022)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.40% (3.7285 => 6.5024, std.dev.: 0.0412)
SingleSource/Benchmarks/Shootout/ary3: 64.05% (5.8158 => 9.5407, std.dev.: 0.8605)
SingleSource/Benchmarks/Shootout-C++/heapsort: 63.86% (2.9033 => 4.7574, std.dev.: 0.3934)
SingleSource/Benchmarks/Shootout-C++/matrix: 49.06% (2.8867 => 4.3028, std.dev.: 0.3178)
MultiSource/Benchmarks/FreeBench/neural/neural: 38.63% (0.3171 => 0.4396, std.dev.: 0.0348)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 33.70% (0.1181 => 0.1579, std.dev.: 0.0034)
SingleSource/Benchmarks/Misc/pi: 26.04% (1.9835 => 2.5001, std.dev.: 0.0199)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 23.76% (36.8900 => 45.6544, std.dev.: 1.5765)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 14.20% (5.4910 => 6.2708, std.dev.: 0.0923)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.38% (2.3304 => 2.6421, std.dev.: 0.0522)
MultiSource/Applications/lambda-0_1_3/lambda: 13.08% (7.0762 => 8.0020, std.dev.: 0.0835)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.34% (14.9584 => 16.8049, std.dev.: 0.1459)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.80% (5.5008 => 6.0400, std.dev.: 0.0540)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.1678 => 0.1837, std.dev.: 0.0011)
MultiSource/Applications/siod/siod: 8.10% (3.3761 => 3.6494, std.dev.: 0.0566)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.08% (3.2027 => 3.4615, std.dev.: 0.0595)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.43% (2.9568 => 3.1765, std.dev.: 0.0444)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.24% (5.3042 => 5.6354, std.dev.: 0.1193)
SingleSource/Benchmarks/Linpack/linpack-pc: 5.42% (48.3256 => 50.9436, std.dev.: 0.7087)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.52% (4.3151 => 4.5102, std.dev.: 0.0195)
SingleSource/Benchmarks/Misc/whetstone: 4.22% (3.4559 => 3.6018, std.dev.: 0.0537)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.84% (1.5956 => 1.6569, std.dev.: 0.0117)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.64% (1.3104 => 1.3581, std.dev.: 0.0051)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.49% (25.0200 => 25.8944, std.dev.: 0.1188)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.88% (1.2639 => 1.2877, std.dev.: 0.0079)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.68% (9.7023 => 9.8652, std.dev.: 0.0239)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.66% (5.0417 => 5.1255, std.dev.: 0.0107)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.44% (3.7593 => 3.8134, std.dev.: 0.0095)
SingleSource/Benchmarks/Shootout-C++/methcall: 1.43% (11.5371 => 11.7025, std.dev.: 0.0481)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.42% (4.9040 => 4.9734, std.dev.: 0.0192)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.03% (9.6817 => 9.7819, std.dev.: 0.0142)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/tsp/tsp: -22.33% (0.1818 => 0.1412, std.dev.: 0.0108)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.26% (2.1022 => 1.4240, std.dev.: 0.0273)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2423, std.dev.: 0.0269)
SingleSource/Benchmarks/Misc/perlin: -21.23% (4.5989 => 3.6225, std.dev.: 0.0295)
SingleSource/Benchmarks/Misc/mandel: -14.33% (1.1996 => 1.0277, std.dev.: 0.0168)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.42% (6.2627 => 5.4846, std.dev.: 0.0098)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.16% (0.5173 => 0.4699, std.dev.: 0.0041)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.52% (0.2047 => 0.1893, std.dev.: 0.0057)
MultiSource/Benchmarks/mafft/pairlocalalign: -6.02% (47.2250 => 44.3831, std.dev.: 0.9260)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.44% (3.8119 => 3.6425, std.dev.: 0.0324)
SingleSource/Benchmarks/Misc/fbench: -4.37% (4.9602 => 4.7433, std.dev.: 0.0704)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.17% (1.1024 => 1.0564, std.dev.: 0.0084)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.91% (1.1032 => 1.0601, std.dev.: 0.0112)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.51% (1.7207 => 1.6603, std.dev.: 0.0044)
SingleSource/Benchmarks/Stanford/FloatMM: -2.69% (0.7806 => 0.7596, std.dev.: 0.0030)
SingleSource/Benchmarks/Misc/oourafft: -2.18% (3.7891 => 3.7065, std.dev.: 0.0295)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.04% (1.8144 => 1.7773, std.dev.: 0.0066)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1378 => 0.1400, std.dev.: 0.0245)
Report Time: 1.39s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130814/846da8a7/attachment.html>
More information about the llvm-testresults
mailing list