[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Oct 23 19:36:16 PDT 2013
http://llvm.org/perf/db_default/v4/nts/16620?compare_to=16616&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 16620, Order: 193290, Start Time: 2013-10-24 00:44:02, End Time: 2013-10-24 02:39:35
To: 16616, Order: 193274, Start Time: 2013-10-23 22:17:47, End Time: 2013-10-24 00:16:55
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 39 (57 on baseline)
Performance Improvements: 10 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1030 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Treesort: 93.32% (0.0464 => 0.0897, std.dev.: 0.0051)
SingleSource/Benchmarks/Stanford/RealMM: 91.47% (0.0457 => 0.0875, std.dev.: 0.0029)
SingleSource/UnitTests/Vector/build: 77.78% (0.0207 => 0.0368, std.dev.: 0.0009)
SingleSource/Benchmarks/McGill/exptree: 76.95% (0.0972 => 0.1720, std.dev.: 0.0230)
SingleSource/Regression/C/2004-02-03-AggregateCopy: 71.90% (0.0153 => 0.0263, std.dev.: 0.0016)
SingleSource/Regression/C++/BuiltinTypeInfo: 71.29% (0.0209 => 0.0358, std.dev.: 0.0014)
SingleSource/Regression/C/matrixTranspose: 67.97% (0.0281 => 0.0472, std.dev.: 0.0028)
SingleSource/UnitTests/Vector/multiplies: 64.13% (0.0329 => 0.0540, std.dev.: 0.0017)
SingleSource/Benchmarks/Shootout-C++/random: 45.40% (0.2282 => 0.3318, std.dev.: 0.0211)
SingleSource/Benchmarks/Misc/whetstone: 41.61% (0.0930 => 0.1317, std.dev.: 0.0130)
MultiSource/Applications/spiff/spiff: 40.12% (0.9350 => 1.3101, std.dev.: 0.1300)
MultiSource/Applications/treecc/treecc: 32.52% (2.3356 => 3.0951, std.dev.: 0.2894)
MultiSource/Applications/SIBsim4/SIBsim4: 16.47% (1.6328 => 1.9018, std.dev.: 0.0556)
MultiSource/Applications/ClamAV/clamscan: 16.00% (17.4152 => 20.2019, std.dev.: 1.0402)
SingleSource/Benchmarks/CoyoteBench/fftbench: 11.74% (0.3987 => 0.4455, std.dev.: 0.0052)
MultiSource/Applications/oggenc/oggenc: 11.46% (5.6064 => 6.2490, std.dev.: 0.0344)
SingleSource/Benchmarks/Shootout-C++/ackermann: 11.34% (0.1914 => 0.2131, std.dev.: 0.0032)
MultiSource/Applications/lambda-0_1_3/lambda: 10.70% (0.9968 => 1.1035, std.dev.: 0.0247)
SingleSource/Benchmarks/Shootout-C++/sieve: 7.87% (0.3063 => 0.3304, std.dev.: 0.0066)
SingleSource/Benchmarks/Shootout-C++/objinst: 6.54% (0.2203 => 0.2347, std.dev.: 0.0026)
SingleSource/Benchmarks/Shootout-C++/heapsort: 5.22% (0.2298 => 0.2418, std.dev.: 0.0031)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/ary: 73.78% (0.0328 => 0.0570, std.dev.: 0.0028)
SingleSource/Benchmarks/Shootout/heapsort: 56.67% (3.2466 => 5.0864, std.dev.: 0.1425)
SingleSource/Benchmarks/Stanford/Treesort: 43.71% (0.0723 => 0.1039, std.dev.: 0.0049)
SingleSource/Benchmarks/Stanford/Queens: 43.64% (0.0291 => 0.0418, std.dev.: 0.0024)
SingleSource/Benchmarks/CoyoteBench/fftbench: 37.77% (1.7598 => 2.4244, std.dev.: 0.2216)
SingleSource/Benchmarks/Shootout-C++/ackermann: 34.68% (3.4949 => 4.7071, std.dev.: 0.2542)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 29.87% (0.1483 => 0.1926, std.dev.: 0.0023)
SingleSource/Benchmarks/Shootout-C++/heapsort: 19.30% (4.1746 => 4.9801, std.dev.: 0.2072)
SingleSource/Benchmarks/Shootout-C++/hash: 10.37% (0.7501 => 0.8279, std.dev.: 0.0056)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2608 => 1.3524, std.dev.: 0.0138)
MultiSource/Benchmarks/Ptrdist/bc/bc: 6.38% (1.1137 => 1.1847, std.dev.: 0.0099)
MultiSource/Benchmarks/Ptrdist/ks/ks: 5.68% (1.4132 => 1.4935, std.dev.: 0.0079)
MultiSource/Benchmarks/BitBench/five11/five11: 4.15% (5.4554 => 5.6817, std.dev.: 0.0752)
SingleSource/Benchmarks/Misc/flops: 3.59% (9.2876 => 9.6208, std.dev.: 0.0191)
MultiSource/Benchmarks/sim/sim: 3.21% (4.0159 => 4.1449, std.dev.: 0.0136)
MultiSource/Applications/JM/lencod/lencod: 3.15% (7.5256 => 7.7623, std.dev.: 0.0484)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.40% (3.9511 => 4.0063, std.dev.: 0.0033)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.15% (6.5822 => 6.6578, std.dev.: 0.0269)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C/loader/loader: -31.83% (0.5249 => 0.3578, std.dev.: 0.0355)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -23.56% (0.0696 => 0.0532, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -16.85% (1.6160 => 1.3437, std.dev.: 0.0821)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.46% (1.5047 => 1.3022, std.dev.: 0.0272)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.30% (1.5562 => 1.3493, std.dev.: 0.0246)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -12.47% (1.6619 => 1.4546, std.dev.: 0.0238)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (0.2406 => 0.2270, std.dev.: 0.0032)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Regression/C/uint64_to_float: -5.39% (1.4814 => 1.4016, std.dev.: 0.0184)
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.55% (2.6788 => 2.5568, std.dev.: 0.0224)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.08% (16.9191 => 16.7359, std.dev.: 0.0696)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 3.14% (0.1370 => 0.1413, std.dev.: 0.0314)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Treesort: 97.58% (0.0454 => 0.0897, std.dev.: 0.0051)
SingleSource/Benchmarks/Stanford/RealMM: 94.44% (0.0450 => 0.0875, std.dev.: 0.0029)
SingleSource/UnitTests/Vector/build: 92.67% (0.0191 => 0.0368, std.dev.: 0.0009)
SingleSource/Benchmarks/McGill/exptree: 81.63% (0.0947 => 0.1720, std.dev.: 0.0230)
SingleSource/UnitTests/Vector/multiplies: 77.05% (0.0305 => 0.0540, std.dev.: 0.0017)
SingleSource/Regression/C/2004-02-03-AggregateCopy: 74.17% (0.0151 => 0.0263, std.dev.: 0.0016)
SingleSource/Regression/C++/BuiltinTypeInfo: 73.79% (0.0206 => 0.0358, std.dev.: 0.0014)
SingleSource/Regression/C/matrixTranspose: 71.01% (0.0276 => 0.0472, std.dev.: 0.0028)
SingleSource/Benchmarks/Shootout-C++/random: 65.24% (0.2008 => 0.3318, std.dev.: 0.0211)
SingleSource/Benchmarks/Misc/whetstone: 50.69% (0.0874 => 0.1317, std.dev.: 0.0130)
MultiSource/Applications/spiff/spiff: 47.02% (0.8911 => 1.3101, std.dev.: 0.1300)
MultiSource/Applications/lambda-0_1_3/lambda: 37.70% (0.8014 => 1.1035, std.dev.: 0.0247)
MultiSource/Applications/treecc/treecc: 37.46% (2.2516 => 3.0951, std.dev.: 0.2894)
MultiSource/Applications/JM/lencod/lencod: 29.10% (16.5902 => 21.4178, std.dev.: 0.2635)
MultiSource/Applications/SIBsim4/SIBsim4: 24.03% (1.5333 => 1.9018, std.dev.: 0.0556)
MultiSource/Applications/ClamAV/clamscan: 22.14% (16.5398 => 20.2019, std.dev.: 1.0402)
SingleSource/Benchmarks/Stanford/Oscar: 20.36% (0.0673 => 0.0810, std.dev.: 0.0046)
SingleSource/Benchmarks/Misc/perlin: 20.24% (0.0578 => 0.0695, std.dev.: 0.0030)
MultiSource/Applications/JM/ldecod/ldecod: 20.04% (7.4026 => 8.8864, std.dev.: 0.3484)
MultiSource/Applications/sqlite3/sqlite3: 17.96% (16.2888 => 19.2142, std.dev.: 0.4714)
MultiSource/Applications/oggenc/oggenc: 17.16% (5.3339 => 6.2490, std.dev.: 0.0344)
SingleSource/Benchmarks/Shootout-C++/sieve: 16.34% (0.2840 => 0.3304, std.dev.: 0.0066)
SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2083 => 0.2418, std.dev.: 0.0031)
SingleSource/Benchmarks/Shootout-C++/lists1: 15.19% (0.3087 => 0.3556, std.dev.: 0.0146)
SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3934 => 0.4455, std.dev.: 0.0052)
SingleSource/Benchmarks/Shootout-C++/ackermann: 11.86% (0.1905 => 0.2131, std.dev.: 0.0032)
SingleSource/Benchmarks/Shootout-C++/objinst: 10.76% (0.2119 => 0.2347, std.dev.: 0.0026)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Queens: 73.44% (0.0241 => 0.0418, std.dev.: 0.0024)
SingleSource/Benchmarks/Shootout-C++/heapsort: 65.39% (3.0111 => 4.9801, std.dev.: 0.2072)
SingleSource/Benchmarks/Shootout-C++/methcall: 62.71% (7.6426 => 12.4354, std.dev.: 0.0340)
SingleSource/Benchmarks/Shootout-C++/ary: 49.61% (0.0381 => 0.0570, std.dev.: 0.0028)
SingleSource/Benchmarks/Stanford/Bubblesort: 48.75% (0.0279 => 0.0415, std.dev.: 0.0051)
SingleSource/Benchmarks/Stanford/Treesort: 44.11% (0.0721 => 0.1039, std.dev.: 0.0049)
SingleSource/Benchmarks/Stanford/Towers: 43.61% (0.0266 => 0.0382, std.dev.: 0.0023)
SingleSource/Benchmarks/Shootout/heapsort: 41.68% (3.5900 => 5.0864, std.dev.: 0.1425)
SingleSource/Benchmarks/CoyoteBench/fftbench: 40.98% (1.7197 => 2.4244, std.dev.: 0.2216)
MultiSource/Benchmarks/Ptrdist/ks/ks: 30.65% (1.1431 => 1.4935, std.dev.: 0.0079)
SingleSource/Benchmarks/Shootout-C++/ackermann: 17.66% (4.0006 => 4.7071, std.dev.: 0.2542)
SingleSource/Benchmarks/Shootout-C++/hash: 11.49% (0.7426 => 0.8279, std.dev.: 0.0056)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.79% (36.8417 => 40.4487, std.dev.: 0.9953)
SingleSource/Benchmarks/CoyoteBench/huffbench: 9.47% (23.4704 => 25.6942, std.dev.: 0.1527)
SingleSource/UnitTests/Vector/multiplies: 8.92% (0.5561 => 0.6057, std.dev.: 0.0078)
MultiSource/Benchmarks/sim/sim: 8.19% (3.8312 => 4.1449, std.dev.: 0.0136)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.05% (1.2516 => 1.3524, std.dev.: 0.0138)
MultiSource/Benchmarks/Ptrdist/bc/bc: 7.57% (1.1013 => 1.1847, std.dev.: 0.0099)
MultiSource/Benchmarks/BitBench/five11/five11: 5.77% (5.3716 => 5.6817, std.dev.: 0.0752)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.72% (3.1730 => 3.3544, std.dev.: 0.0273)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (4.0596 => 4.1972, std.dev.: 0.0303)
MultiSource/Benchmarks/SciMark2-C/scimark2: 3.37% (89.7126 => 92.7324, std.dev.: 0.7052)
MultiSource/Applications/hexxagon/hexxagon: 2.47% (14.7810 => 15.1464, std.dev.: 0.0760)
SingleSource/Benchmarks/Shootout-C++/lists: 2.35% (16.2163 => 16.5973, std.dev.: 0.0180)
SingleSource/Benchmarks/Shootout-C++/sieve: 2.10% (3.4725 => 3.5455, std.dev.: 0.0151)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.95% (1.7652 => 1.7996, std.dev.: 0.0070)
SingleSource/Benchmarks/Misc/flops: 1.88% (9.4433 => 9.6208, std.dev.: 0.0191)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.29% (3.9552 => 4.0063, std.dev.: 0.0033)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.24% (1.0477 => 1.0607, std.dev.: 0.0032)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.09% (3.1569 => 3.1914, std.dev.: 0.0133)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -53.44% (0.5226 => 0.2433, std.dev.: 0.0318)
MultiSource/Applications/sgefa/sgefa: -42.57% (1.5790 => 0.9068, std.dev.: 0.0033)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.50% (0.0400 => 0.0250, std.dev.: 0.0012)
SingleSource/Benchmarks/Linpack/linpack-pc: -29.91% (57.2347 => 40.1154, std.dev.: 4.6729)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.62% (15.9508 => 12.8209, std.dev.: 0.4140)
MultiSource/Benchmarks/mafft/pairlocalalign: -12.66% (50.0284 => 43.6949, std.dev.: 0.6004)
MultiSource/Benchmarks/FreeBench/mason/mason: -11.71% (0.3304 => 0.2917, std.dev.: 0.0029)
SingleSource/UnitTests/Vectorizer/gcc-loops: -11.20% (20.8247 => 18.4925, std.dev.: 0.1198)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.93% (3.4956 => 3.1136, std.dev.: 0.0316)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.94% (3.0561 => 2.8133, std.dev.: 0.0550)
MultiSource/Applications/JM/lencod/lencod: -5.09% (8.1785 => 7.7623, std.dev.: 0.0484)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.47% (2.5938 => 2.4778, std.dev.: 0.0242)
SingleSource/Regression/C/uint64_to_float: -3.52% (1.4528 => 1.4016, std.dev.: 0.0184)
SingleSource/Benchmarks/Misc/oourafft: -3.47% (3.7484 => 3.6184, std.dev.: 0.0393)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.03% (4.3592 => 4.2270, std.dev.: 0.0299)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.44% (3.7874 => 3.6950, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.38% (17.1431 => 16.7359, std.dev.: 0.0696)
SingleSource/Benchmarks/Shootout/sieve: -2.31% (7.2254 => 7.0588, std.dev.: 0.0645)
SingleSource/Benchmarks/Shootout/lists: -2.23% (7.3703 => 7.2061, std.dev.: 0.0628)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.18% (2.4471 => 2.3938, std.dev.: 0.0151)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 4.82% (0.1348 => 0.1413, std.dev.: 0.0314)
Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131023/af19e716/attachment.html>
More information about the llvm-testresults
mailing list