[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Sep 24 09:33:07 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15620?compare_to=15616&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15620, Order: 191301, Start Time: 2013-09-24 14:47:05, End Time: 2013-09-24 16:35:51
To: 15616, Order: 191289, Start Time: 2013-09-24 12:26:58, End Time: 2013-09-24 14:21:02
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 21 (38 on baseline)
Performance Improvements: 55 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1031 (1055 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Queens: 79.32% (0.0474 => 0.0850, std.dev.: 0.0025)
SingleSource/Benchmarks/Misc/flops-3: 75.85% (0.0323 => 0.0568, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout/methcall: 69.65% (0.0369 => 0.0626, std.dev.: 0.0039)
SingleSource/Benchmarks/Stanford/RealMM: 60.00% (0.0490 => 0.0784, std.dev.: 0.0055)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 25.37% (3.8804 => 4.8649, std.dev.: 0.1004)
SingleSource/Benchmarks/Shootout/nestedloop: 24.62% (0.1523 => 0.1898, std.dev.: 0.0033)
SingleSource/Benchmarks/Shootout/ary3: 23.67% (4.7682 => 5.8966, std.dev.: 0.0608)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.64% (0.0455 => 0.0558, std.dev.: 0.0007)
SingleSource/Benchmarks/CoyoteBench/lpbench: 21.36% (4.2497 => 5.1575, std.dev.: 0.1059)
SingleSource/Benchmarks/Shootout/hash: 9.65% (5.2120 => 5.7149, std.dev.: 0.1071)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.28% (0.4237 => 0.4630, std.dev.: 0.0003)
SingleSource/Benchmarks/Shootout-C++/fibo: 8.47% (5.0534 => 5.4812, std.dev.: 0.0406)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.33% (0.3326 => 0.3603, std.dev.: 0.0095)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 6.57% (0.3561 => 0.3795, std.dev.: 0.0013)
MultiSource/Benchmarks/sim/sim: 5.89% (3.8400 => 4.0663, std.dev.: 0.0095)
SingleSource/Benchmarks/Misc/salsa20: 5.17% (7.6489 => 8.0440, std.dev.: 0.0603)
SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.23% (1.2459 => 1.2862, std.dev.: 0.0043)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.69% (5.8265 => 5.9833, std.dev.: 0.0283)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.66% (1.6511 => 1.6951, std.dev.: 0.0011)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (2.4693 => 2.5291, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.06% (5.5121 => 5.6254, std.dev.: 0.0048)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -45.54% (0.1862 => 0.1014, std.dev.: 0.0072)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -42.34% (0.1396 => 0.0805, std.dev.: 0.0036)
MultiSource/Benchmarks/McCat/08-main/main: -42.17% (0.5132 => 0.2968, std.dev.: 0.0198)
MultiSource/Benchmarks/McCat/05-eks/eks: -37.65% (0.8586 => 0.5353, std.dev.: 0.0871)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -34.24% (0.1536 => 0.1010, std.dev.: 0.0020)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -32.75% (0.1304 => 0.0877, std.dev.: 0.0101)
MultiSource/Benchmarks/Fhourstones/fhourstones: -29.25% (0.2434 => 0.1722, std.dev.: 0.0012)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -27.38% (13.5989 => 9.8756, std.dev.: 0.1386)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -26.96% (0.1428 => 0.1043, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/power/power: -26.88% (0.1990 => 0.1455, std.dev.: 0.0162)
MultiSource/Benchmarks/Ptrdist/bc/bc: -25.73% (1.7737 => 1.3173, std.dev.: 0.0290)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -24.40% (0.1799 => 0.1360, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -24.13% (0.3783 => 0.2870, std.dev.: 0.0079)
MultiSource/Benchmarks/Prolangs-C++/city/city: -22.74% (1.9328 => 1.4932, std.dev.: 0.1657)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -18.28% (9.1233 => 7.4552, std.dev.: 0.3576)
MultiSource/Benchmarks/McCat/15-trie/trie: -16.80% (0.0732 => 0.0609, std.dev.: 0.0023)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -16.56% (0.0628 => 0.0524, std.dev.: 0.0027)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -15.20% (0.2533 => 0.2148, std.dev.: 0.0111)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.70% (0.1905 => 0.1663, std.dev.: 0.0014)
MultiSource/Applications/kimwitu++/kc: -12.56% (21.6258 => 18.9091, std.dev.: 0.8320)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -11.37% (0.1293 => 0.1146, std.dev.: 0.0022)
SingleSource/Benchmarks/Shootout-C++/spellcheck: -11.04% (0.4304 => 0.3829, std.dev.: 0.0178)
MultiSource/Benchmarks/7zip/7zip-benchmark: -10.55% (50.3942 => 45.0789, std.dev.: 2.0319)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.90% (28.0175 => 25.2435, std.dev.: 0.5672)
SingleSource/Benchmarks/Shootout-C++/wordfreq: -9.45% (0.3798 => 0.3439, std.dev.: 0.0121)
MultiSource/Benchmarks/Bullet/bullet: -5.67% (35.6059 => 33.5870, std.dev.: 0.7802)
MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.41% (0.3697 => 0.3497, std.dev.: 0.0018)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.88% (0.7084 => 0.6738, std.dev.: 0.0022)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.07% (0.7413 => 0.7111, std.dev.: 0.0076)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.22% (0.9197 => 0.8901, std.dev.: 0.0070)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.32% (0.5868 => 0.5732, std.dev.: 0.0042)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.25% (1.1237 => 1.0984, std.dev.: 0.0058)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.99% (1.1401 => 1.1174, std.dev.: 0.0032)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.83% (0.6573 => 0.6453, std.dev.: 0.0037)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.04% (15.0589 => 14.9029, std.dev.: 0.0602)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Fhourstones/fhourstones: -32.34% (1.9246 => 1.3022, std.dev.: 0.0696)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -27.97% (0.1194 => 0.0860, std.dev.: 0.0001)
MultiSource/Benchmarks/McCat/09-vor/vor: -24.83% (0.1510 => 0.1135, std.dev.: 0.0103)
MultiSource/Benchmarks/Ptrdist/ft/ft: -22.99% (0.9608 => 0.7399, std.dev.: 0.0431)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -20.42% (3.1245 => 2.4864, std.dev.: 0.2395)
MultiSource/Benchmarks/McCat/08-main/main: -18.03% (0.0943 => 0.0773, std.dev.: 0.0001)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -17.24% (1.5691 => 1.2986, std.dev.: 0.0087)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -16.85% (0.5091 => 0.4233, std.dev.: 0.0208)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.48% (0.3688 => 0.3191, std.dev.: 0.0009)
MultiSource/Benchmarks/MallocBench/gs/gs: -11.30% (0.0929 => 0.0824, std.dev.: 0.0014)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -9.40% (2.9460 => 2.6691, std.dev.: 0.0803)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.28% (0.1470 => 0.1363, std.dev.: 0.0004)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -7.26% (69.6159 => 64.5632, std.dev.: 1.5455)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.03% (0.4950 => 0.4602, std.dev.: 0.0046)
MultiSource/Benchmarks/PAQ8p/paq8p: -4.25% (102.1599 => 97.8179, std.dev.: 1.0159)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.91% (0.3500 => 0.3398, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout/lists: -2.43% (7.3855 => 7.2059, std.dev.: 0.0242)
SingleSource/UnitTests/Vectorizer/gcc-loops: -2.23% (18.6496 => 18.2342, std.dev.: 0.1267)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.73% (16.8848 => 16.5925, std.dev.: 0.0606)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.71% (6.6497 => 6.5363, std.dev.: 0.0407)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: - (0.1366 => 0.1366, std.dev.: 0.0135)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/flops-3: 95.86% (0.0290 => 0.0568, std.dev.: 0.0033)
SingleSource/Benchmarks/Stanford/Queens: 94.06% (0.0438 => 0.0850, std.dev.: 0.0025)
SingleSource/Benchmarks/Stanford/RealMM: 74.22% (0.0450 => 0.0784, std.dev.: 0.0055)
SingleSource/Benchmarks/Shootout/methcall: 71.04% (0.0366 => 0.0626, std.dev.: 0.0039)
SingleSource/Benchmarks/Misc/ReedSolomon: 8.02% (0.2183 => 0.2358, std.dev.: 0.0016)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.97% (0.3096 => 0.3250, std.dev.: 0.0039)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.51% (1.9476 => 2.0355, std.dev.: 0.0133)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.65% (0.3374 => 0.3497, std.dev.: 0.0018)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.8775 => 1.9406, std.dev.: 0.0166)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.4764 => 14.9029, std.dev.: 0.0602)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8667 => 0.8901, std.dev.: 0.0070)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.48% (0.6297 => 0.6453, std.dev.: 0.0037)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.19% (0.5609 => 0.5732, std.dev.: 0.0042)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (1.0935 => 1.1174, std.dev.: 0.0032)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.12% (1.0756 => 1.0984, std.dev.: 0.0058)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.83% (0.6617 => 0.6738, std.dev.: 0.0022)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/heapsort: 38.38% (3.0111 => 4.1667, std.dev.: 0.3443)
SingleSource/Benchmarks/Shootout/heapsort: 35.51% (3.5900 => 4.8649, std.dev.: 0.1004)
SingleSource/Benchmarks/CoyoteBench/lpbench: 25.78% (4.1004 => 5.1575, std.dev.: 0.1059)
SingleSource/Benchmarks/Shootout/ary3: 25.53% (4.6972 => 5.8966, std.dev.: 0.0608)
SingleSource/Benchmarks/Shootout/nestedloop: 22.85% (0.1545 => 0.1898, std.dev.: 0.0033)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.56% (0.1374 => 0.1629, std.dev.: 0.0024)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.89% (4.9428 => 5.4812, std.dev.: 0.0406)
SingleSource/Benchmarks/Shootout/hash: 9.88% (5.2009 => 5.7149, std.dev.: 0.1071)
SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0041)
MultiSource/Benchmarks/sim/sim: 6.14% (3.8312 => 4.0663, std.dev.: 0.0095)
SingleSource/Benchmarks/Shootout-C++/methcall: 5.93% (7.6426 => 8.0961, std.dev.: 0.0957)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.56% (0.1871 => 0.1975, std.dev.: 0.0011)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.59% (5.7757 => 5.9833, std.dev.: 0.0283)
SingleSource/Benchmarks/Misc/salsa20: 3.18% (7.7964 => 8.0440, std.dev.: 0.0603)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.92% (2.1472 => 2.2098, std.dev.: 0.0023)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.84% (0.3836 => 0.3945, std.dev.: 0.0023)
MultiSource/Applications/siod/siod: 2.79% (3.5310 => 3.6296, std.dev.: 0.0244)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (5.4925 => 5.6254, std.dev.: 0.0048)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.7652 => 1.7998, std.dev.: 0.0076)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.49% (2.4920 => 2.5291, std.dev.: 0.0077)
SingleSource/Benchmarks/SmallPT/smallpt: 1.48% (16.7972 => 17.0460, std.dev.: 0.0359)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (1.6707 => 1.6951, std.dev.: 0.0011)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -55.09% (0.5226 => 0.2347, std.dev.: 0.0081)
MultiSource/Applications/sgefa/sgefa: -47.04% (1.5790 => 0.8362, std.dev.: 0.0391)
SingleSource/Benchmarks/Linpack/linpack-pc: -23.95% (57.2347 => 43.5281, std.dev.: 2.9758)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.83% (15.9508 => 13.1060, std.dev.: 0.2952)
SingleSource/UnitTests/Vectorizer/gcc-loops: -12.44% (20.8247 => 18.2342, std.dev.: 0.1267)
MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0038)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.36% (3.4956 => 3.1685, std.dev.: 0.0235)
MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (50.0284 => 46.9043, std.dev.: 0.2488)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.27% (2.5938 => 2.5089, std.dev.: 0.0180)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.21% (17.1431 => 16.5925, std.dev.: 0.0606)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.08% (5.4473 => 5.2793, std.dev.: 0.0651)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.74% (2.4471 => 2.3801, std.dev.: 0.0219)
SingleSource/Benchmarks/Shootout/lists: -2.23% (7.3703 => 7.2059, std.dev.: 0.0242)
SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.6646 => 3.6093, std.dev.: 0.0169)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.34% (0.1348 => 0.1366, std.dev.: 0.0135)
Report Time: 1.19s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130924/307d7d36/attachment.html>
More information about the llvm-testresults
mailing list