[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 5 01:12:45 PST 2013


http://llvm.org/perf/db_default/v4/nts/17995?compare_to=17990&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17995, Order: 196474, Start Time: 2013-12-05 07:29:55, End Time: 2013-12-05 09:16:50
      To: 17990, Order: 196464, Start Time: 2013-12-05 05:12:50, End Time: 2013-12-05 07:06:07
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 39 (55 on baseline)
Performance Improvements: 43 (14 on baseline)
Unchanged Tests: 1028 (1041 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/StructModifyTest: 74.63% (0.0134 => 0.0234, std.dev.: 0.0036)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 64.81% (0.0162 => 0.0267, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/Oscar: 62.61% (0.0682 => 0.1109, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 61.57% (0.0497 => 0.0803, std.dev.: 0.0049)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 38.49% (0.0278 => 0.0385, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/multiplies: 36.45% (0.0299 => 0.0408, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.04% (0.9890 => 1.2762, std.dev.: 0.0505)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 25.27% (0.0459 => 0.0575, std.dev.: 0.0038)
  SingleSource/UnitTests/initp1: 20.85% (0.0518 => 0.0626, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 20.64% (10.3248 => 12.4563, std.dev.: 0.3697)
  MultiSource/Benchmarks/MallocBench/gs/gs: 19.65% (5.0138 => 5.9989, std.dev.: 0.2925)
  SingleSource/UnitTests/Vector/constpool: 13.90% (9.2560 => 10.5426, std.dev.: 0.1206)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.20% (5.7397 => 6.4976, std.dev.: 0.2277)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.31% (1.2787 => 1.3977, std.dev.: 0.0302)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.95% (0.1900 => 0.2013, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.1926 => 0.2034, std.dev.: 0.0031)
  MultiSource/Applications/ClamAV/clamscan: 5.38% (17.6374 => 18.5866, std.dev.: 0.2772)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.25% (0.2534 => 0.2667, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.00% (1.2229 => 1.2840, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.88% (0.2109 => 0.2212, std.dev.: 0.0006)
  MultiSource/Applications/sqlite3/sqlite3: 4.19% (16.6754 => 17.3737, std.dev.: 0.0107)
  MultiSource/Applications/lemon/lemon: 3.80% (1.2364 => 1.2834, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.65% (0.3978 => 0.4123, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.61% (1.2336 => 1.2781, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.09% (1.2472 => 1.2858, std.dev.: 0.0117)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.83% (0.8266 => 0.8500, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/minisat/minisat: 20.99% (6.7422 => 8.1573, std.dev.: 0.0809)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 19.02% (3.6454 => 4.3386, std.dev.: 0.0608)
  SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.7119 => 0.8099, std.dev.: 0.0344)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (5.0391 => 5.3489, std.dev.: 0.0966)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.43% (0.3718 => 0.3920, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.10% (0.5907 => 0.6208, std.dev.: 0.0069)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.60% (1.6513 => 1.6943, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.9618 => 8.1454, std.dev.: 0.0187)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.02% (18.7534 => 19.1322, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.67% (6.0810 => 6.1827, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.52% (7.7386 => 7.8560, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.49% (5.9933 => 6.0826, std.dev.: 0.0152)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (98.8446 => 100.2506, std.dev.: 0.3973)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -33.67% (0.1473 => 0.0977, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -33.19% (0.4091 => 0.2733, std.dev.: 0.0168)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -32.82% (0.2456 => 0.1650, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/08-main/main: -32.21% (0.4415 => 0.2993, std.dev.: 0.0331)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -30.73% (0.1487 => 0.1030, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -29.20% (0.4463 => 0.3160, std.dev.: 0.0065)
  SingleSource/UnitTests/SignlessTypes/factor: -27.72% (0.0505 => 0.0365, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -26.35% (0.1875 => 0.1381, std.dev.: 0.0176)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -24.88% (0.1226 => 0.0921, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/bh/bh: -21.71% (0.4468 => 0.3498, std.dev.: 0.0261)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -19.69% (2.3635 => 1.8981, std.dev.: 0.0151)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -19.52% (6.1315 => 4.9344, std.dev.: 0.1896)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -18.73% (0.0598 => 0.0486, std.dev.: 0.0011)
  MultiSource/Applications/treecc/treecc: -17.91% (2.8387 => 2.3304, std.dev.: 0.1840)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -17.05% (0.7690 => 0.6379, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -15.36% (17.6834 => 14.9677, std.dev.: 0.5678)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -13.22% (5.4717 => 4.7483, std.dev.: 0.2768)
  MultiSource/Applications/siod/siod: -9.90% (2.8858 => 2.6002, std.dev.: 0.1033)
  SingleSource/Benchmarks/Shootout-C++/moments: -5.16% (0.4128 => 0.3915, std.dev.: 0.0060)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.35% (10.6367 => 10.1744, std.dev.: 0.1708)
  MultiSource/Applications/JM/lencod/lencod: -3.73% (18.9583 => 18.2519, std.dev.: 0.1179)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.80% (1.3752 => 1.3367, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.46% (1.6697 => 1.6454, std.dev.: 0.0087)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -32.78% (0.0723 => 0.0486, std.dev.: 0.0001)
  MultiSource/Applications/d/make_dparser: -31.43% (0.0560 => 0.0384, std.dev.: 0.0009)
  MultiSource/Benchmarks/nbench/nbench: -19.63% (24.7620 => 19.9001, std.dev.: 1.0147)
  MultiSource/Benchmarks/McCat/18-imp/imp: -18.52% (0.1253 => 0.1021, std.dev.: 0.0004)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -16.28% (0.1044 => 0.0874, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -13.39% (0.3816 => 0.3305, std.dev.: 0.0141)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.61% (10.2789 => 9.5990, std.dev.: 0.1443)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.04% (65.0866 => 61.1528, std.dev.: 1.3535)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (4.8652 => 4.5783, std.dev.: 0.1078)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -5.35% (4.1900 => 3.9659, std.dev.: 0.0614)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.74% (22.4398 => 21.3752, std.dev.: 0.0389)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.30% (1.6522 => 1.5812, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.18% (3.2983 => 3.1604, std.dev.: 0.0107)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.09% (2.9148 => 2.7956, std.dev.: 0.0248)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.40% (8.7182 => 8.5090, std.dev.: 0.0266)
  MultiSource/Benchmarks/Olden/power/power: -2.04% (1.2108 => 1.1861, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -1.99% (0.6517 => 0.6387, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/flops-8: -1.71% (2.5665 => 2.5225, std.dev.: 0.0066)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.43% (15.9066 => 15.6787, std.dev.: 0.0797)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.12% (3.5746 => 3.5344, std.dev.: 0.0083)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 72.55% (0.0153 => 0.0264, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: 71.15% (0.0156 => 0.0267, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/Oscar: 62.13% (0.0684 => 0.1109, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 61.57% (0.0497 => 0.0803, std.dev.: 0.0049)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 56.19% (0.0194 => 0.0303, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 54.67% (0.0514 => 0.0795, std.dev.: 0.0079)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 53.81% (0.0223 => 0.0343, std.dev.: 0.0045)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 43.12% (0.0269 => 0.0385, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/multiplies: 36.00% (0.0300 => 0.0408, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 35.23% (0.9437 => 1.2762, std.dev.: 0.0505)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 34.98% (0.0426 => 0.0575, std.dev.: 0.0038)
  MultiSource/Benchmarks/MallocBench/gs/gs: 28.02% (4.6860 => 5.9989, std.dev.: 0.2925)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.56% (9.8425 => 12.4563, std.dev.: 0.3697)
  SingleSource/UnitTests/initp1: 25.96% (0.0497 => 0.0626, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/em3d/em3d: 25.56% (0.2019 => 0.2535, std.dev.: 0.0170)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 24.58% (0.6942 => 0.8648, std.dev.: 0.0657)
  SingleSource/UnitTests/SignlessTypes/rem: 19.63% (0.1187 => 0.1420, std.dev.: 0.0010)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.22% (5.5433 => 6.4976, std.dev.: 0.2277)
  SingleSource/UnitTests/Vector/constpool: 14.37% (9.2178 => 10.5426, std.dev.: 0.1206)
  MultiSource/Applications/sqlite3/sqlite3: 10.37% (15.7419 => 17.3737, std.dev.: 0.0107)
  MultiSource/Applications/ClamAV/clamscan: 9.55% (16.9661 => 18.5866, std.dev.: 0.2772)
  SingleSource/Benchmarks/Shootout-C++/methcall: 8.80% (0.2033 => 0.2212, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.35% (5.8749 => 6.3654, std.dev.: 0.0713)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.07% (2.7572 => 2.9521, std.dev.: 0.0745)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.88% (1.9834 => 2.1198, std.dev.: 0.0477)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.00% (0.1899 => 0.2013, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 5.61% (0.1926 => 0.2034, std.dev.: 0.0031)
  MultiSource/Applications/JM/lencod/lencod: 5.52% (17.2968 => 18.2519, std.dev.: 0.1179)
  MultiSource/Applications/lemon/lemon: 5.20% (1.2200 => 1.2834, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 4.87% (0.2113 => 0.2216, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.71% (0.2547 => 0.2667, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.83% (0.3971 => 0.4123, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.44% (1.2356 => 1.2781, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.8224 => 0.8500, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 71.21% (0.7670 => 1.3132, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 44.89% (2.9945 => 4.3386, std.dev.: 0.0608)
  MultiSource/Benchmarks/Olden/bisort/bisort: 32.00% (0.6732 => 0.8886, std.dev.: 0.0604)
  MultiSource/Applications/minisat/minisat: 27.70% (6.3881 => 8.1573, std.dev.: 0.0809)
  SingleSource/Benchmarks/Shootout/ary3: 16.23% (4.5977 => 5.3439, std.dev.: 0.2756)
  MultiSource/Applications/lemon/lemon: 15.73% (0.8632 => 0.9990, std.dev.: 0.0239)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 14.81% (1.4716 => 1.6895, std.dev.: 0.0349)
  SingleSource/Benchmarks/Shootout-C++/ary3: 14.30% (4.6797 => 5.3489, std.dev.: 0.0966)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.87% (2.1020 => 2.3726, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/salsa20: 7.25% (7.5947 => 8.1454, std.dev.: 0.0187)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.74% (0.5871 => 0.6208, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.87% (2.6658 => 2.7956, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.56% (5.9133 => 6.1827, std.dev.: 0.0102)
  MultiSource/Applications/spiff/spiff: 4.45% (2.8130 => 2.9383, std.dev.: 0.0391)
  MultiSource/Applications/siod/siod: 4.07% (3.4258 => 3.5651, std.dev.: 0.0449)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.88% (5.9126 => 6.0826, std.dev.: 0.0152)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.76% (18.6185 => 19.1322, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.57% (3.8062 => 3.9042, std.dev.: 0.0295)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.12% (7.6931 => 7.8560, std.dev.: 0.0315)
  SingleSource/Benchmarks/Shootout/lists: 2.08% (6.9930 => 7.1382, std.dev.: 0.0382)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (1.6699 => 1.6943, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.86% (0.1938 => 0.1650, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.31% (0.6882 => 0.6379, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.11% (0.3402 => 0.3160, std.dev.: 0.0065)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.42% (0.2540 => 0.2377, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.07% (2.0207 => 1.8981, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (1.3676 => 1.2988, std.dev.: 0.0167)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.55% (1.1409 => 1.1004, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.91% (1.3457 => 1.3200, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -15.21% (23.4696 => 19.9001, std.dev.: 1.0147)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.22% (10.0217 => 9.5990, std.dev.: 0.1443)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.98% (3.6583 => 3.5494, std.dev.: 0.0325)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.18% (6.0535 => 5.9213, std.dev.: 0.0480)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.56% (7.9597 => 7.8357, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.02% (21.5962 => 21.3752, std.dev.: 0.0389)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/6488a28d/attachment.html>


More information about the llvm-testresults mailing list