[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon Dec 2 15:36:30 PST 2013
http://llvm.org/perf/db_default/v4/nts/17843?compare_to=17835&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21
Comparing:
Run: 17843, Order: 196155, Start Time: 2013-12-02 21:50:42, End Time: 2013-12-02 23:40:34
To: 17835, Order: 196130, Start Time: 2013-12-02 19:31:44, End Time: 2013-12-02 21:21:56
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03
===============
Tests Summary
===============
Performance Regressions: 32 (37 on baseline)
Performance Improvements: 40 (6 on baseline)
Unchanged Tests: 1038 (1067 on baseline)
Total Tests: 1110
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Towers: 76.80% (0.0513 => 0.0907, std.dev.: 0.0023)
SingleSource/Benchmarks/Stanford/Puzzle: 58.92% (0.1273 => 0.2023, std.dev.: 0.0100)
SingleSource/Benchmarks/Misc/flops-3: 56.47% (0.0317 => 0.0496, std.dev.: 0.0034)
SingleSource/Benchmarks/Misc/whetstone: 49.83% (0.0889 => 0.1332, std.dev.: 0.0071)
SingleSource/Benchmarks/Shootout-C++/objinst: 39.56% (0.2136 => 0.2981, std.dev.: 0.0242)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.80% (0.1031 => 0.1431, std.dev.: 0.0133)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 38.31% (0.3947 => 0.5459, std.dev.: 0.0424)
MultiSource/Applications/obsequi/Obsequi: 35.41% (1.1445 => 1.5498, std.dev.: 0.0502)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 28.01% (0.7507 => 0.9610, std.dev.: 0.0240)
MultiSource/Benchmarks/Prolangs-C++/city/city: 15.52% (1.5343 => 1.7724, std.dev.: 0.0626)
MultiSource/Benchmarks/McCat/18-imp/imp: 12.65% (0.4046 => 0.4558, std.dev.: 0.0080)
MultiSource/Applications/lemon/lemon: 11.41% (1.2051 => 1.3426, std.dev.: 0.0464)
MultiSource/Applications/sqlite3/sqlite3: 8.77% (15.9025 => 17.2967, std.dev.: 0.0857)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.91% (1.2743 => 1.3751, std.dev.: 0.0095)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.38% (1.3098 => 1.3934, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.49% (1.2614 => 1.3306, std.dev.: 0.0261)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.53% (1.2590 => 1.3160, std.dev.: 0.0182)
SingleSource/Benchmarks/Shootout-C++/sieve: 4.36% (0.2845 => 0.2969, std.dev.: 0.0016)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.88% (1.2603 => 1.2966, std.dev.: 0.0124)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.73% (1.3678 => 1.4052, std.dev.: 0.0077)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/minisat/minisat: 25.57% (6.3869 => 8.0198, std.dev.: 0.2407)
SingleSource/Benchmarks/Shootout-C++/ary3: 24.75% (4.2789 => 5.3378, std.dev.: 0.1475)
MultiSource/Applications/SPASS/SPASS: 15.67% (8.5869 => 9.9324, std.dev.: 0.1931)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.14% (0.4590 => 0.5193, std.dev.: 0.0190)
SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (5.0068 => 5.4014, std.dev.: 0.0099)
SingleSource/Benchmarks/Misc/flops: 3.87% (9.2705 => 9.6290, std.dev.: 0.0063)
SingleSource/Benchmarks/Misc/salsa20: 3.77% (7.8596 => 8.1556, std.dev.: 0.0775)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.84% (1.8153 => 1.8668, std.dev.: 0.0127)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.14% (5.7099 => 5.8319, std.dev.: 0.0269)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.64% (4.8249 => 4.9038, std.dev.: 0.0182)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (1.6493 => 1.6737, std.dev.: 0.0095)
MultiSource/Applications/lua/lua: 1.29% (28.8241 => 29.1970, std.dev.: 0.1406)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/BitBench/drop3/drop3: -41.53% (0.0886 => 0.0518, std.dev.: 0.0136)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -26.98% (0.2109 => 0.1540, std.dev.: 0.0216)
SingleSource/Benchmarks/Shootout/heapsort: -26.49% (0.0672 => 0.0494, std.dev.: 0.0047)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -18.24% (9.0225 => 7.3765, std.dev.: 0.2036)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -18.22% (6.3526 => 5.1951, std.dev.: 0.2860)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -16.76% (2.0545 => 1.7102, std.dev.: 0.0459)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -16.27% (0.0928 => 0.0777, std.dev.: 0.0045)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -15.92% (5.7550 => 4.8389, std.dev.: 0.2409)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -15.36% (0.1946 => 0.1647, std.dev.: 0.0043)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -13.06% (1.2566 => 1.0925, std.dev.: 0.0072)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.49% (0.0993 => 0.0869, std.dev.: 0.0041)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -12.31% (0.3080 => 0.2701, std.dev.: 0.0058)
MultiSource/Benchmarks/mafft/pairlocalalign: -12.06% (11.5494 => 10.1561, std.dev.: 0.0880)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -10.91% (1.6669 => 1.4851, std.dev.: 0.0129)
MultiSource/Benchmarks/Ptrdist/ks/ks: -10.63% (0.1966 => 0.1757, std.dev.: 0.0079)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -10.33% (0.7056 => 0.6327, std.dev.: 0.0096)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.88% (16.7762 => 15.1193, std.dev.: 0.2545)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.72% (26.7384 => 24.6749, std.dev.: 0.5674)
SingleSource/Benchmarks/Misc-C++/bigfib: -6.62% (0.7044 => 0.6578, std.dev.: 0.0163)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.31% (1.4073 => 1.3185, std.dev.: 0.0111)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.64% (4.5402 => 4.3748, std.dev.: 0.0435)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.80% (1.3086 => 1.2720, std.dev.: 0.0055)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.47% (6.5480 => 6.3864, std.dev.: 0.0408)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -20.86% (3.1745 => 2.5123, std.dev.: 0.0627)
SingleSource/Benchmarks/Shootout-C++/ary: -20.77% (0.0491 => 0.0389, std.dev.: 0.0017)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -18.47% (0.1532 => 0.1249, std.dev.: 0.0044)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.99% (0.5305 => 0.4616, std.dev.: 0.0024)
MultiSource/Benchmarks/7zip/7zip-benchmark: -7.93% (10.6439 => 9.8002, std.dev.: 0.0443)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.93% (65.0888 => 60.5759, std.dev.: 1.5518)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.91% (2.8086 => 2.6708, std.dev.: 0.0467)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.51% (3.0629 => 2.9247, std.dev.: 0.0006)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.49% (0.2894 => 0.2764, std.dev.: 0.0009)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.43% (5.4369 => 5.2506, std.dev.: 0.0062)
SingleSource/Benchmarks/Misc/flops-7: -3.42% (1.7847 => 1.7237, std.dev.: 0.0224)
MultiSource/Benchmarks/PAQ8p/paq8p: -3.18% (100.8502 => 97.6422, std.dev.: 1.1443)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.84% (1.8150 => 1.7635, std.dev.: 0.0064)
SingleSource/Benchmarks/Shootout-C++/lists: -2.83% (16.3149 => 15.8528, std.dev.: 0.0882)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.51% (6.6649 => 6.4977, std.dev.: 0.0166)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.93% (3.6563 => 3.5856, std.dev.: 0.0103)
MultiSource/Applications/hexxagon/hexxagon: -1.46% (15.2157 => 14.9929, std.dev.: 0.0370)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Towers: 77.15% (0.0512 => 0.0907, std.dev.: 0.0023)
SingleSource/Benchmarks/Misc/flops-3: 63.70% (0.0303 => 0.0496, std.dev.: 0.0034)
SingleSource/Benchmarks/Stanford/Puzzle: 59.79% (0.1266 => 0.2023, std.dev.: 0.0100)
SingleSource/Benchmarks/Misc/whetstone: 49.16% (0.0893 => 0.1332, std.dev.: 0.0071)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.46% (0.3859 => 0.5459, std.dev.: 0.0424)
SingleSource/Benchmarks/Shootout-C++/objinst: 40.81% (0.2117 => 0.2981, std.dev.: 0.0242)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.16% (0.1051 => 0.1431, std.dev.: 0.0133)
SingleSource/Benchmarks/Stanford/FloatMM: 35.43% (0.0446 => 0.0604, std.dev.: 0.0060)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 30.31% (0.7375 => 0.9610, std.dev.: 0.0240)
MultiSource/Applications/obsequi/Obsequi: 30.18% (1.1905 => 1.5498, std.dev.: 0.0502)
MultiSource/Benchmarks/Prolangs-C++/city/city: 18.21% (1.4994 => 1.7724, std.dev.: 0.0626)
MultiSource/Benchmarks/McCat/18-imp/imp: 14.75% (0.3972 => 0.4558, std.dev.: 0.0080)
MultiSource/Applications/lemon/lemon: 10.05% (1.2200 => 1.3426, std.dev.: 0.0464)
MultiSource/Applications/sqlite3/sqlite3: 9.88% (15.7419 => 17.2967, std.dev.: 0.0857)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.71% (5.8749 => 6.3864, std.dev.: 0.0408)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.32% (1.2495 => 1.3160, std.dev.: 0.0182)
SingleSource/Benchmarks/Shootout-C++/sieve: 3.96% (0.2856 => 0.2969, std.dev.: 0.0016)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.82% (1.3505 => 1.3751, std.dev.: 0.0095)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 52.90% (2.9492 => 4.5092, std.dev.: 0.0884)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.68% (1.4795 => 1.8594, std.dev.: 0.0307)
MultiSource/Applications/minisat/minisat: 25.54% (6.3881 => 8.0198, std.dev.: 0.2407)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.02% (0.4400 => 0.5193, std.dev.: 0.0190)
SingleSource/Benchmarks/CoyoteBench/lpbench: 17.18% (4.0567 => 4.7536, std.dev.: 0.2103)
MultiSource/Applications/SPASS/SPASS: 16.35% (8.5363 => 9.9324, std.dev.: 0.1931)
SingleSource/Benchmarks/Shootout-C++/ary3: 14.06% (4.6797 => 5.3378, std.dev.: 0.1475)
SingleSource/Benchmarks/Misc/salsa20: 7.39% (7.5947 => 8.1556, std.dev.: 0.0775)
SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (5.0320 => 5.4014, std.dev.: 0.0099)
SingleSource/Benchmarks/Misc/flops: 3.90% (9.2673 => 9.6290, std.dev.: 0.0063)
MultiSource/Applications/aha/aha: 3.72% (3.5645 => 3.6971, std.dev.: 0.0427)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.46% (21.5962 => 22.3439, std.dev.: 0.1811)
SingleSource/Benchmarks/McGill/chomp: 3.18% (1.0099 => 1.0420, std.dev.: 0.0072)
MultiSource/Benchmarks/Olden/bh/bh: 2.40% (2.3919 => 2.4494, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.21% (5.7060 => 5.8319, std.dev.: 0.0269)
SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.65% (4.8243 => 4.9038, std.dev.: 0.0182)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.30% (1.7409 => 1.7635, std.dev.: 0.0064)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5986 => 1.6193, std.dev.: 0.0060)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.19% (6.4210 => 6.4977, std.dev.: 0.0166)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.24% (1.1409 => 1.0925, std.dev.: 0.0072)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.20% (1.3676 => 1.3101, std.dev.: 0.0088)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.50% (1.2914 => 1.2720, std.dev.: 0.0055)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except: -4.41% (0.4987 => 0.4767, std.dev.: 0.0063)
MultiSource/Benchmarks/7zip/7zip-benchmark: -2.21% (10.0217 => 9.8002, std.dev.: 0.0443)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.99% (3.6583 => 3.5856, std.dev.: 0.0103)
Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131202/52f2b6dd/attachment.html>
More information about the llvm-testresults
mailing list