[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Nov 4 16:07:36 PST 2013


http://llvm.org/perf/db_default/v4/nts/16995?compare_to=16969&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16995, Order: 194015, Start Time: 2013-11-04 22:13:42, End Time: 2013-11-05 00:11:08
      To: 16969, Order: 193958, Start Time: 2013-11-03 14:08:01, End Time: 2013-11-03 15:51:19
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 48 (68 on baseline)
Performance Improvements: 9 (19 on baseline)
Added Tests: 2 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1050 (1020 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 91.49% (0.0376 => 0.0720, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 89.88% (0.0929 => 0.1764, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 84.12% (0.0485 => 0.0893, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 83.31% (0.0719 => 0.1318, std.dev.: 0.0094)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 53.55% (0.9690 => 1.4879, std.dev.: 0.1292)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 50.53% (0.3180 => 0.4787, std.dev.: 0.0399)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 48.57% (0.2701 => 0.4013, std.dev.: 0.0409)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 47.07% (0.0939 => 0.1381, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 44.87% (0.7379 => 1.0690, std.dev.: 0.0567)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 43.56% (0.2385 => 0.3424, std.dev.: 0.0348)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 41.32% (4.9566 => 7.0047, std.dev.: 0.7033)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 40.78% (0.6787 => 0.9555, std.dev.: 0.0180)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.66% (1.6531 => 2.2095, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 30.49% (6.1562 => 8.0331, std.dev.: 0.3968)
  SingleSource/Benchmarks/Shootout-C++/lists1: 29.36% (0.3130 => 0.4049, std.dev.: 0.0341)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 28.63% (4.7322 => 6.0871, std.dev.: 0.1214)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 28.36% (1.8966 => 2.4345, std.dev.: 0.1339)
  SingleSource/Benchmarks/Shootout-C++/ary: 28.15% (0.2547 => 0.3264, std.dev.: 0.0154)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.59% (14.7406 => 18.5120, std.dev.: 0.2331)
  MultiSource/Applications/ClamAV/clamscan: 22.57% (16.8156 => 20.6117, std.dev.: 0.9993)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.10% (7.3127 => 8.8555, std.dev.: 0.2698)
  SingleSource/Benchmarks/Shootout-C++/hello: 20.70% (0.1821 => 0.2198, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 19.25% (1.2813 => 1.5280, std.dev.: 0.0547)
  MultiSource/Applications/oggenc/oggenc: 16.91% (5.5266 => 6.4610, std.dev.: 0.0669)
  MultiSource/Benchmarks/PAQ8p/paq8p: 16.55% (2.5558 => 2.9789, std.dev.: 0.1386)
  MultiSource/Applications/lemon/lemon: 16.18% (1.2172 => 1.4142, std.dev.: 0.0447)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 15.38% (0.0878 => 0.1013, std.dev.: 0.0041)
  MultiSource/Benchmarks/nbench/nbench: 14.25% (1.2551 => 1.4339, std.dev.: 0.0476)
  MultiSource/Applications/kimwitu++/kc: 12.72% (18.8534 => 21.2521, std.dev.: 0.4863)
  MultiSource/Applications/sqlite3/sqlite3: 12.53% (16.3160 => 18.3611, std.dev.: 0.4425)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.95% (1.3627 => 1.3893, std.dev.: 0.0079)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 65.45% (0.0411 => 0.0680, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 51.74% (3.0395 => 4.6121, std.dev.: 0.6007)
  MultiSource/Applications/SPASS/SPASS: 50.01% (8.1532 => 12.2310, std.dev.: 0.4925)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 48.58% (2.3845 => 3.5428, std.dev.: 0.0717)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 46.44% (36.3231 => 53.1914, std.dev.: 0.8754)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 40.75% (0.1541 => 0.2169, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 32.11% (21.2814 => 28.1147, std.dev.: 0.7699)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.97% (0.1702 => 0.2093, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.16% (0.3305 => 0.3773, std.dev.: 0.0162)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.14% (0.4671 => 0.5238, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.98% (2.9264 => 3.2476, std.dev.: 0.0702)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.81% (8.5869 => 9.3433, std.dev.: 0.1890)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.34% (4.1013 => 4.3204, std.dev.: 0.0659)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.47% (7.6042 => 7.8678, std.dev.: 0.0999)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.32% (5.8594 => 6.0538, std.dev.: 0.0409)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.05% (35.0948 => 35.4623, std.dev.: 0.0577)
  MultiSource/Benchmarks/Olden/bh/bh: 1.02% (2.3877 => 2.4120, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.56% (5.4499 => 4.6019, std.dev.: 0.2013)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -8.93% (3.5321 => 3.2167, std.dev.: 0.0257)
  SingleSource/Benchmarks/Shootout-C++/methcall: -8.85% (12.3832 => 11.2876, std.dev.: 0.0953)
  MultiSource/Applications/lua/lua: -5.23% (29.6205 => 28.0712, std.dev.: 0.3001)
  MultiSource/Benchmarks/sim/sim: -4.46% (4.0740 => 3.8922, std.dev.: 0.0622)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4436 => 0.4256, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.26% (5.6248 => 5.4979, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.08% (11.9623 => 11.7129, std.dev.: 0.0457)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.04% (23.6368 => 23.3902, std.dev.: 0.0330)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1349 => 0.1348, std.dev.: 0.0072)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 95.65% (0.0368 => 0.0720, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 93.85% (0.0910 => 0.1764, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 89.19% (0.0472 => 0.0893, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 82.30% (0.0723 => 0.1318, std.dev.: 0.0094)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 56.72% (0.9494 => 1.4879, std.dev.: 0.1292)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 54.62% (0.3096 => 0.4787, std.dev.: 0.0399)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 47.75% (0.2716 => 0.4013, std.dev.: 0.0409)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 46.64% (0.2335 => 0.3424, std.dev.: 0.0348)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 45.98% (0.0946 => 0.1381, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 43.28% (0.7461 => 1.0690, std.dev.: 0.0567)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 42.10% (4.9293 => 7.0047, std.dev.: 0.7033)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 39.12% (0.6868 => 0.9555, std.dev.: 0.0180)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.19% (1.6465 => 2.2095, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 33.25% (6.0284 => 8.0331, std.dev.: 0.3968)
  SingleSource/Benchmarks/Shootout-C++/ary: 31.93% (0.2474 => 0.3264, std.dev.: 0.0154)
  SingleSource/Benchmarks/Shootout-C++/lists1: 31.16% (0.3087 => 0.4049, std.dev.: 0.0341)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 31.12% (4.6423 => 6.0871, std.dev.: 0.1214)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 30.37% (1.6047 => 2.0921, std.dev.: 0.1568)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 29.67% (1.8775 => 2.4345, std.dev.: 0.1339)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 27.88% (14.4764 => 18.5120, std.dev.: 0.2331)
  MultiSource/Applications/ClamAV/clamscan: 24.62% (16.5398 => 20.6117, std.dev.: 0.9993)
  SingleSource/Benchmarks/Shootout-C++/hello: 23.00% (0.1787 => 0.2198, std.dev.: 0.0065)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.87% (7.2661 => 8.8555, std.dev.: 0.2698)
  MultiSource/Applications/oggenc/oggenc: 21.13% (5.3339 => 6.4610, std.dev.: 0.0669)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 20.77% (1.2652 => 1.5280, std.dev.: 0.0547)
  MultiSource/Applications/lemon/lemon: 19.22% (1.1862 => 1.4142, std.dev.: 0.0447)
  MultiSource/Benchmarks/PAQ8p/paq8p: 16.06% (2.5666 => 2.9789, std.dev.: 0.1386)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.81% (0.0740 => 0.0857, std.dev.: 0.0037)
  MultiSource/Applications/kimwitu++/kc: 15.75% (18.3608 => 21.2521, std.dev.: 0.4863)
  MultiSource/Benchmarks/nbench/nbench: 14.86% (1.2484 => 1.4339, std.dev.: 0.0476)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.46% (0.0885 => 0.1013, std.dev.: 0.0041)
  MultiSource/Applications/sqlite3/sqlite3: 12.72% (16.2888 => 18.3611, std.dev.: 0.4425)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 7.24% (0.1657 => 0.1777, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.03% (1.2695 => 1.3207, std.dev.: 0.0168)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.85% (0.3480 => 0.3614, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.80% (1.3514 => 1.3893, std.dev.: 0.0079)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.50% (1.1393 => 1.1678, std.dev.: 0.0084)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.98% (4.4696 => 6.9716, std.dev.: 0.2268)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 53.17% (3.0111 => 4.6121, std.dev.: 0.6007)
  MultiSource/Applications/SPASS/SPASS: 48.59% (8.2311 => 12.2310, std.dev.: 0.4925)
  SingleSource/Benchmarks/Shootout-C++/methcall: 47.69% (7.6426 => 11.2876, std.dev.: 0.0953)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 47.56% (2.4010 => 3.5428, std.dev.: 0.0717)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 46.87% (0.0463 => 0.0680, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/matrix: 45.78% (2.8554 => 4.1627, std.dev.: 0.0241)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 45.77% (0.1488 => 0.2169, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 44.38% (36.8417 => 53.1914, std.dev.: 0.8754)
  SingleSource/Benchmarks/Shootout-C++/ary: 40.68% (0.0381 => 0.0536, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 39.52% (4.2391 => 5.9144, std.dev.: 0.1456)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 30.63% (21.5217 => 28.1147, std.dev.: 0.7699)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 22.61% (0.1707 => 0.2093, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.09% (0.4673 => 0.5238, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.57% (2.9372 => 3.2476, std.dev.: 0.0702)
  SingleSource/Benchmarks/Misc/ReedSolomon: 9.59% (8.5256 => 9.3433, std.dev.: 0.1890)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.81% (3.1730 => 3.3892, std.dev.: 0.0393)
  SingleSource/Benchmarks/McGill/misr: 6.76% (0.3771 => 0.4026, std.dev.: 0.0057)
  SingleSource/UnitTests/Vector/multiplies: 6.76% (0.5561 => 0.5937, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.14% (6.1088 => 6.4841, std.dev.: 0.1316)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.03% (96.7834 => 102.6164, std.dev.: 1.4337)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.35% (4.1011 => 4.3204, std.dev.: 0.0659)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.03% (3.5550 => 3.7338, std.dev.: 0.0683)
  MultiSource/Applications/hexxagon/hexxagon: 4.76% (14.7810 => 15.4845, std.dev.: 0.0455)
  MultiSource/Applications/aha/aha: 4.36% (3.5731 => 3.7289, std.dev.: 0.0290)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.32% (3.5642 => 3.7182, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.98% (5.7757 => 6.0055, std.dev.: 0.0039)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.33% (89.7126 => 92.7030, std.dev.: 0.2192)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.10% (5.8715 => 6.0538, std.dev.: 0.0409)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.54% (1.0477 => 1.0743, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.74% (3.1569 => 3.2118, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.60% (57.2347 => 13.3909, std.dev.: 0.0831)
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.06% (0.5226 => 0.2453, std.dev.: 0.0379)
  MultiSource/Applications/sgefa/sgefa: -42.33% (1.5790 => 0.9106, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -19.94% (4.0181 => 3.2167, std.dev.: 0.0257)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.85% (15.9508 => 13.1039, std.dev.: 0.4693)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -13.54% (20.8247 => 18.0045, std.dev.: 0.3061)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.24% (5.0002 => 4.3380, std.dev.: 0.2254)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.14% (3.7437 => 3.3267, std.dev.: 0.0900)
  SingleSource/Benchmarks/Shootout/ary3: -11.14% (4.6972 => 4.1740, std.dev.: 0.1850)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.37% (3.4956 => 3.1332, std.dev.: 0.0254)
  MultiSource/Applications/lua/lua: -4.91% (29.5202 => 28.0712, std.dev.: 0.3001)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.28% (8.1346 => 7.8678, std.dev.: 0.0999)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.03% (2.5938 => 2.5153, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.87% (17.1431 => 16.6507, std.dev.: 0.1186)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.81% (3.7874 => 3.6811, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/power/power: -2.69% (1.2170 => 1.1843, std.dev.: 0.0116)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.68% (2.4471 => 2.3816, std.dev.: 0.0217)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.04% (4.3592 => 4.2703, std.dev.: 0.0162)
  SingleSource/Benchmarks/Misc/whetstone: -1.38% (3.6303 => 3.5803, std.dev.: 0.0109)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.1348 => 0.1348, std.dev.: 0.0072)

Report Time: 0.86s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131104/51be0259/attachment.html>


More information about the llvm-testresults mailing list