[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 14 18:14:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14418?compare_to=14414&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14418, Order: 188423, Start Time: 2013-08-14 23:21:30, End Time: 2013-08-15 01:16:54
      To: 14414, Order: 188410, Start Time: 2013-08-14 21:01:43, End Time: 2013-08-14 22:53:27
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 49 (65 on baseline)
Performance Improvements: 2 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1056 (1016 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 61.78% (0.0730 => 0.1181, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 59.45% (0.0984 => 0.1569, std.dev.: 0.0085)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 57.78% (0.2513 => 0.3965, std.dev.: 0.0122)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 50.85% (0.2285 => 0.3447, std.dev.: 0.0240)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 44.36% (0.0532 => 0.0768, std.dev.: 0.0073)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 39.27% (1.0016 => 1.3949, std.dev.: 0.0571)
  SingleSource/Benchmarks/Misc/flops-7: 36.16% (0.0318 => 0.0433, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 33.46% (0.1288 => 0.1719, std.dev.: 0.0141)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.21% (1.6497 => 2.1150, std.dev.: 0.1164)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.45% (5.1307 => 6.5390, std.dev.: 0.3260)
  MultiSource/Applications/Burg/burg: 23.27% (1.4696 => 1.8116, std.dev.: 0.0720)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.00% (5.1206 => 6.2470, std.dev.: 0.3322)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.27% (1.9829 => 2.3848, std.dev.: 0.0330)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.00% (7.7310 => 9.2771, std.dev.: 0.3464)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.11% (0.0834 => 0.0960, std.dev.: 0.0044)
  MultiSource/Benchmarks/nbench/nbench: 14.68% (1.3089 => 1.5010, std.dev.: 0.0545)
  SingleSource/Benchmarks/Misc/fbench: 14.17% (0.0769 => 0.0878, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.14% (0.2579 => 0.2892, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.35% (1.3940 => 1.5522, std.dev.: 0.0239)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.73% (0.1025 => 0.1135, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.12% (0.1028 => 0.1132, std.dev.: 0.0035)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 9.69% (0.1073 => 0.1177, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.26% (0.1525 => 0.1651, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 6.87% (0.2430 => 0.2597, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.23% (1.3721 => 1.4027, std.dev.: 0.0108)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 51.48% (5.8535 => 8.8671, std.dev.: 1.0396)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 50.58% (0.1477 => 0.2224, std.dev.: 0.0063)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.30% (0.0287 => 0.0417, std.dev.: 0.0014)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.79% (2.5762 => 3.2405, std.dev.: 0.0487)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.36% (2.7284 => 3.2565, std.dev.: 0.1146)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.81% (61.1673 => 72.6715, std.dev.: 1.8358)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.40% (21.4170 => 25.3567, std.dev.: 0.4150)
  SingleSource/Benchmarks/Misc/pi: 14.53% (2.2060 => 2.5265, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.84% (0.2768 => 0.3151, std.dev.: 0.0115)
  SingleSource/Benchmarks/Linpack/linpack-pc: 12.97% (45.6814 => 51.6061, std.dev.: 0.4404)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.99% (2.8999 => 3.1897, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.58% (2.9991 => 3.2265, std.dev.: 0.0713)
  MultiSource/Applications/lemon/lemon: 7.16% (0.9179 => 0.9836, std.dev.: 0.0127)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.30% (3.9582 => 4.2076, std.dev.: 0.0287)
  SingleSource/Benchmarks/Misc/flops-4: 6.08% (1.5513 => 1.6456, std.dev.: 0.0109)
  MultiSource/Applications/lua/lua: 5.06% (29.6821 => 31.1832, std.dev.: 0.0800)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.47% (4.7531 => 4.9182, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.20% (3.5757 => 3.6902, std.dev.: 0.0297)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.42% (20.8996 => 21.4059, std.dev.: 0.0619)
  SingleSource/Benchmarks/Shootout/lists: 1.75% (7.1475 => 7.2725, std.dev.: 0.0085)
  MultiSource/Applications/sgefa/sgefa: 1.56% (1.3689 => 1.3902, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.54% (1.6188 => 1.6438, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.44% (6.4104 => 6.5025, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.13% (5.8558 => 5.9221, std.dev.: 0.0166)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: -12.69% (0.2592 => 0.2263, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.22% (0.9001 => 0.8621, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.04% (0.1371 => 0.1343, std.dev.: 0.0073)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 61.31% (0.2458 => 0.3965, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 60.90% (0.0734 => 0.1181, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 60.59% (0.0977 => 0.1569, std.dev.: 0.0085)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 50.29% (0.0511 => 0.0768, std.dev.: 0.0073)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 44.53% (0.2385 => 0.3447, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc/flops-7: 37.90% (0.0314 => 0.0433, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/lowercase: 36.86% (0.0312 => 0.0427, std.dev.: 0.0038)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.75% (1.6686 => 2.1150, std.dev.: 0.1164)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.67% (1.1012 => 1.3949, std.dev.: 0.0571)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.28% (5.3476 => 6.5390, std.dev.: 0.3260)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.23% (1.9671 => 2.3848, std.dev.: 0.0330)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.43% (7.7035 => 9.2771, std.dev.: 0.3464)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.20% (5.2851 => 6.2470, std.dev.: 0.3322)
  SingleSource/Benchmarks/Misc/fbench: 17.69% (0.0746 => 0.0878, std.dev.: 0.0038)
  MultiSource/Applications/Burg/burg: 15.15% (1.5733 => 1.8116, std.dev.: 0.0720)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.44% (0.2527 => 0.2892, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.71% (0.1016 => 0.1135, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.25% (0.1058 => 0.1177, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.93% (1.3993 => 1.5522, std.dev.: 0.0239)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.63% (0.1506 => 0.1651, std.dev.: 0.0048)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.40% (3.7285 => 6.5025, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout/ary3: 52.47% (5.8158 => 8.8671, std.dev.: 1.0396)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.74% (2.8867 => 4.2938, std.dev.: 0.0685)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 44.23% (0.1542 => 0.2224, std.dev.: 0.0063)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 42.23% (0.0341 => 0.0485, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.79% (0.3171 => 0.4306, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/pi: 27.38% (1.9835 => 2.5265, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.36% (2.9428 => 3.7480, std.dev.: 0.2788)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.67% (1.5030 => 1.9038, std.dev.: 0.0029)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.19% (2.6094 => 3.2405, std.dev.: 0.0487)
  SingleSource/Benchmarks/Shootout/hash: 23.72% (4.1846 => 5.1770, std.dev.: 0.3380)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.65% (2.6992 => 3.2565, std.dev.: 0.1146)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.42% (60.3477 => 72.6715, std.dev.: 1.8358)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.34% (0.0526 => 0.0633, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.63% (21.5567 => 25.3567, std.dev.: 0.4150)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.02% (0.2813 => 0.3151, std.dev.: 0.0115)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (7.0762 => 7.8491, std.dev.: 0.1027)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.44% (14.9584 => 16.5205, std.dev.: 0.3194)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.1678 => 0.1839, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.87% (1.2557 => 1.3671, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.43% (3.4085 => 3.6958, std.dev.: 0.0469)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.42% (5.4910 => 5.9535, std.dev.: 0.0177)
  SingleSource/Benchmarks/McGill/chomp: 7.88% (1.0051 => 1.0843, std.dev.: 0.0236)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.88% (2.9568 => 3.1897, std.dev.: 0.0488)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.69% (2.9962 => 3.2265, std.dev.: 0.0713)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.98% (3.2027 => 3.4261, std.dev.: 0.0264)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.79% (48.3256 => 51.6061, std.dev.: 0.4404)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.14% (5.3042 => 5.6299, std.dev.: 0.0356)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.22% (3.3384 => 3.5128, std.dev.: 0.0489)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.99% (4.0075 => 4.2076, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.98% (1.4327 => 1.5041, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.82% (4.3151 => 4.5232, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.39% (3.5351 => 3.6902, std.dev.: 0.0297)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.94% (6.1245 => 6.3660, std.dev.: 0.0502)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.85% (4.7360 => 4.9182, std.dev.: 0.0074)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.55% (25.0200 => 25.9093, std.dev.: 0.3203)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.14% (3.3877 => 3.4940, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.8739 => 5.0242, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.02% (1.5956 => 1.6438, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (12.8625 => 13.1903, std.dev.: 0.0552)
  SingleSource/Benchmarks/Shootout/matrix: 2.30% (1.7358 => 1.7757, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/flops-4: 1.81% (1.6164 => 1.6456, std.dev.: 0.0109)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.42% (5.8390 => 5.9221, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.26% (4.9040 => 4.9657, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.10% (3.0680 => 3.1017, std.dev.: 0.0112)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/lambda-0_1_3/lambda: -10.20% (0.9461 => 0.8496, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.96% (1.5815 => 1.4873, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.61% (1.6226 => 1.5316, std.dev.: 0.0206)
  MultiSource/Applications/lemon/lemon: -2.30% (1.2976 => 1.2677, std.dev.: 0.0114)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.85% (2.1022 => 1.4327, std.dev.: 0.0597)
  MultiSource/Applications/lemon/lemon: -30.70% (1.4194 => 0.9836, std.dev.: 0.0127)
  MultiSource/Applications/viterbi/viterbi: -27.43% (3.4923 => 2.5344, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.64% (6.9552 => 5.2417, std.dev.: 0.0776)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6130, std.dev.: 0.0109)
  SingleSource/Benchmarks/Misc/mandel: -13.60% (1.1996 => 1.0364, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.63% (6.2627 => 5.5343, std.dev.: 0.1512)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.78% (3.5791 => 3.3005, std.dev.: 0.0883)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.02% (47.2250 => 44.8544, std.dev.: 0.7791)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.13% (0.3773 => 0.3617, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.03% (1.7207 => 1.6514, std.dev.: 0.0095)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.01% (1.1032 => 1.0590, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/fbench: -3.76% (4.9602 => 4.7737, std.dev.: 0.0373)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.63% (1.1024 => 1.0624, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.44% (0.8928 => 0.8621, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.00% (6.0444 => 5.8633, std.dev.: 0.0522)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.94% (0.7355 => 0.7139, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.69% (6.1482 => 5.9831, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.63% (5.2218 => 5.0845, std.dev.: 0.0259)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.45% (0.7806 => 0.7615, std.dev.: 0.0057)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.76% (34.8438 => 34.2305, std.dev.: 0.0580)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.29% (21.6864 => 21.4059, std.dev.: 0.0619)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.54% (0.1378 => 0.1343, std.dev.: 0.0073)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130814/f419f042/attachment.html>


More information about the llvm-testresults mailing list