[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 31 14:27:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11930?compare_to=11927&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11930, Order: 183028, Start Time: 2013-05-31 19:36:56, End Time: 2013-05-31 21:27:57
      To: 11927, Order: 183018, Start Time: 2013-05-31 17:29:35, End Time: 2013-05-31 19:15:13
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 62 (52 on baseline)
Performance Improvements: 3 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1042 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 101.17% (0.0171 => 0.0344, std.dev.: 0.0002)
  SingleSource/UnitTests/stmtexpr: 67.68% (0.0198 => 0.0332, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 66.02% (0.0927 => 0.1539, std.dev.: 0.0013)
  SingleSource/UnitTests/SignlessTypes/factor: 65.42% (0.0347 => 0.0574, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 62.41% (0.0266 => 0.0432, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 57.65% (0.1438 => 0.2267, std.dev.: 0.0062)
  SingleSource/Regression/C/test_indvars: 57.53% (0.0299 => 0.0471, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/sumarray-dbl: 57.20% (0.0236 => 0.0371, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/divides: 56.70% (0.0194 => 0.0304, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 53.93% (0.2713 => 0.4176, std.dev.: 0.0146)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 53.91% (0.0243 => 0.0374, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 48.21% (0.0390 => 0.0578, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 48.14% (0.1724 => 0.2554, std.dev.: 0.0241)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 40.77% (0.9973 => 1.4039, std.dev.: 0.0729)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.16% (1.4278 => 1.9583, std.dev.: 0.0409)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 36.22% (0.3269 => 0.4453, std.dev.: 0.0337)
  SingleSource/Benchmarks/Shootout/random: 35.93% (0.0334 => 0.0454, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 30.09% (5.0101 => 6.5174, std.dev.: 0.1684)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.06% (7.4721 => 9.3447, std.dev.: 0.3376)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.82% (1.9158 => 2.3339, std.dev.: 0.1330)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.43% (0.6007 => 0.7294, std.dev.: 0.0291)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.03% (14.8576 => 17.8334, std.dev.: 0.0646)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 12.08% (0.2301 => 0.2579, std.dev.: 0.0087)
  MultiSource/Applications/d/make_dparser: 10.57% (3.6774 => 4.0661, std.dev.: 0.0755)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.33% (25.6027 => 27.4801, std.dev.: 0.2893)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.01% (1.3949 => 1.4927, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.32% (1.4286 => 1.5189, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 5.84% (0.3799 => 0.4021, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.17% (0.5225 => 0.5495, std.dev.: 0.0026)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.77% (2.5413 => 2.6626, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.13% (1.4364 => 1.4957, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.76% (1.6071 => 1.6675, std.dev.: 0.0134)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.58% (0.3073 => 0.3183, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.68% (1.6947 => 1.7402, std.dev.: 0.0138)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 83.86% (5.7706 => 10.6099, std.dev.: 0.0690)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 64.82% (0.0506 => 0.0834, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 44.08% (0.0456 => 0.0657, std.dev.: 0.0068)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.03% (1.5010 => 2.1169, std.dev.: 0.0377)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 36.73% (0.0961 => 0.1314, std.dev.: 0.0134)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 29.02% (2.4165 => 3.1178, std.dev.: 0.1192)
  MultiSource/Benchmarks/Olden/bisort/bisort: 27.16% (0.6738 => 0.8568, std.dev.: 0.0515)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.34% (0.1184 => 0.1413, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.98% (4.1404 => 4.8435, std.dev.: 0.0178)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.11% (2.5733 => 2.9878, std.dev.: 0.0208)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.54% (29.5176 => 33.5132, std.dev.: 0.5223)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.69% (37.2940 => 40.9070, std.dev.: 0.7814)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.41% (2.0225 => 2.1522, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.89% (4.0327 => 4.2703, std.dev.: 0.0475)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.41% (92.4925 => 97.4999, std.dev.: 1.4352)
  MultiSource/Benchmarks/FreeBench/neural/neural: 5.39% (0.3318 => 0.3497, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.12% (60.5222 => 63.6193, std.dev.: 1.0918)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.26% (1.0572 => 1.1022, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.66% (2.6932 => 2.7917, std.dev.: 0.0347)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.46% (3.3830 => 3.5000, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.32% (6.1038 => 6.3063, std.dev.: 0.0453)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (39.6953 => 40.7239, std.dev.: 0.3153)
  MultiSource/Applications/sqlite3/sqlite3: 2.44% (4.3275 => 4.4333, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.98% (9.7834 => 9.9770, std.dev.: 0.0384)
  SingleSource/Regression/C/uint64_to_float: 1.84% (1.6878 => 1.7188, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.72% (5.8571 => 5.9578, std.dev.: 0.0200)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.7571 => 4.8255, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc/oourafft: 1.27% (3.7237 => 3.7711, std.dev.: 0.0118)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lua/lua: -4.92% (30.2110 => 28.7250, std.dev.: 0.2061)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.57% (3.8654 => 3.7659, std.dev.: 0.0118)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.00% (44.3712 => 43.4852, std.dev.: 0.2626)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.66% (0.1481 => 0.1412, std.dev.: 0.0206)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 83.96% (0.0187 => 0.0344, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 67.44% (0.0258 => 0.0432, std.dev.: 0.0014)
  SingleSource/UnitTests/SignlessTypes/factor: 56.83% (0.0366 => 0.0574, std.dev.: 0.0004)
  SingleSource/Regression/C/test_indvars: 55.45% (0.0303 => 0.0471, std.dev.: 0.0021)
  SingleSource/UnitTests/stmtexpr: 54.42% (0.0215 => 0.0332, std.dev.: 0.0010)
  SingleSource/UnitTests/Vector/sumarray-dbl: 53.31% (0.0242 => 0.0371, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 52.74% (0.2734 => 0.4176, std.dev.: 0.0146)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 47.83% (0.0253 => 0.0374, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 43.16% (0.1075 => 0.1539, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 40.90% (0.9964 => 1.4039, std.dev.: 0.0729)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 37.73% (0.1646 => 0.2267, std.dev.: 0.0062)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.40% (1.4253 => 1.9583, std.dev.: 0.0409)
  SingleSource/Benchmarks/Shootout/random: 35.52% (0.0335 => 0.0454, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 35.42% (0.1886 => 0.2554, std.dev.: 0.0241)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 31.82% (0.3378 => 0.4453, std.dev.: 0.0337)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.30% (0.0465 => 0.0578, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.93% (0.5982 => 0.7294, std.dev.: 0.0291)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.03% (7.7211 => 9.3447, std.dev.: 0.3376)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.99% (5.4314 => 6.5174, std.dev.: 0.1684)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 12.37% (0.2295 => 0.2579, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.56% (15.9860 => 17.8334, std.dev.: 0.0646)
  MultiSource/Applications/d/make_dparser: 8.92% (3.7330 => 4.0661, std.dev.: 0.0755)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.91% (1.3833 => 1.4927, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.49% (1.4131 => 1.5189, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.30% (1.4757 => 1.5834, std.dev.: 0.0401)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.17% (2.5078 => 2.6626, std.dev.: 0.0294)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.96% (25.9348 => 27.4801, std.dev.: 0.2893)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.75% (0.5196 => 0.5495, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.05% (1.4238 => 1.4957, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.50% (0.3848 => 0.4021, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.32% (1.5984 => 1.6675, std.dev.: 0.0134)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.99% (0.3061 => 0.3183, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.78% (1.5727 => 1.6321, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.09% (1.6881 => 1.7402, std.dev.: 0.0138)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 81.70% (0.0459 => 0.0834, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/ary3: 76.47% (6.0122 => 10.6099, std.dev.: 0.0690)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 41.29% (0.0465 => 0.0657, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 27.83% (0.0539 => 0.0689, std.dev.: 0.0057)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.91% (2.5366 => 3.1178, std.dev.: 0.1192)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.56% (0.1172 => 0.1413, std.dev.: 0.0035)
  MultiSource/Applications/sgefa/sgefa: 18.38% (1.1695 => 1.3845, std.dev.: 0.0205)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.81% (2.5800 => 2.9878, std.dev.: 0.0208)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 15.73% (1.8291 => 2.1169, std.dev.: 0.0377)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.36% (2.0236 => 2.1522, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.34% (4.0156 => 4.2703, std.dev.: 0.0475)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.49% (1.2224 => 1.2895, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.27% (1.0571 => 1.1022, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.76% (6.1372 => 6.3063, std.dev.: 0.0453)
  SingleSource/Regression/C/uint64_to_float: 2.00% (1.6851 => 1.7188, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.31% (11.4990 => 11.6498, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/oourafft: 1.06% (3.7315 => 3.7711, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.06% (9.8728 => 9.9770, std.dev.: 0.0384)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.85% (0.2431 => 0.1827, std.dev.: 0.0211)
  SingleSource/Benchmarks/Shootout-C++/strcat: -6.67% (0.2309 => 0.2155, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.04% (0.2151 => 0.2021, std.dev.: 0.0049)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.30% (1.2911 => 0.7320, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.02% (6.2328 => 5.0474, std.dev.: 0.0258)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.10% (25.3677 => 21.2823, std.dev.: 0.0771)
  SingleSource/Benchmarks/Misc/salsa20: -12.69% (10.3398 => 9.0272, std.dev.: 0.0040)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.03% (48.3307 => 43.4852, std.dev.: 0.2626)
  SingleSource/Benchmarks/Shootout-C++/hash: -7.74% (0.7941 => 0.7326, std.dev.: 0.0180)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.63% (0.1945 => 0.1816, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.99% (4.5717 => 4.3435, std.dev.: 0.0026)
  MultiSource/Applications/sqlite3/sqlite3: -4.37% (4.6358 => 4.4333, std.dev.: 0.0255)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.70% (9.1099 => 8.7729, std.dev.: 0.0814)
  SingleSource/Benchmarks/Misc/flops: -3.57% (10.2170 => 9.8527, std.dev.: 0.0233)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.60% (3.8665 => 3.7659, std.dev.: 0.0118)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1441 => 0.1412, std.dev.: 0.0206)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130531/81244e76/attachment.html>


More information about the llvm-testresults mailing list