[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Aug 10 00:42:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14279?compare_to=14275&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14279, Order: 188132, Start Time: 2013-08-10 05:59:50, End Time: 2013-08-10 07:44:50
      To: 14275, Order: 188128, Start Time: 2013-08-10 03:54:01, End Time: 2013-08-10 05:38:33
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 6 (34 on baseline)
Performance Improvements: 1 (52 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1098 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 19.27% (0.0545 => 0.0650)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.59% (5.2422 => 5.9024, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.71% (4.0283 => 4.2585, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.47% (5.0132 => 5.2872, std.dev.: 0.0808)
  SingleSource/Benchmarks/McGill/misr: 3.89% (0.3754 => 0.3900, std.dev.: 0.0003)
  SingleSource/Benchmarks/McGill/queens: 2.08% (1.6515 => 1.6859, std.dev.: 0.0004)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.53% (2.6452 => 2.6047, std.dev.: 0.0143)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 1.21% (0.1326 => 0.1342, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.58% (0.2747 => 0.2731, std.dev.: 0.0112)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.81% (0.0217 => 0.0273, std.dev.: 0.0003)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.92% (0.2813 => 0.2731, std.dev.: 0.0112)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.87% (0.0345 => 0.0273, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 39.48% (0.0466 => 0.0650, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/distray/distray: 18.30% (0.1033 => 0.1222, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (4.7710 => 4.8471, std.dev.: 0.0153)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 66.94% (3.7285 => 6.2245, std.dev.: 0.1372)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.22% (2.8867 => 4.2787, std.dev.: 0.0387)
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.56% (0.3171 => 0.4140, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 23.57% (0.0526 => 0.0650)
  SingleSource/Benchmarks/Shootout/hash: 23.03% (4.1846 => 5.1483, std.dev.: 0.0660)
  SingleSource/Benchmarks/Shootout-C++/hash: 18.78% (0.6295 => 0.7477, std.dev.: 0.0167)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (7.0762 => 7.8486, std.dev.: 0.1011)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.44% (5.4910 => 5.9544, std.dev.: 0.0211)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.15% (48.3256 => 52.2625, std.dev.: 0.3478)
  SingleSource/Benchmarks/McGill/chomp: 7.99% (1.0051 => 1.0854, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.19% (0.1711 => 0.1834, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.97% (3.2027 => 3.4259, std.dev.: 0.0077)
  SingleSource/Benchmarks/McGill/misr: 6.15% (0.3674 => 0.3900, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6220, std.dev.: 0.0642)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.58% (5.5008 => 5.8079, std.dev.: 0.0481)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.55% (3.4085 => 3.5976, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.60% (4.3151 => 4.5135, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.31% (5.1471 => 5.3690, std.dev.: 0.0651)
  SingleSource/Benchmarks/Misc/whetstone: 3.83% (3.4559 => 3.5882, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.34% (3.5351 => 3.6531, std.dev.: 0.0406)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.21% (25.0200 => 25.8227, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.07% (4.8739 => 5.0234, std.dev.: 0.0254)
  MultiSource/Applications/spiff/spiff: 2.94% (2.7609 => 2.8422, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (3.3877 => 3.4870, std.dev.: 0.0076)
  SingleSource/Benchmarks/McGill/queens: 1.95% (1.6536 => 1.6859, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.57% (4.9040 => 4.9812, std.dev.: 0.0141)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.57% (1.4398 => 1.4624, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.57% (2.5636 => 2.6038, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.55% (4.9089 => 4.9852, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (4.2062 => 4.2585, std.dev.: 0.0153)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.74% (0.1072 => 0.0721, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -25.06% (0.0439 => 0.0329, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.38% (0.1114 => 0.0887, std.dev.: 0.0081)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -16.40% (0.1518 => 0.1269, std.dev.: 0.0014)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.90% (0.7091 => 0.6247, std.dev.: 0.0023)
  MultiSource/Applications/JM/ldecod/ldecod: -11.44% (8.6720 => 7.6803, std.dev.: 0.2755)
  MultiSource/Applications/ClamAV/clamscan: -10.92% (19.4145 => 17.2945, std.dev.: 0.4054)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.73% (0.3655 => 0.3263, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.84% (0.1870 => 0.1686, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.24% (1.1012 => 1.0105, std.dev.: 0.0069)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.07% (0.3073 => 0.2825, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.50% (0.1947 => 0.1801, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.10% (1.4514 => 1.3484, std.dev.: 0.0174)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.77% (1.7461 => 1.6279, std.dev.: 0.0075)
  MultiSource/Applications/Burg/burg: -5.73% (1.5733 => 1.4832, std.dev.: 0.0085)
  MultiSource/Applications/lemon/lemon: -4.23% (1.2976 => 1.2427, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.71% (5.3476 => 5.1491, std.dev.: 0.0488)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -3.05% (49.1253 => 47.6271, std.dev.: 0.4756)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.88% (5.2851 => 5.1328, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.88% (1.5629 => 1.5179, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.00% (0.7189 => 0.7045, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.83% (1.4194 => 0.8825, std.dev.: 0.0318)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.60% (2.1022 => 1.4168, std.dev.: 0.0170)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.00% (1.0962 => 0.7673, std.dev.: 0.0987)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.17% (0.0816 => 0.0578, std.dev.: 0.0000)
  MultiSource/Applications/viterbi/viterbi: -27.42% (3.4923 => 2.5347, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6128, std.dev.: 0.0229)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.57% (0.0884 => 0.0711, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.14% (6.9552 => 5.9024, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc/mandel: -14.29% (1.1996 => 1.0282, std.dev.: 0.0193)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.39% (0.0956 => 0.0828, std.dev.: 0.0024)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.41% (2.6094 => 2.3378, std.dev.: 0.0988)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.01% (0.5173 => 0.4655, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -9.53% (0.1542 => 0.1395, std.dev.: 0.0050)
  SingleSource/Regression/C/uint64_to_float: -6.01% (1.5184 => 1.4271, std.dev.: 0.0072)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.09% (0.3773 => 0.3581, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/fbench: -4.15% (4.9602 => 4.7543, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.08% (1.1024 => 1.0574, std.dev.: 0.0044)
  MultiSource/Benchmarks/Bullet/bullet: -3.81% (7.2995 => 7.0217, std.dev.: 0.0712)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.70% (2.7049 => 2.6047, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.46% (6.0444 => 5.8352, std.dev.: 0.0482)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.12% (0.4783 => 0.4634, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9619, std.dev.: 0.0115)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.99% (21.6864 => 21.0372, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.67% (5.2218 => 5.0826, std.dev.: 0.0514)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.40% (0.7806 => 0.7619, std.dev.: 0.0025)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.23% (34.8438 => 34.0653, std.dev.: 0.0386)
  SingleSource/Benchmarks/Misc/oourafft: -2.17% (3.7891 => 3.7070, std.dev.: 0.0205)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.12% (47.2250 => 46.2218, std.dev.: 0.2592)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.06% (29.8131 => 29.1993, std.dev.: 0.1249)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.65% (5.6678 => 5.5745, std.dev.: 0.0335)
  SingleSource/Benchmarks/Shootout/lists: -1.39% (7.2315 => 7.1308, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1378 => 0.1342, std.dev.: 0.0019)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130810/ff1a83a4/attachment.html>


More information about the llvm-testresults mailing list