[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jul 25 19:36:49 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13767?compare_to=13765&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13767, Order: 187172, Start Time: 2013-07-26 00:49:21, End Time: 2013-07-26 02:38:26
      To: 13765, Order: 187158, Start Time: 2013-07-25 22:39:00, End Time: 2013-07-26 00:27:21
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 43 (39 on baseline)
Performance Improvements: 6 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 53.54% (0.1980 => 0.3040, std.dev.: 0.0177)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 52.54% (0.0984 => 0.1501, std.dev.: 0.0104)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 52.17% (0.0483 => 0.0735, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/power/power: 39.76% (0.1431 => 0.2000, std.dev.: 0.0071)
  MultiSource/Benchmarks/McCat/08-main/main: 38.78% (0.2958 => 0.4105, std.dev.: 0.0356)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.50% (0.1691 => 0.2342, std.dev.: 0.0138)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 34.97% (0.3520 => 0.4751, std.dev.: 0.0443)
  MultiSource/Applications/obsequi/Obsequi: 32.01% (1.1812 => 1.5593, std.dev.: 0.0581)
  MultiSource/Benchmarks/McCat/09-vor/vor: 31.58% (0.3512 => 0.4621, std.dev.: 0.0268)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 29.16% (1.1890 => 1.5357, std.dev.: 0.0744)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.96% (0.7269 => 0.9374, std.dev.: 0.0613)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 27.79% (10.0299 => 12.8172, std.dev.: 0.5087)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 26.47% (0.5908 => 0.7472, std.dev.: 0.0244)
  MultiSource/Benchmarks/Olden/bisort/bisort: 21.22% (0.0721 => 0.0874, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 18.97% (1.3237 => 1.5748, std.dev.: 0.0865)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.85% (5.7659 => 6.8529, std.dev.: 0.1721)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.15% (0.7299 => 0.8478, std.dev.: 0.0406)
  MultiSource/Applications/ClamAV/clamscan: 12.66% (16.9589 => 19.1053, std.dev.: 0.5864)
  MultiSource/Applications/kimwitu++/kc: 10.22% (19.2804 => 21.2518, std.dev.: 0.3420)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.86% (0.8293 => 0.8945, std.dev.: 0.0217)
  MultiSource/Applications/sqlite3/sqlite3: 6.18% (17.3511 => 18.4240, std.dev.: 0.3385)
  MultiSource/Benchmarks/sim/sim: 5.86% (0.3770 => 0.3991, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.46% (1.5131 => 1.5806, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.39% (1.3751 => 1.4355, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.38% (1.5586 => 1.6113, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.85% (1.6933 => 1.7247, std.dev.: 0.0028)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 58.30% (0.1614 => 0.2555, std.dev.: 0.0164)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 53.10% (0.0226 => 0.0346, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/bisort/bisort: 37.33% (0.6759 => 0.9282, std.dev.: 0.0268)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 29.26% (1.2340 => 1.5951, std.dev.: 0.0404)
  MultiSource/Applications/minisat/minisat: 27.93% (6.2494 => 7.9946, std.dev.: 0.0990)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.08% (1.2630 => 1.4914, std.dev.: 0.0803)
  SingleSource/Benchmarks/Misc/fp-convert: 16.67% (6.9144 => 8.0672, std.dev.: 0.0082)
  MultiSource/Applications/obsequi/Obsequi: 14.56% (2.2216 => 2.5451, std.dev.: 0.0596)
  SingleSource/Benchmarks/Misc/salsa20: 9.35% (8.2085 => 8.9758, std.dev.: 0.0226)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.86% (0.8309 => 0.8962, std.dev.: 0.0245)
  SingleSource/Benchmarks/Misc/flops-4: 5.55% (1.5435 => 1.6291, std.dev.: 0.0125)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 5.25% (0.4667 => 0.4912, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.91% (1.4677 => 1.5398, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/flops: 4.52% (9.4906 => 9.9198, std.dev.: 0.0402)
  MultiSource/Applications/lua/lua: 2.85% (30.3023 => 31.1652, std.dev.: 0.2214)
  MultiSource/Benchmarks/Olden/bh/bh: 2.42% (2.4095 => 2.4678, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.11% (1.8659 => 1.9052, std.dev.: 0.0150)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.20% (1.4858 => 1.4234, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -13.31% (0.1585 => 0.1374, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/flops-7: -12.11% (1.9670 => 1.7287, std.dev.: 0.0774)
  SingleSource/Benchmarks/McGill/misr: -3.98% (0.3846 => 0.3693, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.42% (1.2833 => 1.2651, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/whetstone: -1.14% (3.5010 => 3.4611, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.57% (0.1335 => 0.1356, std.dev.: 0.0213)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 47.88% (0.1015 => 0.1501, std.dev.: 0.0104)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 35.43% (0.3508 => 0.4751, std.dev.: 0.0443)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 35.30% (0.1731 => 0.2342, std.dev.: 0.0138)
  MultiSource/Benchmarks/McCat/08-main/main: 35.08% (0.3039 => 0.4105, std.dev.: 0.0356)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.30% (0.7194 => 0.9374, std.dev.: 0.0613)
  MultiSource/Benchmarks/Olden/em3d/em3d: 28.43% (0.2367 => 0.3040, std.dev.: 0.0177)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 27.84% (0.5845 => 0.7472, std.dev.: 0.0244)
  MultiSource/Benchmarks/McCat/09-vor/vor: 25.91% (0.3670 => 0.4621, std.dev.: 0.0268)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 24.40% (10.3031 => 12.8172, std.dev.: 0.5087)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.19% (6.1631 => 6.8529, std.dev.: 0.1721)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.16% (1.5037 => 1.6113, std.dev.: 0.0161)
  MultiSource/Benchmarks/sim/sim: 4.81% (0.3808 => 0.3991, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.29% (1.3649 => 1.4234, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.3089 => 0.3218, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.62% (1.3826 => 1.4327, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.11% (1.5479 => 1.5806, std.dev.: 0.0047)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.51% (2.8867 => 4.2871, std.dev.: 0.0143)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.48% (0.0341 => 0.0462, std.dev.: 0.0014)
  MultiSource/Benchmarks/FreeBench/neural/neural: 28.57% (0.3171 => 0.4077, std.dev.: 0.0125)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.02% (1.2558 => 1.5951, std.dev.: 0.0404)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.76% (1.5030 => 1.9052, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 18.32% (2.9428 => 3.4819, std.dev.: 0.1527)
  MultiSource/Applications/siod/siod: 13.63% (3.3761 => 3.8362, std.dev.: 0.0306)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.37% (14.9584 => 16.3607, std.dev.: 0.3276)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.60% (5.4910 => 5.9630, std.dev.: 0.1337)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.10% (48.3256 => 52.2402, std.dev.: 0.3138)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.14% (3.2027 => 3.4315, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.75% (3.4085 => 3.6387, std.dev.: 0.0139)
  SingleSource/Benchmarks/McGill/chomp: 6.51% (1.0051 => 1.0705, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.07% (5.3042 => 5.6261, std.dev.: 0.0873)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.25% (3.3384 => 3.5136, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.45% (5.1471 => 5.3763, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.38% (4.3151 => 4.5040, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.48% (4.8739 => 5.0435, std.dev.: 0.0111)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 2.70% (0.4783 => 0.4912, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.97% (3.3464 => 3.4123, std.dev.: 0.0202)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.84% (2.5240 => 2.5704, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9198, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.50% (5.0417 => 5.1173, std.dev.: 0.0118)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -18.47% (0.1072 => 0.0874, std.dev.: 0.0012)
  MultiSource/Applications/sgefa/sgefa: -13.58% (0.4809 => 0.4156, std.dev.: 0.0064)
  MultiSource/Applications/hexxagon/hexxagon: -11.26% (1.3285 => 1.1789, std.dev.: 0.0361)
  MultiSource/Benchmarks/Olden/power/power: -10.59% (0.2237 => 0.2000, std.dev.: 0.0071)
  MultiSource/Applications/Burg/burg: -6.78% (1.5733 => 1.4666, std.dev.: 0.0120)
  MultiSource/Applications/siod/siod: -6.40% (2.7150 => 2.5413, std.dev.: 0.0470)
  MultiSource/Benchmarks/nbench/nbench: -3.77% (1.3677 => 1.3161, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.09% (1.7797 => 1.7247, std.dev.: 0.0028)
  MultiSource/Applications/spiff/spiff: -1.32% (0.9578 => 0.9452, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.58% (0.0816 => 0.0542, std.dev.: 0.0087)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.04% (2.1022 => 1.4286, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.33% (6.9552 => 5.2633, std.dev.: 0.3285)
  MultiSource/Applications/JM/ldecod/ldecod: -21.89% (0.0859 => 0.0671, std.dev.: 0.0015)
  MultiSource/Applications/sgefa/sgefa: -13.51% (1.4030 => 1.2135, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.72% (6.2627 => 5.5289, std.dev.: 0.0321)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.87% (2.6992 => 2.4869, std.dev.: 0.0712)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.71% (47.2250 => 44.0578, std.dev.: 0.3662)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.63% (1.7207 => 1.6239, std.dev.: 0.0203)
  SingleSource/Regression/C/uint64_to_float: -4.48% (1.5184 => 1.4503, std.dev.: 0.0063)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.48% (0.5173 => 0.4941, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.28% (0.7355 => 0.7040, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.28% (2.7049 => 2.5892, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.09% (6.0444 => 5.8576, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.60% (6.1482 => 5.9885, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.44% (5.2218 => 5.0943, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.09% (5.0180 => 4.9635, std.dev.: 0.0194)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.60% (0.1378 => 0.1356, std.dev.: 0.0213)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130725/42477cff/attachment.html>


More information about the llvm-testresults mailing list