[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 21 14:28:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12620?compare_to=12617&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12620, Order: 184581, Start Time: 2013-06-21 19:41:05, End Time: 2013-06-21 21:28:59
      To: 12617, Order: 184561, Start Time: 2013-06-21 17:30:13, End Time: 2013-06-21 19:16:46
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 42 (49 on baseline)
Performance Improvements: 0 (37 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 56.61% (0.1051 => 0.1646, std.dev.: 0.0055)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 51.91% (0.9441 => 1.4342, std.dev.: 0.0701)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 49.56% (0.1029 => 0.1539, std.dev.: 0.0120)
  MultiSource/Benchmarks/Olden/mst/mst: 45.52% (0.1362 => 0.1982, std.dev.: 0.0168)
  MultiSource/Benchmarks/FreeBench/mason/mason: 44.48% (0.0679 => 0.0981, std.dev.: 0.0064)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 43.71% (0.1391 => 0.1999, std.dev.: 0.0168)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 34.59% (0.0503 => 0.0677, std.dev.: 0.0050)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.88% (0.0549 => 0.0735, std.dev.: 0.0047)
  MultiSource/Applications/obsequi/Obsequi: 20.93% (1.1758 => 1.4219, std.dev.: 0.0675)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.99% (7.5180 => 8.3445, std.dev.: 0.1909)
  MultiSource/Applications/kimwitu++/kc: 7.96% (19.1738 => 20.7009, std.dev.: 0.3305)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.44% (1.6726 => 1.7636, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.88% (1.3977 => 1.4659, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (1.4438 => 1.5025, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.85% (1.5326 => 1.5916, std.dev.: 0.0219)
  MultiSource/Applications/sqlite3/sqlite3: 3.63% (16.6816 => 17.2872, std.dev.: 0.1225)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.06% (1.4879 => 1.5335, std.dev.: 0.0167)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 121.98% (0.1324 => 0.2939, std.dev.: 0.0167)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 65.92% (0.7725 => 1.2817, std.dev.: 0.0225)
  MultiSource/Benchmarks/Olden/bisort/bisort: 43.90% (0.6756 => 0.9722, std.dev.: 0.0337)
  MultiSource/Benchmarks/FreeBench/neural/neural: 36.70% (0.2621 => 0.3583, std.dev.: 0.0150)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 35.85% (0.0756 => 0.1027, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.16% (0.1815 => 0.2308, std.dev.: 0.0101)
  MultiSource/Applications/minisat/minisat: 26.11% (6.2622 => 7.8971, std.dev.: 0.1558)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 21.72% (1.3208 => 1.6077, std.dev.: 0.0431)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.58% (0.4258 => 0.5049, std.dev.: 0.0114)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.62% (4.1421 => 4.8306, std.dev.: 0.0023)
  MultiSource/Applications/obsequi/Obsequi: 14.45% (2.2048 => 2.5234, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/flops-7: 12.84% (1.7447 => 1.9687, std.dev.: 0.0132)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.85% (0.1722 => 0.1840, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.21% (1.6043 => 1.7039, std.dev.: 0.0078)
  MultiSource/Benchmarks/llubenchmark/llu: 5.85% (2.0376 => 2.1569, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.60% (1.0555 => 1.1041, std.dev.: 0.0077)
  MultiSource/Applications/lua/lua: 3.87% (28.2314 => 29.3246, std.dev.: 0.1217)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.75% (0.7757 => 0.8048, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.32% (3.9001 => 4.0297, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.89% (4.9392 => 5.0818, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.73% (6.2084 => 6.3778, std.dev.: 0.0189)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.03% (39.8176 => 40.6248, std.dev.: 0.0657)
  SingleSource/Benchmarks/Shootout/methcall: 1.68% (8.4521 => 8.5945, std.dev.: 0.0515)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.55% (4.5516 => 4.6223, std.dev.: 0.0089)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.27% (5.5718 => 5.6423, std.dev.: 0.0175)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.53% (0.1375 => 0.1354, std.dev.: 0.0276)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 52.27% (0.1081 => 0.1646, std.dev.: 0.0055)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 44.51% (0.1065 => 0.1539, std.dev.: 0.0120)
  MultiSource/Benchmarks/Olden/mst/mst: 41.07% (0.1405 => 0.1982, std.dev.: 0.0168)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.38% (0.1424 => 0.1999, std.dev.: 0.0168)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 39.05% (1.0314 => 1.4342, std.dev.: 0.0701)
  MultiSource/Benchmarks/FreeBench/mason/mason: 38.17% (0.0710 => 0.0981, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 35.86% (0.0541 => 0.0735, std.dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 29.69% (0.0522 => 0.0677, std.dev.: 0.0050)
  MultiSource/Applications/obsequi/Obsequi: 21.19% (1.1733 => 1.4219, std.dev.: 0.0675)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.07% (7.7211 => 8.3445, std.dev.: 0.1909)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.11% (1.4999 => 1.5916, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.07% (1.4165 => 1.5025, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.97% (1.3833 => 1.4659, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.95% (1.6804 => 1.7636, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.92% (1.4757 => 1.5335, std.dev.: 0.0167)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 40.02% (0.2099 => 0.2939, std.dev.: 0.0167)
  MultiSource/Applications/sgefa/sgefa: 38.29% (1.1695 => 1.6173, std.dev.: 0.0183)
  SingleSource/Benchmarks/Stanford/Puzzle: 26.46% (0.1455 => 0.1840, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 25.03% (1.0251 => 1.2817, std.dev.: 0.0225)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.55% (0.0838 => 0.1027, std.dev.: 0.0059)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.59% (16.4665 => 19.8576, std.dev.: 1.1055)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 18.82% (1.3530 => 1.6077, std.dev.: 0.0431)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.66% (0.1945 => 0.2308, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.75% (6.1372 => 7.2265, std.dev.: 0.1898)
  MultiSource/Benchmarks/Olden/bisort/bisort: 12.97% (0.8606 => 0.9722, std.dev.: 0.0337)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.70% (0.4480 => 0.5049, std.dev.: 0.0114)
  MultiSource/Applications/obsequi/Obsequi: 12.66% (2.2398 => 2.5234, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/flops-7: 9.45% (1.7987 => 1.9687, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.93% (5.2003 => 5.6129, std.dev.: 0.0757)
  MultiSource/Applications/minisat/minisat: 7.15% (7.3703 => 7.8971, std.dev.: 0.1558)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.1853 => 3.3839, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.66% (3.2201 => 3.4024, std.dev.: 0.0126)
  MultiSource/Benchmarks/llubenchmark/llu: 5.60% (2.0425 => 2.1569, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.68% (2.9004 => 3.0362, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8810, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.45% (1.0571 => 1.1041, std.dev.: 0.0077)
  MultiSource/Applications/lua/lua: 3.81% (28.2496 => 29.3246, std.dev.: 0.1217)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.77% (5.9362 => 6.1598, std.dev.: 0.0487)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.74% (4.8986 => 5.0818, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.48% (5.2788 => 5.4624, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.07% (4.8966 => 5.0470, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout/methcall: 3.02% (8.3425 => 8.5945, std.dev.: 0.0515)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.00% (5.5010 => 5.6661, std.dev.: 0.0093)
  MultiSource/Benchmarks/Olden/tsp/tsp: 2.56% (1.6613 => 1.7039, std.dev.: 0.0078)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.20% (4.3727 => 4.4687, std.dev.: 0.0273)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.08% (0.7884 => 0.8048, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.05% (5.6582 => 5.7741, std.dev.: 0.0135)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.75% (39.9248 => 40.6248, std.dev.: 0.0657)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.29% (11.4990 => 11.6474, std.dev.: 0.0136)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/constpool: -18.74% (10.3086 => 8.3772, std.dev.: 0.3485)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.06% (0.0803 => 0.0674, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/whetstone: -15.50% (0.1097 => 0.0927, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.54% (0.1322 => 0.1143, std.dev.: 0.0065)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.57% (0.2006 => 0.1794, std.dev.: 0.0028)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.81% (51.0211 => 46.0145, std.dev.: 1.7073)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (5.1587 => 4.7925, std.dev.: 0.0891)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.92% (5.4314 => 5.1099, std.dev.: 0.0627)
  MultiSource/Applications/lemon/lemon: -4.73% (1.3155 => 1.2533, std.dev.: 0.0175)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.13% (0.2738 => 0.2625, std.dev.: 0.0040)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.79% (0.5748 => 0.5530, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.31% (1.2911 => 0.7319, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.98% (4.4050 => 3.2165, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.97% (6.2328 => 4.7389, std.dev.: 0.0589)
  SingleSource/Benchmarks/Misc/salsa20: -22.81% (10.3398 => 7.9815, std.dev.: 0.4337)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.31% (25.3677 => 21.2299, std.dev.: 0.0924)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.99% (11.6227 => 9.9965, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.59% (7.0179 => 6.2744, std.dev.: 0.0102)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -9.49% (3.5120 => 3.1788, std.dev.: 0.1201)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.34% (1.6679 => 1.5122, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.28% (0.7941 => 0.7204, std.dev.: 0.0276)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.92% (9.1099 => 8.2970, std.dev.: 0.0676)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.11% (9.8728 => 9.1704, std.dev.: 0.0605)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.77% (5.5889 => 5.2108, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.90% (4.5717 => 4.3018, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/flops: -5.86% (10.2170 => 9.6178, std.dev.: 0.1048)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.68% (0.2777 => 0.2647, std.dev.: 0.0015)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.57% (3.5327 => 3.3713, std.dev.: 0.0620)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.43% (4.2167 => 4.0297, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.35% (5.3184 => 5.0868, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3276 => 5.1021, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.84% (3.8665 => 3.7568, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.23% (4.5094 => 4.4090, std.dev.: 0.0094)
  SingleSource/UnitTests/Vector/multiplies: -2.01% (0.5665 => 0.5551, std.dev.: 0.0043)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.60% (5.7342 => 5.6423, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.47% (5.4801 => 5.3996, std.dev.: 0.0295)
  MultiSource/Applications/hexxagon/hexxagon: -1.14% (15.4979 => 15.3208, std.dev.: 0.0180)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.04% (0.1441 => 0.1354, std.dev.: 0.0276)

Report Time: 1.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130621/a82745ce/attachment.html>


More information about the llvm-testresults mailing list