[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 26 15:04:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12793?compare_to=12789&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12793, Order: 185015, Start Time: 2013-06-26 20:15:52, End Time: 2013-06-26 22:05:26
      To: 12789, Order: 184972, Start Time: 2013-06-26 18:02:50, End Time: 2013-06-26 19:51:59
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 39 (51 on baseline)
Performance Improvements: 2 (31 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1025 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 62.87% (0.1018 => 0.1658, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 54.96% (0.0948 => 0.1469, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 47.74% (0.0243 => 0.0359, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/health/health: 40.81% (0.1583 => 0.2229, std.dev.: 0.0201)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 36.97% (0.7155 => 0.9800, std.dev.: 0.0655)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 33.56% (0.6678 => 0.8919, std.dev.: 0.0673)
  MultiSource/Benchmarks/MallocBench/gs/gs: 32.98% (4.6588 => 6.1951, std.dev.: 0.2572)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 28.70% (0.5811 => 0.7479, std.dev.: 0.0211)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.70% (0.1115 => 0.1435, std.dev.: 0.0109)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 28.41% (1.1102 => 1.4256, std.dev.: 0.1058)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.96% (5.7578 => 7.3674, std.dev.: 0.1834)
  MultiSource/Benchmarks/McCat/05-eks/eks: 27.25% (0.5926 => 0.7541, std.dev.: 0.0365)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.75% (0.9942 => 1.2303, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.43% (0.2872 => 0.3545, std.dev.: 0.0041)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.70% (0.2986 => 0.3604, std.dev.: 0.0142)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.86% (0.8830 => 1.0584, std.dev.: 0.0635)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.93% (0.3899 => 0.4403, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.21% (1.5880 => 1.7025, std.dev.: 0.0328)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.18% (10.6845 => 11.4521, std.dev.: 0.1856)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.86% (1.6418 => 1.7544, std.dev.: 0.0108)
  MultiSource/Applications/sqlite3/sqlite3: 6.82% (17.1659 => 18.3359, std.dev.: 0.1477)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.29% (1.6695 => 1.7745, std.dev.: 0.0242)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.77% (25.9091 => 27.4031, std.dev.: 0.2892)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.68% (1.4040 => 1.4837, std.dev.: 0.0235)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.42% (2.4746 => 2.6086, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.44% (1.4632 => 1.5135, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.36% (1.4185 => 1.4661, std.dev.: 0.0159)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 67.02% (0.7587 => 1.2672, std.dev.: 0.0740)
  MultiSource/Benchmarks/MallocBench/gs/gs: 53.80% (0.0842 => 0.1295, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 43.21% (0.0942 => 0.1349, std.dev.: 0.0061)
  MultiSource/Benchmarks/McCat/08-main/main: 32.91% (0.0705 => 0.0937, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/bisort/bisort: 28.28% (0.7230 => 0.9275, std.dev.: 0.0293)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.37% (2.6592 => 3.1211, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.81% (4.7366 => 5.0590, std.dev.: 0.0512)
  MultiSource/Benchmarks/llubenchmark/llu: 5.95% (2.0318 => 2.1526, std.dev.: 0.0300)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.88% (90.4333 => 95.7551, std.dev.: 0.3315)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.90% (2.5208 => 2.5938, std.dev.: 0.0283)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.79% (3.4956 => 3.5583, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.66% (5.4697 => 5.5604, std.dev.: 0.0213)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.80% (1.9212 => 1.6369, std.dev.: 0.0702)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.67% (0.0934 => 0.0825, std.dev.: 0.0027)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 19.04% (0.1381 => 0.1644, std.dev.: 0.0101)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 67.76% (0.0214 => 0.0359, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 66.80% (0.0994 => 0.1658, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 55.94% (0.0942 => 0.1469, std.dev.: 0.0058)
  MultiSource/Benchmarks/Olden/health/health: 38.28% (0.1612 => 0.2229, std.dev.: 0.0201)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 36.28% (0.7191 => 0.9800, std.dev.: 0.0655)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 34.49% (0.1067 => 0.1435, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/05-eks/eks: 32.34% (0.5698 => 0.7541, std.dev.: 0.0365)
  MultiSource/Benchmarks/MallocBench/gs/gs: 31.56% (4.7091 => 6.1951, std.dev.: 0.2572)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 31.39% (0.6788 => 0.8919, std.dev.: 0.0673)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 30.57% (5.6424 => 7.3674, std.dev.: 0.1834)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.37% (1.1193 => 1.4256, std.dev.: 0.1058)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 27.04% (0.5887 => 0.7479, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.05% (0.2881 => 0.3545, std.dev.: 0.0041)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.72% (0.2961 => 0.3604, std.dev.: 0.0142)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.28% (1.0314 => 1.2303, std.dev.: 0.0029)
  MultiSource/Benchmarks/McCat/09-vor/vor: 17.65% (0.3723 => 0.4380, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.94% (1.4485 => 1.6649, std.dev.: 0.0595)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.25% (1.5727 => 1.7025, std.dev.: 0.0328)
  MultiSource/Applications/sqlite3/sqlite3: 8.04% (16.9719 => 18.3359, std.dev.: 0.1477)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.64% (1.6299 => 1.7544, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.26% (1.3833 => 1.4837, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.14% (1.6563 => 1.7745, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.10% (1.4131 => 1.5135, std.dev.: 0.0058)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.77% (10.7257 => 11.4521, std.dev.: 0.1856)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.99% (0.2937 => 0.3113, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.95% (1.3838 => 1.4661, std.dev.: 0.0159)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.66% (25.9348 => 27.4031, std.dev.: 0.2892)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.02% (2.5078 => 2.6086, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.47% (1.6726 => 1.7307, std.dev.: 0.0208)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 49.02% (0.0869 => 0.1295, std.dev.: 0.0066)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 40.15% (0.0259 => 0.0363, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 33.96% (0.1007 => 0.1349, std.dev.: 0.0061)
  MultiSource/Applications/sgefa/sgefa: 29.27% (1.1695 => 1.5118, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/08-main/main: 27.14% (0.0737 => 0.0937, std.dev.: 0.0061)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 23.62% (1.0251 => 1.2672, std.dev.: 0.0740)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.04% (2.5366 => 3.1211, std.dev.: 0.0369)
  SingleSource/Benchmarks/Stanford/Puzzle: 18.49% (0.1455 => 0.1724, std.dev.: 0.0054)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.9806 => 1.1475, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.48% (6.1372 => 7.1485, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3828, std.dev.: 0.0208)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.43% (3.2201 => 3.3948, std.dev.: 0.0076)
  MultiSource/Benchmarks/llubenchmark/llu: 5.39% (2.0425 => 2.1526, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.33% (5.2788 => 5.5604, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.11% (4.6639 => 4.9024, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.17% (5.9362 => 6.1840, std.dev.: 0.0226)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.94% (1.0571 => 1.0988, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.38% (5.5010 => 5.6871, std.dev.: 0.0359)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (4.3727 => 4.4815, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/ffbench: 2.45% (1.3696 => 1.4031, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.88% (5.6582 => 5.7648, std.dev.: 0.0251)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (94.2966 => 95.7551, std.dev.: 0.3315)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.07% (0.0803 => 0.0682, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/whetstone: -14.59% (0.1097 => 0.0937, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.57% (0.2006 => 0.1794, std.dev.: 0.0001)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (0.1224 => 0.1123, std.dev.: 0.0006)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.53% (0.1563 => 0.1461, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.10% (1.2911 => 0.7217, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.96% (4.4050 => 2.7327, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/salsa20: -22.26% (10.3398 => 8.0384, std.dev.: 0.4425)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.01% (4.8986 => 3.8695, std.dev.: 0.0431)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.62% (5.7264 => 4.6027, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.83% (6.2328 => 5.0590, std.dev.: 0.0512)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.76% (25.3677 => 21.3698, std.dev.: 0.0057)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.53% (48.3307 => 41.7937, std.dev.: 0.0318)
  MultiSource/Benchmarks/nbench/nbench: -13.52% (22.3004 => 19.2843, std.dev.: 0.9365)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.21% (32.4581 => 29.1433, std.dev.: 0.4626)
  MultiSource/Applications/siod/siod: -9.58% (3.7240 => 3.3671, std.dev.: 0.0419)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.66% (1.6679 => 1.5235, std.dev.: 0.0169)
  MultiSource/Applications/sqlite3/sqlite3: -7.09% (4.6358 => 4.3073, std.dev.: 0.1037)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.85% (4.5717 => 4.2585, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.43% (9.8728 => 9.2376, std.dev.: 0.0524)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.43% (5.5889 => 5.2294, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc/flops: -5.76% (10.2170 => 9.6286, std.dev.: 0.0987)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.83% (2.8537 => 2.7158, std.dev.: 0.0436)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.54% (5.3184 => 5.0771, std.dev.: 0.0151)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.48% (2.4808 => 2.3697, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.82% (5.3276 => 5.1243, std.dev.: 0.0095)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.55% (9.1099 => 8.7862, std.dev.: 0.0503)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.69% (3.8665 => 3.7626, std.dev.: 0.0275)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.09% (6.3757 => 6.2422, std.dev.: 0.0448)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.03% (4.2167 => 4.1309, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.95% (4.5094 => 4.4216, std.dev.: 0.0058)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 14.09% (0.1441 => 0.1644, std.dev.: 0.0101)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130626/5fcff7d7/attachment.html>


More information about the llvm-testresults mailing list