[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 24 15:44:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12720?compare_to=12716&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12720, Order: 184780, Start Time: 2013-06-24 20:55:58, End Time: 2013-06-24 22:45:14
      To: 12716, Order: 184768, Start Time: 2013-06-24 18:44:37, End Time: 2013-06-24 20:33:21
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 27 (46 on baseline)
Performance Improvements: 22 (38 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 48.03% (0.7092 => 1.0498, std.dev.: 0.0245)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 47.32% (0.9902 => 1.4588, std.dev.: 0.0285)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 46.20% (0.7043 => 1.0297, std.dev.: 0.0231)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 41.16% (0.4147 => 0.5854, std.dev.: 0.0289)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 40.56% (0.7444 => 1.0463, std.dev.: 0.0205)
  MultiSource/Benchmarks/MallocBench/gs/gs: 39.70% (4.7429 => 6.6259, std.dev.: 0.2007)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 30.75% (0.5779 => 0.7556, std.dev.: 0.0519)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.04% (5.0488 => 6.4643, std.dev.: 0.3873)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.73% (10.6968 => 13.4494, std.dev.: 0.0992)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 24.48% (0.0768 => 0.0956, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/football/football: 21.73% (1.0253 => 1.2481, std.dev.: 0.0500)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.26% (1.5447 => 1.8576, std.dev.: 0.1022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.59% (1.7192 => 1.7637, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.09% (1.6998 => 1.7354, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.22% (0.0589 => 0.0820, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/bisort/bisort: 23.43% (0.6888 => 0.8502, std.dev.: 0.0424)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.97% (2.6027 => 2.9924, std.dev.: 0.0521)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.29% (1.0492 => 1.1047, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.29% (0.4943 => 0.5155, std.dev.: 0.0014)
  MultiSource/Applications/sgefa/sgefa: 3.51% (1.5585 => 1.6132, std.dev.: 0.0102)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.31% (1.8583 => 1.9012, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.13% (4.6660 => 4.7656, std.dev.: 0.0235)
  SingleSource/Benchmarks/Misc/flops: 1.71% (9.6280 => 9.7929, std.dev.: 0.0365)
  SingleSource/Benchmarks/Shootout/fib2: 1.63% (4.8778 => 4.9574, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.40% (5.3608 => 5.4359, std.dev.: 0.0045)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (99.1480 => 100.2941, std.dev.: 0.4138)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.12% (1.6639 => 1.6826, std.dev.: 0.0069)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/simple: -36.54% (0.0353 => 0.0224, std.dev.: 0.0027)
  SingleSource/UnitTests/member-function-pointers: -33.33% (0.0309 => 0.0206, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -26.00% (0.1096 => 0.0811, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -22.60% (0.1805 => 0.1397, std.dev.: 0.0010)
  MultiSource/Benchmarks/McCat/09-vor/vor: -20.04% (0.4477 => 0.3580, std.dev.: 0.0067)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -19.26% (0.1329 => 0.1073, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/08-main/main: -18.80% (0.3675 => 0.2984, std.dev.: 0.0202)
  SingleSource/UnitTests/initp1: -17.48% (0.0612 => 0.0505, std.dev.: 0.0003)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -16.40% (0.1311 => 0.1096, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -15.42% (0.1200 => 0.1015, std.dev.: 0.0018)
  MultiSource/Benchmarks/McCat/05-eks/eks: -15.03% (0.6513 => 0.5534, std.dev.: 0.0077)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.27% (1.6999 => 1.5764, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout-C++/ary: -6.15% (0.2991 => 0.2807, std.dev.: 0.0070)
  MultiSource/Applications/viterbi/viterbi: -6.12% (0.1978 => 0.1857, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/moments: -5.81% (0.4300 => 0.4050, std.dev.: 0.0052)
  MultiSource/Applications/ClamAV/clamscan: -3.94% (17.4517 => 16.7636, std.dev.: 0.2607)
  MultiSource/Benchmarks/McCat/18-imp/imp: -3.89% (0.4166 => 0.4004, std.dev.: 0.0059)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -3.58% (0.4327 => 0.4172, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -15.00% (0.5094 => 0.4330, std.dev.: 0.0130)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.46% (1.4635 => 1.2812, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -4.32% (4.2180 => 4.0356, std.dev.: 0.0442)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.66% (3.7261 => 3.6641, std.dev.: 0.0146)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.23% (0.1420 => 0.1289, std.dev.: 0.0029)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 55.48% (0.3765 => 0.5854, std.dev.: 0.0289)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 46.41% (0.9964 => 1.4588, std.dev.: 0.0285)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 45.99% (0.7191 => 1.0498, std.dev.: 0.0245)
  MultiSource/Benchmarks/MallocBench/gs/gs: 40.70% (4.7091 => 6.6259, std.dev.: 0.2007)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 36.14% (1.1193 => 1.5238, std.dev.: 0.1103)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 34.31% (0.6788 => 0.9117, std.dev.: 0.0577)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 32.37% (10.1602 => 13.4494, std.dev.: 0.0992)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 30.38% (0.8025 => 1.0463, std.dev.: 0.0205)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.05% (0.7918 => 1.0297, std.dev.: 0.0231)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 28.35% (0.5887 => 0.7556, std.dev.: 0.0519)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.72% (1.5014 => 1.8576, std.dev.: 0.1022)
  MultiSource/Benchmarks/Prolangs-C/football/football: 21.27% (1.0292 => 1.2481, std.dev.: 0.0500)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 21.01% (0.0790 => 0.0956, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.02% (5.4314 => 6.4643, std.dev.: 0.3873)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.02% (0.2721 => 0.2912, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (1.6275 => 1.7354, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.48% (1.6563 => 1.7637, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.26% (1.6292 => 1.7312, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.72% (1.4991 => 1.5848, std.dev.: 0.0285)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.28% (0.3429 => 0.3610, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.90% (1.3833 => 1.4234, std.dev.: 0.0102)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 38.75% (0.0591 => 0.0820, std.dev.: 0.0048)
  MultiSource/Applications/sgefa/sgefa: 37.94% (1.1695 => 1.6132, std.dev.: 0.0102)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.37% (10.2418 => 12.0209, std.dev.: 0.4664)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.98% (2.5800 => 2.9924, std.dev.: 0.0521)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.88% (0.1455 => 0.1686, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.49% (6.1372 => 7.0878, std.dev.: 0.0415)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.65% (2.5366 => 2.8828, std.dev.: 0.0571)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.51% (5.2003 => 5.6429, std.dev.: 0.0153)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.36% (94.2966 => 100.2941, std.dev.: 0.4138)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.62% (0.3860 => 0.4077, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.07% (3.2201 => 3.3832, std.dev.: 0.0484)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.02% (4.6639 => 4.8978, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.92% (2.9004 => 3.0431, std.dev.: 0.0340)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.50% (1.0571 => 1.1047, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.47% (5.2788 => 5.5150, std.dev.: 0.0360)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0264, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.74% (5.9362 => 6.1585, std.dev.: 0.0277)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.35% (0.4988 => 0.5155, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.17% (4.8966 => 5.0520, std.dev.: 0.0171)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (39.9248 => 40.9567, std.dev.: 0.2437)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.27% (4.6379 => 4.7432, std.dev.: 0.0311)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (4.3727 => 4.4686, std.dev.: 0.0063)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.98% (1.7925 => 1.8280, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.87% (5.6582 => 5.7640, std.dev.: 0.0294)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.44% (3.6122 => 3.6641, std.dev.: 0.0146)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.31% (0.1113 => 0.0720, std.dev.: 0.0016)
  MultiSource/Applications/viterbi/viterbi: -23.61% (0.2431 => 0.1857, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.94% (0.0803 => 0.0675, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/whetstone: -14.40% (0.1097 => 0.0939, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.62% (0.2006 => 0.1813, std.dev.: 0.0044)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.10% (0.1563 => 0.1452, std.dev.: 0.0006)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (1.6793 => 1.5764, std.dev.: 0.0268)
  MultiSource/Applications/oggenc/oggenc: -4.86% (5.9886 => 5.6975, std.dev.: 0.0824)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.4199 => 0.4004, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.34% (1.2911 => 0.7316, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -36.24% (4.4050 => 2.8088, std.dev.: 0.0259)
  MultiSource/Benchmarks/FreeBench/neural/neural: -25.88% (0.3513 => 0.2604, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.54% (6.2328 => 4.7656, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.66% (4.8986 => 3.8864, std.dev.: 0.0464)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.76% (5.7264 => 4.5946, std.dev.: 0.0462)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.37% (25.3677 => 21.2160, std.dev.: 0.0626)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.07% (11.6227 => 9.9879, std.dev.: 0.0107)
  SingleSource/Benchmarks/Misc/salsa20: -13.06% (10.3398 => 8.9895, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.17% (7.0179 => 6.3043, std.dev.: 0.0597)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -9.92% (0.1542 => 0.1389, std.dev.: 0.0018)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.93% (9.1099 => 8.2961, std.dev.: 0.0211)
  MultiSource/Applications/siod/siod: -8.86% (3.7240 => 3.3939, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.77% (4.5717 => 4.1707, std.dev.: 0.0198)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.37% (1.6679 => 1.5283, std.dev.: 0.0240)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.21% (48.3307 => 44.8445, std.dev.: 0.1060)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.64% (9.8728 => 9.2171, std.dev.: 0.0377)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.41% (3.5327 => 3.3063, std.dev.: 0.0591)
  MultiSource/Applications/sqlite3/sqlite3: -4.78% (4.6358 => 4.4141, std.dev.: 0.0737)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.52% (5.3184 => 5.0781, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.42% (4.2167 => 4.0305, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.17% (5.3276 => 5.1055, std.dev.: 0.0273)
  SingleSource/Benchmarks/Misc/flops: -4.15% (10.2170 => 9.7929, std.dev.: 0.0365)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.00% (0.9806 => 0.9414, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout/sieve: -2.96% (8.0178 => 7.7802, std.dev.: 0.0410)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.90% (3.8665 => 3.7545, std.dev.: 0.0143)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.69% (6.3757 => 6.2041, std.dev.: 0.0324)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.95% (8.5243 => 8.3582, std.dev.: 0.0095)
  MultiSource/Applications/hexxagon/hexxagon: -1.23% (15.4979 => 15.3068, std.dev.: 0.0514)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -10.55% (0.1441 => 0.1289, std.dev.: 0.0029)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130624/098540c9/attachment.html>


More information about the llvm-testresults mailing list