[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 13 13:48:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12355?compare_to=12352&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12355, Order: 183925, Start Time: 2013-06-13 18:56:04, End Time: 2013-06-13 20:49:04
      To: 12352, Order: 183910, Start Time: 2013-06-13 16:39:36, End Time: 2013-06-13 18:32:56
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 27 (63 on baseline)
Performance Improvements: 8 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/family/family: 53.20% (0.0453 => 0.0694, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 46.79% (0.7269 => 1.0670, std.dev.: 0.0243)
  MultiSource/Benchmarks/MallocBench/gs/gs: 37.06% (4.8581 => 6.6585, std.dev.: 0.1775)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 36.50% (1.2055 => 1.6455, std.dev.: 0.0483)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 36.42% (0.3515 => 0.4795, std.dev.: 0.0230)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 35.81% (0.5837 => 0.7927, std.dev.: 0.0183)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 31.20% (0.1000 => 0.1312, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.13% (10.7435 => 12.7983, std.dev.: 0.5419)
  MultiSource/Applications/lua/lua: 18.30% (4.4361 => 5.2477, std.dev.: 0.0865)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 17.43% (1.2095 => 1.4203, std.dev.: 0.0684)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.98% (6.0614 => 6.8483, std.dev.: 0.0771)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.93% (2.6671 => 2.9587, std.dev.: 0.0664)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.24% (4.3028 => 4.6144, std.dev.: 0.0501)
  MultiSource/Applications/SPASS/SPASS: 6.61% (16.9117 => 18.0288, std.dev.: 0.4064)
  MultiSource/Benchmarks/sim/sim: 3.95% (0.3722 => 0.3869, std.dev.: 0.0034)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.93% (1.5887 => 1.6353, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: 50.33% (0.0908 => 0.1365, std.dev.: 0.0034)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 23.84% (0.0558 => 0.0691, std.dev.: 0.0029)
  MultiSource/Benchmarks/llubenchmark/llu: 12.71% (2.0106 => 2.2661, std.dev.: 0.0868)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.35% (30.2792 => 33.4132, std.dev.: 0.7144)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.85% (21.6938 => 23.8304, std.dev.: 0.0228)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.12% (0.7232 => 0.7602, std.dev.: 0.0104)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.96% (44.0955 => 45.8416, std.dev.: 0.4686)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.80% (1.0567 => 1.0969, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.44% (5.1721 => 5.2982, std.dev.: 0.0406)
  MultiSource/Benchmarks/sim/sim: 1.49% (3.8704 => 3.9280, std.dev.: 0.0131)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.48% (5.8758 => 5.9626, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -31.88% (0.0552 => 0.0376, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/dt: -21.84% (0.0490 => 0.0383, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -14.15% (0.0968 => 0.0831, std.dev.: 0.0008)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.04% (2.8115 => 2.6980, std.dev.: 0.0333)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.27% (1.5346 => 1.4844, std.dev.: 0.0162)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -5.92% (1.0210 => 0.9606, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.67% (1.6719 => 1.6272, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.18% (4.2251 => 4.1332, std.dev.: 0.0130)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.11% (0.1421 => 0.1451, std.dev.: 0.0067)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 63.49% (0.0493 => 0.0806, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 63.29% (0.0425 => 0.0694, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 58.07% (0.0830 => 0.1312, std.dev.: 0.0025)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 50.46% (0.3765 => 0.5665, std.dev.: 0.0344)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 48.38% (0.7191 => 1.0670, std.dev.: 0.0243)
  MultiSource/Benchmarks/MallocBench/gs/gs: 41.40% (4.7091 => 6.6585, std.dev.: 0.1775)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 40.62% (0.3410 => 0.4795, std.dev.: 0.0230)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 39.41% (0.0888 => 0.1238, std.dev.: 0.0123)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 38.31% (0.1065 => 0.1473, std.dev.: 0.0061)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 37.19% (4.9917 => 6.8483, std.dev.: 0.0771)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 37.06% (1.2006 => 1.6455, std.dev.: 0.0483)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 34.65% (0.5887 => 0.7927, std.dev.: 0.0183)
  MultiSource/Benchmarks/McCat/09-vor/vor: 34.25% (0.3723 => 0.4998, std.dev.: 0.0211)
  MultiSource/Benchmarks/McCat/15-trie/trie: 33.81% (0.0633 => 0.0847, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 32.31% (0.3429 => 0.4537, std.dev.: 0.0317)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.97% (10.1602 => 12.7983, std.dev.: 0.5419)
  MultiSource/Benchmarks/Olden/health/health: 24.26% (0.1612 => 0.2003, std.dev.: 0.0142)
  MultiSource/Applications/lua/lua: 21.03% (4.3359 => 5.2477, std.dev.: 0.0865)
  MultiSource/Benchmarks/Prolangs-C/football/football: 20.54% (1.0292 => 1.2406, std.dev.: 0.0815)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 18.81% (1.1954 => 1.4203, std.dev.: 0.0684)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.46% (2.6076 => 2.9587, std.dev.: 0.0664)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.57% (4.1734 => 4.6144, std.dev.: 0.0501)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.47% (0.6254 => 0.6846, std.dev.: 0.0146)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.29% (0.7791 => 0.8515, std.dev.: 0.0261)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.01% (0.5196 => 0.5664, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.56% (1.6073 => 1.7449, std.dev.: 0.0220)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.87% (25.9348 => 27.9763, std.dev.: 0.4062)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.58% (2.5078 => 2.6980, std.dev.: 0.0333)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.31% (1.3833 => 1.4844, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.45% (1.4202 => 1.5118, std.dev.: 0.0260)
  MultiSource/Benchmarks/sim/sim: 4.12% (0.3716 => 0.3869, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.4006 => 0.4127, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 446.15% (0.0026 => 0.0142, std.dev.: 0.0016)
  MultiSource/Benchmarks/MallocBench/gs/gs: 57.08% (0.0869 => 0.1365, std.dev.: 0.0034)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 41.31% (0.0489 => 0.0691, std.dev.: 0.0029)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 39.00% (0.0259 => 0.0360, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 35.25% (0.1007 => 0.1362, std.dev.: 0.0125)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 30.73% (1.3530 => 1.7688, std.dev.: 0.0389)
  MultiSource/Benchmarks/Olden/health/health: 19.52% (0.3341 => 0.3993, std.dev.: 0.0241)
  MultiSource/Applications/sgefa/sgefa: 17.79% (1.1695 => 1.3776, std.dev.: 0.0407)
  MultiSource/Applications/obsequi/Obsequi: 14.35% (2.2398 => 2.5613, std.dev.: 0.0569)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.94% (1.2579 => 1.4332, std.dev.: 0.0612)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 12.86% (40.6198 => 45.8416, std.dev.: 0.4686)
  MultiSource/Benchmarks/Olden/bisort/bisort: 11.62% (0.8606 => 0.9606, std.dev.: 0.0166)
  MultiSource/Benchmarks/llubenchmark/llu: 10.95% (2.0425 => 2.2661, std.dev.: 0.0868)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 10.90% (21.4874 => 23.8304, std.dev.: 0.0228)
  SingleSource/Benchmarks/Misc/pi: 10.20% (1.8318 => 2.0187, std.dev.: 0.0215)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.49% (0.8276 => 0.9061, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.21% (5.2003 => 5.6271, std.dev.: 0.0348)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.48% (3.1853 => 3.3918, std.dev.: 0.0498)
  MultiSource/Applications/lua/lua: 4.97% (28.2496 => 29.6533, std.dev.: 0.5194)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.90% (4.6639 => 4.8925, std.dev.: 0.0229)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.08% (3.9713 => 4.1332, std.dev.: 0.0130)
  MultiSource/Benchmarks/Bullet/bullet: 3.86% (7.1938 => 7.4713, std.dev.: 0.0277)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.77% (1.0571 => 1.0969, std.dev.: 0.0062)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.63% (94.2966 => 97.7215, std.dev.: 0.8301)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.06% (5.5010 => 5.6695, std.dev.: 0.0333)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.64% (5.6582 => 5.8073, std.dev.: 0.0312)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (4.3727 => 4.4726, std.dev.: 0.0101)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.26% (39.9248 => 40.8276, std.dev.: 0.1377)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.86% (16.4665 => 16.7735, std.dev.: 0.0247)
  MultiSource/Benchmarks/sim/sim: 1.22% (3.8805 => 3.9280, std.dev.: 0.0131)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.3757 => 6.4419, std.dev.: 0.0166)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -23.98% (0.2431 => 0.1848, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc/whetstone: -13.86% (0.1097 => 0.0945, std.dev.: 0.0026)
  MultiSource/Applications/JM/lencod/lencod: -9.11% (18.9387 => 17.2141, std.dev.: 0.5748)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.08% (0.1322 => 0.1202, std.dev.: 0.0047)
  MultiSource/Applications/oggenc/oggenc: -4.02% (5.9886 => 5.7480, std.dev.: 0.0830)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.62% (1.6793 => 1.6353, std.dev.: 0.0056)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.67% (1.2911 => 0.7402, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2395, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.41% (6.2328 => 5.0233, std.dev.: 0.0972)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.90% (25.3677 => 21.3341, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc/salsa20: -12.95% (10.3398 => 9.0010, std.dev.: 0.0173)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.59% (48.3307 => 43.6956, std.dev.: 0.0408)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.41% (1.6679 => 1.5109, std.dev.: 0.0270)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.54% (3.5327 => 3.2663, std.dev.: 0.0658)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.76% (9.8728 => 9.3046, std.dev.: 0.0198)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.37% (0.2777 => 0.2628, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.20% (4.5717 => 4.3341, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.09% (5.5889 => 5.3043, std.dev.: 0.1058)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.27% (0.7941 => 0.7602, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.21% (5.3184 => 5.0946, std.dev.: 0.0216)
  MultiSource/Applications/sqlite3/sqlite3: -4.09% (4.6358 => 4.4461, std.dev.: 0.0214)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.90% (9.1099 => 8.7543, std.dev.: 0.0448)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.74% (2.4808 => 2.3879, std.dev.: 0.0282)
  MultiSource/Applications/hexxagon/hexxagon: -3.64% (15.4979 => 14.9340, std.dev.: 0.1401)
  SingleSource/Benchmarks/Misc/flops: -3.37% (10.2170 => 9.8728, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7879, std.dev.: 0.0367)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.61% (3.8665 => 3.7654, std.dev.: 0.0363)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.03% (4.2334 => 4.1475, std.dev.: 0.0287)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.50% (8.5243 => 8.3966, std.dev.: 0.0328)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1441 => 0.1451, std.dev.: 0.0067)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130613/d3082c69/attachment.html>


More information about the llvm-testresults mailing list