[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 13 16:06:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12359?compare_to=12355&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12359, Order: 183941, Start Time: 2013-06-13 21:14:35, End Time: 2013-06-13 23:07:23
      To: 12355, Order: 183925, Start Time: 2013-06-13 18:56:04, End Time: 2013-06-13 20:49:04
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 19 (42 on baseline)
Performance Improvements: 22 (27 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1038 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 65.15% (0.0241 => 0.0398, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 31.46% (0.0944 => 0.1241, std.dev.: 0.0109)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.97% (5.0291 => 6.4862, std.dev.: 0.4747)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.65% (7.5126 => 8.8382, std.dev.: 0.2508)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.47% (1.7449 => 1.7880, std.dev.: 0.0094)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 33.55% (6.7193 => 8.9738, std.dev.: 0.6862)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.43% (0.1223 => 0.1534, std.dev.: 0.0035)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.46% (2.7477 => 3.3098, std.dev.: 0.0278)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.34% (0.0807 => 0.0955, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.38% (64.7872 => 68.9178, std.dev.: 0.7899)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.98% (0.3395 => 0.3598, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.83% (40.4073 => 42.7649, std.dev.: 0.7359)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.42% (5.9123 => 6.1734, std.dev.: 0.0246)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.11% (4.0264 => 4.1918, std.dev.: 0.0542)
  SingleSource/Benchmarks/Misc/ffbench: 4.09% (1.3948 => 1.4518, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.45% (3.0687 => 3.1746, std.dev.: 0.0336)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.38% (1.6272 => 1.6660, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/random: 1.04% (2.4538 => 2.4793, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.02% (5.6977 => 5.7558, std.dev.: 0.0078)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -31.38% (1.0670 => 0.7322, std.dev.: 0.0966)
  MultiSource/Benchmarks/McCat/09-vor/vor: -28.79% (0.4998 => 0.3559, std.dev.: 0.0491)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -25.91% (0.7927 => 0.5873, std.dev.: 0.0795)
  SingleSource/Benchmarks/Shootout-C++/hash: -13.04% (0.5161 => 0.4488, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -12.44% (0.4061 => 0.3556, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout-C++/objinst: -8.96% (0.2557 => 0.2328, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.72% (4.6144 => 4.3044, std.dev.: 0.0557)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (1.7781 => 1.6824, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.07% (0.2288 => 0.2172, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -41.47% (0.1365 => 0.0799, std.dev.: 0.0104)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.25% (0.0691 => 0.0558, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -19.09% (0.1362 => 0.1102, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.42% (1.7693 => 1.4964, std.dev.: 0.0491)
  MultiSource/Applications/SPASS/SPASS: -14.41% (9.6305 => 8.2429, std.dev.: 0.4754)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.88% (0.7602 => 0.7231, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.95% (23.8304 => 22.8893, std.dev.: 0.2935)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -3.68% (1.5633 => 1.5058, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.95% (5.2982 => 5.1419, std.dev.: 0.0331)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -2.27% (0.4887 => 0.4776, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.13% (45.8416 => 44.8669, std.dev.: 0.2663)
  MultiSource/Benchmarks/Olden/power/power: -1.47% (1.2695 => 1.2509, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.26% (5.3043 => 5.2375, std.dev.: 0.0109)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1451 => 0.1432, std.dev.: 0.0158)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 64.46% (0.0242 => 0.0398, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 35.19% (0.2734 => 0.3696, std.dev.: 0.0366)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 35.19% (0.0918 => 0.1241, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/mst/mst: 26.83% (0.1405 => 0.1782, std.dev.: 0.0115)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 23.68% (4.9917 => 6.1735, std.dev.: 0.3720)
  MultiSource/Benchmarks/Bullet/bullet: 19.32% (35.5296 => 42.3942, std.dev.: 1.0097)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.47% (7.7211 => 8.8382, std.dev.: 0.2508)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.24% (1.6073 => 1.7880, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.82% (0.3061 => 0.3331, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.43% (1.5727 => 1.6896, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.12% (1.3838 => 1.4823, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.76% (1.5612 => 1.6667, std.dev.: 0.0401)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.15% (1.4238 => 1.5113, std.dev.: 0.0195)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.45% (1.9079 => 2.0118, std.dev.: 0.0368)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.34% (0.3088 => 0.3222, std.dev.: 0.0031)
  MultiSource/Applications/sqlite3/sqlite3: 3.87% (16.9719 => 17.6281, std.dev.: 0.2113)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.99% (1.7102 => 1.7613, std.dev.: 0.0173)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 53.04% (0.0624 => 0.0955, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/ary3: 49.26% (6.0122 => 8.9738, std.dev.: 0.6862)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 30.89% (0.1172 => 0.1534, std.dev.: 0.0035)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.48% (2.5366 => 3.3098, std.dev.: 0.0278)
  SingleSource/Benchmarks/Stanford/Puzzle: 20.34% (0.1455 => 0.1751, std.dev.: 0.0012)
  MultiSource/Applications/sgefa/sgefa: 18.08% (1.1695 => 1.3809, std.dev.: 0.0365)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.46% (40.6198 => 44.8669, std.dev.: 0.2663)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 10.38% (62.4345 => 68.9178, std.dev.: 0.7899)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.17% (39.1740 => 42.7649, std.dev.: 0.7359)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.56% (5.2003 => 5.6457, std.dev.: 0.0399)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.82% (3.1853 => 3.4345, std.dev.: 0.0286)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.52% (21.4874 => 22.8893, std.dev.: 0.2935)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.39% (0.3382 => 0.3598, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.02% (3.2201 => 3.4139, std.dev.: 0.0588)
  SingleSource/Benchmarks/Misc/ffbench: 6.00% (1.3696 => 1.4518, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.39% (4.0156 => 4.1918, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.11% (5.2788 => 5.4960, std.dev.: 0.0403)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.10% (1.0571 => 1.1004, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.06% (1.4783 => 1.5383, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.00% (5.9362 => 6.1734, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.88% (5.5010 => 5.6597, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.81% (5.6582 => 5.8173, std.dev.: 0.0528)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.55% (3.6122 => 3.7042, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (4.3727 => 4.4728, std.dev.: 0.0242)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.26% (11.4990 => 11.6435, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.84% (0.1113 => 0.0703, std.dev.: 0.0024)
  MultiSource/Applications/viterbi/viterbi: -24.85% (0.2431 => 0.1827, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.62% (0.1322 => 0.1142, std.dev.: 0.0067)
  MultiSource/Applications/JM/lencod/lencod: -9.61% (18.9387 => 17.1186, std.dev.: 0.4266)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.77% (1.2911 => 0.7260, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2395, std.dev.: 0.0278)
  MultiSource/Applications/lemon/lemon: -25.22% (1.3499 => 1.0095, std.dev.: 0.1043)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.93% (6.2328 => 5.0531, std.dev.: 0.0293)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.10% (25.3677 => 21.2846, std.dev.: 0.0554)
  SingleSource/Benchmarks/Misc/salsa20: -12.91% (10.3398 => 9.0046, std.dev.: 0.0970)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.05% (48.3307 => 43.4740, std.dev.: 0.1013)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.94% (0.7941 => 0.7231, std.dev.: 0.0062)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.11% (3.5327 => 3.2461, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.29% (5.5889 => 5.2375, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.99% (9.8728 => 9.2815, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.51% (4.5717 => 4.3196, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.62% (5.3184 => 5.0727, std.dev.: 0.0145)
  MultiSource/Applications/sqlite3/sqlite3: -3.97% (4.6358 => 4.4519, std.dev.: 0.0302)
  MultiSource/Applications/hexxagon/hexxagon: -3.95% (15.4979 => 14.8851, std.dev.: 0.0738)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.82% (9.1099 => 8.7621, std.dev.: 0.0515)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.49% (5.3276 => 5.1419, std.dev.: 0.0331)
  MultiSource/Applications/JM/lencod/lencod: -2.48% (7.0353 => 6.8606, std.dev.: 0.0222)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.44% (3.8665 => 3.7722, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/sieve: -2.28% (8.0178 => 7.8348, std.dev.: 0.0366)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.97% (4.2167 => 4.1337, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.94% (4.5094 => 4.4218, std.dev.: 0.0153)
  MultiSource/Applications/viterbi/viterbi: -1.35% (2.5688 => 2.5340, std.dev.: 0.0058)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1441 => 0.1432, std.dev.: 0.0158)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130613/0e1be47c/attachment.html>


More information about the llvm-testresults mailing list