[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 16 07:24:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13478?compare_to=13474&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13478, Order: 186405, Start Time: 2013-07-16 12:37:40, End Time: 2013-07-16 14:26:27
      To: 13474, Order: 186394, Start Time: 2013-07-16 10:21:16, End Time: 2013-07-16 12:12:21
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (40 on baseline)
Performance Improvements: 33 (56 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1011 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 54.34% (0.0346 => 0.0534, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 42.26% (0.1098 => 0.1562, std.dev.: 0.0114)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.22% (0.6461 => 0.7832, std.dev.: 0.0401)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 18.35% (1.6642 => 1.9696, std.dev.: 0.0822)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.18% (0.2835 => 0.3152, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.47% (1.4745 => 1.5699, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.76% (2.1101 => 2.4004, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/random: 1.19% (2.4481 => 2.4773, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/15-trie/trie: -38.48% (0.1024 => 0.0630, std.dev.: 0.0010)
  MultiSource/Applications/viterbi/viterbi: -31.43% (0.2666 => 0.1828, std.dev.: 0.0274)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -26.65% (1.3000 => 0.9536, std.dev.: 0.1217)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -24.55% (1.5848 => 1.1957, std.dev.: 0.0035)
  MultiSource/Applications/lua/lua: -22.37% (5.6664 => 4.3989, std.dev.: 0.3089)
  MultiSource/Applications/hbd/hbd: -21.21% (2.0935 => 1.6494, std.dev.: 0.1373)
  MultiSource/Benchmarks/McCat/05-eks/eks: -20.63% (0.6913 => 0.5487, std.dev.: 0.0313)
  MultiSource/Applications/obsequi/Obsequi: -20.29% (1.4991 => 1.1949, std.dev.: 0.0849)
  MultiSource/Applications/lambda-0_1_3/lambda: -20.03% (1.0349 => 0.8276, std.dev.: 0.0525)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.17% (1.4731 => 1.1907, std.dev.: 0.0548)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -18.36% (0.0659 => 0.0538, std.dev.: 0.0008)
  MultiSource/Applications/hexxagon/hexxagon: -18.34% (1.3580 => 1.1090, std.dev.: 0.0876)
  MultiSource/Applications/spiff/spiff: -16.94% (1.1177 => 0.9284, std.dev.: 0.0135)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.49% (0.2906 => 0.2456, std.dev.: 0.0043)
  MultiSource/Applications/treecc/treecc: -15.28% (2.7541 => 2.3333, std.dev.: 0.0190)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -13.76% (0.1889 => 0.1629, std.dev.: 0.0034)
  MultiSource/Applications/SPASS/SPASS: -13.14% (19.5973 => 17.0224, std.dev.: 0.1705)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -13.04% (0.1043 => 0.0907, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.47% (1.6946 => 1.4833, std.dev.: 0.0004)
  MultiSource/Applications/sgefa/sgefa: -10.14% (0.4606 => 0.4139, std.dev.: 0.0017)
  MultiSource/Applications/oggenc/oggenc: -7.26% (6.1179 => 5.6735, std.dev.: 0.1200)
  SingleSource/Benchmarks/SmallPT/smallpt: -6.70% (0.1553 => 0.1449, std.dev.: 0.0012)
  MultiSource/Applications/d/make_dparser: -3.93% (3.8585 => 3.7070, std.dev.: 0.0398)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -46.12% (1.6712 => 0.9005, std.dev.: 0.2736)
  MultiSource/Benchmarks/McCat/18-imp/imp: -25.81% (0.1360 => 0.1009, std.dev.: 0.0058)
  MultiSource/Applications/SPASS/SPASS: -19.28% (9.9506 => 8.0325, std.dev.: 0.6292)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -10.20% (41.6171 => 37.3707, std.dev.: 0.8624)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.44% (3.1102 => 2.9099, std.dev.: 0.0651)
  MultiSource/Applications/lua/lua: -4.17% (31.4996 => 30.1851, std.dev.: 0.4972)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.21% (4.3061 => 4.1677, std.dev.: 0.0416)
  SingleSource/Benchmarks/Shootout/lists: -2.38% (7.3781 => 7.2023, std.dev.: 0.0482)
  MultiSource/Applications/sgefa/sgefa: -1.32% (1.5288 => 1.5086, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (2.0517 => 2.0249, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.30% (0.1303 => 0.1286, std.dev.: 0.0403)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 55.69% (0.0343 => 0.0534, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 51.06% (0.1034 => 0.1562, std.dev.: 0.0114)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.93% (0.5982 => 0.7832, std.dev.: 0.0401)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 24.17% (1.5862 => 1.9696, std.dev.: 0.0822)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.87% (0.2768 => 0.3152, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 6.71% (0.2295 => 0.2449, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.38% (1.4757 => 1.5699, std.dev.: 0.0051)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.32% (0.2721 => 0.2893, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2116 => 0.2236, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.62% (0.2206 => 0.2330, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 5.18% (0.2238 => 0.2354, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.78% (0.2513 => 0.2633, std.dev.: 0.0020)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.4253 => 1.4833, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/ary3: 3.72% (0.2799 => 0.2903, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 86.75% (0.1208 => 0.2256, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 58.97% (0.1750 => 0.2782, std.dev.: 0.0010)
  MultiSource/Applications/viterbi/viterbi: 35.79% (2.5688 => 3.4883, std.dev.: 0.0743)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.97% (9.8728 => 12.9302, std.dev.: 0.0146)
  MultiSource/Applications/sgefa/sgefa: 29.00% (1.1695 => 1.5086, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/perlin: 26.64% (3.6271 => 4.5934, std.dev.: 0.0241)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.21% (2.5366 => 3.1000, std.dev.: 0.1098)
  SingleSource/Benchmarks/Misc/mandel: 17.24% (1.0293 => 1.2068, std.dev.: 0.0173)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.97% (0.9806 => 1.1372, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.54% (5.2788 => 6.0462, std.dev.: 0.1056)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 12.13% (5.2561 => 5.8935, std.dev.: 0.0401)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (4.5094 => 5.0010, std.dev.: 0.0760)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.42% (2.9004 => 3.2025, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.82% (4.6379 => 5.0469, std.dev.: 0.0316)
  MultiSource/Applications/lua/lua: 6.85% (28.2496 => 30.1851, std.dev.: 0.4972)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.07% (5.6582 => 5.9451, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/fbench: 4.29% (4.7508 => 4.9544, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.02% (5.9362 => 6.1750, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 3.75% (2.8994 => 3.0081, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.24% (6.1372 => 6.3359, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.70% (4.2167 => 4.3306, std.dev.: 0.0429)
  SingleSource/Benchmarks/Shootout/methcall: 2.50% (8.3425 => 8.5510, std.dev.: 0.0232)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (4.3727 => 4.4804, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.17% (8.5243 => 8.7095, std.dev.: 0.0372)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.69% (34.3107 => 34.8902, std.dev.: 0.0444)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.27% (12.1841 => 12.3389, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.44% (0.0803 => 0.0679, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/whetstone: -14.59% (0.1097 => 0.0937, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -13.12% (1.6292 => 1.4154, std.dev.: 0.0445)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -12.78% (1.5984 => 1.3941, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.48% (1.7006 => 1.4884, std.dev.: 0.0531)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.03% (1.5612 => 1.3734, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -11.99% (1.5727 => 1.3842, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -11.85% (1.5735 => 1.3871, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -11.59% (1.7102 => 1.5120, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.53% (1.6299 => 1.4419, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.99% (1.6726 => 1.4888, std.dev.: 0.0590)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -10.86% (1.6993 => 1.5148, std.dev.: 0.0426)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -9.41% (1.5806 => 1.4319, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.65% (1.6804 => 1.5351, std.dev.: 0.0062)
  MultiSource/Applications/oggenc/oggenc: -5.26% (5.9886 => 5.6735, std.dev.: 0.1200)
  MultiSource/Applications/SPASS/SPASS: -3.49% (17.6379 => 17.0224, std.dev.: 0.1705)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.57% (1.2911 => 0.7286, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/matrix: -32.39% (4.3226 => 2.9225, std.dev.: 0.4668)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -30.36% (4.4050 => 3.0678, std.dev.: 0.0325)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.59% (1.6105 => 1.2145, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -23.28% (4.8986 => 3.7582, std.dev.: 0.0229)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.84% (9.1099 => 7.0295, std.dev.: 0.0476)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.56% (0.7941 => 0.6308, std.dev.: 0.0524)
  SingleSource/Benchmarks/Shootout/hash: -20.19% (5.3656 => 4.2824, std.dev.: 0.2459)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.70% (5.5763 => 4.6452, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.69% (11.6227 => 9.6834, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -16.30% (0.3860 => 0.3231, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.78% (6.2328 => 5.3116, std.dev.: 0.0199)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.49% (25.3677 => 21.6911, std.dev.: 0.0674)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.15% (5.7264 => 4.9162, std.dev.: 0.0110)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.14% (0.1945 => 0.1670, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/salsa20: -13.23% (10.3398 => 8.9722, std.dev.: 0.0075)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.23% (1.6613 => 1.4581, std.dev.: 0.0231)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -10.50% (0.3267 => 0.2924, std.dev.: 0.0006)
  MultiSource/Applications/siod/siod: -9.66% (3.7240 => 3.3643, std.dev.: 0.0406)
  SingleSource/Regression/C/uint64_to_float: -9.52% (1.6851 => 1.5247, std.dev.: 0.0267)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.15% (3.2030 => 2.9099, std.dev.: 0.0651)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.83% (16.4665 => 15.0125, std.dev.: 0.4604)
  MultiSource/Benchmarks/nbench/nbench: -7.14% (22.3004 => 20.7086, std.dev.: 0.1509)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.54% (5.3184 => 4.9707, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.42% (4.5717 => 4.2781, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.07% (5.2003 => 4.8849, std.dev.: 0.0290)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (3.5939 => 3.3980, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.24% (1.3084 => 1.2399, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -5.08% (1.6535 => 1.5695, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.05% (5.5889 => 5.3068, std.dev.: 0.0449)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.96% (1.4783 => 1.4050, std.dev.: 0.0233)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.77% (2.8537 => 2.7175, std.dev.: 0.0421)
  MultiSource/Applications/sqlite3/sqlite3: -4.70% (4.6358 => 4.4181, std.dev.: 0.0539)
  SingleSource/Benchmarks/Misc/whetstone: -4.09% (3.5970 => 3.4500, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/flops: -4.08% (10.2170 => 9.8002, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.77% (7.0179 => 6.7531, std.dev.: 0.0801)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.21% (1.6440 => 1.5913, std.dev.: 0.0072)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.72% (48.3307 => 47.0154, std.dev.: 0.2129)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.63% (3.8665 => 3.7649, std.dev.: 0.0318)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.55% (4.0156 => 3.9533, std.dev.: 0.0238)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -10.76% (0.1441 => 0.1286, std.dev.: 0.0403)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130716/d8d69198/attachment.html>


More information about the llvm-testresults mailing list