[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Sep 15 13:36:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15321?compare_to=15317&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15321, Order: 190767, Start Time: 2013-09-15 18:51:24, End Time: 2013-09-15 20:38:51
      To: 15317, Order: 190764, Start Time: 2013-09-15 15:53:58, End Time: 2013-09-15 18:26:58
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

New Passes: 53 (0 on baseline)
Performance Regressions: 24 (25 on baseline)
Performance Improvements: 3 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1027 (1069 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/JM/ldecod/ldecod
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/McCat/18-imp/imp
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Benchmarks/Prolangs-C/bison/mybison
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  SingleSource/Benchmarks/Misc/ReedSolomon
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.95% (1.1729 => 1.1617, std.dev.: 0.2180)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -0.21% (1.1740 => 1.1715, std.dev.: 0.3104)
  MultiSource/Applications/ClamAV/clamscan: 1.31% (16.5106 => 16.7276, std.dev.: 1.8485)
  MultiSource/Applications/JM/ldecod/ldecod: 4.77% (7.1572 => 7.4986, std.dev.: 0.8929)
  MultiSource/Applications/JM/lencod/lencod: 10.23% (15.2460 => 16.8058, std.dev.: 1.9605)
  MultiSource/Applications/SIBsim4/SIBsim4: 26.40% (1.2839 => 1.6229, std.dev.: 0.0587)
  MultiSource/Applications/oggenc/oggenc: 29.43% (4.1774 => 5.4070, std.dev.: 0.3640)
  MultiSource/Applications/sqlite3/sqlite3: 51.14% (10.9765 => 16.5904, std.dev.: 1.2771)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 0.54% (44.6840 => 44.9263, std.dev.: 2.0297)
  MultiSource/Benchmarks/McCat/18-imp/imp: 16.60% (0.3487 => 0.4066, std.dev.: 0.1350)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (4.7976 => 4.8456, std.dev.: 0.8932)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.38% (14.6248 => 14.6798, std.dev.: 1.0298)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.74% (9.6658 => 9.7370, std.dev.: 0.0499)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.90% (1.5475 => 1.6079, std.dev.: 0.3253)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.04% (0.7108 => 0.7034, std.dev.: 0.0065)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.69% (0.1024 => 0.1113, std.dev.: 0.0440)
  MultiSource/Benchmarks/mafft/pairlocalalign: 0.35% (10.1414 => 10.1774, std.dev.: 0.2999)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.8678 => 4.9597, std.dev.: 0.7591)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.75% (1.5871 => 1.6625, std.dev.: 0.1923)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.48% (0.1920 => 0.2198, std.dev.: 0.0075)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 17.43% (0.4491 => 0.5274, std.dev.: 0.0038)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  MultiSource/Applications/JM/ldecod/ldecod
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/FreeBench/pifft/pifft
  MultiSource/Benchmarks/McCat/18-imp/imp
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Olden/bh/bh
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Benchmarks/Prolangs-C/bison/mybison
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant
  SingleSource/Benchmarks/BenchmarkGame/n-body
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8
  SingleSource/Benchmarks/Misc/ReedSolomon
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 21900.00% (0.0001 => 0.0220, std.dev.: 0.0059)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: - (0.0000 => 0.0507, std.dev.: 0.0074)
  MultiSource/Applications/JM/ldecod/ldecod: - (0.0000 => 0.0734, std.dev.: 0.0040)
  MultiSource/Applications/JM/lencod/lencod: - (0.0000 => 7.6672, std.dev.: 0.3038)
  MultiSource/Applications/SIBsim4/SIBsim4: - (0.0000 => 3.4675, std.dev.: 0.1743)
  MultiSource/Applications/oggenc/oggenc: - (0.0000 => 0.1748, std.dev.: 0.0109)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.2614, std.dev.: 0.1896)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -99.97% (495.4554 => 0.1628, std.dev.: 0.0201)
  MultiSource/Benchmarks/McCat/18-imp/imp: - (0.0000 => 0.1028, std.dev.: 0.0157)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: - (0.0000 => 0.0045, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 331500.00% (0.0001 => 0.3316, std.dev.: 0.0224)
  MultiSource/Benchmarks/Olden/bh/bh: 844.76% (0.2511 => 2.3723, std.dev.: 0.0743)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 0.18% (0.3392 => 0.3398, std.dev.: 0.0537)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0008)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: - (0.0000 => 0.0049, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: - (0.0000 => 0.0584, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1256500.00% (0.0001 => 1.2566, std.dev.: 0.0532)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -79.45% (27.2978 => 5.6091, std.dev.: 0.0159)
  MultiSource/Benchmarks/mafft/pairlocalalign: - (0.0000 => 48.7403, std.dev.: 0.9396)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0000 => 0.0043, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0000 => 0.0313, std.dev.: 0.0044)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.39% (0.5241 => 0.5314, std.dev.: 0.0009)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.42% (4.2953 => 4.4421, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.45% (3.3326 => 3.4475, std.dev.: 0.0318)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -43.13% (2.4821 => 1.4116, std.dev.: 0.0269)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -88.95% (44.8471 => 4.9564, std.dev.: 0.0212)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -99.35% (492.7093 => 3.1995, std.dev.: 0.1379)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -18.13% (0.2730 => 0.2235, std.dev.: 0.0537)
  SingleSource/Benchmarks/Misc/ReedSolomon: - (0.0000 => 8.4937, std.dev.: 0.6082)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -82.26% (0.0637 => 0.0113, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -83.31% (9.7000 => 1.6188, std.dev.: 0.0070)
  SingleSource/UnitTests/Vectorizer/gcc-loops: - (0.0000 => 22.0746, std.dev.: 0.0521)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.60% (0.9504 => 0.9751, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.89% (4.5992 => 4.6860, std.dev.: 0.0249)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: 121.17% (0.2367 => 0.5235, std.dev.: 0.0039)
  MultiSource/Applications/sgefa/sgefa: 104.02% (0.8378 => 1.7093, std.dev.: 0.1042)
  SingleSource/Benchmarks/SmallPT/smallpt: 90.18% (8.9253 => 16.9742, std.dev.: 0.0735)
  SingleSource/Benchmarks/Shootout-C++/matrix: 26.50% (2.9105 => 3.6819, std.dev.: 0.1257)
  SingleSource/Benchmarks/Shootout/sieve: 12.31% (7.1755 => 8.0589, std.dev.: 0.2045)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.66% (2.8117 => 3.0553, std.dev.: 0.0061)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 7.35% (82.3335 => 88.3859, std.dev.: 0.3428)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1167 => 1.1734, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.90% (3.5028 => 3.6394, std.dev.: 0.0404)
  SingleSource/Regression/C/uint64_to_float: 3.85% (1.4243 => 1.4792, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.16% (4.0163 => 4.1431, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/lists: 2.83% (7.2224 => 7.4267, std.dev.: 0.0434)
  SingleSource/Benchmarks/Misc/fp-convert: 2.67% (7.5658 => 7.7678, std.dev.: 0.0433)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.61% (1.2593 => 1.2922, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (2.4843 => 2.5468, std.dev.: 0.0218)
  MultiSource/Applications/siod/siod: 2.36% (3.5765 => 3.6608, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.09% (5.5091 => 5.6245, std.dev.: 0.0024)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.87% (23.3868 => 23.8243, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (2.5355 => 2.5802, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/ary3: 1.74% (4.9148 => 5.0001, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.45% (16.6074 => 16.8479, std.dev.: 0.0179)
  SingleSource/Benchmarks/Shootout/methcall: 1.06% (8.5833 => 8.6745, std.dev.: 0.0194)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -3.21% (0.4087 => 0.3956, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -30.23% (2.0793 => 1.4507, std.dev.: 0.0430)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.34% (17.9652 => 15.3892, std.dev.: 0.8103)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1363, std.dev.: 0.0130)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.71% (0.9494 => 0.9751, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.13% (4.5883 => 4.6860, std.dev.: 0.0249)
  SingleSource/UnitTests/Vector/constpool: 1.90% (8.8921 => 9.0611, std.dev.: 0.0565)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 28.95% (2.8554 => 3.6819, std.dev.: 0.1257)
  SingleSource/Benchmarks/Shootout/sieve: 11.54% (7.2254 => 8.0589, std.dev.: 0.2045)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.55% (1.1013 => 1.1734, std.dev.: 0.0044)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 6.00% (20.8247 => 22.0746, std.dev.: 0.0521)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.67% (0.1871 => 0.1977, std.dev.: 0.0008)
  MultiSource/Applications/siod/siod: 3.68% (3.5310 => 3.6608, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.11% (4.0181 => 4.1431, std.dev.: 0.0015)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (0.5182 => 0.5314, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6245, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/power/power: 2.40% (1.2170 => 1.2462, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/fp-convert: 2.37% (7.5877 => 7.7678, std.dev.: 0.0433)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (4.3592 => 4.4421, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.84% (3.1569 => 3.2151, std.dev.: 0.0025)
  SingleSource/Regression/C/uint64_to_float: 1.82% (1.4528 => 1.4792, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/fib2: 1.59% (3.5966 => 3.6538, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/methcall: 1.53% (8.5434 => 8.6745, std.dev.: 0.0194)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (23.4704 => 23.8243, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.35% (3.7874 => 3.8384, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.06% (5.0196 => 5.0730, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (4.0596 => 4.1011, std.dev.: 0.0145)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.65% (0.1483 => 0.1162, std.dev.: 0.0002)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -10.13% (0.1195 => 0.1074, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.43% (0.2571 => 0.2380, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.19% (0.1956 => 0.1835, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.65% (0.2193 => 0.2069, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.64% (1.7197 => 1.4507, std.dev.: 0.0430)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -6.76% (4.1004 => 3.8233, std.dev.: 0.0969)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.37% (30.1838 => 28.5638, std.dev.: 0.0316)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.95% (2.4471 => 2.3748, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.72% (17.1431 => 16.8479, std.dev.: 0.0179)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.48% (89.7126 => 88.3859, std.dev.: 0.3428)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.21% (4.9022 => 4.8429, std.dev.: 0.0121)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.20% (3.8582 => 3.8118, std.dev.: 0.0011)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1348 => 0.1363, std.dev.: 0.0130)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130915/bdb29fc3/attachment.html>


More information about the llvm-testresults mailing list