[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Sat Mar 9 03:43:16 PST 2013

http://llvm.org/perf/db_default/v4/nts/9248?compare_to=9244&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9248, Order: 176763, Start Time: 2013-03-09 09:58:57, End Time: 2013-03-09 11:43:48
      To: 9244, Order: 176756, Start Time: 2013-03-09 05:04:21, End Time: 2013-03-09 06:45:16
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 10 (28 on baseline)
Performance Improvements: 2 (9 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1061 (1035 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.57% (0.2558 => 0.2726, std.dev.: 0.0063)
  MultiSource/Applications/oggenc/oggenc: 1.04% (5.5519 => 5.6098, std.dev.: 0.0178)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 19.01% (2.2551 => 2.6837, std.dev.: 0.1486)
  SingleSource/Benchmarks/Misc/flops: 9.73% (8.5461 => 9.3778, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/mandel: 8.59% (1.0701 => 1.1620, std.dev.: 0.0195)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.13% (2.6610 => 2.7444, std.dev.: 0.0070)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.5223 => 0.5375, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.62% (1.0220 => 1.0488, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.73% (40.5583 => 41.2604, std.dev.: 0.1968)
  SingleSource/Benchmarks/Shootout/methcall: 1.24% (8.4801 => 8.5856, std.dev.: 0.0262)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/richards_benchmark: -3.09% (1.3566 => 1.3147, std.dev.: 0.0154)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.85% (60.5901 => 58.8634, std.dev.: 0.4630)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.16% (1.1367 => 1.1349, std.dev.: 0.0095)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 24.62% (0.0199 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -1.52% (0.1511 => 0.1488, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: 2.19% (1.1566 => 1.1819, std.dev.: 0.0529)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.95% (0.1327 => 0.1406, std.dev.: 0.0185)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.16% (0.0637 => 0.0689, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.47% (0.0273 => 0.0277, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.03% (0.0659 => 0.0679, std.dev.: 0.0127)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.71% (1.1598 => 1.1680, std.dev.: 0.1899)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.73% (0.0022 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.82% (0.0550 => 0.0593, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.73% (0.0299 => 0.0358, std.dev.: 0.0089)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.83% (1.6843 => 1.6704, std.dev.: 0.0016)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 14.29% (0.0007 => 0.0008)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 123.40% (0.0047 => 0.0105, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0007 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.99% (29.2222 => 29.8032, std.dev.: 1.8864)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -97.83% (0.0046 => 0.0001, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/Altivec/casts: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0007 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.12% (26.8681 => 26.5661, std.dev.: 0.3879)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.02% (0.4125 => 0.4497, std.dev.: 0.1900)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/lencod/lencod: 6.81% (16.7203 => 17.8582, std.dev.: 0.0565)
  MultiSource/Applications/JM/ldecod/ldecod: 6.44% (7.2467 => 7.7132, std.dev.: 0.0149)
  MultiSource/Applications/d/make_dparser: 5.73% (3.5353 => 3.7379, std.dev.: 0.0292)
  MultiSource/Applications/lemon/lemon: 5.26% (1.2932 => 1.3612, std.dev.: 0.0137)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.18% (0.4051 => 0.4261, std.dev.: 0.0030)
  MultiSource/Applications/SPASS/SPASS: 2.91% (16.3304 => 16.8062, std.dev.: 0.0195)
  MultiSource/Applications/oggenc/oggenc: 2.88% (5.4527 => 5.6098, std.dev.: 0.0178)
  MultiSource/Applications/minisat/minisat: 2.77% (0.7554 => 0.7763, std.dev.: 0.0061)
  MultiSource/Applications/ClamAV/clamscan: 2.59% (16.1821 => 16.6016, std.dev.: 0.0947)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.51% (1.1277 => 1.1560, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.9184 => 0.9403, std.dev.: 0.0037)
  MultiSource/Applications/lua/lua: 2.32% (4.1835 => 4.2806, std.dev.: 0.0358)
  MultiSource/Applications/siod/siod: 2.29% (2.4196 => 2.4751, std.dev.: 0.0032)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.08% (1.1320 => 1.1556, std.dev.: 0.0033)
  MultiSource/Applications/treecc/treecc: 2.04% (2.2217 => 2.2671, std.dev.: 0.0165)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (1.4195 => 1.4447, std.dev.: 0.0078)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.19% (1.8524 => 1.8744, std.dev.: 0.0080)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 32.17% (0.0314 => 0.0415, std.dev.: 0.0003)
  SingleSource/Benchmarks/McGill/chomp: 7.82% (1.0339 => 1.1147, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/pi: 7.80% (2.0512 => 2.2111, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.83% (2.9511 => 3.1527, std.dev.: 0.0294)
  SingleSource/Benchmarks/Misc/mandel: 6.78% (1.0882 => 1.1620, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (6.2349 => 6.5273, std.dev.: 0.0516)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.72% (0.5182 => 0.5375, std.dev.: 0.0054)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (57.5400 => 59.6302, std.dev.: 0.0607)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.52% (1.0331 => 1.0488, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/methcall: 1.43% (8.4644 => 8.5856, std.dev.: 0.0262)
  SingleSource/Benchmarks/Shootout/fib2: 1.06% (4.9040 => 4.9561, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.06% (0.0810 => 0.0445, std.dev.: 0.0044)
  SingleSource/Benchmarks/McGill/chomp: -7.77% (0.1957 => 0.1805, std.dev.: 0.0007)
  SingleSource/Benchmarks/Linpack/linpack-pc: -6.58% (0.2751 => 0.2570, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.74% (0.7818 => 0.7604, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.14% (0.6155 => 0.6023, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -12.55% (4.7243 => 4.1315, std.dev.: 0.0666)
  MultiSource/Applications/SPASS/SPASS: -4.94% (8.4733 => 8.0544, std.dev.: 0.1190)
  SingleSource/Benchmarks/Misc/ffbench: -2.00% (1.4279 => 1.3994, std.dev.: 0.0107)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.61% (1.1828 => 1.1638, std.dev.: 0.0039)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.54% (1.1288 => 1.1349, std.dev.: 0.0095)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1477 => 0.1488, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: 0.21% (1.1794 => 1.1819, std.dev.: 0.0529)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1309 => 0.1406, std.dev.: 0.0185)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.40% (0.0613 => 0.0689, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.41% (0.0663 => 0.0679, std.dev.: 0.0127)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1660 => 1.1680, std.dev.: 0.1899)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0594 => 0.0593, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.83% (0.0361 => 0.0358, std.dev.: 0.0089)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.59% (1.6803 => 1.6704, std.dev.: 0.0016)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 14.13% (0.0092 => 0.0105, std.dev.: 0.0011)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.03% (29.7937 => 29.8032, std.dev.: 1.8864)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.32% (26.9213 => 26.5661, std.dev.: 0.3879)

Report Time: 0.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130309/f259e62b/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results