[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Sat Mar 9 17:18:24 PST 2013

http://llvm.org/perf/db_default/v4/nts/9268?compare_to=9264&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9268, Order: 176777, Start Time: 2013-03-09 23:25:11, End Time: 2013-03-10 01:18:53
      To: 9264, Order: 176776, Start Time: 2013-03-09 20:29:32, End Time: 2013-03-09 22:10:12
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 18 (29 on baseline)
Performance Improvements: 1 (3 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1054 (1040 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.00% (4.6327 => 5.1425, std.dev.: 0.0641)
  MultiSource/Applications/minisat/minisat: 9.74% (0.7719 => 0.8471, std.dev.: 0.0244)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.32% (1.6101 => 1.7602, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.70% (1.3119 => 1.4260, std.dev.: 0.0261)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.22% (1.1468 => 1.2067, std.dev.: 0.0036)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.99% (1.1488 => 1.2061, std.dev.: 0.0165)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.78% (1.1673 => 1.2114, std.dev.: 0.0127)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 42.00% (0.8750 => 1.2425, std.dev.: 0.0114)
  MultiSource/Applications/minisat/minisat: 28.15% (6.1782 => 7.9173, std.dev.: 0.1383)
  MultiSource/Applications/JM/ldecod/ldecod: 19.86% (0.0569 => 0.0682, std.dev.: 0.0034)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.81% (0.0855 => 0.0956, std.dev.: 0.0007)
  MultiSource/Benchmarks/McCat/09-vor/vor: 10.15% (0.1084 => 0.1194, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops: 9.79% (8.5432 => 9.3796, std.dev.: 0.0665)
  SingleSource/Benchmarks/Misc/mandel: 7.67% (1.0536 => 1.1344, std.dev.: 0.0299)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.29% (1.8259 => 1.9043, std.dev.: 0.0093)
  MultiSource/Benchmarks/nbench/nbench: 3.76% (22.0275 => 22.8547, std.dev.: 0.2364)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.36% (0.6048 => 0.6191, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.57% (5.8467 => 5.9387, std.dev.: 0.0269)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -3.13% (0.4155 => 0.4025, std.dev.: 0.0019)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.77% (1.1406 => 1.1494, std.dev.: 0.2619)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.65% (0.0248 => 0.0234, std.dev.: 0.0037)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 5.44% (0.1397 => 0.1473, std.dev.: 0.0103)
  MultiSource/Applications/lemon/lemon: 35.38% (1.1386 => 1.5414, std.dev.: 0.1686)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.37% (0.1361 => 0.1356, std.dev.: 0.0189)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.87% (0.0606 => 0.0684, std.dev.: 0.0173)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.65% (0.0217 => 0.0277, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.54% (0.0650 => 0.0627, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.1589 => 1.1659, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.93% (0.0502 => 0.0592, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.35% (0.0315 => 0.0335, std.dev.: 0.0061)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.14% (1.6529 => 1.6717, std.dev.: 0.0178)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -2.27% (0.0088 => 0.0086, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0007 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.16% (29.2497 => 29.2040, std.dev.: 2.0059)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -75.00% (0.0004 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -90.91% (0.0011 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.74% (26.5476 => 26.7452, std.dev.: 0.2192)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.09% (0.4125 => 0.4335, std.dev.: 0.1069)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/hbd/hbd: 15.35% (1.5307 => 1.7657, std.dev.: 0.0794)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.94% (4.5532 => 5.1425, std.dev.: 0.0641)
  MultiSource/Applications/lemon/lemon: 12.94% (1.2932 => 1.4605, std.dev.: 0.0452)
  MultiSource/Applications/minisat/minisat: 12.14% (0.7554 => 0.8471, std.dev.: 0.0244)
  MultiSource/Applications/JM/ldecod/ldecod: 10.58% (7.2467 => 8.0135, std.dev.: 0.2145)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.74% (1.6187 => 1.7602, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.58% (14.7643 => 16.0310, std.dev.: 0.3565)
  MultiSource/Benchmarks/sim/sim: 8.38% (0.3567 => 0.3866, std.dev.: 0.0063)
  MultiSource/Applications/oggenc/oggenc: 7.76% (5.4527 => 5.8757, std.dev.: 0.1588)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.70% (1.3240 => 1.4260, std.dev.: 0.0261)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 7.01% (1.1277 => 1.2067, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.72% (9.4701 => 10.1063, std.dev.: 0.2336)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 6.55% (1.1320 => 1.2061, std.dev.: 0.0165)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.8668 => 1.9772, std.dev.: 0.0239)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.84% (1.1555 => 1.2114, std.dev.: 0.0127)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.88% (2.4999 => 2.5969, std.dev.: 0.0367)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 39.69% (0.8895 => 1.2425, std.dev.: 0.0114)
  MultiSource/Applications/minisat/minisat: 27.81% (6.1945 => 7.9173, std.dev.: 0.1383)
  MultiSource/Benchmarks/nbench/nbench: 10.56% (20.6711 => 22.8547, std.dev.: 0.2364)
  SingleSource/Benchmarks/Misc/pi: 6.47% (2.0512 => 2.1839, std.dev.: 0.0149)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.86% (6.2349 => 6.5379, std.dev.: 0.0224)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (57.5400 => 59.6405, std.dev.: 0.1089)
  MultiSource/Applications/lua/lua: 3.33% (28.1709 => 29.1090, std.dev.: 0.3307)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.45% (0.6043 => 0.6191, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/methcall: 1.90% (8.4644 => 8.6254, std.dev.: 0.0324)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.66% (1.8732 => 1.9043, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.55% (5.8478 => 5.9387, std.dev.: 0.0269)
  SingleSource/Benchmarks/Shootout/fib2: 1.14% (4.9040 => 4.9598, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.08% (1.2546 => 1.2682, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -46.54% (0.0810 => 0.0433, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.8286 => 3.6547, std.dev.: 0.0059)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.53% (1.1828 => 1.1647, std.dev.: 0.0047)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.82% (1.1288 => 1.1494, std.dev.: 0.2619)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.65% (0.0248 => 0.0234, std.dev.: 0.0037)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1477 => 0.1473, std.dev.: 0.0103)
  MultiSource/Applications/lemon/lemon: 30.69% (1.1794 => 1.5414, std.dev.: 0.1686)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.59% (0.1309 => 0.1356, std.dev.: 0.0189)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.58% (0.0613 => 0.0684, std.dev.: 0.0173)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.43% (0.0663 => 0.0627, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1660 => 1.1659, std.dev.: 0.0120)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.34% (0.0594 => 0.0592, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.20% (0.0361 => 0.0335, std.dev.: 0.0061)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.51% (1.6803 => 1.6717, std.dev.: 0.0178)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -6.52% (0.0092 => 0.0086, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.98% (29.7937 => 29.2040, std.dev.: 2.0059)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.65% (26.9213 => 26.7452, std.dev.: 0.2192)

Report Time: 0.55s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130309/5823200f/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results