[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Mar 1 19:19:51 PST 2013

http://llvm.org/perf/db_default/v4/nts/9038?compare_to=9035&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9038, Order: 176396, Start Time: 2013-03-02 01:33:06, End Time: 2013-03-02 03:20:12
      To: 9035, Order: 176387, Start Time: 2013-03-01 23:27:08, End Time: 2013-03-02 01:11:19
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 20 (24 on baseline)
Performance Improvements: 0 (1 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1052 (1047 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.79% (0.0906 => 0.1040, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.65% (0.9179 => 1.0065, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.51% (0.4044 => 0.4388, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3442 => 0.3685, std.dev.: 0.0034)
  MultiSource/Applications/JM/lencod/lencod: 6.23% (16.6943 => 17.7339, std.dev.: 0.2595)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.37% (0.2654 => 0.2770, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.94% (0.3300 => 0.3430, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.57% (0.6804 => 0.6911, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.44% (1.2714 => 1.2897, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 41.45% (3.1537 => 4.4609, std.dev.: 0.2997)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 33.90% (4.5015 => 6.0274, std.dev.: 0.2523)
  MultiSource/Applications/SPASS/SPASS: 25.90% (8.0905 => 10.1856, std.dev.: 0.7144)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.62% (3.3630 => 3.8210, std.dev.: 0.1481)
  SingleSource/Benchmarks/Misc/mandel: 8.30% (1.0537 => 1.1412, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/ffbench: 2.48% (1.4048 => 1.4396, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.14% (5.8435 => 5.9684, std.dev.: 0.0168)
  MultiSource/Applications/siod/siod: 1.80% (3.4268 => 3.4884, std.dev.: 0.0103)
  MultiSource/Benchmarks/llubenchmark/llu: 1.71% (1.9846 => 2.0186, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.45% (1.6194 => 1.6429, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.03% (5.7755 => 5.8351, std.dev.: 0.0198)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -1.76% (1.1448 => 1.1246, std.dev.: 0.1594)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0002)
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1465 => 0.1463, std.dev.: 0.0209)
  MultiSource/Applications/lemon/lemon: -1.33% (1.1912 => 1.1754, std.dev.: 0.3019)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.09% (0.4245 => 0.4249, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.97% (0.1378 => 0.1282, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.19% (0.0636 => 0.0669, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.81% (0.0277 => 0.0272, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.28% (0.0711 => 0.0713, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -8.29% (1.2800 => 1.1739, std.dev.: 0.0477)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0030 => 0.0020, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -46.67% (0.0015 => 0.0008, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.54% (0.0560 => 0.0591, std.dev.: 0.0066)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.60% (0.0333 => 0.0331, std.dev.: 0.0030)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.25% (1.6590 => 1.6798, std.dev.: 0.0077)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0004 => 0.0008, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -29.59% (0.0098 => 0.0069, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.22% (29.0149 => 29.3701, std.dev.: 2.3988)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.14% (26.4415 => 26.7438, std.dev.: 0.2573)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.54% (0.0908 => 0.1040, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.59% (0.9184 => 1.0065, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.08% (0.4060 => 0.4388, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.07% (0.3474 => 0.3685, std.dev.: 0.0034)
  MultiSource/Applications/JM/lencod/lencod: 6.06% (16.7203 => 17.7339, std.dev.: 0.2595)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.14% (0.2197 => 0.2310, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.3302 => 0.3430, std.dev.: 0.0032)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.50% (5.3794 => 5.4603, std.dev.: 0.0266)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.37% (1.2723 => 1.2897, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 42.05% (3.1404 => 4.4609, std.dev.: 0.2997)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.08% (4.4954 => 6.0274, std.dev.: 0.2523)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 14.16% (3.3471 => 3.8210, std.dev.: 0.1481)
  SingleSource/Benchmarks/Misc/pi: 5.49% (2.0512 => 2.1638, std.dev.: 0.0275)
  SingleSource/Benchmarks/Misc/mandel: 4.87% (1.0882 => 1.1412, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.11% (6.2349 => 6.4914, std.dev.: 0.0455)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.61% (8.6184 => 8.9297, std.dev.: 0.0601)
  SingleSource/Benchmarks/Shootout/methcall: 2.76% (8.4644 => 8.6982, std.dev.: 0.0089)
  MultiSource/Applications/siod/siod: 2.17% (3.4143 => 3.4884, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 2.06% (5.8478 => 5.9684, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.92% (1.6120 => 1.6429, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.80% (4.7361 => 4.8213, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.19% (5.7666 => 5.8351, std.dev.: 0.0198)
  MultiSource/Benchmarks/Olden/tsp/tsp: 1.12% (1.4232 => 1.4391, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.03% (3.6942 => 3.7324, std.dev.: 0.0148)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: -7.76% (0.1650 => 0.1522, std.dev.: 0.0033)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.37% (1.1288 => 1.1246, std.dev.: 0.1594)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0002)
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -0.95% (0.1477 => 0.1463, std.dev.: 0.0209)
  MultiSource/Applications/lemon/lemon: -0.34% (1.1794 => 1.1754, std.dev.: 0.3019)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.01% (0.4125 => 0.4249, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.06% (0.1309 => 0.1282, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.0613 => 0.0669, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.54% (0.0663 => 0.0713, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.68% (1.1660 => 1.1739, std.dev.: 0.0477)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.03% (0.0029 => 0.0020, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.51% (0.0594 => 0.0591, std.dev.: 0.0066)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.31% (0.0361 => 0.0331, std.dev.: 0.0030)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (1.6803 => 1.6798, std.dev.: 0.0077)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0092 => 0.0069, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.42% (29.7937 => 29.3701, std.dev.: 2.3988)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.66% (26.9213 => 26.7438, std.dev.: 0.2573)

Report Time: 0.33s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130301/877420b4/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results