[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Tue Mar 5 22:12:38 PST 2013

http://llvm.org/perf/db_default/v4/nts/9148?compare_to=9144&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9148, Order: 176544, Start Time: 2013-03-06 04:30:43, End Time: 2013-03-06 06:13:06
      To: 9144, Order: 176543, Start Time: 2013-03-06 02:30:13, End Time: 2013-03-06 04:12:11
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 10 (20 on baseline)
Performance Improvements: 4 (13 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1058 (1039 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/Burg/burg: 3.96% (1.3826 => 1.4373, std.dev.: 0.0103)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.92% (1.6697 => 1.7686, std.dev.: 0.0170)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.82% (0.4107 => 0.4346, std.dev.: 0.0064)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.12% (1.8345 => 1.9101, std.dev.: 0.0171)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.49% (21.3876 => 21.9203, std.dev.: 0.1483)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.02% (43.0092 => 43.8768, std.dev.: 0.1118)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.95% (2.6918 => 2.7443, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.83% (5.7881 => 5.8943, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.18% (2.9751 => 3.0101, std.dev.: 0.0100)
  SingleSource/Benchmarks/McGill/queens: 1.05% (1.7955 => 1.8143, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -10.60% (23.2546 => 20.7906, std.dev.: 0.9079)
  SingleSource/Benchmarks/Misc/mandel: -9.77% (1.1578 => 1.0447, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.6626 => 0.6326, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.32% (5.9257 => 5.8473, std.dev.: 0.0149)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.40% (1.1337 => 1.1382, std.dev.: 0.0086)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0052)
  MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1440 => 0.1465, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: 4.68% (1.1543 => 1.2083, std.dev.: 0.0236)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4228 => 0.4221, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1336 => 0.1443, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.40% (0.0667 => 0.0723, std.dev.: 0.0172)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.39% (0.0641 => 0.0714, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.68% (1.1637 => 1.1716, std.dev.: 0.0519)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.0591 => 0.0558, std.dev.: 0.0055)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.73% (0.0357 => 0.0258, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.37% (1.6617 => 1.6678, std.dev.: 0.0040)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -50.38% (0.0131 => 0.0065, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.58% (29.4128 => 29.2410, std.dev.: 0.0398)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 363.64% (0.0011 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.98% (26.4939 => 26.7524, std.dev.: 0.0102)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 9.75% (0.1292 => 0.1418, std.dev.: 0.0042)
  MultiSource/Applications/JM/lencod/lencod: 6.14% (16.7203 => 17.7473, std.dev.: 0.0460)
  MultiSource/Applications/JM/ldecod/ldecod: 5.16% (7.2467 => 7.6206, std.dev.: 0.0138)
  MultiSource/Applications/sqlite3/sqlite3: 4.50% (16.1895 => 16.9177, std.dev.: 0.1720)
  MultiSource/Applications/d/make_dparser: 4.34% (3.5353 => 3.6886, std.dev.: 0.0435)
  MultiSource/Applications/lua/lua: 2.65% (4.1835 => 4.2944, std.dev.: 0.0394)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.41% (10.6134 => 10.8692, std.dev.: 0.0443)
  MultiSource/Applications/SPASS/SPASS: 2.30% (16.3304 => 16.7066, std.dev.: 0.0707)
  MultiSource/Applications/Burg/burg: 2.01% (1.4090 => 1.4373, std.dev.: 0.0103)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.9184 => 0.9363, std.dev.: 0.0009)
  MultiSource/Applications/ClamAV/clamscan: 1.73% (16.1821 => 16.4628, std.dev.: 0.0819)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: 7.41% (1.0339 => 1.1105, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.70% (2.9511 => 3.1489, std.dev.: 0.0329)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.00% (1.6685 => 1.7686, std.dev.: 0.0170)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.72% (0.4111 => 0.4346, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.73% (6.2349 => 6.5298, std.dev.: 0.0093)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (57.5400 => 59.6471, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.32% (1.5783 => 1.6307, std.dev.: 0.0107)
  SingleSource/Benchmarks/McGill/queens: 1.20% (1.7928 => 1.8143, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.17% (2.9754 => 3.0101, std.dev.: 0.0100)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -49.14% (0.0810 => 0.0412, std.dev.: 0.0020)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.33% (0.2542 => 0.2076, std.dev.: 0.0067)
  SingleSource/Benchmarks/McGill/chomp: -8.53% (0.1957 => 0.1790, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -7.49% (0.2751 => 0.2545, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.12% (0.7818 => 0.7574, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.58% (0.6155 => 0.5996, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.49% (2.0100 => 1.7388, std.dev.: 0.0975)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -6.55% (1.5701 => 1.4672, std.dev.: 0.0371)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (3.8286 => 3.6603, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/mandel: -4.00% (1.0882 => 1.0447, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.27% (0.6540 => 0.6326, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.33% (41.3934 => 40.8428, std.dev.: 0.1436)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.06% (1.1828 => 1.1703, std.dev.: 0.0014)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.83% (1.1288 => 1.1382, std.dev.: 0.0086)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0052)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1477 => 0.1465, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: 2.45% (1.1794 => 1.2083, std.dev.: 0.0236)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.33% (0.4125 => 0.4221, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.24% (0.1309 => 0.1443, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.94% (0.0613 => 0.0723, std.dev.: 0.0172)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.69% (0.0663 => 0.0714, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1660 => 1.1716, std.dev.: 0.0519)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0594 => 0.0558, std.dev.: 0.0055)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.53% (0.0361 => 0.0258, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.74% (1.6803 => 1.6678, std.dev.: 0.0040)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -29.35% (0.0092 => 0.0065, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.86% (29.7937 => 29.2410, std.dev.: 0.0398)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.63% (26.9213 => 26.7524, std.dev.: 0.0102)

Report Time: 0.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130306/9665c6fc/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results