[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 5 07:33:14 PST 2013


http://llvm.org/perf/db_default/v4/nts/9126?compare_to=9122&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9126, Order: 176480, Start Time: 2013-03-05 13:48:48, End Time: 2013-03-05 15:33:42
      To: 9122, Order: 176477, Start Time: 2013-03-05 11:48:08, End Time: 2013-03-05 13:30:01
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 11 (17 on baseline)
Performance Improvements: 1 (8 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1060 (1047 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 2.45% (0.8949 => 0.9168, std.dev.: 0.0049)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.69% (1.1219 => 1.1409, std.dev.: 0.0052)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 12.39% (1.7332 => 1.9480, std.dev.: 0.0789)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.25% (5.8452 => 6.4446, std.dev.: 0.1364)
  SingleSource/Benchmarks/Shootout-C++/hash: 5.63% (0.6305 => 0.6660, std.dev.: 0.0106)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.66% (0.6004 => 0.6224, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.12% (0.4033 => 0.4159, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/richards_benchmark: 2.97% (1.3074 => 1.3462, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/flops: 2.03% (9.1900 => 9.3767, std.dev.: 0.0378)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.42% (5.8436 => 5.9266, std.dev.: 0.0227)
  SingleSource/Benchmarks/Shootout/hash: 1.31% (4.1830 => 4.2379, std.dev.: 0.0207)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.24% (4.9259 => 4.8647, std.dev.: 0.0145)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.46% (1.1242 => 1.1519, std.dev.: 0.1283)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1459 => 0.1471, std.dev.: 0.0005)
  MultiSource/Applications/lemon/lemon: -2.41% (1.1685 => 1.1403, std.dev.: 0.5118)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.10% (0.4232 => 0.4321, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.85% (0.1254 => 0.1365, std.dev.: 0.0222)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.98% (0.0602 => 0.0638, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.11% (0.0271 => 0.0274, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.70% (0.0687 => 0.0641, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1646 => 1.1646, std.dev.: 0.0204)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.58% (0.0590 => 0.0563, std.dev.: 0.0114)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.97% (0.0319 => 0.0354, std.dev.: 0.0081)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (1.6656 => 1.6616, std.dev.: 0.0216)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -64.62% (0.0130 => 0.0046, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.63% (29.3190 => 29.1329, std.dev.: 2.0479)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5000.00% (0.0001 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0007 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.68% (26.3598 => 26.8020, std.dev.: 0.2730)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 5.99% (0.3358 => 0.3559, std.dev.: 0.0057)
  MultiSource/Applications/JM/lencod/lencod: 5.56% (16.7203 => 17.6495, std.dev.: 0.0236)
  MultiSource/Applications/d/make_dparser: 4.63% (3.5353 => 3.6991, std.dev.: 0.0022)
  MultiSource/Applications/JM/ldecod/ldecod: 4.55% (7.2467 => 7.5765, std.dev.: 0.0283)
  MultiSource/Applications/hbd/hbd: 2.53% (1.5307 => 1.5694, std.dev.: 0.0116)
  MultiSource/Applications/minisat/minisat: 2.34% (0.7554 => 0.7731, std.dev.: 0.0045)
  MultiSource/Applications/SPASS/SPASS: 2.15% (16.3304 => 16.6809, std.dev.: 0.0341)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: 9.18% (1.0339 => 1.1288, std.dev.: 0.0190)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.33% (2.9511 => 3.1968, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/pi: 7.96% (2.0512 => 2.2145, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (6.2349 => 6.5271, std.dev.: 0.0130)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.65% (57.5400 => 59.6408, std.dev.: 0.3050)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.36% (0.5182 => 0.5356, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.00% (0.6043 => 0.6224, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.05% (2.3323 => 2.3802, std.dev.: 0.0164)
  SingleSource/Benchmarks/Shootout/hash: 1.43% (4.1780 => 4.2379, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.35% (5.8478 => 5.9266, std.dev.: 0.0227)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.31% (0.0810 => 0.0443, std.dev.: 0.0049)
  MultiSource/Benchmarks/FreeBench/neural/neural: -19.20% (0.2542 => 0.2054, std.dev.: 0.0106)
  SingleSource/Benchmarks/McGill/chomp: -8.58% (0.1957 => 0.1789, std.dev.: 0.0032)
  SingleSource/Benchmarks/Linpack/linpack-pc: -7.67% (0.2751 => 0.2540, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.36% (2.0100 => 1.7415, std.dev.: 0.0928)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -12.80% (4.7243 => 4.1197, std.dev.: 0.0834)
  SingleSource/Benchmarks/Misc/ffbench: -3.36% (1.4279 => 1.3799, std.dev.: 0.0162)
  MultiSource/Applications/SPASS/SPASS: -3.09% (8.4733 => 8.2115, std.dev.: 0.0425)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.05% (1.1288 => 1.1519, std.dev.: 0.1283)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1477 => 0.1471, std.dev.: 0.0005)
  MultiSource/Applications/lemon/lemon: -3.32% (1.1794 => 1.1403, std.dev.: 0.5118)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.75% (0.4125 => 0.4321, std.dev.: 0.0100)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.28% (0.1309 => 0.1365, std.dev.: 0.0222)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.08% (0.0613 => 0.0638, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.32% (0.0663 => 0.0641, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1660 => 1.1646, std.dev.: 0.0204)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -48.15% (0.0027 => 0.0014, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.22% (0.0594 => 0.0563, std.dev.: 0.0114)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.94% (0.0361 => 0.0354, std.dev.: 0.0081)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.11% (1.6803 => 1.6616, std.dev.: 0.0216)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -50.00% (0.0092 => 0.0046, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.22% (29.7937 => 29.1329, std.dev.: 2.0479)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.44% (26.9213 => 26.8020, std.dev.: 0.2730)

Report Time: 1.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130305/b0368344/attachment.html>


More information about the llvm-testresults mailing list