[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Mar 7 19:18:34 PST 2013


http://llvm.org/perf/db_default/v4/nts/9204?compare_to=9201&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9204, Order: 176671, Start Time: 2013-03-08 01:32:47, End Time: 2013-03-08 03:19:05
      To: 9201, Order: 176665, Start Time: 2013-03-07 23:25:59, End Time: 2013-03-08 01:13:57
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 2 (10 on baseline)
Performance Improvements: 19 (6 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1052 (1056 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.90% (4.0663 => 4.1842, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout-C++/fibo: 1.20% (4.7715 => 4.8288, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -37.63% (0.1621 => 0.1011, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.54% (0.0969 => 0.0644, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -32.08% (0.1147 => 0.0779, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -28.25% (0.2046 => 0.1468, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.78% (0.7851 => 0.6612, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/08-main/main: -11.42% (0.3354 => 0.2971, std.dev.: 0.0057)
  MultiSource/Applications/siod/siod: -10.05% (2.7461 => 2.4701, std.dev.: 0.0657)
  MultiSource/Applications/hbd/hbd: -9.34% (1.7433 => 1.5804, std.dev.: 0.0630)
  MultiSource/Benchmarks/sim/sim: -7.44% (0.4043 => 0.3742, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.39% (0.2838 => 0.2685, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.05% (0.2890 => 0.2744, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.95% (0.6410 => 0.6093, std.dev.: 0.0086)
  SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2175 => 0.2070, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.77% (0.7562 => 0.7201, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.29% (1.6930 => 1.6203, std.dev.: 0.0064)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.19% (1.4893 => 1.4418, std.dev.: 0.0126)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.24% (0.4871 => 0.4762, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/siod/siod: -1.56% (3.4750 => 3.4209, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.13% (2.5719 => 2.5428, std.dev.: 0.0028)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -1.08% (1.1652 => 1.1526, std.dev.: 0.0606)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0249 => 0.0248, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1476 => 0.1477, std.dev.: 0.0134)
  MultiSource/Applications/lemon/lemon: -15.77% (1.3682 => 1.1525, std.dev.: 0.2121)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.25% (0.1385 => 0.1243, std.dev.: 0.0320)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.88% (0.0625 => 0.0643, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0633 => 0.0633, std.dev.: 0.0145)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.1718 => 1.1665, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -69.57% (0.0023 => 0.0007, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -88.89% (0.0009 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.56% (0.0531 => 0.0528, std.dev.: 0.0029)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.79% (0.0358 => 0.0348, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (1.6673 => 1.6597, std.dev.: 0.3418)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -33.33% (0.0006 => 0.0004, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -44.62% (0.0130 => 0.0072, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.08% (29.2147 => 29.2391, std.dev.: 1.4490)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 30.77% (0.0039 => 0.0051, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.79% (26.3036 => 26.5114, std.dev.: 0.3151)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.29% (0.4125 => 0.4632, std.dev.: 0.0087)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/JM/lencod/lencod: 6.28% (16.7203 => 17.7696, std.dev.: 0.3710)
  MultiSource/Applications/d/make_dparser: 5.72% (3.5353 => 3.7374, std.dev.: 0.0594)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.21% (2.4999 => 2.5802, std.dev.: 0.0278)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.73% (12.6632 => 13.5159, std.dev.: 0.2207)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.79% (6.2349 => 6.5333, std.dev.: 0.1126)
  SingleSource/Regression/C/uint64_to_float: 4.34% (1.6847 => 1.7578, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.17% (8.6184 => 8.9776, std.dev.: 0.0080)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (57.5400 => 59.6462, std.dev.: 0.0739)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (4.1146 => 4.1842, std.dev.: 0.0136)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.07% (1.8732 => 1.8932, std.dev.: 0.0067)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -47.04% (0.0810 => 0.0429, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/neural/neural: -17.94% (0.2542 => 0.2086, std.dev.: 0.0025)
  SingleSource/Benchmarks/Linpack/linpack-pc: -5.34% (0.2751 => 0.2604, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.33% (2.0100 => 1.7420, std.dev.: 0.0903)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (3.8286 => 3.6605, std.dev.: 0.0025)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.13% (1.1828 => 1.1694, std.dev.: 0.0036)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.11% (1.1288 => 1.1526, std.dev.: 0.0606)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: - (0.1477 => 0.1477, std.dev.: 0.0134)
  MultiSource/Applications/lemon/lemon: -2.28% (1.1794 => 1.1525, std.dev.: 0.2121)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.04% (0.1309 => 0.1243, std.dev.: 0.0320)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.89% (0.0613 => 0.0643, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.52% (0.0663 => 0.0633, std.dev.: 0.0145)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1660 => 1.1665, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -75.86% (0.0029 => 0.0007, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.11% (0.0594 => 0.0528, std.dev.: 0.0029)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.60% (0.0361 => 0.0348, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.23% (1.6803 => 1.6597, std.dev.: 0.3418)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -21.74% (0.0092 => 0.0072, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.86% (29.7937 => 29.2391, std.dev.: 1.4490)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.52% (26.9213 => 26.5114, std.dev.: 0.3151)

Report Time: 0.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130307/4aee4059/attachment.html>


More information about the llvm-testresults mailing list