[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jan 22 23:15:29 PST 2013


http://llvm.org/perf/db_default/v4/nts/7852?compare_to=7848&baseline=7471
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8

Comparing:
     Run: 7852, Order: 173224, Start Time: 2013-01-23 05:13:56, End Time: 2013-01-23 07:15:45
      To: 7848, Order: 173222, Start Time: 2013-01-23 02:57:34, End Time: 2013-01-23 04:56:44
Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (1 on baseline)
Performance Regressions: 2 (3 on baseline)
Performance Improvements: 0 (28 on baseline)
Existing Failures: 40 (39 on baseline)
Unchanged Tests: 1062 (1032 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Dhrystone/fldry: 3.27% (0.6598 => 0.6814, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.26% (3.4757 => 3.5195, std.dev.: 0.0139)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: -1.17% (1.1228 => 1.1097, std.dev.: 0.1457)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0223 => 0.0224, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0433 => 0.0432, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0335 => 0.0336, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0319 => 0.0318, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/casts: -0.96% (0.0208 => 0.0206, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0007)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: 1.64% (0.1459 => 0.1483, std.dev.: 0.0042)
  MultiSource/Applications/lemon/lemon: 3.04% (1.1609 => 1.1962, std.dev.: 0.3817)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.45% (0.3933 => 0.3990, std.dev.: 0.0793)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1443 => 0.1440, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0933 => 0.0960, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0263 => 0.0229, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0528 => 0.0549, std.dev.: 0.0027)
  MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.64% (1.1471 => 1.1544, std.dev.: 0.0424)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.94% (0.0584 => 0.0607, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.53% (0.0293 => 0.0318, std.dev.: 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.60% (0.7362 => 0.7406, std.dev.: 0.0018)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 144.00% (0.0050 => 0.0122, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7545 => 12.7464, std.dev.: 0.2866)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000)

New Passes - Execution Time
---------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 324012.50% (0.0008 => 2.5929, std.dev.: 0.0136)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.51% (1.1825 => 2.3119, std.dev.: 0.0720)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.32% (0.2562 => 0.2852, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.15% (0.0727 => 0.0486, std.dev.: 0.0007)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0046)
  SingleSource/Benchmarks/SmallPT/smallpt: -27.28% (0.1888 => 0.1373, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.89% (0.1684 => 0.1248, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.38% (0.0676 => 0.0545, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.88% (1.0986 => 0.9461, std.dev.: 0.0262)
  MultiSource/Applications/hexxagon/hexxagon: -10.57% (1.1433 => 1.0225, std.dev.: 0.0238)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.38% (1.3924 => 1.2478, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.46% (6.4235 => 5.8159, std.dev.: 0.1209)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.16% (0.7693 => 0.7296, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.18% (1.3220 => 1.2668, std.dev.: 0.0142)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.7225 => 0.7104, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0035)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.63% (1.4588 => 1.3037, std.dev.: 0.0305)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/nestedloop: -8.95% (0.2200 => 0.2003, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.56% (23.3986 => 21.3947, std.dev.: 0.6036)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.44% (0.3201 => 0.2963, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.83% (1.4446 => 1.3893, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.38% (17.2182 => 16.6360, std.dev.: 0.1048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.71% (0.5826 => 0.5668, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.33% (3.5669 => 3.5195, std.dev.: 0.0139)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3152, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.29% (8.6447 => 8.5332, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1543, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/fibo: -1.07% (4.3512 => 4.3045, std.dev.: 0.0080)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: -7.89% (1.2047 => 1.1097, std.dev.: 0.1457)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0007)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -3.07% (0.1530 => 0.1483, std.dev.: 0.0042)
  MultiSource/Applications/lemon/lemon: -38.00% (1.9293 => 1.1962, std.dev.: 0.3817)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.46% (0.4049 => 0.3990, std.dev.: 0.0793)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.64% (0.1510 => 0.1440, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.0978 => 0.0960, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.03% (0.0276 => 0.0229, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.95% (0.0590 => 0.0549, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1617 => 1.1544, std.dev.: 0.0424)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0018)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7781 => 12.7464, std.dev.: 0.2866)

Report Time: 0.97s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130123/796f4e86/attachment.html>


More information about the llvm-testresults mailing list