[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Mar 8 10:16:40 PST 2013

http://llvm.org/perf/db_default/v4/nts/9226?compare_to=9223&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9226, Order: 176700, Start Time: 2013-03-08 16:32:40, End Time: 2013-03-08 18:17:12
      To: 9223, Order: 176688, Start Time: 2013-03-08 14:25:21, End Time: 2013-03-08 16:13:29
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 5 (19 on baseline)
Performance Improvements: 16 (6 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1052 (1047 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.34% (1.1551 => 1.1706, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 5.41% (50.0592 => 52.7683, std.dev.: 0.2769)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.46% (4.1300 => 4.2316, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.21% (2.6982 => 2.7308, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.15% (4.0005 => 4.0464, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: -41.63% (0.0257 => 0.0150, std.dev.: 0.0009)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -32.41% (0.0395 => 0.0267, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.83% (0.4668 => 0.3929, std.dev.: 0.0053)
  SingleSource/Benchmarks/Dhrystone/fldry: -14.14% (0.0707 => 0.0607, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (0.2036 => 0.1899, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.30% (0.8095 => 0.7585, std.dev.: 0.0195)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.89% (0.1800 => 0.1694, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9794 => 0.9378, std.dev.: 0.0093)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -4.12% (0.3765 => 0.3610, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.21% (0.3585 => 0.3470, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.49% (1.1335 => 1.1053, std.dev.: 0.0106)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -14.33% (5.2097 => 4.4632, std.dev.: 0.1971)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -8.06% (1.1236 => 1.0330, std.dev.: 0.0342)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -2.30% (1.6113 => 1.5743, std.dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.96% (2.3628 => 2.3165, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc/ffbench: -1.56% (1.4135 => 1.3915, std.dev.: 0.0084)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -2.95% (1.1567 => 1.1226, std.dev.: 0.0875)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.20% (0.0250 => 0.0247, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: 3.62% (0.1465 => 0.1518, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: 2.55% (1.1701 => 1.1999, std.dev.: 0.0194)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.54% (0.1291 => 0.1298, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.44% (0.0603 => 0.0678, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.53% (0.0652 => 0.0675, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1646 => 1.1644, std.dev.: 0.0013)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0594 => 0.0511, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.81% (0.0352 => 0.0321, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (1.6738 => 1.6984, std.dev.: 0.0760)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -0.96% (0.0104 => 0.0103, std.dev.: 0.0047)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.73% (31.6743 => 29.2253, std.dev.: 2.2050)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -91.67% (0.0012 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -84.21% (0.0038 => 0.0006, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.82% (26.8542 => 26.6349, std.dev.: 0.0908)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.00% (0.4125 => 0.4455, std.dev.: 0.1141)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.59% (0.1292 => 0.1403, std.dev.: 0.0019)
  MultiSource/Applications/JM/lencod/lencod: 6.88% (16.7203 => 17.8707, std.dev.: 0.3741)
  MultiSource/Applications/JM/ldecod/ldecod: 5.85% (7.2467 => 7.6703, std.dev.: 0.0559)
  MultiSource/Benchmarks/Bullet/bullet: 5.53% (33.9296 => 35.8062, std.dev.: 0.2728)
  MultiSource/Benchmarks/sim/sim: 4.88% (0.3567 => 0.3741, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: 4.45% (1.2932 => 1.3508, std.dev.: 0.0136)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.94% (0.3302 => 0.3432, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (9.4701 => 9.7869, std.dev.: 0.0874)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.34% (0.3358 => 0.3470, std.dev.: 0.0039)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.8843 => 0.9119, std.dev.: 0.0104)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.93% (0.6853 => 0.6985, std.dev.: 0.0049)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.54% (1.4195 => 1.4414, std.dev.: 0.0080)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.97% (2.9511 => 3.1273, std.dev.: 0.0369)
  SingleSource/Benchmarks/Misc/pi: 5.09% (2.0512 => 2.1557, std.dev.: 0.0270)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.73% (6.2349 => 6.5300, std.dev.: 0.0475)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.83% (57.5400 => 59.7416, std.dev.: 0.0758)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.29% (4.0968 => 4.2316, std.dev.: 0.0039)
  MultiSource/Benchmarks/Bullet/bullet: 2.94% (7.1351 => 7.3446, std.dev.: 0.0803)
  SingleSource/Benchmarks/Shootout/methcall: 2.16% (8.4644 => 8.6476, std.dev.: 0.0615)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -44.94% (0.0810 => 0.0446, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.29% (0.2542 => 0.2077, std.dev.: 0.0028)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -9.52% (0.3990 => 0.3610, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (3.8286 => 3.6604, std.dev.: 0.0639)
  SingleSource/Benchmarks/Misc/ffbench: -2.55% (1.4279 => 1.3915, std.dev.: 0.0084)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.15% (2.3673 => 2.3165, std.dev.: 0.0153)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.55% (1.1288 => 1.1226, std.dev.: 0.0875)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0248 => 0.0247, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1477 => 0.1518, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: 1.74% (1.1794 => 1.1999, std.dev.: 0.0194)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.84% (0.1309 => 0.1298, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.60% (0.0613 => 0.0678, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.81% (0.0663 => 0.0675, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1660 => 1.1644, std.dev.: 0.0013)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0594 => 0.0511, std.dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.08% (0.0361 => 0.0321, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.08% (1.6803 => 1.6984, std.dev.: 0.0760)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 11.96% (0.0092 => 0.0103, std.dev.: 0.0047)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.91% (29.7937 => 29.2253, std.dev.: 2.2050)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -79.31% (0.0029 => 0.0006, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.06% (26.9213 => 26.6349, std.dev.: 0.0908)

Report Time: 0.58s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130308/f8cabf17/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results