[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jan 14 19:16:45 PST 2013


http://llvm.org/perf/db_default/v4/nts/7604?compare_to=7601&baseline=7471
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8

Comparing:
     Run: 7604, Order: 172491, Start Time: 2013-01-15 01:12:18, End Time: 2013-01-15 03:16:52
      To: 7601, Order: 172483, Start Time: 2013-01-14 22:50:15, End Time: 2013-01-15 00:54:53
Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
Performance Regressions: 6 (6 on baseline)
Performance Improvements: 4 (20 on baseline)
Existing Failures: 41 (40 on baseline)
Unchanged Tests: 1053 (1037 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.71% (0.0493 => 0.0674, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.53% (14.7386 => 15.9963, std.dev.: 0.3380)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.79% (1.0015 => 1.0294, std.dev.: 0.0070)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.33% (0.3302 => 0.3412, std.dev.: 0.0023)
  MultiSource/Applications/aha/aha: 1.69% (3.5084 => 3.5678, std.dev.: 0.0172)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (63.3479 => 64.0535, std.dev.: 0.2379)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/constpool: -7.88% (9.3025 => 8.5693, std.dev.: 0.2227)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.21% (0.5326 => 0.4995, std.dev.: 0.0073)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.96% (2.1654 => 1.5817, std.dev.: 0.1262)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.65% (4.4957 => 4.1068, std.dev.: 0.1315)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: -0.52% (1.1299 => 1.1240, std.dev.: 0.1577)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.85% (0.0433 => 0.0425, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.19% (0.0336 => 0.0332, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.55% (0.0330 => 0.0315, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.63% (0.0429 => 0.0422, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 7.84% (0.0204 => 0.0220, std.dev.: 0.0001)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.87% (0.0231 => 0.0233, std.dev.: 0.0029)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -2.44% (0.1475 => 0.1439, std.dev.: 0.0235)
  MultiSource/Applications/lemon/lemon: -0.88% (1.1838 => 1.1734, std.dev.: 0.2985)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.86% (0.3928 => 0.4276, std.dev.: 0.1397)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.61% (0.1466 => 0.1475, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.23% (0.1059 => 0.0993, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.52% (0.0270 => 0.0320, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.78% (0.0615 => 0.0561, std.dev.: 0.0135)
  MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.87% (1.1543 => 1.1874, std.dev.: 0.0156)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 57.89% (0.0019 => 0.0030, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.38% (0.0026 => 0.0009, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0613 => 0.0608, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.18% (0.0311 => 0.0298, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7475 => 0.7454, std.dev.: 0.0731)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 155.00% (0.0040 => 0.0102, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.29% (12.7818 => 12.7451, std.dev.: 0.0190)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p
  MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (14.9757 => 15.9963, std.dev.: 0.3380)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.04% (1.0088 => 1.0294, std.dev.: 0.0070)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 323975.00% (0.0008 => 2.5926, std.dev.: 0.0310)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.30% (1.1825 => 2.3094, std.dev.: 0.0533)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (63.1520 => 64.0535, std.dev.: 0.2379)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.88% (0.0808 => 0.0510, std.dev.: 0.0077)
  SingleSource/Benchmarks/SmallPT/smallpt: -25.69% (0.1888 => 0.1403, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.40% (1.0986 => 0.9404, std.dev.: 0.0429)
  SingleSource/UnitTests/Vector/constpool: -13.33% (9.8875 => 8.5693, std.dev.: 0.2227)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.26% (0.0889 => 0.0780, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.04% (0.0847 => 0.0745, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.25% (0.7686 => 0.6898, std.dev.: 0.0252)
  MultiSource/Applications/aha/aha: -9.22% (0.1378 => 0.1251, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.65% (6.4235 => 5.9962, std.dev.: 0.1508)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.10% (0.5134 => 0.4821, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/ary: -4.70% (0.2551 => 0.2431, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/lists1: -4.52% (0.3206 => 0.3061, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.55% (0.9124 => 0.8800, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -29.08% (4.4739 => 3.1731, std.dev.: 0.3671)
  SingleSource/Benchmarks/Shootout/hash: -9.85% (4.5259 => 4.0800, std.dev.: 0.0499)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.77% (1.4588 => 1.3309, std.dev.: 0.0178)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -7.80% (4.4540 => 4.1068, std.dev.: 0.1315)
  SingleSource/Benchmarks/Dhrystone/dry: -1.95% (0.5295 => 0.5192, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/matrix: -1.06% (2.9083 => 2.8776, std.dev.: 0.0021)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: -6.70% (1.2047 => 1.1240, std.dev.: 0.1577)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.76% (0.0451 => 0.0425, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.74% (0.0394 => 0.0332, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.17% (0.0445 => 0.0422, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0001)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (0.0255 => 0.0233, std.dev.: 0.0029)
  MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -5.95% (0.1530 => 0.1439, std.dev.: 0.0235)
  MultiSource/Applications/lemon/lemon: -39.18% (1.9293 => 1.1734, std.dev.: 0.2985)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.61% (0.4049 => 0.4276, std.dev.: 0.1397)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.32% (0.1510 => 0.1475, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0978 => 0.0993, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.94% (0.0276 => 0.0320, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0135)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.21% (1.1617 => 1.1874, std.dev.: 0.0156)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.19% (0.0268 => 0.0298, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7437 => 0.7454, std.dev.: 0.0731)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 10.87% (0.0092 => 0.0102, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7781 => 12.7451, std.dev.: 0.0190)

Report Time: 0.96s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130114/bd4921ae/attachment.html>


More information about the llvm-testresults mailing list