[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 5 13:49:21 PST 2013


http://llvm.org/perf/db_default/v4/nts/9135?compare_to=9132&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9135, Order: 176507, Start Time: 2013-03-05 20:04:33, End Time: 2013-03-05 21:49:49
      To: 9132, Order: 176491, Start Time: 2013-03-05 17:55:33, End Time: 2013-03-05 19:42:38
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 5 (10 on baseline)
Performance Improvements: 5 (4 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1062 (1058 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/mandel: 9.54% (1.0478 => 1.1478, std.dev.: 0.0251)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (0.3318 => 0.3565, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.17% (2.2740 => 2.3916, std.dev.: 0.0434)
  SingleSource/Benchmarks/McGill/misr: 2.32% (0.4654 => 0.4762, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/methcall: 1.50% (8.5003 => 8.6280, std.dev.: 0.0310)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/office/office: -6.91% (0.2330 => 0.2169, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.67% (0.3139 => 0.2961, std.dev.: 0.0027)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.70% (2.6693 => 2.5971, std.dev.: 0.0249)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.72% (96.2131 => 90.7052, std.dev.: 1.0309)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.63% (3.3775 => 3.3225, std.dev.: 0.0175)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.01% (1.1351 => 1.1350, std.dev.: 0.1439)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 1.59% (0.1448 => 0.1471, std.dev.: 0.0015)
  MultiSource/Applications/lemon/lemon: 0.46% (1.1868 => 1.1922, std.dev.: 0.1705)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.26% (0.4262 => 0.4486, std.dev.: 0.0192)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.07% (0.1362 => 0.1293, std.dev.: 0.0208)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.30% (0.0645 => 0.0585, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.82% (0.0207 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.30% (0.0666 => 0.0644, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1655 => 1.1680, std.dev.: 0.0141)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0591 => 0.0592, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.40% (0.0357 => 0.0352, std.dev.: 0.0003)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (1.6727 => 1.6679, std.dev.: 0.0253)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 3.85% (0.0078 => 0.0081, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.05% (29.2645 => 29.2801, std.dev.: 2.2964)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -98.04% (0.0051 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.17% (26.7069 => 26.3937, std.dev.: 0.1993)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/sim/sim: 5.41% (0.3567 => 0.3760, std.dev.: 0.0034)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.17% (0.9066 => 0.9535, std.dev.: 0.0158)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.89% (2.4999 => 2.5971, std.dev.: 0.0249)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: 8.49% (1.0339 => 1.1217, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.18% (6.2349 => 6.5580, std.dev.: 0.0320)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (57.5400 => 59.6184, std.dev.: 0.0916)
  SingleSource/Benchmarks/Shootout/methcall: 1.93% (8.4644 => 8.6280, std.dev.: 0.0310)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.89% (1.5783 => 1.6081, std.dev.: 0.0112)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (0.6582 => 0.6694, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/fib2: 1.00% (4.9040 => 4.9532, std.dev.: 0.0044)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.06% (0.0810 => 0.0445, std.dev.: 0.0069)
  SingleSource/Benchmarks/McGill/chomp: -8.64% (0.1957 => 0.1788, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.40% (3.8286 => 3.6602, std.dev.: 0.0080)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.87% (3.4205 => 3.3225, std.dev.: 0.0175)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.55% (1.1288 => 1.1350, std.dev.: 0.1439)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1477 => 0.1471, std.dev.: 0.0015)
  MultiSource/Applications/lemon/lemon: 1.09% (1.1794 => 1.1922, std.dev.: 0.1705)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.75% (0.4125 => 0.4486, std.dev.: 0.0192)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.22% (0.1309 => 0.1293, std.dev.: 0.0208)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.0613 => 0.0585, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.87% (0.0663 => 0.0644, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1660 => 1.1680, std.dev.: 0.0141)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.34% (0.0594 => 0.0592, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.49% (0.0361 => 0.0352, std.dev.: 0.0003)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.74% (1.6803 => 1.6679, std.dev.: 0.0253)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -11.96% (0.0092 => 0.0081, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.72% (29.7937 => 29.2801, std.dev.: 2.2964)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 33.33% (0.0006 => 0.0008)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.96% (26.9213 => 26.3937, std.dev.: 0.1993)

Report Time: 0.57s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130305/c1b15c43/attachment.html>


More information about the llvm-testresults mailing list