[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Fri Mar 8 08:12:58 PST 2013

http://llvm.org/perf/db_default/v4/nts/9223?compare_to=9219&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9223, Order: 176688, Start Time: 2013-03-08 14:25:21, End Time: 2013-03-08 16:13:29
      To: 9219, Order: 176687, Start Time: 2013-03-08 12:09:01, End Time: 2013-03-08 13:49:42
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 24 (24 on baseline)
Performance Improvements: 5 (3 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1044 (1045 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 78.47% (0.0144 => 0.0257, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 47.39% (0.0268 => 0.0395, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 40.34% (0.1294 => 0.1816, std.dev.: 0.0131)
  SingleSource/UnitTests/Vector/constpool: 20.27% (8.3268 => 10.0146, std.dev.: 0.6017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.85% (1.8615 => 2.0262, std.dev.: 0.0069)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.20% (4.0806 => 4.3335, std.dev.: 0.0655)
  SingleSource/Regression/C++/ofstream_ctor: 6.10% (0.2163 => 0.2295, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.6537 => 0.6823, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.13% (0.3873 => 0.4033, std.dev.: 0.0017)
  MultiSource/Benchmarks/Bullet/bullet: 3.72% (34.5048 => 35.7877, std.dev.: 0.1928)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 42.20% (1.5004 => 2.1335, std.dev.: 0.0494)
  SingleSource/Benchmarks/Shootout/ary3: 41.78% (8.3214 => 11.7978, std.dev.: 0.8208)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.60% (1.4880 => 1.8689, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.28% (4.1223 => 4.8348, std.dev.: 0.0368)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.80% (1.0327 => 1.1236, std.dev.: 0.0328)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.51% (9.2790 => 10.0690, std.dev.: 0.2777)
  MultiSource/Benchmarks/Bullet/bullet: 4.84% (7.0678 => 7.4101, std.dev.: 0.0683)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.94% (4.0065 => 4.1645, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.49% (8.7062 => 9.0098, std.dev.: 0.0073)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.09% (39.1805 => 40.3905, std.dev.: 0.2509)
  SingleSource/Benchmarks/Shootout/methcall: 2.47% (8.4822 => 8.6918, std.dev.: 0.0152)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.40% (3.5715 => 3.6214, std.dev.: 0.0096)
  MultiSource/Applications/siod/siod: 1.21% (3.4186 => 3.4598, std.dev.: 0.0091)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.16% (23.5109 => 23.7841, std.dev.: 0.0497)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -6.02% (53.2677 => 50.0592, std.dev.: 1.1860)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.26% (4.2557 => 4.1171, std.dev.: 0.0188)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.74% (0.6781 => 0.6663, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.21% (2.4826 => 2.4526, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.08% (5.8355 => 5.7722, std.dev.: 0.0078)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.54% (1.1280 => 1.1567, std.dev.: 0.1301)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.81% (0.0248 => 0.0250, std.dev.: 0.0030)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 1.17% (0.1448 => 0.1465, std.dev.: 0.0043)
  MultiSource/Applications/lemon/lemon: -1.02% (1.1821 => 1.1701, std.dev.: 0.2445)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.06% (0.1265 => 0.1291, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.87% (0.0669 => 0.0603, std.dev.: 0.0211)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.76% (0.0657 => 0.0652, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1666 => 1.1646, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.57% (0.0028 => 0.0029, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.07% (0.0560 => 0.0594, std.dev.: 0.0125)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.65% (0.0327 => 0.0352, std.dev.: 0.0074)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (1.6692 => 1.6738, std.dev.: 0.0174)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 67.74% (0.0062 => 0.0104, std.dev.: 0.0048)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.32% (29.2404 => 31.6743, std.dev.: 1.3762)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 200.00% (0.0004 => 0.0012, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -25.49% (0.0051 => 0.0038, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/casts: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.39% (26.4868 => 26.8542, std.dev.: 0.1136)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.27% (0.4125 => 0.4301, std.dev.: 0.0731)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 39.58% (0.0283 => 0.0395, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 37.47% (0.1321 => 0.1816, std.dev.: 0.0131)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.38% (1.8524 => 2.0262, std.dev.: 0.0069)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.51% (4.0688 => 4.3335, std.dev.: 0.0655)
  MultiSource/Benchmarks/Bullet/bullet: 5.48% (33.9296 => 35.7877, std.dev.: 0.1928)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.8843 => 0.9317, std.dev.: 0.0098)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 4.69% (46.1715 => 48.3349, std.dev.: 0.7860)
  MultiSource/Benchmarks/sim/sim: 4.49% (0.3567 => 0.3727, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.8288 => 5.0221, std.dev.: 0.0741)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.41% (0.3900 => 0.4033, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.33% (4.5532 => 4.6593, std.dev.: 0.0217)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 42.32% (8.2895 => 11.7978, std.dev.: 0.8208)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 35.88% (1.5701 => 2.1335, std.dev.: 0.0494)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.60% (9.1037 => 10.0690, std.dev.: 0.2777)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.76% (1.0331 => 1.1236, std.dev.: 0.0328)
  SingleSource/Benchmarks/Misc/pi: 7.83% (2.0512 => 2.2118, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.40% (6.2349 => 6.5713, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.54% (8.6184 => 9.0098, std.dev.: 0.0073)
  MultiSource/Benchmarks/Bullet/bullet: 3.85% (7.1351 => 7.4101, std.dev.: 0.0683)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (57.5400 => 59.7135, std.dev.: 0.1489)
  SingleSource/Benchmarks/Shootout/methcall: 2.69% (8.4644 => 8.6918, std.dev.: 0.0152)
  MultiSource/Applications/siod/siod: 1.33% (3.4143 => 3.4598, std.dev.: 0.0091)
  SingleSource/Benchmarks/McGill/queens: 1.28% (1.7928 => 1.8157, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.25% (23.4908 => 23.7841, std.dev.: 0.0497)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -36.42% (0.0810 => 0.0515, std.dev.: 0.0102)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.21% (0.2542 => 0.2079, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.54% (3.8286 => 3.6546, std.dev.: 0.0112)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 2.47% (1.1288 => 1.1567, std.dev.: 0.1301)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.81% (0.0248 => 0.0250, std.dev.: 0.0030)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1477 => 0.1465, std.dev.: 0.0043)
  MultiSource/Applications/lemon/lemon: -0.79% (1.1794 => 1.1701, std.dev.: 0.2445)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.38% (0.1309 => 0.1291, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.63% (0.0613 => 0.0603, std.dev.: 0.0211)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.66% (0.0663 => 0.0652, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1660 => 1.1646, std.dev.: 0.0043)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0594 => 0.0594, std.dev.: 0.0125)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.49% (0.0361 => 0.0352, std.dev.: 0.0074)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (1.6803 => 1.6738, std.dev.: 0.0174)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 13.04% (0.0092 => 0.0104, std.dev.: 0.0048)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.31% (29.7937 => 31.6743, std.dev.: 1.3762)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 31.03% (0.0029 => 0.0038, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (26.9213 => 26.8542, std.dev.: 0.1136)

Report Time: 0.57s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130308/831bec7a/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results