[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Wed Mar 13 15:11:24 PDT 2013

http://llvm.org/perf/db_default/v4/nts/9382?compare_to=9379&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9382, Order: 176963, Start Time: 2013-03-13 20:23:52, End Time: 2013-03-13 22:12:01
      To: 9379, Order: 176957, Start Time: 2013-03-13 18:17:23, End Time: 2013-03-13 20:03:29
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 21 (28 on baseline)
Performance Improvements: 2 (7 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1050 (1037 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.69% (2.5070 => 2.7500, std.dev.: 0.0412)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.71% (4.0707 => 4.4254, std.dev.: 0.0276)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.12% (0.5118 => 0.5380, std.dev.: 0.0092)
  MultiSource/Applications/d/make_dparser: 4.90% (3.7564 => 3.9406, std.dev.: 0.0178)
  MultiSource/Applications/oggenc/oggenc: 4.25% (5.5779 => 5.8149, std.dev.: 0.0609)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 53.99% (3.0938 => 4.7640, std.dev.: 0.0608)
  SingleSource/Benchmarks/Shootout/ary3: 46.10% (8.3881 => 12.2546, std.dev.: 0.4544)
  SingleSource/Benchmarks/Shootout-C++/ary: 22.69% (0.0520 => 0.0638, std.dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 22.17% (1.5249 => 1.8630, std.dev.: 0.1215)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.96% (4.1105 => 4.8487, std.dev.: 0.0370)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.25% (0.0906 => 0.1026, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/flops-7: 6.90% (1.9811 => 2.1177, std.dev.: 0.0349)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.56% (4.3170 => 4.5569, std.dev.: 0.0424)
  MultiSource/Applications/siod/siod: 4.37% (3.3977 => 3.5461, std.dev.: 0.0065)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 4.30% (1.1587 => 1.2085, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.20% (21.9919 => 22.9162, std.dev.: 0.2049)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.64% (8.7722 => 9.0042, std.dev.: 0.0518)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.33% (1.2694 => 1.2990, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.21% (1.3176 => 1.3335, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/dt: 1.07% (0.9852 => 0.9957, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/matrix: 1.01% (1.5496 => 1.5653, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ffbench: -2.89% (1.4545 => 1.4124, std.dev.: 0.0108)
  MultiSource/Applications/spiff/spiff: -2.18% (2.8360 => 2.7743, std.dev.: 0.0110)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.19% (1.1519 => 1.1497, std.dev.: 0.0005)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.68% (0.0224 => 0.0230, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: -42.86% (0.0014 => 0.0008, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1435 => 0.1454, std.dev.: 0.0160)
  MultiSource/Applications/lemon/lemon: 3.67% (1.1595 => 1.2021, std.dev.: 0.5508)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.74% (0.1324 => 0.1248, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.29% (0.0653 => 0.0681, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0277 => 0.0274, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.00% (0.0640 => 0.0672, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1672 => 1.1695, std.dev.: 0.0491)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.50% (0.0600 => 0.0603, std.dev.: 0.0027)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.89% (0.0338 => 0.0341, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.06% (1.6560 => 1.6736, std.dev.: 0.0022)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0071)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.00% (29.5533 => 33.6896, std.dev.: 0.6708)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/Altivec/casts: -50.00% (0.0002 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.67% (26.3604 => 26.7996, std.dev.: 0.2853)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.59% (0.4125 => 0.4273, std.dev.: 0.0517)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/d/make_dparser: 11.46% (3.5353 => 3.9406, std.dev.: 0.0178)
  MultiSource/Applications/JM/lencod/lencod: 9.05% (16.7203 => 18.2343, std.dev.: 0.2599)
  MultiSource/Applications/JM/ldecod/ldecod: 8.88% (7.2467 => 7.8904, std.dev.: 0.2388)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.76% (4.0688 => 4.4254, std.dev.: 0.0276)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.5524 => 2.7500, std.dev.: 0.0412)
  MultiSource/Applications/oggenc/oggenc: 6.64% (5.4527 => 5.8149, std.dev.: 0.0609)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.5064 => 0.5380, std.dev.: 0.0092)
  MultiSource/Benchmarks/sim/sim: 5.30% (0.3567 => 0.3756, std.dev.: 0.0069)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 47.83% (8.2895 => 12.2546, std.dev.: 0.4544)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 46.67% (3.2482 => 4.7640, std.dev.: 0.0608)
  SingleSource/Benchmarks/Shootout-C++/ary: 26.34% (0.0505 => 0.0638, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/flops-7: 9.17% (1.9399 => 2.1177, std.dev.: 0.0349)
  SingleSource/Benchmarks/McGill/chomp: 8.33% (1.0339 => 1.1200, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout-C++/lists1: 6.55% (0.6043 => 0.6439, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.05% (4.2970 => 4.5569, std.dev.: 0.0424)
  SingleSource/Benchmarks/Misc/pi: 6.00% (2.0512 => 2.1743, std.dev.: 0.0232)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.48% (8.6184 => 9.0042, std.dev.: 0.0518)
  SingleSource/Regression/C/uint64_to_float: 4.35% (1.6847 => 1.7580, std.dev.: 0.0275)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 4.31% (1.1586 => 1.2085, std.dev.: 0.0053)
  MultiSource/Applications/siod/siod: 3.86% (3.4143 => 3.5461, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.81% (22.0762 => 22.9162, std.dev.: 0.2049)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (57.5400 => 59.6723, std.dev.: 0.0546)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.54% (1.2546 => 1.2990, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/flops: 3.17% (9.3754 => 9.6723, std.dev.: 0.0641)
  SingleSource/Benchmarks/Shootout/methcall: 2.42% (8.4644 => 8.6694, std.dev.: 0.0133)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.73% (4.4250 => 4.5017, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/dt: 1.59% (0.9801 => 0.9957, std.dev.: 0.0036)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.04% (23.4908 => 23.7347, std.dev.: 0.0436)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -44.20% (0.0810 => 0.0452, std.dev.: 0.0075)
  MultiSource/Benchmarks/FreeBench/neural/neural: -17.47% (0.2542 => 0.2098, std.dev.: 0.0082)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/strcat: -12.37% (0.0873 => 0.0765, std.dev.: 0.0023)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.18% (1.9660 => 1.8051, std.dev.: 0.0458)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (3.8286 => 3.6680, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.95% (3.9434 => 3.8667, std.dev.: 0.0286)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.3943 => 3.3368, std.dev.: 0.0063)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.85% (1.1288 => 1.1497, std.dev.: 0.0005)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.26% (0.0248 => 0.0230, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -1.56% (0.1477 => 0.1454, std.dev.: 0.0160)
  MultiSource/Applications/lemon/lemon: 1.92% (1.1794 => 1.2021, std.dev.: 0.5508)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.66% (0.1309 => 0.1248, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.09% (0.0613 => 0.0681, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.36% (0.0663 => 0.0672, std.dev.: 0.0011)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1660 => 1.1695, std.dev.: 0.0491)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.52% (0.0594 => 0.0603, std.dev.: 0.0027)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (0.0361 => 0.0341, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (1.6803 => 1.6736, std.dev.: 0.0022)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0071)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.08% (29.7937 => 33.6896, std.dev.: 0.6708)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.22% (0.0009 => 0.0011, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -58.62% (0.0029 => 0.0012, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (26.9213 => 26.7996, std.dev.: 0.2853)

Report Time: 0.58s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130313/d06eb924/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results