[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Tue Mar 5 18:08:35 PST 2013

http://llvm.org/perf/db_default/v4/nts/9142?compare_to=9139&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9142, Order: 176531, Start Time: 2013-03-06 00:22:34, End Time: 2013-03-06 02:09:02
      To: 9139, Order: 176513, Start Time: 2013-03-05 22:11:21, End Time: 2013-03-06 00:01:10
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

Performance Regressions: 5 (13 on baseline)
Performance Improvements: 32 (8 on baseline)
Existing Failures: 32 (32 on baseline)
Unchanged Tests: 1035 (1051 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 17.71% (1.8770 => 2.2095, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.88% (4.5170 => 4.6018, std.dev.: 0.0181)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.77% (2.3324 => 2.3736, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.8108 => 4.8761, std.dev.: 0.0145)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.07% (3.8744 => 3.9157, std.dev.: 0.0095)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -38.13% (0.1238 => 0.0766, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/mandel: -20.64% (0.0591 => 0.0469, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/gs/gs: -15.72% (5.4035 => 4.5541, std.dev.: 0.2639)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -11.68% (0.0865 => 0.0764, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -11.54% (0.2332 => 0.2063, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -10.77% (0.0975 => 0.0870, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -10.07% (0.1092 => 0.0982, std.dev.: 0.0023)
  MultiSource/Applications/lua/lua: -9.21% (4.6911 => 4.2589, std.dev.: 0.0414)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.89% (2.0386 => 1.8574, std.dev.: 0.0427)
  MultiSource/Benchmarks/McCat/08-main/main: -8.54% (0.3242 => 0.2965, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -8.38% (0.1480 => 0.1356, std.dev.: 0.0041)
  MultiSource/Applications/kimwitu++/kc: -7.48% (20.0933 => 18.5909, std.dev.: 0.4545)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.42% (1.4925 => 1.3817, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -7.23% (1.2658 => 1.1743, std.dev.: 0.0080)
  MultiSource/Benchmarks/Olden/bh/bh: -7.22% (0.3562 => 0.3305, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2364 => 0.2200, std.dev.: 0.0044)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.36% (0.1871 => 0.1752, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/bigfib: -6.17% (0.7393 => 0.6937, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.98% (1.3683 => 1.3002, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.19% (1.1332 => 1.0857, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.65% (1.3744 => 1.3242, std.dev.: 0.0070)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -29.19% (4.4593 => 3.1577, std.dev.: 0.4813)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -28.33% (6.2167 => 4.4553, std.dev.: 0.6300)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -18.57% (1.6385 => 1.3343, std.dev.: 0.0287)
  MultiSource/Benchmarks/Olden/bisort/bisort: -18.11% (0.7922 => 0.6487, std.dev.: 0.0118)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -17.82% (0.1044 => 0.0858, std.dev.: 0.0007)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -14.02% (1.4955 => 1.2858, std.dev.: 0.0179)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -6.73% (4.2699 => 3.9824, std.dev.: 0.0901)
  SingleSource/Benchmarks/Misc/oourafft: -6.61% (4.0243 => 3.7581, std.dev.: 0.0271)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.42% (48.1502 => 46.5055, std.dev.: 0.4218)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.59% (9.2013 => 9.0548, std.dev.: 0.0527)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.03% (1.1778 => 1.1657, std.dev.: 0.0019)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -5.11% (1.1985 => 1.1372, std.dev.: 0.0127)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.90% (0.0232 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1488 => 0.1480, std.dev.: 0.0172)
  MultiSource/Applications/lemon/lemon: -6.63% (1.2767 => 1.1921, std.dev.: 0.3576)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.59% (0.4536 => 0.4237, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.65% (0.1276 => 0.1297, std.dev.: 0.0251)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.60% (0.0606 => 0.0646, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.65% (0.0688 => 0.0656, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1687 => 1.1677, std.dev.: 0.0518)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0593 => 0.0593, std.dev.: 0.0103)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.48% (0.0355 => 0.0332, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (1.6560 => 1.6629, std.dev.: 0.0114)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -38.96% (0.0077 => 0.0047, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.74% (29.5177 => 29.2985, std.dev.: 2.3493)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 155.00% (0.0020 => 0.0051, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0007 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.40% (26.7624 => 26.6553, std.dev.: 0.2448)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 7.91% (0.2112 => 0.2279, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.59% (0.2768 => 0.2895, std.dev.: 0.0030)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.88% (1.1277 => 1.1489, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: 8.80% (1.0339 => 1.1249, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc/pi: 7.72% (2.0512 => 2.2095, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.64% (43.6112 => 46.5055, std.dev.: 0.4218)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (12.6632 => 13.2918, std.dev.: 0.1009)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 4.00% (4.4250 => 4.6018, std.dev.: 0.0181)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.82% (0.5182 => 0.5380, std.dev.: 0.0051)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (57.5400 => 59.6472, std.dev.: 0.0894)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.96% (4.7361 => 4.8761, std.dev.: 0.0145)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.64% (90.5803 => 92.9751, std.dev.: 0.3705)
  SingleSource/Benchmarks/Shootout/methcall: 2.61% (8.4644 => 8.6853, std.dev.: 0.0087)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -46.42% (0.0810 => 0.0434, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/neural/neural: -17.74% (0.2542 => 0.2091, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.68% (0.0985 => 0.0870, std.dev.: 0.0038)
  SingleSource/Benchmarks/McGill/chomp: -7.87% (0.1957 => 0.1803, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -6.94% (0.6971 => 0.6487, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.62% (3.8286 => 3.6517, std.dev.: 0.0069)
  SingleSource/Benchmarks/Dhrystone/dry: -4.26% (0.5278 => 0.5053, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.45% (1.1828 => 1.1657, std.dev.: 0.0019)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.74% (1.1288 => 1.1372, std.dev.: 0.0127)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0000)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1477 => 0.1480, std.dev.: 0.0172)
  MultiSource/Applications/lemon/lemon: 1.08% (1.1794 => 1.1921, std.dev.: 0.3576)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.72% (0.4125 => 0.4237, std.dev.: 0.0200)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.92% (0.1309 => 0.1297, std.dev.: 0.0251)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.38% (0.0613 => 0.0646, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.06% (0.0663 => 0.0656, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1660 => 1.1677, std.dev.: 0.0518)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0594 => 0.0593, std.dev.: 0.0103)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.03% (0.0361 => 0.0332, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (1.6803 => 1.6629, std.dev.: 0.0114)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -48.91% (0.0092 => 0.0047, std.dev.: 0.0023)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.66% (29.7937 => 29.2985, std.dev.: 2.3493)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.99% (26.9213 => 26.6553, std.dev.: 0.2448)

Report Time: 0.53s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130305/c1c0f589/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results