[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 12 22:39:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9358?compare_to=9355&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9358, Order: 176924, Start Time: 2013-03-13 03:57:41, End Time: 2013-03-13 05:39:53
      To: 9355, Order: 176917, Start Time: 2013-03-13 01:57:32, End Time: 2013-03-13 03:39:13
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 6 (28 on baseline)
Performance Improvements: 3 (9 on baseline)
Existing Failures: 31 (31 on baseline)
Unchanged Tests: 1064 (1035 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.97% (1.5845 => 1.6157, std.dev.: 0.0051)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.01% (0.0491 => 0.0604, std.dev.: 0.0023)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.04% (0.5235 => 0.5499, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.39% (1.0341 => 1.0795, std.dev.: 0.0010)
  MultiSource/Applications/lua/lua: 3.85% (28.8152 => 29.9233, std.dev.: 0.0919)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.60% (4.4670 => 4.5384, std.dev.: 0.0028)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.43% (1.3106 => 1.2918, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.21% (1.3096 => 1.2938, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.20% (7.2097 => 7.0511, std.dev.: 0.0452)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.68% (1.1293 => 1.1370, std.dev.: 0.0692)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 22.77% (0.0202 => 0.0248, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1480 => 0.1486, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -2.52% (1.1953 => 1.1652, std.dev.: 0.2183)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.46% (0.1309 => 0.1303, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.48% (0.0606 => 0.0621, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.71% (0.0210 => 0.0264, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.27% (0.0709 => 0.0700, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1596 => 1.1659, std.dev.: 0.0519)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1250.00% (0.0002 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.63% (0.0578 => 0.0557, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.17% (0.0327 => 0.0357, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (1.6709 => 1.6795, std.dev.: 0.0157)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 39.36% (0.0094 => 0.0131, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0007 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.11% (29.2897 => 29.2584, std.dev.: 1.7595)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 125.00% (0.0004 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0051 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.28% (26.4003 => 26.4741, std.dev.: 0.1739)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.24% (0.4125 => 0.4300, std.dev.: 0.0072)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.34% (23.8286 => 26.2925, std.dev.: 0.0890)
  MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1292 => 0.1421, std.dev.: 0.0005)
  MultiSource/Applications/JM/lencod/lencod: 6.45% (16.7203 => 17.7989, std.dev.: 0.1525)
  MultiSource/Benchmarks/sim/sim: 5.33% (0.3567 => 0.3757, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (7.0997 => 7.4720, std.dev.: 0.0262)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.32% (0.7182 => 0.7492, std.dev.: 0.0035)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.42% (0.3358 => 0.3473, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.36% (1.8668 => 1.9296, std.dev.: 0.0087)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (9.4701 => 9.7509, std.dev.: 0.0693)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.84% (4.8288 => 4.9657, std.dev.: 0.0146)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.74% (2.4999 => 2.5685, std.dev.: 0.0173)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (14.7643 => 15.1598, std.dev.: 0.0929)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.67% (0.4798 => 0.4926, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.57% (1.2600 => 1.2924, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.27% (4.8791 => 4.9900, std.dev.: 0.0167)
  MultiSource/Benchmarks/Bullet/bullet: 1.72% (33.9296 => 34.5148, std.dev.: 0.0850)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.67% (4.5532 => 4.6294, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.4308 => 1.4494, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.01% (1.2537 => 1.2664, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 7.88% (2.0512 => 2.2129, std.dev.: 0.0064)
  SingleSource/Benchmarks/McGill/chomp: 7.87% (1.0339 => 1.1153, std.dev.: 0.0234)
  MultiSource/Applications/lua/lua: 6.22% (28.1709 => 29.9233, std.dev.: 0.0919)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.12% (0.5182 => 0.5499, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.49% (1.0331 => 1.0795, std.dev.: 0.0010)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (57.5400 => 59.5725, std.dev.: 0.0991)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.56% (4.4250 => 4.5384, std.dev.: 0.0028)
  SingleSource/Benchmarks/McGill/queens: 1.29% (1.7928 => 1.8160, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/fib2: 1.15% (4.9040 => 4.9606, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -46.42% (0.0810 => 0.0434, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.49% (0.2542 => 0.2072, std.dev.: 0.0026)
  SingleSource/Benchmarks/Linpack/linpack-pc: -5.60% (0.2751 => 0.2597, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.87% (0.5161 => 0.5013, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.32% (2.0100 => 1.7422, std.dev.: 0.0092)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.34% (1.3761 => 1.2613, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/bisort/bisort: -7.96% (0.6971 => 0.6416, std.dev.: 0.0048)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.41% (40.0804 => 39.1125, std.dev.: 0.0560)
  MultiSource/Benchmarks/FreeBench/neural/neural: -1.34% (1.0845 => 1.0700, std.dev.: 0.0056)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.73% (1.1288 => 1.1370, std.dev.: 0.0692)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0248 => 0.0248, std.dev.: 0.0001)
  MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1477 => 0.1486, std.dev.: 0.0014)
  MultiSource/Applications/lemon/lemon: -1.20% (1.1794 => 1.1652, std.dev.: 0.2183)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.46% (0.1309 => 0.1303, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.31% (0.0613 => 0.0621, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (0.0276 => 0.0264, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.58% (0.0663 => 0.0700, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1660 => 1.1659, std.dev.: 0.0519)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.23% (0.0594 => 0.0557, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.11% (0.0361 => 0.0357, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (1.6803 => 1.6795, std.dev.: 0.0157)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 42.39% (0.0092 => 0.0131, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.80% (29.7937 => 29.2584, std.dev.: 1.7595)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.66% (26.9213 => 26.4741, std.dev.: 0.1739)

Report Time: 0.55s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130313/a1988330/attachment.html>


More information about the llvm-testresults mailing list