[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Apr 7 06:54:20 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10318?compare_to=10314&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10318, Order: 178974, Start Time: 2013-04-07 12:15:17, End Time: 2013-04-07 13:55:24
      To: 10314, Order: 178973, Start Time: 2013-04-07 07:27:57, End Time: 2013-04-07 09:07:36
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (12 on baseline)
Performance Regressions: 10 (113 on baseline)
Performance Improvements: 5 (92 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (20 on baseline)
Unchanged Tests: 1073 (865 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (1.2625 => 1.2874, std.dev.: 0.0087)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.75% (1.3176 => 1.3407, std.dev.: 0.0056)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.33% (0.9320 => 0.9444, std.dev.: 0.0048)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.26% (1.4921 => 1.5109, std.dev.: 0.0054)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.25% (4.9529 => 5.0146, std.dev.: 0.0138)
  MultiSource/Applications/hexxagon/hexxagon: 1.22% (1.0368 => 1.0494, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 12.47% (1.7227 => 1.9376, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc/salsa20: 7.99% (9.7498 => 10.5289, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops: 7.29% (8.6800 => 9.3129, std.dev.: 0.0009)
  MultiSource/Applications/spiff/spiff: 4.85% (2.9132 => 3.0546, std.dev.: 0.0018)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -7.14% (0.1428 => 0.1326, std.dev.: 0.0037)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -5.90% (0.3799 => 0.3575, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.04% (0.7229 => 0.7009, std.dev.: 0.0079)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Regression/C/uint64_to_float: -7.29% (1.8036 => 1.6721, std.dev.: 0.0147)
  MultiSource/Applications/SPASS/SPASS: -2.08% (8.2341 => 8.0627, std.dev.: 0.0381)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -1.07% (1.1414 => 1.1292, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 17.71% (0.0192 => 0.0226, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -1.34% (0.1490 => 0.1470, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.31% (0.1093 => 0.1162, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.69% (0.0541 => 0.0588, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.59% (0.0258 => 0.0241, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.67% (0.0597 => 0.0601, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.36% (0.0274 => 0.0273, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -25.00% (0.0008 => 0.0006, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 345.83% (0.0024 => 0.0107, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (24.3423 => 24.3090, std.dev.: 0.1007)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014)
  MultiSource/Applications/lemon/lemon: -28.56% (1.1794 => 0.8426, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.80% (0.4125 => 0.4323, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.01% (0.0663 => 0.0590, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.54% (1.1660 => 1.1840, std.dev.: 0.0489)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.03% (1.6803 => 1.5454, std.dev.: 0.0112)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.81% (29.7937 => 28.9568, std.dev.: 0.3606)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 79.31% (0.0029 => 0.0052)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: 33.33% (0.0006 => 0.0008)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.70% (1.0687 => 1.3647, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.31% (1.0418 => 1.3263, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.04% (1.0958 => 1.3921, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.98% (1.0617 => 1.3481, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.61% (1.1023 => 1.3956, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.21% (1.1209 => 1.4147, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.16% (1.1428 => 1.4417, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.04% (1.1626 => 1.4653, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.03% (1.0507 => 1.3242, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.48% (1.0864 => 1.3632, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.41% (1.0528 => 1.3203, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 25.32% (1.1744 => 1.4717, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 25.21% (1.2270 => 1.5363, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.79% (1.0890 => 1.3590, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 24.77% (1.0951 => 1.3664, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.41% (1.0526 => 1.3095, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.53% (1.1699 => 1.4452, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 22.46% (1.1727 => 1.4361, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.52% (1.2419 => 1.4967, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.22% (1.2537 => 1.5072, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 20.10% (1.2835 => 1.5415, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 20.09% (1.3046 => 1.5667, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 20.00% (1.2566 => 1.5079, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 19.90% (1.2723 => 1.5255, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.74% (1.3313 => 1.5941, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.68% (1.2853 => 1.5382, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.67% (1.2925 => 1.5467, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.65% (1.2929 => 1.5470, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 19.24% (1.3491 => 1.6086, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.11% (1.3692 => 1.6309, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.99% (1.3451 => 1.6006, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 18.90% (1.3638 => 1.6215, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.53% (1.4622 => 1.7331, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.44% (1.2704 => 1.5047, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 17.96% (1.3357 => 1.5756, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.32% (1.4005 => 1.6431, std.dev.: 0.0132)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.92% (23.8286 => 26.6687, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.35% (0.7182 => 0.7710, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.45% (7.0997 => 7.5579, std.dev.: 0.0289)
  MultiSource/Applications/d/make_dparser: 5.97% (3.5353 => 3.7465, std.dev.: 0.0030)
  MultiSource/Applications/JM/ldecod/ldecod: 5.13% (7.2467 => 7.6181, std.dev.: 0.0381)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 5.02% (0.2112 => 0.2218, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.69% (0.4051 => 0.4241, std.dev.: 0.0016)
  MultiSource/Benchmarks/sim/sim: 4.68% (0.3567 => 0.3734, std.dev.: 0.0006)
  MultiSource/Applications/JM/lencod/lencod: 4.57% (16.7203 => 17.4849, std.dev.: 0.0295)
  MultiSource/Applications/sqlite3/sqlite3: 4.30% (16.1895 => 16.8857, std.dev.: 0.0113)
  MultiSource/Applications/SPASS/SPASS: 4.06% (16.3304 => 16.9937, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.9184 => 0.9525, std.dev.: 0.0019)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.67% (2.4999 => 2.5917, std.dev.: 0.0104)
  MultiSource/Applications/kimwitu++/kc: 3.38% (18.4474 => 19.0710, std.dev.: 0.0585)
  MultiSource/Benchmarks/Bullet/bullet: 3.36% (33.9296 => 35.0713, std.dev.: 0.0366)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.31% (1.8668 => 1.9286, std.dev.: 0.0115)
  MultiSource/Applications/ClamAV/clamscan: 3.24% (16.1821 => 16.7062, std.dev.: 0.0770)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.4195 => 1.4647, std.dev.: 0.0054)
  MultiSource/Applications/lua/lua: 3.14% (4.1835 => 4.3147, std.dev.: 0.0173)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (4.4482 => 4.5774, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.83% (4.8288 => 4.9653, std.dev.: 0.0236)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.78% (4.8791 => 5.0146, std.dev.: 0.0138)
  MultiSource/Applications/hbd/hbd: 2.70% (1.5307 => 1.5720, std.dev.: 0.0121)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.63% (0.4798 => 0.4924, std.dev.: 0.0006)
  MultiSource/Applications/siod/siod: 2.57% (2.4196 => 2.4817, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.53% (14.7643 => 15.1382, std.dev.: 0.0070)
  MultiSource/Applications/minisat/minisat: 2.52% (0.7554 => 0.7744, std.dev.: 0.0027)
  MultiSource/Applications/treecc/treecc: 2.46% (2.2217 => 2.2763, std.dev.: 0.0072)
  MultiSource/Applications/hexxagon/hexxagon: 2.32% (1.0256 => 1.0494, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (9.4701 => 9.6885, std.dev.: 0.0328)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.2600 => 1.2874, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.11% (0.5064 => 0.5171, std.dev.: 0.0010)
  MultiSource/Applications/Burg/burg: 2.00% (1.4090 => 1.4372, std.dev.: 0.0085)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7996 => 0.8137, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.69% (4.5532 => 4.6303, std.dev.: 0.0119)
  MultiSource/Applications/oggenc/oggenc: 1.48% (5.4527 => 5.5335, std.dev.: 0.0301)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (1.3240 => 1.3407, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 53.82% (0.3010 => 0.4630, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/fp-convert: 39.72% (5.6800 => 7.9360, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout/sieve: 28.02% (6.8087 => 8.7168, std.dev.: 0.0032)
  MultiSource/Benchmarks/MallocBench/gs/gs: 24.67% (0.0608 => 0.0758, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/hash: 23.40% (4.1780 => 5.1555, std.dev.: 0.0301)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.29% (12.6632 => 14.9793, std.dev.: 0.7635)
  SingleSource/Benchmarks/McGill/chomp: 16.63% (1.0339 => 1.2058, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.18% (3.7569 => 4.3273, std.dev.: 0.1625)
  SingleSource/Benchmarks/Misc/salsa20: 15.05% (9.1513 => 10.5289, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.07% (8.7510 => 9.9819, std.dev.: 0.0022)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.79% (6.9897 => 7.9536, std.dev.: 0.0435)
  SingleSource/Benchmarks/Misc/pi: 13.77% (2.0512 => 2.3336, std.dev.: 0.0205)
  MultiSource/Benchmarks/Olden/tsp/tsp: 11.94% (1.4232 => 1.5932, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/hash: 11.53% (0.6540 => 0.7294, std.dev.: 0.0005)
  MultiSource/Applications/spiff/spiff: 10.08% (2.7749 => 3.0546, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.67% (0.1655 => 0.1815, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.62% (4.8642 => 5.2349, std.dev.: 0.0774)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.90% (2.9511 => 3.1548, std.dev.: 0.0303)
  MultiSource/Benchmarks/Olden/em3d/em3d: 6.85% (4.5899 => 4.9043, std.dev.: 0.0396)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (3.3943 => 3.5963, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.29% (1.3414 => 1.4124, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.86% (5.1346 => 5.3843, std.dev.: 0.0329)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.51% (0.6480 => 0.6772, std.dev.: 0.0101)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.20% (1.0331 => 1.0765, std.dev.: 0.0103)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.18% (23.4908 => 24.4724, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.06% (5.0818 => 5.2880, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.84% (5.1006 => 5.2964, std.dev.: 0.0389)
  SingleSource/Benchmarks/Shootout/lists: 3.76% (7.2055 => 7.4767, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/whetstone: 3.39% (3.4590 => 3.5762, std.dev.: 0.0114)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.15% (59.5643 => 61.4384, std.dev.: 0.3864)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.07% (9.6958 => 9.9939, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.98% (6.1397 => 6.3228, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.82% (3.7953 => 3.9025, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.45% (2.7893 => 2.8575, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/power/power: 2.26% (1.2248 => 1.2525, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.14% (1.4499 => 1.4809, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/bh/bh: 2.11% (2.3749 => 2.4251, std.dev.: 0.0023)
  MultiSource/Applications/minisat/minisat: 1.39% (6.1945 => 6.2809, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/oourafft: 1.11% (3.7589 => 3.8006, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/fib2: 1.08% (4.9040 => 4.9569, std.dev.: 0.0044)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.98% (0.0810 => 0.0389, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/neural/neural: -21.36% (0.2542 => 0.1999, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.37% (0.1176 => 0.0960, std.dev.: 0.0015)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.99% (0.0817 => 0.0670, std.dev.: 0.0004)
  SingleSource/Benchmarks/McGill/chomp: -11.55% (0.1957 => 0.1731, std.dev.: 0.0017)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -10.40% (0.3990 => 0.3575, std.dev.: 0.0082)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.1151 => 0.1034, std.dev.: 0.0019)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.29% (0.2751 => 0.2523, std.dev.: 0.0013)
  MultiSource/Applications/lemon/lemon: -5.97% (1.2932 => 1.2160, std.dev.: 0.0014)
  MultiSource/Applications/sgefa/sgefa: -4.00% (0.4027 => 0.3866, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.40% (6.9229 => 6.6872, std.dev.: 0.0179)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.40% (0.3793 => 0.3664, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.89% (1.6187 => 1.5720, std.dev.: 0.0163)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.39% (0.8631 => 0.8425, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/football/football: -2.14% (0.9944 => 0.9731, std.dev.: 0.0047)
  MultiSource/Benchmarks/nbench/nbench: -1.87% (1.2881 => 1.2640, std.dev.: 0.0039)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.64% (46.1715 => 45.4165, std.dev.: 0.1788)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.14% (1.5284 => 1.5109, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.18% (0.3861 => 0.1383, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.97% (3.4380 => 1.4449, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.06% (3.8940 => 1.7112, std.dev.: 0.0139)
  MultiSource/Benchmarks/FreeBench/neural/neural: -50.05% (1.0845 => 0.5417, std.dev.: 0.0987)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.85% (0.5213 => 0.2875, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -34.36% (6.8267 => 4.4809, std.dev.: 0.0348)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -32.18% (0.1871 => 0.1269, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/ary3: -29.72% (8.2895 => 5.8260, std.dev.: 0.1089)
  MultiSource/Applications/viterbi/viterbi: -25.27% (3.4506 => 2.5787, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.57% (0.2316 => 0.1747, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/18-imp/imp: -23.82% (0.1465 => 0.1116, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -22.47% (0.1789 => 0.1387, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.11% (5.8948 => 4.5913, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -19.77% (3.5506 => 2.8488, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -19.71% (0.0756 => 0.0607, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.61% (0.3279 => 0.2636, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/perlin: -19.47% (4.5691 => 3.6795, std.dev.: 0.0041)
  SingleSource/Benchmarks/McGill/misr: -16.83% (0.4729 => 0.3933, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -16.79% (9.0122 => 7.4987, std.dev.: 0.2030)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.79% (6.0446 => 5.0298, std.dev.: 0.1020)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.47% (1.9660 => 1.6422, std.dev.: 0.0424)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.42% (0.0950 => 0.0794, std.dev.: 0.0007)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.48% (0.1040 => 0.0879, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -15.04% (6.7010 => 5.6934, std.dev.: 0.0009)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.32% (57.5400 => 49.8771, std.dev.: 0.0728)
  MultiSource/Applications/oggenc/oggenc: -12.87% (0.1826 => 0.1591, std.dev.: 0.0048)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.51% (0.0855 => 0.0748, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/mandel: -12.43% (1.0882 => 0.9529, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -11.35% (6.0602 => 5.3724, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -11.15% (5.6245 => 4.9974, std.dev.: 0.1759)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.38% (5.0054 => 4.4859, std.dev.: 0.0002)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -10.11% (1.3761 => 1.2370, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.22% (0.3091 => 0.2806, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.14% (5.0816 => 4.6171, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.81% (0.4111 => 0.3749, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -8.37% (4.2970 => 3.9375, std.dev.: 0.0142)
  SingleSource/Benchmarks/McGill/queens: -7.95% (1.7928 => 1.6503, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.74% (3.3978 => 3.1349, std.dev.: 0.0018)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.70% (89.3093 => 82.4286, std.dev.: 0.1013)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.64% (9.5512 => 8.8212, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout/strcat: -7.57% (0.1572 => 0.1453, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.49% (0.4368 => 0.4041, std.dev.: 0.0008)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.41% (13.2022 => 12.2245, std.dev.: 0.0138)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.25% (0.4924 => 0.4567, std.dev.: 0.0038)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (0.5182 => 0.4842, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/distray/distray: -6.09% (0.2431 => 0.2283, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -6.05% (0.2167 => 0.2036, std.dev.: 0.0038)
  SingleSource/Benchmarks/Dhrystone/dry: -5.91% (0.5278 => 0.4966, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.68% (3.9434 => 3.7195, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.18% (0.4520 => 0.4286, std.dev.: 0.0057)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.88% (2.4484 => 2.3288, std.dev.: 0.0318)
  MultiSource/Applications/SPASS/SPASS: -4.85% (8.4733 => 8.0627, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.82% (3.0513 => 2.9043, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (5.7666 => 5.4992, std.dev.: 0.0655)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.62% (9.0356 => 8.6183, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.44% (3.3618 => 3.2125, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc/fbench: -4.40% (4.9661 => 4.7476, std.dev.: 0.0178)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.39% (1.5779 => 1.5086, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.62% (0.3093 => 0.2981, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.44% (0.8122 => 0.7843, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.40% (3.3922 => 3.2770, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.22% (6.2349 => 6.0341, std.dev.: 0.0241)
  MultiSource/Applications/siod/siod: -3.10% (3.4143 => 3.3086, std.dev.: 0.0184)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.8286 => 3.7193, std.dev.: 0.0001)
  MultiSource/Benchmarks/Bullet/bullet: -2.74% (7.1351 => 6.9395, std.dev.: 0.0427)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.72% (2.5722 => 2.5022, std.dev.: 0.0081)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.31% (35.0623 => 34.2532, std.dev.: 0.1735)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.29% (4.3713 => 4.2711, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.28% (2.3673 => 2.3134, std.dev.: 0.0189)
  SingleSource/Benchmarks/Linpack/linpack-pc: -2.07% (52.8418 => 51.7464, std.dev.: 0.2711)
  SingleSource/Benchmarks/Misc/flops-3: -1.45% (2.0809 => 2.0507, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.34% (16.6302 => 16.4076, std.dev.: 0.0516)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.21% (1.1828 => 1.1685, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.16% (3.6942 => 3.6513, std.dev.: 0.0004)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.04% (1.1288 => 1.1292, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.87% (0.0248 => 0.0226, std.dev.: 0.0001)
  MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1477 => 0.1470, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.23% (0.1309 => 0.1162, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.0613 => 0.0588, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.68% (0.0276 => 0.0241, std.dev.: 0.0009)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.18% (0.0594 => 0.0601, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.38% (0.0361 => 0.0273, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 16.30% (0.0092 => 0.0107, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.70% (26.9213 => 24.3090, std.dev.: 0.1007)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130407/9597b0aa/attachment.html>


More information about the llvm-testresults mailing list