[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Apr 5 06:55:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10248?compare_to=10244&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10248, Order: 178862, Start Time: 2013-04-05 12:15:42, End Time: 2013-04-05 13:56:31
      To: 10244, Order: 178860, Start Time: 2013-04-05 10:13:52, End Time: 2013-04-05 11:56:44
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 11 (121 on baseline)
Performance Improvements: 17 (78 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1061 (871 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.57% (0.6608 => 0.6712, std.dev.: 0.0023)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.52% (1.4993 => 1.5221, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.48% (1.0683 => 1.0841, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.25% (1.2878 => 1.3039, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.40% (4.1135 => 4.8293, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.37% (6.1170 => 6.9959, std.dev.: 0.1447)
  MultiSource/Benchmarks/nbench/nbench: 13.98% (20.1721 => 22.9916, std.dev.: 0.3793)
  SingleSource/Benchmarks/Misc/pi: 2.90% (2.3340 => 2.4018, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.54% (4.7975 => 4.9194, std.dev.: 0.0362)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.20% (2.6746 => 2.7334, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout/methcall: 1.09% (8.5997 => 8.6938, std.dev.: 0.0058)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.68% (1.5828 => 1.5404, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.48% (1.4373 => 1.4016, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.28% (1.5844 => 1.5483, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.97% (1.6059 => 1.5742, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.69% (1.3335 => 1.3109, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.55% (1.4701 => 1.4473, std.dev.: 0.0067)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.51% (2.6145 => 2.5749, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.45% (1.4539 => 1.4328, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.43% (1.5592 => 1.5369, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.25% (1.5322 => 1.5131, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.14% (1.4770 => 1.4602, std.dev.: 0.0038)
  MultiSource/Applications/Burg/burg: -1.06% (1.4443 => 1.4290, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.03% (15.2695 => 15.1123, std.dev.: 0.0588)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/mandel: -11.67% (1.0922 => 0.9647, std.dev.: 0.0384)
  MultiSource/Applications/minisat/minisat: -5.20% (6.6325 => 6.2877, std.dev.: 0.0485)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.00% (92.7600 => 89.0501, std.dev.: 0.8766)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.07% (2.9711 => 2.9392, std.dev.: 0.0119)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -0.24% (1.1329 => 1.1302, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0227 => 0.0227, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1452 => 0.1443, std.dev.: 0.0022)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.37% (0.1098 => 0.1113, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.38% (0.0580 => 0.0588, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.76% (0.0263 => 0.0261, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.00% (0.0008 => 0.0006, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.56% (0.0582 => 0.0538, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (0.0274 => 0.0268, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -17.56% (0.0131 => 0.0108, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.80% (24.7211 => 24.5245, std.dev.: 0.2193)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
  MultiSource/Applications/lemon/lemon: -28.07% (1.1794 => 0.8483, std.dev.: 0.0704)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.60% (0.4125 => 0.4356, std.dev.: 0.0116)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0663 => 0.0607, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.58% (1.1660 => 1.1844, std.dev.: 0.0479)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -8.01% (1.6803 => 1.5457, std.dev.: 0.0063)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.58% (29.7937 => 28.7270, std.dev.: 2.2375)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.16% (1.0418 => 1.3039, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 23.91% (1.0617 => 1.3155, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.76% (1.1023 => 1.3642, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.47% (1.1428 => 1.3996, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.47% (1.0958 => 1.3420, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.34% (1.0687 => 1.3075, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.22% (1.1626 => 1.4209, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 22.08% (1.0507 => 1.2827, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 22.06% (1.0528 => 1.2850, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.79% (1.1209 => 1.3651, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 21.46% (1.0951 => 1.3301, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.02% (1.0526 => 1.2739, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.88% (1.2270 => 1.4832, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.72% (1.0890 => 1.3146, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 20.66% (1.0864 => 1.3109, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 19.89% (1.1727 => 1.4059, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 19.35% (1.1744 => 1.4016, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.49% (1.1699 => 1.3862, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.46% (1.2835 => 1.4948, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 16.20% (1.2566 => 1.4602, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 15.44% (1.2537 => 1.4473, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.29% (1.2419 => 1.4318, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 15.03% (1.3046 => 1.5007, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.01% (1.2723 => 1.4633, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 14.99% (1.2929 => 1.4867, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 14.97% (1.2925 => 1.4860, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.77% (1.2853 => 1.4751, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.52% (1.3313 => 1.5246, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.26% (1.3451 => 1.5369, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 14.18% (1.3491 => 1.5404, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.02% (1.3692 => 1.5611, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 13.74% (1.2704 => 1.4449, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.53% (1.3638 => 1.5483, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 13.29% (1.4622 => 1.6565, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.28% (1.3357 => 1.5131, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.40% (1.4005 => 1.5742, std.dev.: 0.0094)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.82% (23.8286 => 26.4080, std.dev.: 0.1265)
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.75% (0.1292 => 0.1405, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.55% (0.7182 => 0.7724, std.dev.: 0.0084)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (7.0997 => 7.5064, std.dev.: 0.0566)
  MultiSource/Applications/d/make_dparser: 5.59% (3.5353 => 3.7328, std.dev.: 0.0052)
  MultiSource/Benchmarks/sim/sim: 4.99% (0.3567 => 0.3745, std.dev.: 0.0023)
  MultiSource/Applications/JM/lencod/lencod: 4.99% (16.7203 => 17.5546, std.dev.: 0.0563)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.3358 => 0.3520, std.dev.: 0.0012)
  MultiSource/Applications/JM/ldecod/ldecod: 4.77% (7.2467 => 7.5923, std.dev.: 0.0448)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.55% (0.8843 => 0.9245, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.48% (0.2768 => 0.2892, std.dev.: 0.0031)
  MultiSource/Applications/sqlite3/sqlite3: 4.35% (16.1895 => 16.8939, std.dev.: 0.1667)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.06% (1.4195 => 1.4771, std.dev.: 0.0024)
  MultiSource/Applications/hbd/hbd: 4.01% (1.5307 => 1.5921, std.dev.: 0.0093)
  MultiSource/Applications/lua/lua: 3.76% (4.1835 => 4.3408, std.dev.: 0.0094)
  MultiSource/Applications/ClamAV/clamscan: 3.53% (16.1821 => 16.7532, std.dev.: 0.0695)
  MultiSource/Benchmarks/Bullet/bullet: 3.44% (33.9296 => 35.0951, std.dev.: 0.0930)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.39% (4.8288 => 4.9926, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.9184 => 0.9485, std.dev.: 0.0029)
  MultiSource/Applications/hexxagon/hexxagon: 3.18% (1.0256 => 1.0582, std.dev.: 0.0036)
  MultiSource/Applications/SPASS/SPASS: 3.15% (16.3304 => 16.8442, std.dev.: 0.0445)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.4051 => 0.4176, std.dev.: 0.0006)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.00% (2.4999 => 2.5749, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.90% (9.4701 => 9.7449, std.dev.: 0.0136)
  SingleSource/UnitTests/Vector/constpool: 2.73% (8.5132 => 8.7455, std.dev.: 0.0756)
  MultiSource/Applications/kimwitu++/kc: 2.55% (18.4474 => 18.9173, std.dev.: 0.0405)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4798 => 0.4916, std.dev.: 0.0033)
  MultiSource/Applications/minisat/minisat: 2.44% (0.7554 => 0.7738, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (4.5532 => 4.6632, std.dev.: 0.0220)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (14.7643 => 15.1123, std.dev.: 0.0588)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.26% (0.6853 => 0.7008, std.dev.: 0.0022)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.24% (4.8791 => 4.9884, std.dev.: 0.0392)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.2600 => 1.2881, std.dev.: 0.0064)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5064 => 0.5176, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.98% (0.6582 => 0.6712, std.dev.: 0.0023)
  MultiSource/Applications/treecc/treecc: 1.94% (2.2217 => 2.2649, std.dev.: 0.0055)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.88% (1.1277 => 1.1489, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.6481 => 0.6598, std.dev.: 0.0039)
  MultiSource/Applications/siod/siod: 1.69% (2.4196 => 2.4605, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.62% (1.3240 => 1.3455, std.dev.: 0.0078)
  MultiSource/Applications/oggenc/oggenc: 1.55% (5.4527 => 5.5373, std.dev.: 0.0269)
  MultiSource/Applications/Burg/burg: 1.42% (1.4090 => 1.4290, std.dev.: 0.0042)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (10.6134 => 10.7536, std.dev.: 0.0295)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.07% (0.9379 => 0.9479, std.dev.: 0.0018)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 53.89% (0.3010 => 0.4632, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/fp-convert: 39.70% (5.6800 => 7.9349, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.76% (8.7510 => 11.6180, std.dev.: 0.0339)
  MultiSource/Benchmarks/MallocBench/gs/gs: 29.11% (0.0608 => 0.0785, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout/sieve: 28.13% (6.8087 => 8.7238, std.dev.: 0.0022)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.60% (12.6632 => 15.7788, std.dev.: 0.8637)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 22.33% (6.4626 => 7.9058, std.dev.: 0.0723)
  SingleSource/Benchmarks/Misc/pi: 17.09% (2.0512 => 2.4018, std.dev.: 0.0062)
  SingleSource/Benchmarks/McGill/chomp: 16.25% (1.0339 => 1.2019, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc/salsa20: 15.12% (9.1513 => 10.5352, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.94% (4.0968 => 4.7090, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.78% (4.4289 => 5.0391, std.dev.: 0.0758)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.06% (4.1182 => 4.6147)
  MultiSource/Benchmarks/nbench/nbench: 11.23% (20.6711 => 22.9916, std.dev.: 0.3793)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.40% (4.7906 => 5.1932, std.dev.: 0.0011)
  MultiSource/Applications/sgefa/sgefa: 8.38% (1.2184 => 1.3205, std.dev.: 0.0029)
  MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (4.5899 => 4.9194, std.dev.: 0.0362)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.72% (2.9511 => 3.1493, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc/richards_benchmark: 5.86% (1.3414 => 1.4200, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.50% (5.1006 => 5.3809, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.45% (4.7982 => 5.0595, std.dev.: 0.0036)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.97% (0.6480 => 0.6802, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.60% (1.0331 => 1.0806, std.dev.: 0.0108)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.19% (23.4908 => 24.4756, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.32% (4.8642 => 5.0256, std.dev.: 0.0125)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.12% (1.8732 => 1.9317, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/lists: 2.91% (7.2055 => 7.4150, std.dev.: 0.0364)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.85% (3.7953 => 3.9033, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.79% (59.5643 => 61.2270, std.dev.: 0.1583)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.78% (3.3978 => 3.4922, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/methcall: 2.71% (8.4644 => 8.6938, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.27% (5.0054 => 5.1191, std.dev.: 0.0320)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.14% (2.7893 => 2.8490, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/bh/bh: 2.10% (2.3749 => 2.4248, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.96% (5.1346 => 5.2352, std.dev.: 0.0005)
  MultiSource/Applications/aha/aha: 1.88% (3.4994 => 3.5653, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.77% (2.0956 => 2.1326, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (4.4954 => 4.5685, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.55% (1.4499 => 1.4724, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/oourafft: 1.33% (3.7589 => 3.8088, std.dev.: 0.0152)
  SingleSource/Benchmarks/Shootout/fib2: 1.01% (4.9040 => 4.9536, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -52.84% (0.0810 => 0.0382, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/neural/neural: -22.11% (0.2542 => 0.1980, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.43% (0.1176 => 0.0971, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/mason/mason: -15.91% (0.0817 => 0.0687, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/chomp: -12.16% (0.1957 => 0.1719, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.34% (0.1151 => 0.1032, std.dev.: 0.0019)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.32% (0.2751 => 0.2522, std.dev.: 0.0006)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.14% (0.3990 => 0.3705, std.dev.: 0.0055)
  MultiSource/Applications/lemon/lemon: -6.44% (1.2932 => 1.2099, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.60% (6.9229 => 6.6739, std.dev.: 0.0162)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.63% (1.6187 => 1.5761, std.dev.: 0.0083)
  MultiSource/Benchmarks/nbench/nbench: -2.21% (1.2881 => 1.2596, std.dev.: 0.0026)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.92% (46.1715 => 45.2855, std.dev.: 0.0678)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.72% (0.9944 => 0.9773, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.32% (0.7818 => 0.7715, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.67% (0.3861 => 0.1364, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.92% (3.4380 => 1.4466, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -55.41% (3.8940 => 1.7362, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.78% (1.0845 => 0.5446, std.dev.: 0.0960)
  MultiSource/Benchmarks/FreeBench/mason/mason: -44.52% (0.5213 => 0.2892, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -32.55% (0.1871 => 0.1262, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/ary3: -29.34% (8.2895 => 5.8571, std.dev.: 0.0350)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -25.26% (0.0950 => 0.0710, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -25.13% (0.0756 => 0.0566, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.27% (0.2316 => 0.1754, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -21.97% (0.1789 => 0.1396, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -20.55% (9.6958 => 7.7031, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.98% (0.3279 => 0.2624, std.dev.: 0.0004)
  MultiSource/Benchmarks/McCat/18-imp/imp: -19.39% (0.1465 => 0.1181, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -19.19% (3.5506 => 2.8694, std.dev.: 0.0165)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -18.44% (1.9660 => 1.6035, std.dev.: 0.0177)
  SingleSource/Benchmarks/McGill/misr: -17.32% (0.4729 => 0.3910, std.dev.: 0.0116)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.47% (57.5400 => 49.7906, std.dev.: 0.0929)
  MultiSource/Applications/oggenc/oggenc: -12.38% (0.1826 => 0.1600, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.82% (9.0122 => 7.9474, std.dev.: 0.1045)
  SingleSource/Benchmarks/Misc/mandel: -11.35% (1.0882 => 0.9647, std.dev.: 0.0384)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.81% (0.1040 => 0.0938, std.dev.: 0.0017)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -9.63% (9.5512 => 8.6316, std.dev.: 0.1258)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.22% (0.3091 => 0.2806, std.dev.: 0.0022)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.79% (1.3761 => 1.2552, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.76% (0.4111 => 0.3751, std.dev.: 0.0054)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.75% (4.7243 => 4.3108, std.dev.: 0.0056)
  SingleSource/Benchmarks/McGill/queens: -7.64% (1.7928 => 1.6559, std.dev.: 0.0102)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.50% (89.3093 => 82.6142, std.dev.: 0.0460)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.49% (0.4368 => 0.4041, std.dev.: 0.0002)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.42% (13.2022 => 12.2226, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.13% (2.5458 => 2.3642, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.95% (4.2970 => 3.9985, std.dev.: 0.0314)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.58% (0.5182 => 0.4841, std.dev.: 0.0112)
  SingleSource/Benchmarks/Dhrystone/dry: -6.20% (0.5278 => 0.4951, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/distray/distray: -6.17% (0.2431 => 0.2281, std.dev.: 0.0041)
  MultiSource/Applications/SPASS/SPASS: -6.06% (8.4733 => 7.9597, std.dev.: 0.1578)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (3.2482 => 3.0532, std.dev.: 0.0187)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (0.3093 => 0.2915, std.dev.: 0.0059)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.55% (3.9434 => 3.7246, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -5.21% (0.2167 => 0.2054, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.00% (2.4484 => 2.3259, std.dev.: 0.0392)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.98% (0.4520 => 0.4295, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.76% (5.8948 => 5.6144, std.dev.: 0.0310)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.00% (4.7361 => 4.5466, std.dev.: 0.0379)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.92% (2.3673 => 2.2746, std.dev.: 0.0235)
  MultiSource/Benchmarks/Bullet/bullet: -3.86% (7.1351 => 6.8595, std.dev.: 0.0470)
  MultiSource/Benchmarks/Olden/bisort/bisort: -3.40% (0.6971 => 0.6734, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.36% (6.0602 => 5.8568, std.dev.: 0.0344)
  SingleSource/Benchmarks/Misc/ffbench: -3.23% (1.4279 => 1.3818, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.16% (6.2349 => 6.0379, std.dev.: 0.0016)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.04% (0.8122 => 0.7875, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (3.3922 => 3.2900, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.99% (3.8286 => 3.7142, std.dev.: 0.0245)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.52% (2.5722 => 2.5075, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.13% (4.3713 => 4.2782, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (1.1828 => 1.1585, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.91% (43.6112 => 42.7770, std.dev.: 0.0909)
  SingleSource/Benchmarks/Misc/flops-3: -1.84% (2.0809 => 2.0427, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.22% (2.9754 => 2.9392, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.19% (5.7666 => 5.6978, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.17% (16.6302 => 16.4349, std.dev.: 0.0597)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.09% (52.8418 => 52.2647, std.dev.: 0.0310)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.12% (1.1288 => 1.1302, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.47% (0.0248 => 0.0227, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -2.30% (0.1477 => 0.1443, std.dev.: 0.0022)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -14.97% (0.1309 => 0.1113, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.0613 => 0.0588, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.43% (0.0276 => 0.0261, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -77.78% (0.0027 => 0.0006, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.43% (0.0594 => 0.0538, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.76% (0.0361 => 0.0268, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 17.39% (0.0092 => 0.0108, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.90% (26.9213 => 24.5245, std.dev.: 0.2193)

Report Time: 0.59s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130405/b7fa9ea8/attachment.html>


More information about the llvm-testresults mailing list