[llvm-testresults] linaro-chrome-01__O3-vect__clang_DEV__armv7 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Mar 12 03:43:47 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9330?compare_to=9327&baseline=8654
Nickname: linaro-chrome-01__O3-vect__clang_DEV__armv7:10

Comparing:
     Run: 9330, Order: 176848, Start Time: 2013-03-12 05:38:06, End Time: 2013-03-12 10:43:22
      To: 9327, Order: 176837, Start Time: 2013-03-12 00:28:40, End Time: 2013-03-12 05:25:31
Baseline: 8654, Order: 175454, Start Time: 2013-02-18 20:31:40, End Time: 2013-02-19 01:40:48

===============
Tests Summary
===============

New Passes: 0 (1 on baseline)
Performance Regressions: 44 (10 on baseline)
Performance Improvements: 9 (212 on baseline)
Existing Failures: 18 (18 on baseline)
Unchanged Tests: 1033 (863 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/FloatPrecision: 600.00% (0.0050 => 0.0350, std.dev.: 0.0047)
  SingleSource/UnitTests/block-copied-in-cxxobj: 300.00% (0.0050 => 0.0200, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0200 => 0.0400, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 66.67% (0.0150 => 0.0250, std.dev.: 0.0024)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 66.67% (0.0150 => 0.0250, std.dev.: 0.0000)
  SingleSource/UnitTests/2009-12-07-StructReturn: 66.67% (0.0150 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/sumarray: 60.00% (0.0250 => 0.0400, std.dev.: 0.0024)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 42.86% (0.0350 => 0.0500, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-04-22-Switch: 40.00% (0.0250 => 0.0350, std.dev.: 0.0024)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 38.46% (0.0650 => 0.0900, std.dev.: 0.0062)
  SingleSource/UnitTests/2003-08-11-VaListArg: 37.50% (0.0400 => 0.0550, std.dev.: 0.0041)
  SingleSource/Regression/C++/global_ctor: 33.33% (0.0300 => 0.0400, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/random: 27.27% (0.0550 => 0.0700, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.81% (0.1550 => 0.1950, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops-5: 25.00% (0.0600 => 0.0750, std.dev.: 0.0024)
  SingleSource/Regression/C/sumarraymalloc: 23.08% (0.0650 => 0.0800, std.dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/Towers: 21.05% (0.0950 => 0.1150, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/bisort/bisort: 20.83% (0.1200 => 0.1450, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.15% (0.1650 => 0.1900, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/fbench: 11.11% (0.1350 => 0.1500, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.59% (0.3950 => 0.4250, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 7.50% (0.4000 => 0.4300, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.8050 => 0.8650, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/strcat: 7.32% (0.4100 => 0.4400, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.74% (0.4450 => 0.4750, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.88% (0.4250 => 0.4500, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.63% (0.5400 => 0.5650, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 2.41% (0.4150 => 0.4250)
  SingleSource/Benchmarks/Shootout-C++/moments: 1.86% (0.8050 => 0.8200, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/lists1: 1.49% (0.6700 => 0.6800, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/JM/ldecod/ldecod: 12.50% (0.1200 => 0.1350, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Treesort: 11.43% (0.1750 => 0.1950, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 11.24% (0.4450 => 0.4950, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 7.78% (0.4500 => 0.4850, std.dev.: 0.0131)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.71% (1.5750 => 1.6650, std.dev.: 0.0189)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.88% (1.2300 => 1.2900, std.dev.: 0.0125)
  SingleSource/Benchmarks/Linpack/linpack-pc: 3.36% (51.2650 => 52.9850, std.dev.: 0.0612)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.03% (0.9900 => 1.0200, std.dev.: 0.0041)
  MultiSource/Applications/siod/siod: 2.44% (6.1400 => 6.2900, std.dev.: 0.0367)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.38% (9.4700 => 9.6950, std.dev.: 0.0402)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 2.30% (0.4350 => 0.4450, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.76% (11.3600 => 11.5600, std.dev.: 0.0287)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.34% (1.8650 => 1.8900, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.03% (1.9400 => 1.9600, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -37.50% (0.0400 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -37.50% (0.0400 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: -28.57% (0.0350 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -28.57% (0.0350 => 0.0250, std.dev.: 0.0024)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.33% (0.2400 => 0.2200, std.dev.: 0.0024)
  SingleSource/UnitTests/SignlessTypes/factor: -7.89% (0.1900 => 0.1750, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.43% (5.9550 => 5.8700, std.dev.: 0.0143)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (15.4550 => 15.2750, std.dev.: 0.0225)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.56% (24.3400 => 23.9600, std.dev.: 0.1326)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/Shootout-C++/except
  SingleSource/Regression/C++/EH/ctor_dtor_count
  SingleSource/Regression/C++/EH/ctor_dtor_count-2
  SingleSource/Regression/C++/EH/exception_spec_test
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C++/EH/inlined_cleanup
  SingleSource/Regression/C++/EH/simple_rethrow
  SingleSource/Regression/C++/EH/simple_throw
  SingleSource/Regression/C++/EH/throw_rethrow_test
  MultiSource/Applications/Burg/burg: - (0.0000 => 0.0000)
  MultiSource/Applications/ClamAV/clamscan: - (0.3050 => 0.3050, std.dev.: 0.0103)
  MultiSource/Applications/lemon/lemon: 1.64% (2.7500 => 2.7950, std.dev.: 0.2699)
  MultiSource/Applications/sqlite3/sqlite3: 0.25% (10.0450 => 10.0700, std.dev.: 0.4573)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.17% (0.2300 => 0.2250, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.85% (0.1300 => 0.1350, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (3.2800 => 3.2550, std.dev.: 0.0618)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.01% (84.5800 => 84.5750, std.dev.: 0.1571)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.20% (1.2500 => 1.2350, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/except: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/exception_spec_test: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/function_try_block: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/simple_rethrow: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/simple_throw: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0000 => 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.63% (0.7900 => 0.7950, std.dev.: 0.0287)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0100 => 0.0250, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.84% (12.4350 => 15.2750, std.dev.: 0.0225)
  SingleSource/Benchmarks/McGill/queens: 15.00% (0.1000 => 0.1150, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/fibo: 4.94% (0.4050 => 0.4250, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.07% (7.0000 => 7.4250, std.dev.: 0.1020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.20% (1.2500 => 1.2900, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.48% (9.4600 => 9.6950, std.dev.: 0.0402)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.65% (52.1250 => 52.9850, std.dev.: 0.0612)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.49% (1.0050 => 1.0200, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (11.3900 => 11.5600, std.dev.: 0.0287)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/2003-06-16-VolatileError: -100.00% (0.0200 => 0.0000, std.dev.: 0.0071)
  SingleSource/UnitTests/2002-05-02-ManyArguments: -88.89% (0.0450 => 0.0050, std.dev.: 0.0103)
  SingleSource/UnitTests/Threads/2010-12-08-tls: -85.71% (0.0700 => 0.0100, std.dev.: 0.0085)
  SingleSource/UnitTests/2010-05-24-BitfieldTest: -83.33% (0.0300 => 0.0050, std.dev.: 0.0082)
  SingleSource/Regression/C/2003-05-14-initialize-string: -80.00% (0.0250 => 0.0050, std.dev.: 0.0062)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -75.00% (0.0400 => 0.0100, std.dev.: 0.0085)
  SingleSource/Regression/C++/2011-03-28-Bitfield: -72.73% (0.0550 => 0.0150, std.dev.: 0.0108)
  SingleSource/Regression/C/callargs: -72.73% (0.0550 => 0.0150, std.dev.: 0.0118)
  SingleSource/UnitTests/2002-05-02-CastTest3: -71.43% (0.0350 => 0.0100, std.dev.: 0.0062)
  SingleSource/UnitTests/2008-04-18-LoopBug: -70.00% (0.0500 => 0.0150, std.dev.: 0.0062)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -69.23% (0.0650 => 0.0200, std.dev.: 0.0085)
  SingleSource/UnitTests/2003-05-31-LongShifts: -66.67% (0.0300 => 0.0100, std.dev.: 0.0062)
  SingleSource/UnitTests/2004-02-02-NegativeZero: -66.67% (0.0300 => 0.0100, std.dev.: 0.0041)
  SingleSource/Regression/C/PR1386: -62.50% (0.0400 => 0.0150, std.dev.: 0.0062)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: -62.50% (0.0400 => 0.0150, std.dev.: 0.0062)
  SingleSource/Regression/C++/2003-05-14-expr_stmt: -60.00% (0.0250 => 0.0100, std.dev.: 0.0047)
  SingleSource/Regression/C++/pointer_method2: -57.89% (0.0950 => 0.0400, std.dev.: 0.0071)
  SingleSource/UnitTests/2006-01-23-UnionInit: -55.56% (0.0900 => 0.0400, std.dev.: 0.0062)
  SingleSource/Regression/C++/EH/ctor_dtor_count: -54.55% (0.0550 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-08-02-CastTest: -54.55% (0.0550 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-12-13-MishaTest: -54.55% (0.0550 => 0.0250, std.dev.: 0.0062)
  SingleSource/UnitTests/2003-07-10-SignConversions: -54.55% (0.0550 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-05-26-Shorts: -53.85% (0.0650 => 0.0300, std.dev.: 0.0062)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: -50.00% (0.0500 => 0.0250, std.dev.: 0.0000)
  SingleSource/UnitTests/2002-05-02-CastTest1: -50.00% (0.0200 => 0.0100, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: -50.00% (0.0500 => 0.0250, std.dev.: 0.0071)
  SingleSource/UnitTests/2003-08-20-FoldBug: -50.00% (0.0400 => 0.0200, std.dev.: 0.0071)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0600 => 0.0300, std.dev.: 0.0071)
  SingleSource/UnitTests/Vector/sumarray-dbl: -50.00% (0.0500 => 0.0250, std.dev.: 0.0085)
  SingleSource/Regression/C++/fixups: -47.06% (0.0850 => 0.0450, std.dev.: 0.0024)
  SingleSource/Regression/C/compare: -46.15% (0.0650 => 0.0350, std.dev.: 0.0082)
  SingleSource/UnitTests/2002-05-02-CastTest: -45.45% (0.0550 => 0.0300, std.dev.: 0.0094)
  SingleSource/UnitTests/SignlessTypes/cast2: -45.45% (0.0550 => 0.0300, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/ary3: -45.00% (0.1000 => 0.0550, std.dev.: 0.0062)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -44.44% (0.0450 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -44.44% (0.0450 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/byval-alignment: -44.44% (0.0450 => 0.0250, std.dev.: 0.0047)
  SingleSource/Regression/C/sumarray: -43.75% (0.0800 => 0.0450, std.dev.: 0.0125)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: -42.86% (0.0350 => 0.0200, std.dev.: 0.0024)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: -42.86% (0.0350 => 0.0200, std.dev.: 0.0024)
  SingleSource/UnitTests/vla: -42.86% (0.1400 => 0.0800, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout/objinst: -41.67% (0.1200 => 0.0700, std.dev.: 0.0122)
  SingleSource/Regression/C/uint64_to_float: -41.67% (0.1200 => 0.0700, std.dev.: 0.0118)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -41.38% (0.1450 => 0.0850, std.dev.: 0.0103)
  SingleSource/Regression/C++/EH/exception_spec_test: -40.91% (0.1100 => 0.0650, std.dev.: 0.0085)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -40.74% (0.1350 => 0.0800, std.dev.: 0.0085)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -40.00% (0.0500 => 0.0300, std.dev.: 0.0041)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -40.00% (0.0500 => 0.0300, std.dev.: 0.0062)
  SingleSource/UnitTests/SignlessTypes/ccc: -40.00% (0.0750 => 0.0450, std.dev.: 0.0024)
  SingleSource/UnitTests/initp1: -39.29% (0.1400 => 0.0850, std.dev.: 0.0094)
  SingleSource/Regression/C++/EH/function_try_block: -38.46% (0.0650 => 0.0400, std.dev.: 0.0071)
  SingleSource/Regression/C++/EH/throw_rethrow_test: -38.46% (0.0650 => 0.0400, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -37.50% (0.1200 => 0.0750, std.dev.: 0.0131)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -37.50% (0.0400 => 0.0250, std.dev.: 0.0041)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -37.50% (0.0400 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/2007-03-02-VaCopy: -37.50% (0.0400 => 0.0250, std.dev.: 0.0024)
  SingleSource/Benchmarks/Stanford/Perm: -36.84% (0.0950 => 0.0600, std.dev.: 0.0082)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: -36.36% (0.0550 => 0.0350, std.dev.: 0.0041)
  SingleSource/Regression/C/globalrefs: -36.36% (0.0550 => 0.0350)
  SingleSource/UnitTests/2003-07-06-IntOverflow: -36.36% (0.0550 => 0.0350, std.dev.: 0.0024)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -36.36% (0.0550 => 0.0350, std.dev.: 0.0041)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -36.36% (0.0550 => 0.0350, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -36.00% (0.1250 => 0.0800, std.dev.: 0.0085)
  SingleSource/Benchmarks/Stanford/Treesort: -34.62% (0.1300 => 0.0850, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/lists: -34.04% (0.2350 => 0.1550, std.dev.: 0.0047)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -33.33% (0.1350 => 0.0900, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -33.33% (0.2250 => 0.1500, std.dev.: 0.0155)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.33% (0.1200 => 0.0800, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -33.33% (0.1950 => 0.1300, std.dev.: 0.0201)
  SingleSource/Benchmarks/Stanford/Quicksort: -33.33% (0.1200 => 0.0800, std.dev.: 0.0041)
  SingleSource/UnitTests/2002-05-02-CastTest2: -33.33% (0.0450 => 0.0300, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-05-07-VarArgs: -33.33% (0.0600 => 0.0400, std.dev.: 0.0071)
  SingleSource/UnitTests/2003-07-09-SignedArgs: -33.33% (0.0600 => 0.0400, std.dev.: 0.0071)
  SingleSource/UnitTests/TestLoop: -33.33% (0.0450 => 0.0300, std.dev.: 0.0047)
  SingleSource/UnitTests/Vector/sumarray: -33.33% (0.0600 => 0.0400, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/multiplies: -33.33% (0.0750 => 0.0500, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -31.91% (0.2350 => 0.1600, std.dev.: 0.0131)
  SingleSource/Benchmarks/Stanford/FloatMM: -31.82% (0.1100 => 0.0750, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -31.71% (0.2050 => 0.1400, std.dev.: 0.0170)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -31.58% (0.0950 => 0.0650, std.dev.: 0.0108)
  SingleSource/Regression/C/badidx: -30.77% (0.0650 => 0.0450, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -30.77% (0.0650 => 0.0450, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -30.00% (0.2500 => 0.1750, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/mandel-text: -30.00% (0.0500 => 0.0350, std.dev.: 0.0047)
  SingleSource/Regression/C++/EH/ConditionalExpr: -30.00% (0.0500 => 0.0350, std.dev.: 0.0024)
  SingleSource/Regression/C/PR640: -30.00% (0.0500 => 0.0350, std.dev.: 0.0041)
  SingleSource/UnitTests/2003-04-22-Switch: -30.00% (0.0500 => 0.0350, std.dev.: 0.0024)
  SingleSource/UnitTests/Threads/tls: -30.00% (0.0500 => 0.0350, std.dev.: 0.0041)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -29.63% (0.1350 => 0.0950, std.dev.: 0.0131)
  SingleSource/Regression/C++/EH/simple_rethrow: -28.57% (0.0350 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -28.57% (0.0350 => 0.0250, std.dev.: 0.0024)
  SingleSource/UnitTests/SignlessTypes/shr: -28.57% (0.0700 => 0.0500, std.dev.: 0.0041)
  SingleSource/Regression/C/sumarray2d: -28.57% (0.1050 => 0.0750, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -28.21% (0.1950 => 0.1400, std.dev.: 0.0103)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -27.66% (0.2350 => 0.1700, std.dev.: 0.0201)
  SingleSource/UnitTests/2003-05-14-AtExit: -27.27% (0.0550 => 0.0400, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -26.67% (0.2250 => 0.1650, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -26.42% (0.2650 => 0.1950, std.dev.: 0.0024)
  SingleSource/Benchmarks/Dhrystone/fldry: -25.93% (0.1350 => 0.1000, std.dev.: 0.0122)
  MultiSource/Benchmarks/BitBench/five11/five11: -25.81% (0.1550 => 0.1150, std.dev.: 0.0147)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -25.00% (0.1800 => 0.1350, std.dev.: 0.0125)
  SingleSource/Benchmarks/Stanford/Oscar: -25.00% (0.1800 => 0.1350, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/family/family: -23.81% (0.1050 => 0.0800, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -23.68% (0.1900 => 0.1450, std.dev.: 0.0047)
  SingleSource/Benchmarks/McGill/misr: -23.53% (0.1700 => 0.1300, std.dev.: 0.0094)
  SingleSource/Benchmarks/Misc/dt: -23.53% (0.0850 => 0.0650, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/methcall: -23.53% (0.0850 => 0.0650, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -23.08% (0.1950 => 0.1500, std.dev.: 0.0163)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -23.08% (0.1300 => 0.1000, std.dev.: 0.0041)
  SingleSource/UnitTests/SignlessTypes/factor: -22.22% (0.2250 => 0.1750, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.06% (0.3400 => 0.2650, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -22.00% (0.2500 => 0.1950, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -21.74% (0.2300 => 0.1800, std.dev.: 0.0147)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -21.62% (0.1850 => 0.1450, std.dev.: 0.0131)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.83% (0.1200 => 0.0950, std.dev.: 0.0000)
  MultiSource/Benchmarks/FreeBench/distray/distray: -20.75% (0.2650 => 0.2100, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -20.45% (0.2200 => 0.1750, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -20.25% (0.3950 => 0.3150, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -20.00% (0.2250 => 0.1800, std.dev.: 0.0147)
  SingleSource/Benchmarks/Stanford/Bubblesort: -20.00% (0.1000 => 0.0800, std.dev.: 0.0041)
  SingleSource/Regression/C/sumarraymalloc: -20.00% (0.1000 => 0.0800, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -18.92% (0.1850 => 0.1500, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -18.75% (0.2400 => 0.1950, std.dev.: 0.0170)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -18.60% (0.2150 => 0.1750, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -18.46% (0.3250 => 0.2650, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -17.95% (0.1950 => 0.1600, std.dev.: 0.0103)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -16.67% (0.7500 => 0.6250, std.dev.: 0.0347)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -16.03% (0.6550 => 0.5500, std.dev.: 0.0309)
  SingleSource/Benchmarks/McGill/chomp: -16.00% (0.5000 => 0.4200, std.dev.: 0.0062)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -15.79% (0.1900 => 0.1600, std.dev.: 0.0047)
  SingleSource/UnitTests/SignlessTypes/rem: -15.25% (0.2950 => 0.2500, std.dev.: 0.0071)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -14.81% (0.1350 => 0.1150, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout/hash: -14.81% (0.1350 => 0.1150, std.dev.: 0.0071)
  SingleSource/Benchmarks/Stanford/IntMM: -14.81% (0.1350 => 0.1150, std.dev.: 0.0047)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -14.58% (0.2400 => 0.2050, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc/flops-1: -14.29% (0.0700 => 0.0600, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -14.15% (0.5300 => 0.4550, std.dev.: 0.0201)
  MultiSource/Applications/aha/aha: -13.79% (0.2900 => 0.2500, std.dev.: 0.0103)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -13.43% (0.3350 => 0.2900, std.dev.: 0.0141)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -13.33% (0.3000 => 0.2600, std.dev.: 0.0082)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.99% (0.3850 => 0.3350, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/hash2: -12.84% (1.0900 => 0.9500, std.dev.: 0.0239)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.83% (3.4300 => 2.9900, std.dev.: 0.0417)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -12.74% (1.8050 => 1.5750, std.dev.: 0.0268)
  SingleSource/Benchmarks/Stanford/Puzzle: -12.00% (0.2500 => 0.2200, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/power/power: -11.94% (0.3350 => 0.2950, std.dev.: 0.0118)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.67% (0.3000 => 0.2650, std.dev.: 0.0071)
  SingleSource/Regression/C++/ofstream_ctor: -11.43% (0.5250 => 0.4650, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout/matrix: -11.11% (0.1800 => 0.1600, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/ary: -10.83% (0.6000 => 0.5350, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -10.81% (0.3700 => 0.3300, std.dev.: 0.0108)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.20% (0.2450 => 0.2200, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/ary3: -9.60% (0.6250 => 0.5650, std.dev.: 0.0047)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.52% (0.3150 => 0.2850, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/bigfib: -9.42% (1.5400 => 1.3950, std.dev.: 0.0122)
  SingleSource/Benchmarks/Misc/fbench: -9.09% (0.1650 => 0.1500, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/ary2: -8.80% (0.6250 => 0.5700, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -8.33% (0.1800 => 0.1650, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.16% (0.9800 => 0.9000, std.dev.: 0.0165)
  MultiSource/Benchmarks/Olden/health/health: -7.35% (0.3400 => 0.3150, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.34% (0.5450 => 0.5050, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.09% (1.3400 => 1.2450, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/sieve: -6.87% (0.6550 => 0.6100, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout-C++/wc: -6.06% (0.4950 => 0.4650, std.dev.: 0.0094)
  SingleSource/Benchmarks/CoyoteBench/almabench: -5.88% (0.1700 => 0.1600)
  SingleSource/Benchmarks/Shootout-C++/moments: -5.75% (0.8700 => 0.8200, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.7200 => 0.6800, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.4750 => 0.4500, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.23% (2.7700 => 2.6250, std.dev.: 0.0533)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.56% (4.4950 => 4.2900, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -4.46% (0.7850 => 0.7500, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.42% (0.9050 => 0.8650, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/random: -4.40% (0.4550 => 0.4350, std.dev.: 0.0047)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.37% (1.1450 => 1.0950, std.dev.: 0.0143)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.35% (0.9200 => 0.8800, std.dev.: 0.0071)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.85% (6.1050 => 5.8700, std.dev.: 0.0143)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.30% (8.7750 => 8.4850, std.dev.: 0.0062)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.26% (1.0750 => 1.0400, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -64.29% (0.0700 => 0.0250, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -57.14% (0.0350 => 0.0150, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -46.78% (132.9100 => 70.7400, std.dev.: 0.4446)
  MultiSource/Applications/d/make_dparser: -40.00% (0.1500 => 0.0900, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/Quicksort: -35.00% (0.1000 => 0.0650)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -24.72% (44.0050 => 33.1250, std.dev.: 0.5459)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -23.81% (0.1050 => 0.0800, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout/nestedloop: -21.62% (0.3700 => 0.2900, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.68% (70.3150 => 55.7750, std.dev.: 0.3466)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.33% (0.3000 => 0.2450, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout-C++/strcat: -17.50% (0.2000 => 0.1650, std.dev.: 0.0085)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -16.88% (0.3850 => 0.3200, std.dev.: 0.0178)
  SingleSource/Benchmarks/Stanford/Queens: -15.38% (0.0650 => 0.0550, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.3600 => 0.3050, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -15.00% (0.3000 => 0.2550, std.dev.: 0.0131)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.87% (0.4600 => 0.4100, std.dev.: 0.0062)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.47% (0.2950 => 0.2700, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -7.98% (4.3850 => 4.0350, std.dev.: 0.1041)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.94% (0.3150 => 0.2900, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -7.29% (0.4800 => 0.4450, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -6.73% (0.5200 => 0.4850, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.56% (109.4200 => 102.2450, std.dev.: 0.3712)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -6.18% (1.2950 => 1.2150, std.dev.: 0.0255)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -5.65% (0.6200 => 0.5850, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.00% (0.3000 => 0.2850, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.61% (3.4700 => 3.3100, std.dev.: 0.0324)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -3.85% (0.2600 => 0.2500, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/lowercase: -3.73% (0.8050 => 0.7750, std.dev.: 0.0108)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.12% (5.1900 => 5.0800, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops-4: -1.80% (4.1750 => 4.1000, std.dev.: 0.0236)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.64% (2.1300 => 2.0950, std.dev.: 0.0125)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -1.54% (1.3000 => 1.2800, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.52% (24.3300 => 23.9600, std.dev.: 0.1326)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.13% (2.6500 => 2.6200)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/Shootout-C++/except
  SingleSource/Regression/C++/EH/ctor_dtor_count
  SingleSource/Regression/C++/EH/ctor_dtor_count-2
  SingleSource/Regression/C++/EH/exception_spec_test
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C++/EH/inlined_cleanup
  SingleSource/Regression/C++/EH/simple_rethrow
  SingleSource/Regression/C++/EH/simple_throw
  SingleSource/Regression/C++/EH/throw_rethrow_test
  MultiSource/Applications/Burg/burg: - (0.0000 => 0.0000)
  MultiSource/Applications/ClamAV/clamscan: -10.29% (0.3400 => 0.3050, std.dev.: 0.0103)
  MultiSource/Applications/lemon/lemon: -29.06% (3.9400 => 2.7950, std.dev.: 0.2699)
  MultiSource/Applications/sqlite3/sqlite3: 2.65% (9.8100 => 10.0700, std.dev.: 0.4573)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -19.64% (0.2800 => 0.2250, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.1350 => 0.1350, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (3.2950 => 3.2550, std.dev.: 0.0618)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.04% (84.6050 => 84.5750, std.dev.: 0.1571)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.52% (1.2800 => 1.2350, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/except: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/exception_spec_test: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/function_try_block: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/simple_rethrow: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/simple_throw: - (0.0000 => 0.0000)
  SingleSource/Regression/C++/EH/throw_rethrow_test: - (0.0000 => 0.0000)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130312/b3cc4064/attachment.html>


More information about the llvm-testresults mailing list