[llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 9 16:42:46 PST 2013


http://llvm.org/perf/db_default/v4/nts/7447?compare_to=7445&baseline=5138
Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7

Comparing:
     Run: 7447, Order: 172011, Start Time: 2013-01-09 23:08:58, End Time: 2013-01-10 00:42:44
      To: 7445, Order: 171996, Start Time: 2013-01-09 21:11:06, End Time: 2013-01-09 22:45:32
Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39

===============
Tests Summary
===============

Performance Regressions: 10 (93 on baseline)
Performance Improvements: 52 (136 on baseline)
Added Tests: 0 (12 on baseline)
Unchanged Tests: 1042 (863 on baseline)
Total Tests: 1104

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.05% (0.4076 => 0.4567, std.dev.: 0.0087)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: 6.23% (4.4864 => 4.7658, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/dt: 3.30% (1.0173 => 1.0509, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.90% (3.0601 => 3.1183, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.68% (4.1044 => 4.1732, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.60% (2.0524 => 2.0853, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.54% (4.2736 => 4.3392, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.52% (1.0162 => 1.0316, std.dev.: 0.0030)
  MultiSource/Applications/lemon/lemon: 1.28% (1.4336 => 1.4519, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (2.2986 => 2.3251, std.dev.: 0.0001)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -18.59% (0.8855 => 0.7209, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -18.52% (0.8963 => 0.7303, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -18.45% (0.8987 => 0.7329, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -18.40% (0.8968 => 0.7318, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -18.29% (0.9189 => 0.7508, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -17.97% (0.9331 => 0.7654, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -17.91% (0.9237 => 0.7583, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -17.77% (0.9563 => 0.7864, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -17.71% (0.9244 => 0.7607, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -17.61% (0.9436 => 0.7774, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -17.40% (0.9607 => 0.7935, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -17.25% (0.9711 => 0.8036, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -16.85% (1.0031 => 0.8341, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -16.68% (1.0006 => 0.8337, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -16.60% (1.0072 => 0.8400, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -16.57% (1.0251 => 0.8552, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -16.25% (1.0465 => 0.8764, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -15.33% (1.0937 => 0.9260, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -13.39% (0.8325 => 0.7210, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.35% (0.8217 => 0.7120, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -13.33% (0.8321 => 0.7212, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -13.32% (0.8327 => 0.7218, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.13% (0.8528 => 0.7408, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.87% (0.8672 => 0.7556, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.83% (0.8600 => 0.7497, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -12.78% (0.8899 => 0.7762, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -12.77% (0.8603 => 0.7504, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -12.76% (0.8756 => 0.7639, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.50% (0.8950 => 0.7831, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -12.21% (0.9055 => 0.7949, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.18% (0.9330 => 0.8194, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -12.01% (0.9351 => 0.8228, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.89% (0.9434 => 0.8312, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.67% (0.0874 => 0.0772, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -11.47% (0.9767 => 0.8647, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -11.36% (0.9535 => 0.8452, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -11.25% (1.0106 => 0.8969, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7903 => 0.7552, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.24% (0.5924 => 0.5673, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -2.44% (0.4836 => 0.4718, std.dev.: 0.0009)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.01% (0.5565 => 0.5453, std.dev.: 0.0005)
  MultiSource/Applications/oggenc/oggenc: -1.76% (5.1888 => 5.0974, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.75% (2.7532 => 2.7051, std.dev.: 0.0110)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.32% (2.1182 => 2.0903, std.dev.: 0.0008)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.31% (2.3990 => 2.3676, std.dev.: 0.0050)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.09% (5.0409 => 4.9859, std.dev.: 0.0120)
  MultiSource/Benchmarks/nbench/nbench: -1.07% (1.1546 => 1.1422, std.dev.: 0.0005)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash2: -3.15% (3.2897 => 3.1861, std.dev.: 0.0028)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.92% (0.8767 => 0.8599)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.74% (77.6902 => 76.3408, std.dev.: 0.0219)
  MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.2926 => 7.1928, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.02% (3.7217 => 3.6837, std.dev.: 0.0011)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.85% (0.0717 => 0.1182, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 58.83% (0.0974 => 0.1547, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798)
  MultiSource/Benchmarks/FreeBench/neural/neural: 44.27% (0.1500 => 0.2164, std.dev.: 0.0003)
  SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.04% (0.6395 => 0.8764, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.60% (0.1132 => 0.1535, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.22% (0.6395 => 0.8647, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.24% (0.6260 => 0.8341, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.00% (0.5688 => 0.7508, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.85% (0.5805 => 0.7654, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.52% (0.6230 => 0.8194, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.32% (0.5581 => 0.7329, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.18% (0.5567 => 0.7303, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.85% (0.5941 => 0.7774, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.23% (0.5802 => 0.7556, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.06% (0.5849 => 0.7607, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.97% (0.5478 => 0.7120, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.85% (0.5705 => 0.7408, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.48% (0.5570 => 0.7212, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.47% (0.5569 => 0.7210, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.46% (0.6440 => 0.8337, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.42% (0.5859 => 0.7583, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.10% (0.5591 => 0.7218, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.93% (0.5925 => 0.7639, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.21% (0.6189 => 0.7935, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.12% (0.5857 => 0.7504, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.10% (0.6676 => 0.8552, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.87% (0.5863 => 0.7497, std.dev.: 0.0002)
  SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.65% (0.6446 => 0.8228, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0021)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.88% (1.6474 => 2.0903, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.51% (0.6681 => 0.8452, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.43% (0.6194 => 0.7831, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.23% (0.6297 => 0.7949, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.67% (0.6667 => 0.8312, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.21% (0.7339 => 0.8969, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0011)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.76% (2.2587 => 2.7051, std.dev.: 0.0110)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0001)
  SingleSource/UnitTests/ObjC/BoolLiteralTest: 19.12% (0.3834 => 0.4567, std.dev.: 0.0087)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: 14.55% (1.1450 => 1.3116, std.dev.: 0.0006)
  MultiSource/Applications/sgefa/sgefa: 13.85% (0.3357 => 0.3822, std.dev.: 0.0019)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1081 => 0.1222, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.65% (0.1982 => 0.2213, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.6364 => 1.8163, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4916 => 0.5453, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.63% (4.5069 => 4.9859, std.dev.: 0.0120)
  MultiSource/Benchmarks/McCat/05-eks/eks: 10.52% (0.4515 => 0.4990, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.89% (3.5339 => 3.8835, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.7021 => 0.7552, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/hash: 7.05% (0.4524 => 0.4843, std.dev.: 0.0075)
  MultiSource/Applications/Burg/burg: 6.66% (1.2515 => 1.3348, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5329 => 0.5673, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (0.4861 => 0.5148, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (1.4642 => 1.5503, std.dev.: 0.0030)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (9.2283 => 9.7570, std.dev.: 0.0086)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.2784 => 1.3507, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.70% (0.3255 => 0.3408, std.dev.: 0.0002)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.3319 => 0.3443, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (5.4682 => 5.6211, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0008)
  MultiSource/Applications/oggenc/oggenc: 1.49% (5.0226 => 5.0974, std.dev.: 0.0022)
  MultiSource/Applications/spiff/spiff: 1.38% (0.8418 => 0.8534, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6633, std.dev.: 0.0173)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.24% (0.9531 => 1.0316, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4411, std.dev.: 0.0043)
  MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1697, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.92% (54.5751 => 56.7171, std.dev.: 0.0858)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1101, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0013)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3136, std.dev.: 0.0019)
  MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0011)
  MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6018, std.dev.: 0.0014)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.13% (0.1281 => 0.1100, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0001)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0003)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.01% (2.4924 => 2.3676, std.dev.: 0.0050)
  SingleSource/UnitTests/ObjC/trivial-interface: -4.98% (0.3812 => 0.3622, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0003)
  SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0003)
  SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0060)
  SingleSource/UnitTests/ObjC/exceptions-4: -4.87% (0.3880 => 0.3691, std.dev.: 0.0006)
  SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.82% (0.9852 => 0.9377, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (0.3821 => 0.3637, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.79% (0.7198 => 0.6853, std.dev.: 0.0006)
  SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0002)
  SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0002)
  SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0001)
  SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3884 => 0.3716, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3142 => 0.3009, std.dev.: 0.0012)
  SingleSource/UnitTests/ObjC/property: -4.19% (0.4199 => 0.4023, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -4.18% (0.3016 => 0.2890, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0004)
  SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0001)
  SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4280 => 0.4111, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0001)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -3.90% (2.1713 => 2.0866, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -3.87% (0.3252 => 0.3126, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/methcall: -3.83% (0.3025 => 0.2909, std.dev.: 0.0001)
  MultiSource/Applications/hexxagon/hexxagon: -3.83% (1.3148 => 1.2645, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.81% (0.9542 => 0.9178, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.75% (0.3658 => 0.3521, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0011)
  SingleSource/UnitTests/ObjC++/Hello: -3.23% (0.6347 => 0.6142, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -3.13% (0.4151 => 0.4021, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.07% (0.3621 => 0.3510, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.03% (0.3931 => 0.3812, std.dev.: 0.0003)
  SingleSource/UnitTests/ObjC++/property-reference-object: -3.01% (0.6441 => 0.6247, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.7919 => 0.7688, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.86% (0.3849 => 0.3739, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/constpool: -2.79% (20.7746 => 20.1947, std.dev.: 0.0177)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.75% (0.4321 => 0.4202, std.dev.: 0.0005)
  MultiSource/Applications/sqlite3/sqlite3: -2.64% (17.1032 => 16.6517, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.2210 => 1.1907, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: -2.47% (4.3330 => 4.2261, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8585, std.dev.: 0.0091)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6079, std.dev.: 0.0032)
  SingleSource/UnitTests/ObjC++/property-reference: -2.31% (0.7779 => 0.7599, std.dev.: 0.0010)
  MultiSource/Applications/JM/lencod/lencod: -2.31% (16.1920 => 15.8179, std.dev.: 0.0085)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.31% (1.2221 => 1.1939, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0030)
  MultiSource/Applications/JM/ldecod/ldecod: -2.17% (7.0961 => 6.9423, std.dev.: 0.0039)
  MultiSource/Applications/siod/siod: -2.06% (2.4021 => 2.3527, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.97% (0.8521 => 0.8353, std.dev.: 0.0010)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (1.2300 => 1.2061, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.93% (0.9179 => 0.9002, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.85% (0.5999 => 0.5888, std.dev.: 0.0020)
  MultiSource/Benchmarks/Bullet/bullet: -1.80% (34.0927 => 33.4788, std.dev.: 0.0250)
  MultiSource/Applications/lua/lua: -1.76% (4.0594 => 3.9881, std.dev.: 0.0041)
  MultiSource/Applications/hbd/hbd: -1.63% (1.5610 => 1.5356, std.dev.: 0.0022)
  MultiSource/Applications/ClamAV/clamscan: -1.31% (15.2527 => 15.0523, std.dev.: 0.0148)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.28% (8.0126 => 7.9104, std.dev.: 0.0006)
  MultiSource/Applications/treecc/treecc: -1.05% (2.1401 => 2.1176, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Dhrystone/fldry: -61.82% (1.8100 => 0.6910, std.dev.: 0.0141)
  SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.76% (0.6962 => 0.3428, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/mandel-2: -24.41% (1.3643 => 1.0313, std.dev.: 0.0015)
  MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9944, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7561, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001)
  MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599)
  SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1260, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8044, std.dev.: 0.0007)
  SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475)
  SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8970, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0003)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (7.9763 => 7.7258, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/ary3: -2.53% (3.7241 => 3.6299, std.dev.: 0.0118)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.28% (1.3096 => 1.2798, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0004)
  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0051)
  MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1928, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6580, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.8776 => 4.8141, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002)

Added Tests - Compile Time
--------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  MultiSource/Benchmarks/7zip/7zip-benchmark
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/SmallPT/smallpt
  SingleSource/UnitTests/Vectorizer/gcc-loops

Added Tests - Execution Time
----------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  MultiSource/Benchmarks/7zip/7zip-benchmark
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/SmallPT/smallpt
  SingleSource/UnitTests/Vectorizer/gcc-loops

Report Time: 1.24s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130109/e7e46a64/attachment.html>


More information about the llvm-testresults mailing list