[llvm-testresults] lab-mini-01O3-plainclang_DEV__x86_64 test results

Thu Dec 13 00:12:32 PST 2012

http://llvm.org/perf/db_default/v4/nts/6726?compare_to=6723&baseline=5138
Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7

Comparing:
     Run: 6726, Order: 170100, Start Time: 2012-12-13 06:42:59, End Time: 2012-12-13 08:13:20
      To: 6723, Order: 170096, Start Time: 2012-12-13 04:52:43, End Time: 2012-12-13 06:19:50
Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39

===============
Tests Summary
===============

New Failures: 0 (46 on baseline)
Performance Regressions: 0 (7 on baseline)
Performance Improvements: 0 (131 on baseline)
Added Tests: 0 (54 on baseline)
Existing Failures: 46 (0 on baseline)
Unchanged Tests: 1054 (862 on baseline)
Total Tests: 1100

===========================
Run-Over-Run Changes Detail
===========================

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sgefa/sgefa
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/FreeBench/neural/neural
  MultiSource/Benchmarks/FreeBench/pifft/pifft
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/McCat/05-eks/eks
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Olden/power/power
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer
  MultiSource/Benchmarks/llubenchmark/llu
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/nbench/nbench
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2
  SingleSource/Benchmarks/Misc/fbench
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm
  MultiSource/Applications/JM/lencod/lencod: 0.22% (14.9361 => 14.9683, std.dev.: 0.0090)
  MultiSource/Applications/oggenc/oggenc: 0.07% (2.1582 => 2.1598, std.dev.: 0.0027)
  MultiSource/Applications/sgefa/sgefa: -0.41% (0.2932 => 0.2920, std.dev.: 0.0008)
  MultiSource/Applications/sqlite3/sqlite3: 0.09% (9.3040 => 9.3124, std.dev.: 0.0094)
  MultiSource/Benchmarks/Bullet/bullet: 0.12% (30.2479 => 30.2833, std.dev.: 0.0555)
  MultiSource/Benchmarks/FreeBench/neural/neural: 0.16% (0.0630 => 0.0631, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -0.06% (0.6449 => 0.6445, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 0.09% (0.6948 => 0.6954, std.dev.: 0.0002)
  MultiSource/Benchmarks/McCat/05-eks/eks: 0.12% (0.3437 => 0.3441, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 0.04% (3.4929 => 3.4943, std.dev.: 0.0945)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.01% (13.5141 => 13.5132, std.dev.: 0.2913)
  MultiSource/Benchmarks/Olden/power/power: 0.26% (0.0771 => 0.0773, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.19% (0.2602 => 0.2607, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.19% (0.2608 => 0.2613, std.dev.: 0.0093)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 0.21% (0.0467 => 0.0468, std.dev.: 0.0054)
  MultiSource/Benchmarks/llubenchmark/llu: - (0.0270 => 0.0270, std.dev.: 0.0000)
  MultiSource/Benchmarks/mafft/pairlocalalign: 0.06% (8.4259 => 8.4313, std.dev.: 0.0030)
  MultiSource/Benchmarks/nbench/nbench: 0.45% (0.5782 => 0.5808, std.dev.: 0.0182)
  SingleSource/Benchmarks/LivermoreLoops/kernel11: 0.38% (0.0530 => 0.0532, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 0.08% (0.3622 => 0.3625, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 0.14% (0.0730 => 0.0731, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/fbench: 0.25% (0.0399 => 0.0400, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: - (0.0515 => 0.0515, std.dev.: 0.0011)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sgefa/sgefa
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/FreeBench/neural/neural
  MultiSource/Benchmarks/FreeBench/pifft/pifft
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/McCat/05-eks/eks
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Olden/power/power
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer
  MultiSource/Benchmarks/llubenchmark/llu
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/nbench/nbench
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2
  SingleSource/Benchmarks/Misc/fbench
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm
  MultiSource/Applications/JM/lencod/lencod: - (0.0001 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001)
  MultiSource/Applications/sgefa/sgefa: - (0.0001 => 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/FreeBench/neural/neural: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/McCat/05-eks/eks: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/Olden/power/power: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/llubenchmark/llu: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/mafft/pairlocalalign: - (0.0001 => 0.0001)
  MultiSource/Benchmarks/nbench/nbench: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/LivermoreLoops/kernel11: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Misc/fbench: - (0.0001 => 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: - (0.0001 => 0.0001)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sgefa/sgefa
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/FreeBench/neural/neural
  MultiSource/Benchmarks/FreeBench/pifft/pifft
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/McCat/05-eks/eks
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Olden/power/power
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer
  MultiSource/Benchmarks/llubenchmark/llu
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/nbench/nbench
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2
  SingleSource/Benchmarks/Misc/fbench
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm
  MultiSource/Applications/JM/lencod/lencod: -7.56% (16.1920 => 14.9683, std.dev.: 0.0090)
  MultiSource/Applications/oggenc/oggenc: -57.00% (5.0226 => 2.1598, std.dev.: 0.0027)
  MultiSource/Applications/sgefa/sgefa: -13.02% (0.3357 => 0.2920, std.dev.: 0.0008)
  MultiSource/Applications/sqlite3/sqlite3: -45.55% (17.1032 => 9.3124, std.dev.: 0.0094)
  MultiSource/Benchmarks/Bullet/bullet: -11.17% (34.0927 => 30.2833, std.dev.: 0.0555)
  MultiSource/Benchmarks/FreeBench/neural/neural: -57.93% (0.1500 => 0.0631, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -34.58% (0.9852 => 0.6445, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -18.39% (0.8521 => 0.6954, std.dev.: 0.0002)
  MultiSource/Benchmarks/McCat/05-eks/eks: -23.79% (0.4515 => 0.3441, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -13.34% (4.0323 => 3.4943, std.dev.: 0.0945)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.89% (14.2083 => 13.5132, std.dev.: 0.2913)
  MultiSource/Benchmarks/Olden/power/power: -33.02% (0.1154 => 0.0773, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -60.86% (0.6660 => 0.2607, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -60.81% (0.6667 => 0.2613, std.dev.: 0.0093)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -56.71% (0.1081 => 0.0468, std.dev.: 0.0054)
  MultiSource/Benchmarks/llubenchmark/llu: -46.85% (0.0508 => 0.0270, std.dev.: 0.0000)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.64% (9.2283 => 8.4313, std.dev.: 0.0030)
  MultiSource/Benchmarks/nbench/nbench: -49.63% (1.1530 => 0.5808, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -57.77% (0.1731 => 0.0731, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/fbench: -35.48% (0.0620 => 0.0400, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -18.77% (0.0634 => 0.0515, std.dev.: 0.0011)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sgefa/sgefa
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/FreeBench/neural/neural
  MultiSource/Benchmarks/FreeBench/pifft/pifft
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/McCat/05-eks/eks
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/Olden/power/power
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer
  MultiSource/Benchmarks/llubenchmark/llu
  MultiSource/Benchmarks/mafft/pairlocalalign
  MultiSource/Benchmarks/nbench/nbench
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2
  SingleSource/Benchmarks/Misc/fbench
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm
  MultiSource/Applications/JM/lencod/lencod: -100.00% (7.5730 => 0.0001)
  MultiSource/Applications/oggenc/oggenc: -99.92% (0.1331 => 0.0001)
  MultiSource/Applications/sgefa/sgefa: -99.98% (0.6299 => 0.0001)
  MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.5320 => 0.0001)
  MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3040 => 0.0001)
  MultiSource/Benchmarks/FreeBench/neural/neural: -99.96% (0.2233 => 0.0001)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -99.91% (0.1171 => 0.0001)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -100.00% (2.3169 => 0.0001)
  MultiSource/Benchmarks/McCat/05-eks/eks: -96.55% (0.0029 => 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.96% (0.2341 => 0.0001)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2081 => 0.0001)
  MultiSource/Benchmarks/Olden/power/power: -99.99% (1.4833 => 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -100.00% (5.4195 => 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -100.00% (8.6966 => 0.0001)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -99.99% (1.4293 => 0.0001)
  MultiSource/Benchmarks/llubenchmark/llu: -100.00% (3.7435 => 0.0001)
  MultiSource/Benchmarks/mafft/pairlocalalign: -100.00% (27.8210 => 0.0001)
  MultiSource/Benchmarks/nbench/nbench: -100.00% (11.6767 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -100.00% (2.9900 => 0.0001)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -100.00% (7.3669 => 0.0001)
  SingleSource/Benchmarks/Misc/fbench: -100.00% (2.2633 => 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -100.00% (42.8707 => 0.0001)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.32% (0.3834 => 0.4383, std.dev.: 0.0110)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 74.99% (31.3723 => 54.8992, std.dev.: 0.0613)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (3.1932 => 3.2869, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1041, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.45% (54.5751 => 55.9147, std.dev.: 0.3643)
  SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6739, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0148)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.90% (2.4924 => 2.3205, std.dev.: 0.0045)
  MultiSource/Applications/JM/ldecod/ldecod: -6.09% (7.0961 => 6.6636, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0000)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.05% (0.3821 => 0.3590, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.98% (0.3142 => 0.2954, std.dev.: 0.0061)
  SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.96% (0.1796 => 0.1689, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.73% (0.6052 => 0.5705, std.dev.: 0.0083)
  MultiSource/Benchmarks/Prolangs-C/football/football: -5.72% (0.9179 => 0.8654, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -5.71% (0.4151 => 0.3914, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0133)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3330, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.66% (1.3722 => 1.2945, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0122)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.66% (0.3658 => 0.3451, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.64% (0.5941 => 0.5606, std.dev.: 0.0076)
  SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.59% (0.6033 => 0.5696, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.56% (0.5805 => 0.5482, std.dev.: 0.0067)
  SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0002)
  SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0060)
  SingleSource/UnitTests/ObjC/trivial-interface: -5.54% (0.3812 => 0.3601, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.52% (0.5688 => 0.5374, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0053)
  SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0110)
  SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -5.45% (1.2300 => 1.1630, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.42% (0.6736 => 0.6371, std.dev.: 0.0011)
  SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.34% (0.7524 => 0.7122, std.dev.: 0.0135)
  SingleSource/UnitTests/ObjC/exceptions: -5.32% (0.4176 => 0.3954, std.dev.: 0.0004)
  MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/matrix: -5.25% (0.3255 => 0.3084, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0003)
  MultiSource/Applications/hexxagon/hexxagon: -5.15% (1.3148 => 1.2471, std.dev.: 0.0080)
  MultiSource/Applications/SPASS/SPASS: -5.11% (15.5079 => 14.7148, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0005)
  SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/lists: -5.05% (0.3621 => 0.3438, std.dev.: 0.0004)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.03% (1.3864 => 1.3166, std.dev.: 0.0017)
  SingleSource/UnitTests/ObjC/instance-method-metadata: -5.02% (0.3884 => 0.3689, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0004)
  MultiSource/Applications/d/make_dparser: -5.01% (3.5154 => 3.3394, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.98% (0.4321 => 0.4106, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.96% (8.0126 => 7.6150, std.dev.: 0.1512)
  SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.95% (0.9557 => 0.9084, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.95% (0.4427 => 0.4208, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.95% (0.2548 => 0.2422, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.94% (0.2933 => 0.2788, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -4.93% (2.1713 => 2.0642, std.dev.: 0.0081)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.91% (0.5168 => 0.4914, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0004)
  SingleSource/UnitTests/ObjC++/property-reference: -4.90% (0.7779 => 0.7398, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0005)
  SingleSource/UnitTests/ObjC++/Hello: -4.88% (0.6347 => 0.6037, std.dev.: 0.0002)
  MultiSource/Applications/minisat/minisat: -4.87% (0.7447 => 0.7084, std.dev.: 0.0001)
  SingleSource/Regression/C++/ofstream_ctor: -4.87% (0.3059 => 0.2910, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: -4.86% (15.2527 => 14.5112, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0001)
  MultiSource/Benchmarks/McCat/08-main/main: -4.85% (0.2659 => 0.2530, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/ary2: -4.83% (0.3481 => 0.3313, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/bh/bh: -4.82% (0.2985 => 0.2841, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (0.4861 => 0.4627, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.78% (0.2278 => 0.2169, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0001)
  MultiSource/Applications/lua/lua: -4.75% (4.0594 => 3.8664, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/wc: -4.74% (0.3205 => 0.3053, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.72% (0.3581 => 0.3412, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/moments: -4.71% (0.4248 => 0.4048, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0000)
  SingleSource/UnitTests/ObjC++/property-reference-object: -4.64% (0.6441 => 0.6142, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0010)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.57% (0.4813 => 0.4593, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.55% (1.6474 => 1.5724, std.dev.: 0.0015)
  MultiSource/Applications/treecc/treecc: -4.55% (2.1401 => 2.0428, std.dev.: 0.0106)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.4056 => 21.3894, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.50% (0.7021 => 0.6705, std.dev.: 0.0005)
  MultiSource/Applications/siod/siod: -4.42% (2.4021 => 2.2960, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.38% (0.3491 => 0.3338, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -4.36% (0.4083 => 0.3905, std.dev.: 0.0066)
  SingleSource/Benchmarks/Shootout-C++/sieve: -4.36% (0.3788 => 0.3623, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.30% (0.5329 => 0.5100, std.dev.: 0.0001)
  MultiSource/Applications/kimwitu++/kc: -4.30% (18.2933 => 17.5075, std.dev.: 0.0252)
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0003)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.18% (0.7982 => 0.7648, std.dev.: 0.0015)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.05% (4.5069 => 4.3243, std.dev.: 0.0357)
  SingleSource/Benchmarks/Misc-C++/bigfib: -4.00% (0.6750 => 0.6480, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.55% (2.2587 => 2.1785, std.dev.: 0.0007)
  MultiSource/Applications/hbd/hbd: -3.53% (1.5610 => 1.5059, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/constpool: -3.24% (20.7746 => 20.1021, std.dev.: 0.0174)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.64% (5.4682 => 5.3239, std.dev.: 0.0111)
  MultiSource/Applications/spiff/spiff: -2.07% (0.8418 => 0.8244, std.dev.: 0.0020)
  MultiSource/Applications/Burg/burg: -1.05% (1.2515 => 1.2383, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Dhrystone/fldry: -61.57% (1.8100 => 0.6955, std.dev.: 0.0086)
  SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226)
  SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1714, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -7.16% (1.0217 => 0.9485, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475)
  SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.88% (1.3096 => 1.2850, std.dev.: 0.0071)
  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.44% (6.5735 => 6.4788, std.dev.: 0.0089)
  MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4366, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001)

Added Tests - Compile Time
--------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/LivermoreLoops/kernel01
  SingleSource/Benchmarks/LivermoreLoops/kernel02
  SingleSource/Benchmarks/LivermoreLoops/kernel03
  SingleSource/Benchmarks/LivermoreLoops/kernel04
  SingleSource/Benchmarks/LivermoreLoops/kernel05
  SingleSource/Benchmarks/LivermoreLoops/kernel06
  SingleSource/Benchmarks/LivermoreLoops/kernel07
  SingleSource/Benchmarks/LivermoreLoops/kernel08
  SingleSource/Benchmarks/LivermoreLoops/kernel09
  SingleSource/Benchmarks/LivermoreLoops/kernel10
  SingleSource/Benchmarks/LivermoreLoops/kernel12
  SingleSource/Benchmarks/LivermoreLoops/kernel13
  SingleSource/Benchmarks/LivermoreLoops/kernel14
  SingleSource/Benchmarks/LivermoreLoops/kernel15
  SingleSource/Benchmarks/LivermoreLoops/kernel16
  SingleSource/Benchmarks/LivermoreLoops/kernel17
  SingleSource/Benchmarks/LivermoreLoops/kernel18
  SingleSource/Benchmarks/LivermoreLoops/kernel19
  SingleSource/Benchmarks/LivermoreLoops/kernel20
  SingleSource/Benchmarks/LivermoreLoops/kernel21
  SingleSource/Benchmarks/LivermoreLoops/kernel22
  SingleSource/Benchmarks/LivermoreLoops/kernel23
  SingleSource/Benchmarks/LivermoreLoops/kernel24
  SingleSource/UnitTests/Vectorizer/gcc-loops

Added Tests - Execution Time
----------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ALAC/encode/alacconvert-encode
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/LivermoreLoops/kernel01
  SingleSource/Benchmarks/LivermoreLoops/kernel02
  SingleSource/Benchmarks/LivermoreLoops/kernel03
  SingleSource/Benchmarks/LivermoreLoops/kernel04
  SingleSource/Benchmarks/LivermoreLoops/kernel05
  SingleSource/Benchmarks/LivermoreLoops/kernel06
  SingleSource/Benchmarks/LivermoreLoops/kernel07
  SingleSource/Benchmarks/LivermoreLoops/kernel08
  SingleSource/Benchmarks/LivermoreLoops/kernel09
  SingleSource/Benchmarks/LivermoreLoops/kernel10
  SingleSource/Benchmarks/LivermoreLoops/kernel12
  SingleSource/Benchmarks/LivermoreLoops/kernel13
  SingleSource/Benchmarks/LivermoreLoops/kernel14
  SingleSource/Benchmarks/LivermoreLoops/kernel15
  SingleSource/Benchmarks/LivermoreLoops/kernel16
  SingleSource/Benchmarks/LivermoreLoops/kernel17
  SingleSource/Benchmarks/LivermoreLoops/kernel18
  SingleSource/Benchmarks/LivermoreLoops/kernel19
  SingleSource/Benchmarks/LivermoreLoops/kernel20
  SingleSource/Benchmarks/LivermoreLoops/kernel21
  SingleSource/Benchmarks/LivermoreLoops/kernel22
  SingleSource/Benchmarks/LivermoreLoops/kernel23
  SingleSource/Benchmarks/LivermoreLoops/kernel24
  SingleSource/UnitTests/Vectorizer/gcc-loops

Report Time: 1.06s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20121213/0fb6428e/attachment.html>

[llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results

[llvm-testresults] lab-mini-01O3-plainclang_DEV__x86_64 test results