[llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results

[llvm-testresults at cs.uiuc.edu]

http://llvm.org/perf/db_default/v4/nts/1508?compare_to=1505&baseline=1011
Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4
Comparing:
     Run: 1508, Order: 159184, Start Time: 2012-06-26 04:47:17, End Time: 2012-06-26 05:48:04
      To: 1505, Order: 159179, Start Time: 2012-06-26 02:54:25, End Time: 2012-06-26 03:55:33
Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 4 (31 on baseline)
Performance Improvements: 7 (14 on baseline)
Existing Failures: 21 (19 on baseline)
Unchanged Tests: 862 (828 on baseline)
Total Tests: 894

===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: 3.33% (12.0929 => 12.4958, std. dev.: 0.0000)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (1.5102 => 1.5378, std. dev.: 0.0019)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.3024 => 2.3302, std. dev.: 0.0002)
  MultiSource/Applications/siod/siod: 1.20% (3.2523 => 3.2913, std. dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.89% (11.4866 => 11.0402, std. dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (5.3499 => 5.2600, std. dev.: 0.0039)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (8.2165 => 8.0801, std. dev.: 0.0262)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.25% (7.2971 => 7.2056, std. dev.: 0.0146)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: -9.31% (1.2293 => 1.1148, std. dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9412 => 18.5553, std. dev.: 0.0244)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (8.1422 => 7.9153, std. dev.: 0.0042)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

================================
Run-Over-Baseline Changes Detail
================================
New Failures - Compile Time
---------------------------
  MultiSource/Benchmarks/Bullet/bullet

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/Bullet/bullet

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ObjC/trivial-interface: 7.98% (0.3473 => 0.3750, std. dev.: 0.0027)
  SingleSource/UnitTests/ObjC/exceptions-2: 7.78% (0.3497 => 0.3769, std. dev.: 0.0003)
  SingleSource/UnitTests/ObjC/exceptions-3: 7.74% (0.3516 => 0.3788, std. dev.: 0.0002)
  SingleSource/UnitTests/ObjC/instance-method-metadata: 7.71% (0.3543 => 0.3816, std. dev.: 0.0013)
  SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3543 => 0.3815, std. dev.: 0.0004)
  SingleSource/UnitTests/ObjC/synchronized: 7.67% (0.3561 => 0.3834, std. dev.: 0.0004)
  SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3694 => 0.3969, std. dev.: 0.0004)
  SingleSource/UnitTests/ObjC/property: 7.21% (0.3886 => 0.4166, std. dev.: 0.0001)
  SingleSource/UnitTests/ObjC/parameter-passing: 7.13% (0.3927 => 0.4207, std. dev.: 0.0003)
  SingleSource/UnitTests/ObjC/exceptions: 7.11% (0.3828 => 0.4100, std. dev.: 0.0087)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.49% (10.3673 => 11.0402, std. dev.: 0.0091)
  MultiSource/Applications/JM/ldecod/ldecod: 4.49% (10.4361 => 10.9052, std. dev.: 0.0169)
  SingleSource/UnitTests/ObjC++/Hello: 3.85% (0.5925 => 0.6153, std. dev.: 0.0002)
  SingleSource/UnitTests/ObjC++/property-reference-object: 3.73% (0.6030 => 0.6255, std. dev.: 0.0003)
  MultiSource/Applications/JM/lencod/lencod: 3.61% (21.9371 => 22.7293, std. dev.: 0.0027)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.88% (0.7433 => 0.7647, std. dev.: 0.0013)
  SingleSource/UnitTests/ObjC++/property-reference: 2.87% (0.7326 => 0.7536, std. dev.: 0.0055)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.54% (0.4615 => 0.4732, std. dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.15% (7.0540 => 7.2056, std. dev.: 0.0146)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (2.2022 => 2.2367, std. dev.: 0.0005)
  MultiSource/Applications/spiff/spiff: 1.51% (0.7835 => 0.7953, std. dev.: 0.0043)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (7.9617 => 8.0801, std. dev.: 0.0262)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.9449 => 5.0116, std. dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.34% (8.1363 => 8.2457, std. dev.: 0.0102)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.34% (4.2646 => 4.3217, std. dev.: 0.0035)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (9.4845 => 9.6098, std. dev.: 0.0144)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.20% (5.0018 => 5.0619, std. dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.0665 => 2.0873, std. dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lua/lua: 2.87% (26.0924 => 26.8419, std. dev.: 0.0151)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.94% (1.5086 => 1.5378, std. dev.: 0.0019)
  SingleSource/Benchmarks/Dhrystone/dry: 1.46% (2.4116 => 2.4467, std. dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: -16.13% (0.8651 => 0.7256, std. dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.19% (5.2763 => 4.7913, std. dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.21% (2.9384 => 2.6972, std. dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.29% (1.1194 => 1.0490, std. dev.: 0.0010)
  SingleSource/UnitTests/Vector/constpool: -5.26% (54.1659 => 51.3190, std. dev.: 0.0114)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.05% (6.6874 => 6.4164, std. dev.: 0.0239)
  MultiSource/Applications/ClamAV/clamscan: -3.23% (22.1758 => 21.4606, std. dev.: 0.0315)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.73% (5.3526 => 5.2600, std. dev.: 0.0039)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (5.3855 => 5.2927, std. dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/chomp: -9.90% (1.2373 => 1.1148, std. dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5553, std. dev.: 0.0244)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (8.1563 => 7.9153, std. dev.: 0.0042)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -2.52% (32.5116 => 31.6913, std. dev.: 0.0019)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.09% (1.3677 => 1.3528, std. dev.: 0.0001)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Report Time: 1.40s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120626/74c54fca/attachment.html>