[llvm-testresults] lab-mini-02O3-vectorizeclang_DEV__x86_64 test results

Wed Jun 20 01:46:02 PDT 2012

http://llvm.org/perf/db_default/v4/nts/1288?compare_to=1285&baseline=1011
Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4
Comparing:
     Run: 1288, Order: 158796, Start Time: 2012-06-20 07:46:40, End Time: 2012-06-20 08:47:30
      To: 1285, Order: 158792, Start Time: 2012-06-20 06:16:39, End Time: 2012-06-20 07:19:24
Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 6 (41 on baseline)
Performance Improvements: 2 (11 on baseline)
Existing Failures: 21 (19 on baseline)
Unchanged Tests: 865 (821 on baseline)
Total Tests: 894

===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.27% (10.0452 => 10.4737, std. dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (2.1067 => 2.1348, std. dev.: 0.0044)
  MultiSource/Applications/hexxagon/hexxagon: 1.07% (1.3049 => 1.3188, std. dev.: 0.0003)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 27.92% (6.9063 => 8.8345, std. dev.: 0.0013)
  MultiSource/Benchmarks/Olden/power/power: 2.26% (1.1027 => 1.1276, std. dev.: 0.0000)
  SingleSource/Benchmarks/Misc/lowercase: 1.31% (7.9432 => 8.0471, std. dev.: 0.0196)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (5.2358 => 5.1823, std. dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/fbench: -1.42% (2.2997 => 2.2671, std. dev.: 0.0121)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

================================
Run-Over-Baseline Changes Detail
================================
New Failures - Compile Time
---------------------------
  MultiSource/Benchmarks/Bullet/bullet

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/Bullet/bullet

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/ObjC/trivial-interface: 8.15% (0.3473 => 0.3756, std. dev.: 0.0001)
  SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std. dev.: 0.0029)
  SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3543 => 0.3823, std. dev.: 0.0003)
  SingleSource/UnitTests/ObjC/exceptions-3: 7.88% (0.3516 => 0.3793, std. dev.: 0.0002)
  SingleSource/UnitTests/ObjC/synchronized: 7.86% (0.3561 => 0.3841, std. dev.: 0.0003)
  SingleSource/UnitTests/ObjC/for-in: 7.77% (0.3694 => 0.3981, std. dev.: 0.0001)
  SingleSource/UnitTests/ObjC/instance-method-metadata: 7.54% (0.3543 => 0.3810, std. dev.: 0.0011)
  SingleSource/UnitTests/ObjC/exceptions: 7.37% (0.3828 => 0.4110, std. dev.: 0.0004)
  SingleSource/UnitTests/ObjC/property: 7.13% (0.3886 => 0.4163, std. dev.: 0.0004)
  SingleSource/UnitTests/ObjC/parameter-passing: 7.10% (0.3927 => 0.4206, std. dev.: 0.0002)
  SingleSource/UnitTests/ObjC++/Hello: 4.25% (0.5925 => 0.6177, std. dev.: 0.0008)
  SingleSource/UnitTests/ObjC++/property-reference-object: 4.16% (0.6030 => 0.6281, std. dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/lists: 4.00% (0.3422 => 0.3559, std. dev.: 0.0030)
  SingleSource/Regression/C++/ofstream_ctor: 3.75% (0.2905 => 0.3014, std. dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3232 => 0.3348, std. dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/except: 3.52% (0.2871 => 0.2972, std. dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.4289 => 0.4438, std. dev.: 0.0019)
  SingleSource/UnitTests/ObjC++/property-reference: 3.41% (0.7326 => 0.7576, std. dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ary3: 3.41% (0.3283 => 0.3395, std. dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std. dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/wc: 3.31% (0.3052 => 0.3153, std. dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 3.31% (2.0665 => 2.1348, std. dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3603 => 0.3719, std. dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.16% (0.3162 => 0.3262, std. dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3379 => 0.3484, std. dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.82% (0.3684 => 0.3788, std. dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3865 => 0.3974, std. dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.74% (0.4203 => 0.4318, std. dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.4064 => 0.4174, std. dev.: 0.0004)
  MultiSource/Applications/hexxagon/hexxagon: 2.69% (1.2842 => 1.3188, std. dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.67% (0.4048 => 0.4156, std. dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.64% (0.8172 => 0.8388, std. dev.: 0.0084)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 2.37% (0.4636 => 0.4746, std. dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (0.4620 => 0.4728, std. dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6456 => 0.6576, std. dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (5.0018 => 5.0701, std. dev.: 0.0054)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.2646 => 4.3189, std. dev.: 0.0130)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.24% (4.9449 => 5.0062, std. dev.: 0.0107)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (10.3673 => 10.4737, std. dev.: 0.0014)
  MultiSource/Applications/JM/ldecod/ldecod: 1.01% (10.4361 => 10.5411, std. dev.: 0.0198)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lua/lua: 2.41% (26.0924 => 26.7216, std. dev.: 0.0400)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: -15.24% (0.8651 => 0.7333, std. dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.32% (5.2763 => 4.7845, std. dev.: 0.0019)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.35% (2.9384 => 2.6930, std. dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.74% (1.1194 => 1.0439, std. dev.: 0.0005)
  SingleSource/UnitTests/Vector/constpool: -4.95% (54.1659 => 51.4844, std. dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.28% (6.6874 => 6.4011, std. dev.: 0.0054)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.77% (5.3855 => 5.1823, std. dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.35% (5.3526 => 5.1734, std. dev.: 0.0020)
  MultiSource/Applications/ClamAV/clamscan: -2.16% (22.1758 => 21.6964, std. dev.: 0.0278)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.58% (2.2022 => 2.1674, std. dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.23% (1.7609 => 1.7393, std. dev.: 0.0020)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/stepanov_container

Report Time: 1.39s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120620/51958df9/attachment.html>

[llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results

[llvm-testresults] lab-mini-02O3-vectorizeclang_DEV__x86_64 test results