[LLVMdev] LLVM 3.4.1 - Testing Phase

[Ben Pope]

On Sunday, April 13, 2014 12:31 AM, Sylvestre Ledru wrote:
> On 12/04/2014 00:02, Tom Stellard wrote:
>> Hi,
>>
>> I have just tagged the first release candidate for the
>> 3.4.1 release, so testers may begin testing.  Please refer to
>> http://llvm.org/docs/ReleaseProcess.html for information on how to
>> validate a release.  If you have any questions or need
>> something clarified, just email the list.
>>
>> For the 3.4.1 release we want to compare test results against 3.4-final.
>>
>> I have added support to the test-release.sh script for dot releases and
>> have done basic testing.  However, if you run into issues please send
>> an email to the list and we can try to get it worked out.
>>
>>
> The Debian & Ubuntu packages built from the 3.4.1 branches are working
> fine with tests:
> http://llvm.org/apt/
>
> (Sorry about the delay, I had a dead hard drive on one of my build systems).
>
> So, good work Tom!

I've failed a little bit on timing, and I will defer to Sylvestre for 
the builds, since they are nicely packaged.

Here are my results on Ubuntu Saucy, compared to my installed 3.4 (clang 
version 3.4 (tags/RELEASE_34/final)):

= Test Summary =
New Failures	2
Performance Regressions	198
Performance Improvements	79
Existing Failures	120
Unchanged Tests	593
Total Tests	992

All the failures are compile or execution time.

The new failures are compile/execution time for
MultiSource/Applications/sgefa/sgefa


If I compare it to my previous run of the 3.4 built using the 
test-release (clang version 3.4 (tags/RELEASE_34/final)):

= Tests Summary =
New Failures	122
New Passes	1
Performance Regressions	52
Performance Improvements	379
Added Tests	2
Unchanged Tests	436
Total Tests	992

The new pass is execution time for:
MultiSource/Benchmarks/Olden/voronoi/voronoi

I'm not sure why there are so many failures on compile and execution time.

Ben