[LLVMdev] test-suite failures

[Eric Christopher]

On Nov 7, 2011, at 4:40 PM, reed kotler wrote:

> On 11/07/2011 02:29 PM, Eli Friedman wrote:
>> On Mon, Nov 7, 2011 at 2:11 PM, reed kotler<rkotler at mips.com>  wrote:
>>> We have a modified version of projects/test-suite that we can run cross
>>> using Qemu.
>>> 
>>> We would like to put that back so that other people can test MIPS
>>> before putting back.
>>> Well, this would be easily modifiable for ARM and other targets that are
>>> supported by QEMU.
>>> 
>>> But in this case, we would need to check in a version of QEMU and also
>>> the needed pieces of a MIPS tool chain for assembly, linking, etc.
>>> 
>>> Any thoughts on this?
>> If you need changes to RunSafely.sh etc. to tell the scripts to use
>> application-level emulation via qemu, in addition to the existing
>> options, that seems fine.  We aren't going to put QEMU or binutils
>> into the LLVM repository, though.  If you want to make sure people
>> don't break MIPS, I would suggest setting up a buildbot running the
>> test-suite continuously.
>> 
>> -Eli
> We have a build bot running nightly against LLVM tip of tree but when 
> they break something, how do they figure out what they did? They need to 
> be able to run what we ran.

It will be up to you to help them via a test case that they can look at and as much assistance as possible. This is what every other platform does.

-eric