[LLVMdev] Proposal for improving the llvm nightly tester

[Tanya M. Lattner]

> 1.  Improvements to the perl script which manage actual testing
> (./util/NewNightlyTest.pl)
>     (a).  compiling llvm-gcc
>     (b).  allowing someone to use an existing tree versus checking out a
> new one
> 2.  The improvements to the email that get sent to the llvm-testresults
>      (a). finding a point in time where some test failed
>      (b). comparing two different sets of test results that aren't just 2
> days apart
>  here if you have any suggestions which help someone analysis test results
> would be grateful.

I think you need to expand on this. Basically, these would be improvements 
to how the data is displayed and analyzed. The second part is making the 
emails that get sent out better. They are separate things.

You should come up with ideas on your own about how someone might want to 
interpret the data and allow that flexibility via the web pages.

> 3. Running llvm testsuite for all targets, target variants and operating
> systems(using an simulator for hardware which is not available) ex:gcc
> project's compile farm [2]

How will you test this?

> 4. Running Fortran,  Ada, C/C++/ObjC tests as well with test results emailed
> to the llvm-testresults.

Are these different or new tests? Why wouldn't they just be a part of the 
llvm-test module? Then you don't have to do any modifications to the 
scripts.

-Tanya


> Most of the server side and the database design has already done by
> "tonic"(IRC nickname at #llvm), so suggestions regarding others would be
> important, so that we have a fully featured nightly tester .And finally all
> the php scripts need to be updated according to the required new features.
> Thanks in advance. Please add your comments.!
> Regards,
> -Rajika
>
> [1] - http://llvm.org/nightlytest/
> [2] - http://gcc.gnu.org/wiki/CompileFarm
>
>