[LLVMdev] Testing documentation and terminology

[Tanya Lattner]

>
>
>> Currently, the first is called the "LLVM test suite" (which is the
>> subject of
>> the testing documentation). The second is called the DejaGNU tests,
>> code
>> fragment tests or llvm/test. The last one is the most confusing,
>> it's called
>> the whole program tests, test-suite (named after the svn directory
>> it is in,
>> easily confused with the entire test suite), llvm-test (named after
>> the
>> directory in which you should place it, easily confused with llvm/
>> test).
>
> llvm-test was the name of the CVS module.  When we moved to SVN, it
> got renamed to test-suite, which I consider to be very confusing.  We
> should probably recommend that people check it out into test-suite,
> and refer to it as that.  Alternatively, change the svn module name to
> something more useful.
>

I think at one time we did try to allow people to check it out as  
test-suite, but there is something in the Makefiles that require it  
to be llvm-test (I don't know exactly what though). So this is  
something that needs to be fixed. It would be great to get it fixed.

-Tanya


>> Furthermore, I would no longer refer to all of llvm's testing stuff
>> as the
>> "LLVM test suite", but use the term "LLVM test architecture" or
>> "framework" or
>> something similar (suggestions?).
>
> LLVM testing infrastructure?
>
>> Since the testing stuff is composed of two
>> distinct parts, I'm not sure the term "suite" is appropriate here.
>> If people
>> think that "test suite" is still very much appropriate here, I think
>> that
>> renaming the "test-suite" svn module would be in order.
>
> Right.  It is somewhat complicated by the fact that "llvm-test" is
> really just a collection of programs with some makefile drivers.  How
> about calling it "program-tests" or "llvm-program-tests" or something
> like that?
>
>> Lastly, I would refer to the "whole program tests" as the "Test
>> suite", since
>> it is a suite of testing programs that can be run as a whole. This
>> will also
>> make sure that the name properly matches the svn module that the
>> "whole
>> program tests" are housing in.
>
> Yeah, we definitely need a better name :)
>
>> After these changes, I think the testing framework should be a lot
>> easier to
>> describe and document and more accessible to new users.
>
> Sounds great to me,
>
> -Chris
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20080523/ec693d20/attachment.html>