[PATCH] D29030: [LNT] Add cross-compilation support to 'lnt runtest test-suite'

Wed Jan 25 11:13:47 PST 2017

I did a half-hearted attempt here: https://reviews.llvm.org/D19949 <https://reviews.llvm.org/D19949>

The main blocker here IMO is that we want some meta information about a build in LNT (compiler version used, hostname of the machine, ...) which the testsuite currently doesn't produce by itself. I see 3 solutions for that:
- We could change the test-suite cmake file to write this information to a separate file
- We could modify lit to produce the metainformation in the output (that functionality feels out of place in lit IMO), or possibly pass the information along from a file produced by cmake
- We could continue using a client side lnt tool that collects the information as part of the submission process.

- Matthias

> On Jan 25, 2017, at 10:59 AM, Chris Matthews via llvm-commits <llvm-commits at lists.llvm.org> wrote:
> 
> I agree that dropping all the client side tools would be (REALLY) nice.  The proxied test-suite approach adds conceptual and implementation complexity.
> 
> lnt runtest test-suite is still doing a lot, it is not by any means a thin wrapper.  I’d love to see a concrete proposal how we can migrate that into the test suite.
> 
> Also at the same time, I think the test-suite would start to need its own testing.
> On January 25, 2017 at 1:40:03 AM, Kristof Beyls via Phabricator (reviews at reviews.llvm.org <mailto:reviews at reviews.llvm.org>) wrote:
> 
>> kristof.beyls marked an inline comment as done. 
>> kristof.beyls added a comment. 
>> 
>> 
>> 
>> >>> As for the rest of the commit: Using a toolchain file looks like just passing a -D flag which is already supported. As for picking up the compiler, couldn't you simply extract that from CMakeCache.txt? And if that doesn't work, shouldn't we rather upstream the changes to CMakeLists.txt that print the compiler instead of having LNT mess around with them? 
>> >>  
>> >> I'm trying to eliminate as many not-needed command line options as possible, e.g. --llvm-arch, --cross-compiling, ... . There are already more than enough command line options to lnt runtest, reducing the amount of them probably would make it simpler to use. 
>> >> Indeed, just using a -D flag to enable cross-compiling instead of having a separate lnt runtest command line option for it would be preferable (and then documenting how to use it to do cross-compiling). 
>> >> But then, doesn't the same argument apply to dropping lnt runtest -cflags or lnt runtest -cppflags: they also both could be set using -D? 
>> >> Anyway, let's not go there as part of this patch; I'll first look into whether I can eliminate the need for opts.cc and opts.cxx also for the non-cross-compiling case. In that case, I indeed no longer see the need for a separate option so that lnt is aware we're cross-compiling, and instead we can just use -D. 
>> >  
>> > My argument would be to drop the whole "lnt runtest" mode and let users do the cmake/ninja/lit sequence themselfes and teach "lnt submit" to just submit the results. That way you are never limited by missing or confusing options in lnt runtest, have one layer less to debug and we have one thing less to maintain and keep up to date. Though we may need to write more documentation about the cmake/lit test-suite. 
>> 
>> Interesting idea, I like it! When I explain others (non-LLVM-developers) about what lnt is, the first thing I explain is that it is both a tool to run the LLVM test-suite (which mostly isn't interesting to the non-LLVM-developers) and a server/database/analysis engine to keep track of code generation quality of a code generator (which is interesting to non-LLVM code generator developers). At least from this point of view, it'd be nice if lnt was "one thing" rather than "two things". 
>> Maybe 'lnt submit' could also be dropped, and users could upload the produced json after a lit run using e.g. curl? On one hand, submitting jsons to the server could be classified as being part of the "server/database/analysis engine" functionality. OTOH, it might remove the need for lnt on the client/test machine side completely? 
>> 
>> 
>> https://reviews.llvm.org/D29030 
>> 
>> 
>> 
> _______________________________________________
> llvm-commits mailing list
> llvm-commits at lists.llvm.org <mailto:llvm-commits at lists.llvm.org>
> http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits <http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-commits>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20170125/9246ccdf/attachment.html>