<div dir="ltr">use_clang() already will fall back on searching the environment variable 'CLANG' to find a path to it.<div><br></div><div><div> self.config.clang = self.use_llvm_tool(</div><div> 'clang', search_env='CLANG', required=required)</div></div><div><br></div><div>But we could make this environment variable a parameter to use_clang() if we wanted to. As long as we can agree that we don't need to worry about gcc -- at least for now -- then it should all simplify down quite a bit. And AFAICT, there's nobody using gcc with the lit tests right now, so it just adds unnecessary complexity. And if and when we do have people using it, there is even more work to be done. </div><div><br></div><div>If someone only wants a clang that isn't the just-built clang (for example a release version to make sure the tests run faster), all they need to do is set the environment variable 'CLANG' and it should be fine. <br></div><div><br></div><div>Since the lit suite is still very new and developing, I'm not too concerned about regressing a feature (especially one with zero users), because the important thing to me is that it's designed right so that the feature can grow in organically and not be "forced" in with a subpar implementation.</div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Nov 13, 2018 at 4:23 PM Stella Stamenova <<a href="mailto:stilis@microsoft.com">stilis@microsoft.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_-7755242525583096278WordSection1">
<p class="MsoNormal">The plan for the lit tests sounds reasonable to me. I would also remove LLDB_TEST_C/CXX_COMPILER entirely so that we can reduce confusion since they’re only used for the lit tests, right?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">My only concern is that I’ve been told that there are people who will build lldb with a different compiler than the tests – so the properties for LLDB_TEST_C/CXX_COMPILER might actually be used especially in cases where clang is not built
alongside lldb.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal">-Stella<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>From:</b> Zachary Turner <<a href="mailto:zturner@google.com" target="_blank">zturner@google.com</a>> <br>
<b>Sent:</b> Tuesday, November 13, 2018 4:16 PM</p></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_-7755242525583096278WordSection1"><p class="MsoNormal"><br>
<b>To:</b> Stella Stamenova <<a href="mailto:stilis@microsoft.com" target="_blank">stilis@microsoft.com</a>><br>
<b>Cc:</b> <a href="mailto:reviews%2BD54009%2Bpublic%2B0e164460da8f1d7f@reviews.llvm.org" target="_blank">reviews+D54009+public+0e164460da8f1d7f@reviews.llvm.org</a>; <a href="mailto:pavel@labath.sk" target="_blank">pavel@labath.sk</a>; <a href="mailto:chris.bieneman@me.com" target="_blank">chris.bieneman@me.com</a>; <a href="mailto:dccitaliano@gmail.com" target="_blank">dccitaliano@gmail.com</a>; <a href="mailto:aleksandr.urakov@jetbrains.com" target="_blank">aleksandr.urakov@jetbrains.com</a>; <a href="mailto:jdevlieghere@apple.com" target="_blank">jdevlieghere@apple.com</a>; <a href="mailto:abidh.haq@gmail.com" target="_blank">abidh.haq@gmail.com</a>; <a href="mailto:teemperor@gmail.com" target="_blank">teemperor@gmail.com</a>; <a href="mailto:ki.stfu@gmail.com" target="_blank">ki.stfu@gmail.com</a>; <a href="mailto:mgorny@gentoo.org" target="_blank">mgorny@gentoo.org</a>;
<a href="mailto:dan@su-root.co.uk" target="_blank">dan@su-root.co.uk</a>; <a href="mailto:jfbastien@apple.com" target="_blank">jfbastien@apple.com</a>; <a href="mailto:lldb-commits@lists.llvm.org" target="_blank">lldb-commits@lists.llvm.org</a>; <a href="mailto:llvm@inglorion.net" target="_blank">llvm@inglorion.net</a><br>
<b>Subject:</b> Re: [PATCH] D54009: Refactor LLDB lit configuration files<u></u><u></u></p></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_-7755242525583096278WordSection1"><p class="MsoNormal"></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Ok so for dotest, it seems to be ignoring the config.cc and config.cxx entirely. So we can theoretically do whatever we want with it, or change around the directory structure so that it's more like:<u></u><u></u></p></div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_-7755242525583096278WordSection1"><div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">lldb<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">* lit<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">* * Dotest<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">* * Unit<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">* * Tests<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">and put the config.cc / config.cxx logic under Tests. That's a large change though and probably not worth making such a large change right away.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">dotest tests manually construct the command line directly in CMake via this `LLDB_DOTEST_ARGS_PROPERTY` global property, and then in lldb/lit/Suite/lit.cfg we have this line:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">dotest_cmd = [config.dotest_path, '-q']<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">dotest_cmd.extend(config.dotest_args_str.split(';'))<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">So pretty much everythign the parent lit file has done is totally ignored. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">With that in mind, **for the lit tests only** I propose dropping support for non-clang compilers and ignoring LLDB_TEST_C_COMPILER and LLDB_TEST_CXX_COMPILER (you can still have a custom path to clang executable via an environment variable,
which is consistent with how clang's test suite works).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Note that when you run ninja check-lldb-lit you will now get messages that tell you the exact path to the clang executable, so you can see what the PATH resolution is doing.<u></u><u></u></p>
</div>
</div></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_-7755242525583096278WordSection1">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Tue, Nov 13, 2018 at 4:02 PM Zachary Turner <<a href="mailto:zturner@google.com" target="_blank">zturner@google.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<p class="MsoNormal">On Tue, Nov 13, 2018 at 3:47 PM Stella Stamenova <<a href="mailto:stilis@microsoft.com" target="_blank">stilis@microsoft.com</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">I am not sure if that’s the right solution for a couple of reasons:
<u></u><u></u></p>
<ol start="1" type="1">
<li class="m_-7755242525583096278m-1817337732708028278m8143167336583448376msolistparagraph">
As far as I can tell only clang calls use_clang (and only lld calls use_lld), while the other projects such as lld and llvm rely on the environment to be setup correctly<u></u><u></u></li><li class="m_-7755242525583096278m-1817337732708028278m8143167336583448376msolistparagraph">
Lld also has tests that invoke clang-cl and they pass – while the ones in LLDB do not, so the invocation of use_clang is not necessary for the tests to pass (maybe?)<u></u><u></u></li><li class="m_-7755242525583096278m-1817337732708028278m8143167336583448376msolistparagraph">
LLDB allows us to specify whether to use gcc or clang as well as the path and it can also have a test compiler specified via LLDB_USE_TEST_*_COMPILER, so we should first decide what scenarios we want to support before trying to make this work and possibly making
it even more confusing and complicated<u></u><u></u></li></ol>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Do you know what the answer for 3) is? What compilers are valid to specify for the lit/suite/unittests via the various parameters?<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal">For the unit tests, I don't think we ever specify a compiler, or we don't ever read the value. Because a unit test shouldn't be compiling anything, it's a different kind of test.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">For the dotest suite, specifying the compiler is important and it can definitely be gcc, but I don't think this uses the same method of going through config.cc. In fact, I'm not sure how it determines what compiler to use at the moment,
as it's been a number of years since I've looked at the dotest suite.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">For the lit tests, I'm inclined to say we should keep things simple and only support clang for now, and add support for new compilers such as gcc if and when someone actually wants it. Otherwise YAGNI.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Definitely that time will come, but it doesn't make sense to support it immediately if nobody is using it today and nobody is planning to enable it immediately.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">So I'm tempted to say that perhaps we should just call llvm_config.use_clang() and llvm_config.use_lld() and ignore LLDB_TEST_COMPILER, which in my experience has only been a source of unnecessary complexity that never actually gets used
in practice.<u></u><u></u></p>
</div>
</div>
</div>
</blockquote>
</div>
</div></div></blockquote></div>