[lldb-dev] Questions about the LLDB testsuite and improving its reliability

[Zachary Turner via lldb-dev]

On Wed, Jan 17, 2018 at 3:39 PM Adrian Prantl <aprantl at apple.com> wrote:

>
> On Jan 17, 2018, at 3:25 PM, Zachary Turner <zturner at google.com> wrote:
>
> I don't know what would be involved in getting the tests building out of
> tree with Make.  But I do know it would be simple with CMake.  I'm sure
> it's probably not terrible with Make either, I just don't know enough about
> it to say.
>
> One thing that I do like about CMake is that it can be integrated into the
> existing LLDB build configuration step, which already uses CMake, to build
> inferiors up front.  This has the potential to speed up the test suite by
> an order of magnitude.
>
>
> Since the tests in the LLDB testsuite are typically very small and don't
> import a lot of headers I'm not convinced that an incremental build of the
> tests will have a very big impact on the running time of the testsuite, but
> to be honest I also haven't benchmarked it to see where the time is really
> spent.
>

It actually is pretty significant.  Part of this is due to the fact that a
single .py file has multiple tests, and the compile happens for every one
of those tests, even though it just produces the exact same output every
time.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/lldb-dev/attachments/20180117/fc15f85f/attachment.html>