<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <br>
    <div class="moz-cite-prefix">On 07/09/2018 01:53 PM, Matthias Braun
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:7F4E29E2-6025-4CE0-9728-B93F62063AC4@apple.com">
      <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
      <div class="">I personally was hoping that maybe when we move to
        github and have to reorganize the repositories anyway, we can
        split out "ABI-Testsuite" and "ClangAnalyzer" from the
        llvm-testsuite repository, given that they pretty orthogonal to
        the rest.</div>
    </blockquote>
    <br>
    Sounds good to me.<br>
    <br>
    <blockquote type="cite"
      cite="mid:7F4E29E2-6025-4CE0-9728-B93F62063AC4@apple.com">
      <div class=""><br class="">
      </div>
      <div class=""><br class="">
      </div>
      Judging from builder names we one ABI-Testuite builder: <a
        href="http://lab.llvm.org:8011/builders/clang-x86_64-linux-abi-test"
        class="" moz-do-not-send="true">http://lab.llvm.org:8011/builders/clang-x86_64-linux-abi-test</a></blockquote>
    <br>
    Should we, in principle, have these for other architectures?<br>
    <br>
    <blockquote type="cite"
      cite="mid:7F4E29E2-6025-4CE0-9728-B93F62063AC4@apple.com">
      <div class="">(and BTW: I am very happy that we have it!)</div>
    </blockquote>
    <br>
    (Certainly +1 to that).<br>
    <br>
    <blockquote type="cite"
      cite="mid:7F4E29E2-6025-4CE0-9728-B93F62063AC4@apple.com">
      <div class=""><br class="">
      </div>
      <div class="">- Matthias</div>
      <div class="">
        <div class="">
          <div class="">
            <div><br class="">
              <blockquote type="cite" class="">
                <div class="">On Jul 9, 2018, at 10:48 AM, Hal Finkel
                  <<a href="mailto:hfinkel@anl.gov" class=""
                    moz-do-not-send="true">hfinkel@anl.gov</a>>
                  wrote:</div>
                <br class="Apple-interchange-newline">
                <div class=""><br style="caret-color: rgb(0, 0, 0);
                    font-family: Helvetica; font-size: 12px; font-style:
                    normal; font-variant-caps: normal; font-weight:
                    normal; letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">On 07/09/2018 12:32 PM, Matthias Braun via
                    llvm-dev wrote:</span><br style="caret-color: rgb(0,
                    0, 0); font-family: Helvetica; font-size: 12px;
                    font-style: normal; font-variant-caps: normal;
                    font-weight: normal; letter-spacing: normal;
                    text-align: start; text-indent: 0px; text-transform:
                    none; white-space: normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <blockquote type="cite" style="font-family: Helvetica;
                    font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; orphans: auto; text-align:
                    start; text-indent: 0px; text-transform: none;
                    white-space: normal; widows: auto; word-spacing:
                    0px; -webkit-text-size-adjust: auto;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">If this is mainly about size then I
                    would rather propose to split the "ABI-Testsuite"
                    folder into a separate repository. With 1.5G it
                    takes up more space than the rest of the repository
                    combined yet it is coneptually independent of the
                    rest of the testsuite and most people are not
                    running it.<br class="">
                  </blockquote>
                  <br style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">I think is a good idea regardless.</span><br
                    style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <br style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">Actually, do we have any buildbots running
                    the ABI testsuite?</span><br style="caret-color:
                    rgb(0, 0, 0); font-family: Helvetica; font-size:
                    12px; font-style: normal; font-variant-caps: normal;
                    font-weight: normal; letter-spacing: normal;
                    text-align: start; text-indent: 0px; text-transform:
                    none; white-space: normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <br style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class=""> -Hal</span><br style="caret-color: rgb(0,
                    0, 0); font-family: Helvetica; font-size: 12px;
                    font-style: normal; font-variant-caps: normal;
                    font-weight: normal; letter-spacing: normal;
                    text-align: start; text-indent: 0px; text-transform:
                    none; white-space: normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <br style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <blockquote type="cite" style="font-family: Helvetica;
                    font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; orphans: auto; text-align:
                    start; text-indent: 0px; text-transform: none;
                    white-space: normal; widows: auto; word-spacing:
                    0px; -webkit-text-size-adjust: auto;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class=""><br class="">
                    - Matthias<br class="">
                    <br class="">
                    <blockquote type="cite" class="">On Jul 9, 2018, at
                      9:11 AM, Michael Kruse via llvm-dev <<a
                        href="mailto:llvm-dev@lists.llvm.org" class=""
                        moz-do-not-send="true">llvm-dev@lists.llvm.org</a>>
                      wrote:<br class="">
                      <br class="">
                      If I understand correctly, you wish to put the the
                      test-suite<br class="">
                      framework (cmake/, litsupport/, litsupport-tests/,
                      tools/, utils/)<br class="">
                      into a different repository than the test sources
                      (MultiSource/,<br class="">
                      SingleSource, etc)?<br class="">
                      <br class="">
                      Conceptually, the test framework (llvm-lit) is
                      already separated,<br class="">
                      living in the main LLVM repository. The build
                      instructions (cmake<br class="">
                      files) are hard to separate from the source files
                      to compile.<br class="">
                      <br class="">
                      I don't find that the External/ part works well.
                      It was created for<br class="">
                      licensing reasons, for proprietary source that
                      cannot be included in<br class="">
                      the repository. I have yet to successfully make
                      any non-SPEC program<br class="">
                      work. For instance, I cannot find the source of
                      Povray that works with<br class="">
                      test-suite's makefile/CMakeLists.txt<br class="">
                      <br class="">
                      Michael<br class="">
                      <br class="">
                      <br class="">
                      <br class="">
                      <br class="">
                      2018-07-09 2:26 GMT-05:00 Elena Lepilkina via
                      llvm-dev<br class="">
                      <<a href="mailto:llvm-dev@lists.llvm.org"
                        class="" moz-do-not-send="true">llvm-dev@lists.llvm.org</a>>:<br
                        class="">
                      <blockquote type="cite" class="">Dear community,<br
                          class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        LLVM test-suite includes both default
                        applications (benchmarks, tests) and<br class="">
                        test harness (CMake modules, lit-support, some
                        scripts, etc.). Test suite<br class="">
                        provides extension interface to add “external”
                        tests suite and folders. This<br class="">
                        worked well, we enhanced basic harness and
                        integrated large set of internal<br class="">
                        benchmarks and applications.<br class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        However, we have users interested in LLVM test
                        harness to build, profile,<br class="">
                        test applications and experiment with
                        tools/compilers without using<br class="">
                        applications from full LLVM test-suite (~2,5
                        Gb).<br class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        Are there reasons why separation of test-suite
                        into 1) basic test-harness<br class="">
                        and 2) applications is undesirable or
                        impossible?<br class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        We will be glad to hear opinions of community.<br
                          class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        Best regards,<br class="">
                        <br class="">
                        Elena Lepilkina,<br class="">
                        <br class="">
                        Synopsys Corp, ARC processors<br class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        <br class="">
                        _______________________________________________<br
                          class="">
                        LLVM Developers mailing list<br class="">
                        <a href="mailto:llvm-dev@lists.llvm.org"
                          class="" moz-do-not-send="true">llvm-dev@lists.llvm.org</a><br
                          class="">
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br class="">
                        <br class="">
                      </blockquote>
                      _______________________________________________<br
                        class="">
                      LLVM Developers mailing list<br class="">
                      <a href="mailto:llvm-dev@lists.llvm.org" class=""
                        moz-do-not-send="true">llvm-dev@lists.llvm.org</a><br
                        class="">
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br class="">
                    </blockquote>
                    _______________________________________________<br
                      class="">
                    LLVM Developers mailing list<br class="">
                    <a href="mailto:llvm-dev@lists.llvm.org" class=""
                      moz-do-not-send="true">llvm-dev@lists.llvm.org</a><br
                      class="">
<a class="moz-txt-link-freetext" href="http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev">http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev</a><br class="">
                  </blockquote>
                  <br style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">--<span class="Apple-converted-space"> </span></span><br
                    style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">Hal Finkel</span><br style="caret-color:
                    rgb(0, 0, 0); font-family: Helvetica; font-size:
                    12px; font-style: normal; font-variant-caps: normal;
                    font-weight: normal; letter-spacing: normal;
                    text-align: start; text-indent: 0px; text-transform:
                    none; white-space: normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">Lead, Compiler Technology and Programming
                    Languages</span><br style="caret-color: rgb(0, 0,
                    0); font-family: Helvetica; font-size: 12px;
                    font-style: normal; font-variant-caps: normal;
                    font-weight: normal; letter-spacing: normal;
                    text-align: start; text-indent: 0px; text-transform:
                    none; white-space: normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">Leadership Computing Facility</span><br
                    style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none;" class="">
                  <span style="caret-color: rgb(0, 0, 0); font-family:
                    Helvetica; font-size: 12px; font-style: normal;
                    font-variant-caps: normal; font-weight: normal;
                    letter-spacing: normal; text-align: start;
                    text-indent: 0px; text-transform: none; white-space:
                    normal; word-spacing: 0px;
                    -webkit-text-stroke-width: 0px; text-decoration:
                    none; float: none; display: inline !important;"
                    class="">Argonne National Laboratory</span></div>
              </blockquote>
            </div>
            <br class="">
          </div>
        </div>
      </div>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Hal Finkel
Lead, Compiler Technology and Programming Languages
Leadership Computing Facility
Argonne National Laboratory</pre>
  </body>
</html>