<div dir="ltr"><div dir="ltr">On Wed, 9 Dec 2020 at 17:06, Romero, Nichols A. <<a href="mailto:naromero@anl.gov">naromero@anl.gov</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">





<div lang="EN-US" style="overflow-wrap: break-word;">
<div class="gmail-m_2636035252166876079WordSection1">
<p class="MsoNormal">Yes, I am working on identifying some OSS applications and benchmarks.<br></p></div></div></blockquote><div><br></div><div>Awesome!</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US" style="overflow-wrap: break-word;"><div class="gmail-m_2636035252166876079WordSection1"><div><div><div><p class="MsoNormal">Are they in some public dashboard like this one? <a href="http://lab.llvm.org:8011/#/console" target="_blank">
http://lab.llvm.org:8011/#/console</a></p></div></div></div></div></div></blockquote><div><br></div><div>Yes, though it's not really obvious (or even easy) to find that out. :(</div><div><br></div><div>You can look at the configuration file:</div><div><a href="https://github.com/llvm/llvm-zorg/blob/master/buildbot/osuosl/master/config/builders.py">https://github.com/llvm/llvm-zorg/blob/master/buildbot/osuosl/master/config/builders.py</a><br></div><div><br></div><div>If the builder is using `ClangBuilder`, just check the ones that have the option: `<span class="gmail-pl-s1" style="box-sizing:border-box;color:rgb(36,41,46);font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">runTestSuite</span><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">=</span><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">True`</span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre"><br></span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">I can see Arm, AArch64, PPC, IBM-Z, X86.</span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre"><br></span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">The ones with `testsuite_flags=['</span><span style="color:rgb(3,47,98);font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">--benchmarking-only']` will be running in benchmark mode and submitting the results to the LNT server.</span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre"><br></span></div><div><span class="gmail-pl-c1" style="box-sizing:border-box;font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,monospace;font-size:12px;white-space:pre">Other builder types may be doing it, but I don't know about those.</span></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US" style="overflow-wrap: break-word;"><div class="gmail-m_2636035252166876079WordSection1"><div><div><div><p class="MsoNormal"><u></u><u></u></p>
<p class="MsoNormal">The goal is to have an analogous set-up to what is done now for C/C++. I am just getting up to speed now on it.<br></p></div></div></div></div></div></blockquote><div><br></div><div>I want to make sure I'm not trying to push you, just giving you the runes that aren't obvious when you first start working on it.</div><div><br></div><div>We have a number of people (including me, many times) excited to add tests or infrastructure to the test-suite only to give up half-way because of the mess it is.</div><div><br></div><div>Folks really did a good number on it in the past few years (CMake support, statistical analysis, benchmark mode), so it's probably a lot easier now than when I had to work on it.</div><div><br></div><div>Good luck and thanks for taking on such a thankless task. :)</div><div><br></div><div>cheers,</div><div>--renato</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US" style="overflow-wrap: break-word;"><div class="gmail-m_2636035252166876079WordSection1"><div><div><div>
</div>
</div>
</div>
</div>
</div>

</blockquote></div></div>