<div dir="ltr">Change <a href="http://reviews.llvm.org/D12831">http://reviews.llvm.org/D12831</a> in review (waiting on Windows results for that) adds a test event stream that supports pluggable test event formatters. The first formatter I've added is JUnit/XUnit output. That's to support typical JUnit/XUnit output handling built into most commercial and open source CI solutions. But that eventing mechanism is intended to support quite a wider range of possible applications, including outputting to different formats, displaying test results as they occur in different viewers/controllers, etc.<div><br></div><div>-Todd</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 15, 2015 at 10:33 AM, Siva Chandra <span dir="ltr"><<a href="mailto:sivachandra@google.com" target="_blank">sivachandra@google.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span class="">On Tue, Sep 15, 2015 at 9:59 AM, Tamas Berghammer <span dir="ltr"><<a href="mailto:tberghammer@google.com" target="_blank">tberghammer@google.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div>I think downloading data with the json API won't help because it will only list the failures displayed on the Web UI what don't contain full test names and don't contain info about the UnexpectedSuccess-es. If you want to download it from the web interface then I am pretty sure we have to parse in the stdout of the test runner and change dotest in a way that it displays more information about the outcome of the different tests.</div></div></blockquote><div><br></div></span><div>I fully support making those changes to dotest. Also, it would be nice to actually have a stats cron running along with the master with a webui, something like this: <a href="https://build.chromium.org/p/chromium/stats" target="_blank">https://build.chromium.org/p/chromium/stats</a> and <a href="http://build.chromium.org/f/chromium/flakiness/" target="_blank">http://build.chromium.org/f/chromium/flakiness/</a>. Its a tall ask, but at the very least, we should have dotest.py put out machine readable output. This could be done on request (as in, when a certain flag is set).</div></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">-Todd</div></div>
</div>