<div dir="ltr"><div dir="ltr"><div dir="ltr">Hi Bjoern,<div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">Not surprising I guess – but lately I’m much interested into MaterializationUnit and MaterializationResponsibility xD</blockquote><div><br></div><div>They're very central APIs. I'm happy to answer questions on them during the BoF, though we probably can't go in to great detail. Any discussion will help identify ways to improve the documentation though.</div><div><br></div><div>Alex Denisov has set up a JIT Compilers community page for the Virtual Dev Meeting: <a href="https://whova.com/portal/webapp/llvm_202010/CommunityBoard/topic/406390/">https://whova.com/portal/webapp/llvm_202010/CommunityBoard/topic/406390/</a> . I'll be checking that periodically for discussion (~10am to 6pm PDT).</div><div><br></div><div>Praveen has proposed a meet up for JIT clients during the coffee break tomorrow -- I'll be there for that if anyone wants to drop in. I'm also happy to schedule Zoom meetings for more detailed discussions for other topics. If anyone wants to propose one in the community page above -- I'll be free from 10am to 6pm PDT tomorrow and Thursday (outside the BoF itself).</div><div><br></div><div>-- Lang.</div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Oct 5, 2020 at 10:55 PM Gaier, Bjoern <<a href="mailto:Bjoern.Gaier@horiba.com">Bjoern.Gaier@horiba.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div lang="DE">
<div class="gmail-m_-7433254071944874550WordSection1">
<p class="MsoNormal"><span lang="EN-GB">Hey Lang,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB">Not surprising I guess – but lately I’m much interested into
</span><span lang="EN-GB" style="color:black">MaterializationUnit and MaterializationResponsibility xD<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black">Not only because I’m total stuck there again, but also because I wonder what is possible with it besides from what I failed to do.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black">I know that this might be to much for the BoF, but might be nice for the documentation.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black">Kind greetings<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="color:black">Björn</span><span lang="EN-GB"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-GB"><u></u> <u></u></span></p>
<div style="border-style:solid none none;border-top-width:1pt;border-top-color:rgb(225,225,225);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> Lang Hames <<a href="mailto:lhames@gmail.com" target="_blank">lhames@gmail.com</a>>
<br>
<b>Sent:</b> 06 October 2020 04:29<br>
<b>To:</b> Andres Freund <<a href="mailto:andres@anarazel.de" target="_blank">andres@anarazel.de</a>><br>
<b>Cc:</b> Praveen Velliengiri <<a href="mailto:praveenvelliengiri@gmail.com" target="_blank">praveenvelliengiri@gmail.com</a>>; LLVM Developers Mailing List <<a href="mailto:llvm-dev@lists.llvm.org" target="_blank">llvm-dev@lists.llvm.org</a>>; David Blaikie <<a href="mailto:dblaikie@gmail.com" target="_blank">dblaikie@gmail.com</a>>; Geoff Levner <<a href="mailto:glevner@gmail.com" target="_blank">glevner@gmail.com</a>>; Christian Schafmeister <<a href="mailto:meister@temple.edu" target="_blank">meister@temple.edu</a>>; Stefan Gränitz <<a href="mailto:stefan.graenitz@gmail.com" target="_blank">stefan.graenitz@gmail.com</a>>;
guangnan he <<a href="mailto:gnhe2009@gmail.com" target="_blank">gnhe2009@gmail.com</a>>; Jacob Lifshay <<a href="mailto:programmerjake@gmail.com" target="_blank">programmerjake@gmail.com</a>>; Gaier, Bjoern <<a href="mailto:Bjoern.Gaier@horiba.com" target="_blank">Bjoern.Gaier@horiba.com</a>>; Jared Wyles <<a href="mailto:jared.wyles@gmail.com" target="_blank">jared.wyles@gmail.com</a>>; Vivien Millet <<a href="mailto:vivien.millet@gmail.com" target="_blank">vivien.millet@gmail.com</a>>; Chris Bieneman <<a href="mailto:beanz@apple.com" target="_blank">beanz@apple.com</a>><br>
<b>Subject:</b> Re: LLVM Developers Meeting JIT BoF -- Request for Topics of Interest<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">Hi All,<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I've listed the current topics of interest below, along with some notes on each. We only have 30 minutes so we'll barely scratch the surface of these during the BoF itself. My main aims are for you to meet each other, identify potential
areas of collaboration, identify things that I can do to unblock you, and get the ball rolling on some conversations that we can continue on the mailing lists. It looks like we'll have an opportunity to set up impromptu meet-ups too (see <a href="https://www.youtube.com/watch?v=Qpbefagv6Ts" target="_blank">https://www.youtube.com/watch?v=Qpbefagv6Ts</a>)
so if you want to do a deeper dive on a topic area we can set one or more of those up -- just let me know in this thread.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Topics so far:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">A very brief status update on OrcV2 and JITLink.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Future / Potential use-cases for the JIT.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- LLDB, the Swift interpreter, REPLs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Compile time improvements<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Experimenting with / performance-testing custom JIT pipelines (any volunteers?)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Compile-time improvements for the existing pipeline. This is probably a broad community project, but JIT users might have interesting workloads / results to contribute.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Hiding compile times with concurrency.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Profiling, Debugging, PGO<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Profiling and Debugging support (especially via JITLink)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- How do we integrate PGO (any volunteers to experiment with this?)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Reoptimization<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- What it is.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Any volunteers to start working on API design and experiments?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Is resource management a problem (do we need to free unoptimized code) and if so how do we make it safe?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I'll add another of my own topics in here:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Documentation<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- What would make life better for Orc beginners?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- What would make life better for Orc experts?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- What would make it easier for you to contribute to Orc?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> -- Any volunteers to help with the documentation effort?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Looking forward to seeing you all on Thursday.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">-- Lang.<u></u><u></u></p>
</div>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Fri, Oct 2, 2020 at 11:21 AM Andres Freund <<a href="mailto:andres@anarazel.de" target="_blank">andres@anarazel.de</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Hi,<br>
<br>
On 2020-10-02 10:44:43 -0700, Lang Hames wrote:<br>
> Sounds good to me. I think there are two sub-topics here:<br>
> (1) JIT specifics. E.g. What default optimization pipelines should we<br>
> provide in the JIT? The standard 0/1/2/3/s options, or would it make sense<br>
> to develop something JIT specific?<br>
<br>
Yea. I've some hopes for "new PM" making it easier to have maintainable<br>
and customizable pipelines. I've not played around with it too much -<br>
largely because there's no C API last time I checked.<br>
<br>
<br>
<br>
> (2) General compile time improvements. Everyone will benefit from compile<br>
> time improvements, but JIT clients are likely to be extra sensitive to it.<br>
> Have we identified any problem areas or redundancies that would be of<br>
> interest to the broader LLVM community, and that we could solicit help in<br>
> fixing.<br>
<br>
I'd guess that some of the things that can be done to significantly<br>
improve JIT performance aren't generally applicable to most other uses<br>
of LLVM. E.g. the overhead of redoing the same analyses for code gen is<br>
mostly an issue on higher optimization levels, and I assume that a large<br>
portion of e.g. clang users using -O3 will do LTO. Where a split between<br>
optimization and code gen seems necessary in number of cases.<br>
<br>
<br>
> > Possibly also related to LLJIT design - having LLJIT first generate<br>
> > minimally optimized code and then, while that is in use, doing optimization<br>
> > and optimized codegen concurrently, would be neat. It feels like that'd<br>
> > fit well into LLJIT, given that it already provides things like<br>
> > background compile threads.<br>
> <br>
> <br>
> Absolutely. Supporting this use-case was one of the motivations for the<br>
> concurrency support in OrcV2. It's doable at the moment, but it requires a<br>
> fair bit of manual work on the client's part. Implementation and API design<br>
> in this area seem like good topics.<br>
<br>
Cool.<br>
<br>
Greetings,<br>
<br>
Andres Freund<u></u><u></u></p>
</blockquote>
</div>
</div>
Als GmbH eingetragen im Handelsregister Bad Homburg v.d.H. HRB 9816, USt.ID-Nr. DE 114 165 789 Geschäftsführer: Dr. Hiroshi Nakamura, Dr. Robert Plank, Markus Bode, Heiko Lampert, Takashi Nagano, Junichi Tajika, Ergin Cansiz.
</div>
</blockquote></div>