<div dir="ltr">Just some relatively quick thoughts, since I am still on vacation. +Luis from ChromeOS toolchain.<br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 12, 2016 at 7:56 AM, Kristof Beyls <span dir="ltr"><<a href="mailto:Kristof.Beyls@arm.com" target="_blank" class="cremed">Kristof.Beyls@arm.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">



<div style="word-wrap:break-word">
FWIW, for our ARM Compiler product, we follow top-of-trunk, not the releases.
<div>Next to picking up new functionality quicker, it also allows us to detect regressions</div>
<div>in LLVM against our in-house testing quickly, not 6 months later. We find that when</div>
<div>we find a regression within 24 to 48 hours of the commit introducing it, it's much</div>
<div>cheaper to get it fixed.</div>
<div><br>
</div>
<div>In my opinion, it would be better overall for the LLVM project if top-of-trunk is</div>
<div>tested as much as possible, if testing resources are so scarce that a choice</div>
<div>has to be made between testing top-of-trunk or testing a release branch.</div></div></blockquote><div><br></div><div>I am 100% in agreement here. TOT regressions cost more than people think. I have seen firsthand how this hurts the non-LLVM parts of Android. In Android, more testing resources are devoted to release branches, and thus the development branch picks up bizarre regressions that are harder to track down and fix than they should be. Since I don't update the compiler in the release branch (at least not without good reason), this means that compiler regressions are harder for me to track down, because nobody pays attention to dev results until it is hurting them in the next release. :( I have some ideas to make this better in the future, but nothing to share just yet.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">
<div><br>
</div>
<div>Thanks,</div>
<div><br>
</div>
<div>Kristof</div><div><div>
<div><br>
</div>
<div>
<blockquote type="cite">
<div>On 12 May 2016, at 02:10, Robinson, Paul <<a href="mailto:paul.robinson@sony.com" target="_blank" class="cremed">paul.robinson@sony.com</a>> wrote:</div>
<br>
<div>
<div>
<blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
-----Original Message-----<br>
From: Renato Golin [<a href="mailto:renato.golin@linaro.org" target="_blank" class="cremed">mailto:renato.golin@linaro.org</a>]<br>
Sent: Wednesday, May 11, 2016 11:11 AM<br>
To: Hans Wennborg<br>
Cc: LLVM Dev; Clang Dev; Quentin Colombet; Tom Stellard; Robinson, Paul;<br>
Jim Grosbach; Kristof Beyls; Frédéric Richez; Reid Kleckner; Philip<br>
Reames; Matthias Braun; Bernhard Rosenkränzer; Sylvestre Ledru; Matthias<br>
Klose; Stephen Hines; Jeff Law; Ed Maste; Behan Webster<br>
Subject: Re: LLVM Releases: Upstream vs. Downstream / Distros<br>
<br>
On 11 May 2016 at 17:16, Hans Wennborg <<a href="mailto:hans@chromium.org" target="_blank" class="cremed">hans@chromium.org</a>> wrote:<br>
<blockquote type="cite">This is a long email :-) I've made some comments inline, but I'll<br>
summarize my thoughts here:<br>
</blockquote>
<br>
Thanks Hans!<br>
<br>
I'll respond them inline, below.<br>
<br>
<br>
<blockquote type="cite">- I think we should use the bug tracker to capture issues that affect<br>
releases. It would be cool if a commit hook could update bugzilla<br>
entries that refer to it.<br>
</blockquote>
<br>
That seems like a simple hook.<br>
<br>
<br>
<blockquote type="cite">At least for the major releases, I think we're doing pretty well on<br>
timing in terms of predictability: since 3.6, we have release every<br>
six months: first week of March and first week of September (+- a few<br>
days). Branching has been similarly predictive: mid-January and<br>
mid-July.<br>
</blockquote>
<br>
Indeed, we got a lot better more recently (last 2y), and mostly thanks<br>
to you. :)<br>
</blockquote>
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">Absolutely.
  It's enough of a track record to allow reasonable planning.</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br>
We used to vary 3 months +-, and now we're down to a few days.<br>
Whatever we decide, I think we should make it official but putting it<br>
out somewhere, so people can rely on that.<br>
</blockquote>
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">A
 public commitment to the future release schedule would be that much</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">more
 justification for planning to participate.</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br>
Right now, even if you're extra awesome, there's nothing telling the<br>
distros and LLVM-based products that it will be so if someone else<br>
takes over the responsibility, so they can't adapt.<br>
<br>
That's what I meant by "quasi-chaotic".<br>
<br>
<br>
<blockquote type="cite">If there are many downstream releases for which shifting this schedule<br>
would be useful, I suppose we could do that, but it seems unlikely<br>
that there would be agreement on this, and changing the schedule is<br>
disruptive for those who depend on it.<br>
</blockquote>
<br>
That's the catch. If we want them to participate, the process has to<br>
have some meaning to them. The fact that not many people do, is clear<br>
to me what it means.<br>
<br>
We also need to know better how many other releases already depend on<br>
the upstream process (not just Chromium, for obvious reasons), to be<br>
able to do an informed choice of dates and frequency.<br>
<br>
The more well positioned and frequent we are, the more people will<br>
help, but there's a point where the curve bends down, and the cost is<br>
just too great. We need to find the inflection point, and that will<br>
require some initial investigations and guesses, and a lot of fine<br>
tuning later. But if we're all on the same page, I think we can do<br>
that, even if it takes time.<br>
<br>
I'm particularly concerned with Android, because they not only have<br>
their own tree with heavily modified LLVM components (ex.<br>
Compiler-RT), but they also build differently and so their process are<br>
completely alien to ours. One of the key reasons why these things<br>
happened is because:<br></blockquote></div></div></blockquote></div></div></div></div></blockquote><div><br></div><div>I am not sure why you think Android's compiler-rt is an example of a "heavily modified" component. As I see it, our compiler-rt matches upstream almost exactly (with one minor mistake from a duplicate merge that results in extra copies of some static functions that we don't even build). We do have 3 cherry-picks for some MIPS ASan patches, but all of those come directly from TOT master.</div><div><br></div><div>There are some Android-only patches in LLVM and Clang (thanks to RenderScript, and not being able to easily upstream these - i.e. the RS frontend doesn't live as an LLVM upstream project, so it is hard to write tests for these modifications). None of those patches should impact things greatly. Assuming you sync to the same CL (plus <10 cherry-picks to all projects), any C/C++ regression should be reproducible with a normal TOT build. This has been true since we did upstream our most divergent patch (re: calling conventions for ARM vectors) a few months ago.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><div><div><blockquote type="cite"><div><div><blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br>
* They couldn't rely on our releases, as fixing bugs and back-porting<br>
wasn't a thing back then<br></blockquote></div></div></blockquote></div></div></div></div></blockquote><div>The real problem is retaining history. Release branches don't make this very nice, and necessitate that we swap out an entire chunk of history for a different chunk of history every time we change releases. That is pretty obnoxious for keeping a good idea of what has happened, and thus following master makes this easier for us (and I assume others too). We did try using a release branch back for LLVM 3.5, but the maintenance cost for then updating things when we wanted to move past 3.5 showed me why I don't want to really look </div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><div><div><blockquote type="cite"><div><div><blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
* They already had their own release schedule, so aligning with ours<br>
brought no extra benefit<br></blockquote></div></div></blockquote></div></div></div></div></blockquote><div>It is not 100% clear that Android will want to be dependent on LLVM's release schedule. I think that there are definitely benefits to having everyone do extra validation, but I am unconvinced that it is the "same" validation for everyone that is valuable, hence this might not make things go much smoother/faster for those groups.</div><div><br></div><div>Thanks,</div><div>Steve</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><div><div><blockquote type="cite"><div><div><blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
* We always expected people to work off trunk, and everyone had to<br>
create their own process<br>
<br>
I don't want to change how people work, just to add one more valid way<br>
of working, which is most stable for upstream releases. :)<br>
<br>
<br>
<br>
<blockquote type="cite">The only reasonable way I see of aligning upstream releases with<br>
downstream schedules would be to release much more often. This works<br>
well in Chromium where there's a 6-week staged release schedule. This<br>
would mean there's always a branch going for the next release, and<br>
important bug fixes would get merged to that.<br>
</blockquote>
<br>
Full validation every 6 weeks is just not possible. But a multiple of<br>
that, say every 3~4 months, could be much easier to work around.<br>
<br>
<br>
<br>
<blockquote type="cite">In Chromium we drive<br>
this from the bug tracker -- it would be very hard to scan each commit<br>
for things to cherry-pick. This kind of process has a high cost<br>
though, there has to be good infrastructure for it (buildbots on the<br>
branch for all targets, for example), developers have to be aware, and<br>
even then it's a lot of work for those doing the releases. I'm not<br>
sure we'd want to take this on. I'm also not sure it would be suitable<br>
for a compiler, where we want the releases to have long life-time.<br>
</blockquote>
<br>
This works because you have a closed system. As you say, Chromium is<br>
mostly final product, not a tool to develop other products, and the<br>
validation is a lot simpler.<br>
<br>
With Clang, we'd want to involve external releases into it, and it<br>
simply wouldn't scale.<br>
<br>
<br>
<br>
<blockquote type="cite">For the major releases, I've tried to do this. We could certainly<br>
formalize it by posting it on the web page though.<br>
</blockquote>
<br>
I think that'd be the first step, yes. But I wanted to start with a<br>
good number. 2 times a year? Would 3 times improve things that much<br>
for the outsiders? Or just moving the dates would be enough for most<br>
people?<br>
<br>
That's why I copied so many outsiders, so they can chime in and let us<br>
know what would be good for *them*.<br>
</blockquote>
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">Data
 point: At Sony we ship our stuff every 6 months and that isn't</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">going
 to change.  Our policy has been to base our releases on upstream</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">releases,
 and given our current lead times, the current upstream release</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">schedule
 is actually not bad, especially if it has stopped drifting.</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">Having
 four releases pretty consistently follow the current schedule is</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">extremely
 positive, thanks!</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">It
 would help our internal planning to publish the schedule for future</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">releases.
  You never know, we might even be able to fork an internal</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">branch
 in time to help with the release testing, although that is not</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">in
 any way a lightweight process (so no promises).</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">There
 has been some talk about moving toward releasing from upstream</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">trunk,
 or more precisely to streamlining our internal testing process</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">in
 order to allow us to seriously contemplate releasing from upstream</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">trunk.
  I can't argue with the streamlining part, for sure.  Whether</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">the
 rest of it works out must remain to be seen.</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<span style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;float:none;display:inline!important">--paulr</span><br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<blockquote type="cite" style="font-family:Menlo-Regular;font-size:11px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">
<br>
<br>
<blockquote type="cite">Most importantly, those folks should get involved :-)<br>
</blockquote>
<br>
Indeed!<br>
<br>
<br>
<blockquote type="cite">In practice, we kind of have this for at least some of the targets.<br>
Maybe we should write this down somewhere instead of me asking for<br>
(the same) volunteers each time the release process starts?<br>
</blockquote>
<br>
I give consent to mark me as the ARM/AArch64 release tester for the<br>
foreseeable future. :)<br>
<br>
I can also help Sylvestre, Doko, Ed, Jeff, Bero etc. to test on their<br>
system running on ARM/AArch64 hardware.<br>
<br>
cheers,<br>
--renato</blockquote>
</div>
</div>
</blockquote>
</div>
<br>
</div></div></div>

</blockquote></div><br></div></div>