<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">Huh. I used to run a buildbot system for a different project, on an ancient version of buildbot: 0.7.3 (which was current at the time I set it up, and I never upgraded it, since it was internal, and working just fine). That version doesn't even have a feature to throw away old state, and the buildmaster had build columns with 10000 builds worth of history in them, with no apparent issues. Now certainly LLVM's buildbot has many more builders (I only had ~10, vs LLVM's ~80), but unless the current version performs much worse than the old version (might be the case!), or the machine it's running on is much slower than the one I had (dunno!), it seems surprising that it starts falling over after only 500 builds worth of history.<div><br></div><div><div>I <i>think</i> that version read all the build-state pickle files at startup and just kept it in memory. If that's changed, and it hits all the build-state pickle files on every page load, that would seem an unfortunate change.<br><div><br><div><div>On May 21, 2015, at 1:34 AM, Mike Edwards <<a href="mailto:mike@sqlby.me">mike@sqlby.me</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div dir="ltr">FWIW, my experience with our Buildbot system has taught me that anything past 500 or so build logs per builder, causes Buildbot to behave very poorly. Buildbot uses pickle files to store build status results and the meta information such as the location of the actual text file with the build and test step stdio information. When Buidlbot loads a webpage (such as the Waterfall or Console view) it reads all of the relevant pickle files for the builds it is displaying information for. If you happen to have a large build history, all of the pickle files are read while the page is loading. This will bring Buildbot to an almost complete standstill. It's unfortunate that this information never made it out of the pickle files and into the transactional backend. Maybe time to start looking for a better CI solution (if one really even exists)?<div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 20, 2015 at 7:24 PM, Chris Matthews <span dir="ltr"><<a href="mailto:chris.matthews@apple.com" target="_blank">chris.matthews@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="auto"><div>YMMV, but I think when I tried this with buildbot 250 was the largest I could get per build, no matter how many I told it to keep. <br><br>Sent from my iPad</div><div><div class="h5"><div><br>On May 20, 2015, at 6:27 PM, Sean Silva <<a href="mailto:chisophugis@gmail.com" target="_blank">chisophugis@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 19, 2015 at 12:50 PM, Reid Kleckner <span dir="ltr"><<a href="mailto:rnk@google.com" target="_blank">rnk@google.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Tue, May 19, 2015 at 11:50 AM, Chris Matthews <span dir="ltr"><<a href="mailto:chris.matthews@apple.com" target="_blank">chris.matthews@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div style="word-wrap:break-word">sanitizer-windows</div></blockquote><div><br></div><div>So, I tried to track down what went wrong here, and the oldest build I can find is:</div><div><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lab.llvm.org-3A8011_builders_sanitizer-2Dwindows_builds_3916&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=Mfk2qtn1LTDThVkh6-oGglNfMADXfJdty4_bhmuhMHA&m=07HRhUHP9xtwQD7oY-E_vDRSffW8a2G4DHivXOmJIrA&s=DGWMQ6ZQWPHdddx7WOxrX9EFyXuBVTAUNV9StHvXrm4&e=" target="_blank">http://lab.llvm.org:8011/builders/sanitizer-windows/builds/3916</a></div><div><br></div><div>This raises a different problem: the buildmaster doesn't hold onto enough logs. That build is from five days ago, and already I can't find the relevant blamelist causing the breakage. =/</div></div></div></div></blockquote><div><br></div><div>+1, in today's day and age, it's senseless to not just keep infinite logs.</div><div><br></div><div>-- Sean Silva</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>_______________________________________________<br>
cfe-dev mailing list<br>
<a href="mailto:cfe-dev@cs.uiuc.edu" target="_blank">cfe-dev@cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/cfe-dev</a><br>
<br></blockquote></div><br></div></div>
</blockquote></div></div></div><br>_______________________________________________<br>
LLVM Developers mailing list<br>
<a href="mailto:LLVMdev@cs.uiuc.edu">LLVMdev@cs.uiuc.edu</a> <a href="http://llvm.cs.uiuc.edu/" target="_blank">http://llvm.cs.uiuc.edu</a><br>
<a href="http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev" target="_blank">http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev</a><br>
<br></blockquote></div><br></div></div>
_______________________________________________<br>LLVM Developers mailing list<br><a href="mailto:LLVMdev@cs.uiuc.edu">LLVMdev@cs.uiuc.edu</a> <a href="http://llvm.cs.uiuc.edu">http://llvm.cs.uiuc.edu</a><br><a href="http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev">http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev</a><br></blockquote></div><br></div></div></div></body></html>