[LLVMdev] RFC:LNT Improvements

[Kristof Beyls]

Hi Chris,

I think it would definitely be useful to share your script; so that we don't
need to reinvent
the wheel.

Thanks!

Kristof

> > - Make sure board has low background noise
> >        Perform a system performance benchmark before each run and
> compare the value with the reference(obtained during machine set-up). If
> the percentage difference is too large, abort or defer the run. In
prototype
> this feature is implemented using Bash script and not integrated into LNT.
> Will rewrite in Python.
> >        LNT: benchmark.sh
> 
> I wrote a very similar python script for checking system baselines.  I
think this
> is a great idea.  My script ran several non-compiler related tasks, which
> *should* be stable on any machine.  By should I mean, they are long
running
> and intentionally only test one aspect of the system.  I did not gate
results on
> these runs, but instead submitted these results to LNT, then allowed it to
> report on anomalies it detected.  So far this process has detected some
> problems on our testing machines.  If there is interest I can share that
script.