fhahn added a comment. A while ago I put up a patch to make the scheduler slightly more aggressive with using latency https://reviews.llvm.org/D38279. I did not really have time to follow it up though. https://reviews.llvm.org/D45229