[PATCH] D113857: [llvm-reduce] Add parallel chunk processing.

Florian Hahn via Phabricator via llvm-commits llvm-commits at lists.llvm.org
Wed Nov 17 04:16:04 PST 2021


fhahn updated this revision to Diff 387897.
fhahn marked 2 inline comments as done.
fhahn added a comment.
Herald added a subscriber: mgorny.

Adjust task handling: instead of queuing 2 * NumJobs task up front and waiting for all of them to complete, first queue a number closer to the available jobs (NumJobs + 2 at the moment, so there's a bit of extra work in case a few jobs finish early).

The patch now uses a queue to keep track of all futures for the scheduled tasks. After scheduling the initial set of tasks, we wait for the first task in the queue to complete. After it completes, we schedule anohter tasks (if we can and there's no other tasks that successfully reduced a chunk). We continue waiting for tasks in the queue, until we reach a job that reduced a chunk or we are out of jobs.


Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D113857/new/

https://reviews.llvm.org/D113857

Files:
  llvm/test/tools/llvm-reduce/operands-skip.ll
  llvm/tools/llvm-reduce/CMakeLists.txt
  llvm/tools/llvm-reduce/deltas/Delta.cpp

-------------- next part --------------
A non-text attachment was scrubbed...
Name: D113857.387897.patch
Type: text/x-patch
Size: 10487 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20211117/54fce677/attachment-0001.bin>


More information about the llvm-commits mailing list