[PATCH] D26967: Put opt-viewer critical items in parallel

[Florian Hahn via llvm-commits]

fhahn added a comment.

Here are some numbers I gathered for analyzing 250 opt.yaml files generated by compiling clang/llvm with the following options: "-O2 -g -fsave-optimization-record -mllvm -pass-remarks -mllvm -pass-remarks-missed". The size of the .opt.yaml files varies between a few kB and a few MB.

I used Python 2.7.6 on Linux with PyYAML and libyaml  on an Intel Xeon with a large number of cores (`time` used to measure the runtime):

baseline:
`./opt-viewer-base.py `cat yamls_250.txt ` `pwd`/out-baseline  257.55s user 86.05s system 91% cpu 6:15.89 total`

parallel with 10 processes 
./opt-viewer.py `cat yamls_250.txt ` `pwd`/out-parallel-10  607.80s user 268.75s system 160% cpu 9:04.52 total`

parallel with 4 processes
`./opt-viewer.py `cat yamls_250.txt ` `pwd`/out-parallel-4  524.31s user 196.45s system 163% cpu 7:20.54 total`

I'm not sure if I did something wrong. How big were the opt.yaml files you used?


Repository:
  rL LLVM

https://reviews.llvm.org/D26967