[all-commits] [llvm/llvm-project] 5b4f14: [analyzer][tests] Introduce analyzer benchmarking ...

[Valeriy Savchenko via All-commits]

  Branch: refs/heads/master
  Home:   https://github.com/llvm/llvm-project
  Commit: 5b4f143564502664a9d1197d6909047eab49530e
      https://github.com/llvm/llvm-project/commit/5b4f143564502664a9d1197d6909047eab49530e
  Author: Valeriy Savchenko <vsavchenko at apple.com>
  Date:   2020-07-14 (Tue, 14 Jul 2020)

  Changed paths:
    M clang/utils/analyzer/SATest.py
    A clang/utils/analyzer/SATestBenchmark.py
    M clang/utils/analyzer/SATestBuild.py
    M clang/utils/analyzer/SATestUpdateDiffs.py
    M clang/utils/analyzer/requirements.txt

  Log Message:
  -----------
  [analyzer][tests] Introduce analyzer benchmarking framework

Summary:
This commit includes a couple of changes:
  * Benchmark selected projects by analyzing them multiple times
  * Compare two benchmarking results and visualizing them on one chart
  * Organize project build logging, so we can use the same code
    in benchmarks

Differential Revision: https://reviews.llvm.org/D83539


  Commit: 089a0ad8bc993923817d7957f08bd67dbecd56af
      https://github.com/llvm/llvm-project/commit/089a0ad8bc993923817d7957f08bd67dbecd56af
  Author: Valeriy Savchenko <vsavchenko at apple.com>
  Date:   2020-07-14 (Tue, 14 Jul 2020)

  Changed paths:
    M clang/utils/analyzer/Dockerfile
    M clang/utils/analyzer/entrypoint.py
    A clang/utils/analyzer/projects/capnproto/cleanup_run_static_analyzer.sh
    A clang/utils/analyzer/projects/capnproto/run_static_analyzer.cmd
    A clang/utils/analyzer/projects/cppcheck/cleanup_run_static_analyzer.sh
    A clang/utils/analyzer/projects/cppcheck/run_static_analyzer.cmd
    A clang/utils/analyzer/projects/faiss/cleanup_run_static_analyzer.sh
    A clang/utils/analyzer/projects/faiss/run_static_analyzer.cmd
    A clang/utils/analyzer/projects/harfbuzz/cleanup_run_static_analyzer.sh
    A clang/utils/analyzer/projects/harfbuzz/run_static_analyzer.cmd
    M clang/utils/analyzer/projects/projects.json
    A clang/utils/analyzer/projects/tmux/cleanup_run_static_analyzer.sh
    A clang/utils/analyzer/projects/tmux/run_static_analyzer.cmd

  Log Message:
  -----------
  [analyzer][tests] Add 5 more projects for testing

Differential Revision: https://reviews.llvm.org/D83701


Compare: https://github.com/llvm/llvm-project/compare/faa7e306e41b...089a0ad8bc99