[PATCH] D83286: [analyzer][solver] Track symbol disequalities

Valeriy Savchenko via Phabricator via cfe-commits cfe-commits at lists.llvm.org
Mon Jul 13 01:28:47 PDT 2020


vsavchenko added a comment.

Introduction
------------

I have some test results with execution times.  Because the execution time varies from one execution to another, I've measured performance on master twice (I know that it's not very conclusive) to show that equivalence tracking doesn't affect performance of the analyzer.  So, please, let's treat it more like a smoke test that everything stayed the same with a new functionality rather than a full-blown performance benchmarking.

Raw results
-----------

| project    | master run#1 | master run#2 | patch run#1 |
| ---------- | ------------ | ------------ | ----------- |
| box2d      | 137.57s      | 156.36s      | 142.46s     |
| cxxopts    | 26.74s       | 29.31s       | 27.01s      |
| drogon     | 257.43s      | 265.88s      | 263.00s     |
| duckdb     | 2251.08s     | 2297.60s     | 2258.06s    |
| fmt        | 266.96s      | 293.06s      | 279.26s     |
| libsoundio | 33.89s       | 35.37s       | 36.48s      |
| oatpp      | 171.58s      | 175.25s      | 172.92s     |
| re2        | 84.12s       | 133.46s      | 87.24s      |
| simbody    | 1405.25s     | 1374.38s     | 1365.58s    |
| symengine  | 455.94s      | 487.50s      | 466.28s     |
| termbox    | 20.91s       | 20.28s       | 20.88s      |
| tinyexpr   | 11.91s       | 13.53s       | 12.58s      |
| tinyspline | 48.61s       | 49.01s       | 48.90s      |
| tinyvm     | 27.77s       | 29.32s       | 28.70s      |
| zstd       | 150.28s      | 152.86s      | 154.21s     |
|



Processed results
-----------------

| project    | min delta | max delta | within range                         |
| ---------- | --------- | --------- | ------------------------------------ |
| box2d      | -8.9%     | 3.6%      | {icon check-circle color=green}      |
| cxxopts    | -7.8%     | 1.0%      | {icon check-circle color=green}      |
| drogon     | -1.1%     | 2.2%      | {icon check-circle color=green}      |
| duckdb     | -1.7%     | 0.3%      | {icon check-circle color=green}      |
| fmt        | -4.7%     | 4.6%      | {icon check-circle color=green}      |
| libsoundio | 3.1%      | 7.6%      | {icon arrow-circle-up color=red}     |
| oatpp      | -1.3%     | 0.8%      | {icon check-circle color=green}      |
| re2        | -34.6%    | 3.7%      | {icon check-circle color=green}      |
| simbody    | -2.8%     | -0.6%     | {icon arrow-circle-down color=green} |
| symengine  | -4.4%     | 2.3%      | {icon check-circle color=green}      |
| termbox    | -0.1%     | 3.0%      | {icon check-circle color=green}      |
| tinyexpr   | -7.0%     | 5.6%      | {icon check-circle color=green}      |
| tinyspline | -0.2%     | 0.6%      | {icon check-circle color=green}      |
| tinyvm     | -2.1%     | 3.3%      | {icon check-circle color=green}      |
| zstd       | 0.9%      | 2.6%      | {icon arrow-circle-up color=red}     |
|


Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D83286/new/

https://reviews.llvm.org/D83286





More information about the cfe-commits mailing list