[PATCH] D83286: [analyzer][solver] Track symbol disequalities

[Valeriy Savchenko via Phabricator via cfe-commits]

vsavchenko added a comment.

Introduction
------------

I have some test results with execution times.  Because the execution time varies from one execution to another, I've measured performance on master twice (I know that it's not very conclusive) to show that equivalence tracking doesn't affect performance of the analyzer.  So, please, let's treat it more like a smoke test that everything stayed the same with a new functionality rather than a full-blown performance benchmarking.

Raw results
-----------

| project    | master run#1 | master run#2 | patch run#1 |
| ---------- | ------------ | ------------ | ----------- |
| box2d      | 137.57s      | 156.36s      | 142.46s     |
| cxxopts    | 26.74s       | 29.31s       | 27.01s      |
| drogon     | 257.43s      | 265.88s      | 263.00s     |
| duckdb     | 2251.08s     | 2297.60s     | 2258.06s    |
| fmt        | 266.96s      | 293.06s      | 279.26s     |
| libsoundio | 33.89s       | 35.37s       | 36.48s      |
| oatpp      | 171.58s      | 175.25s      | 172.92s     |
| re2        | 84.12s       | 133.46s      | 87.24s      |
| simbody    | 1405.25s     | 1374.38s     | 1365.58s    |
| symengine  | 455.94s      | 487.50s      | 466.28s     |
| termbox    | 20.91s       | 20.28s       | 20.88s      |
| tinyexpr   | 11.91s       | 13.53s       | 12.58s      |
| tinyspline | 48.61s       | 49.01s       | 48.90s      |
| tinyvm     | 27.77s       | 29.32s       | 28.70s      |
| zstd       | 150.28s      | 152.86s      | 154.21s     |
|



Processed results
-----------------

| project    | min delta | max delta | within range                         |
| ---------- | --------- | --------- | ------------------------------------ |
| box2d      | -8.9%     | 3.6%      | {icon check-circle color=green}      |
| cxxopts    | -7.8%     | 1.0%      | {icon check-circle color=green}      |
| drogon     | -1.1%     | 2.2%      | {icon check-circle color=green}      |
| duckdb     | -1.7%     | 0.3%      | {icon check-circle color=green}      |
| fmt        | -4.7%     | 4.6%      | {icon check-circle color=green}      |
| libsoundio | 3.1%      | 7.6%      | {icon arrow-circle-up color=red}     |
| oatpp      | -1.3%     | 0.8%      | {icon check-circle color=green}      |
| re2        | -34.6%    | 3.7%      | {icon check-circle color=green}      |
| simbody    | -2.8%     | -0.6%     | {icon arrow-circle-down color=green} |
| symengine  | -4.4%     | 2.3%      | {icon check-circle color=green}      |
| termbox    | -0.1%     | 3.0%      | {icon check-circle color=green}      |
| tinyexpr   | -7.0%     | 5.6%      | {icon check-circle color=green}      |
| tinyspline | -0.2%     | 0.6%      | {icon check-circle color=green}      |
| tinyvm     | -2.1%     | 3.3%      | {icon check-circle color=green}      |
| zstd       | 0.9%      | 2.6%      | {icon arrow-circle-up color=red}     |
|


Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D83286/new/

https://reviews.llvm.org/D83286