[libcxx-commits] [libcxx] [libc++] Run all the microbenchmarks in run-benchmarks (PR #181374)

Louis Dionne via libcxx-commits libcxx-commits at lists.llvm.org
Fri Feb 13 07:38:25 PST 2026


https://github.com/ldionne created https://github.com/llvm/llvm-project/pull/181374

Running all the benchmarks does not significantly increase the total time, and it ensures that what we upload to LNT corresponds exactly to what's in the test suite.

>From cb2b01ea0386b75980ceacb363834313f34f7e41 Mon Sep 17 00:00:00 2001
From: Louis Dionne <ldionne.2 at gmail.com>
Date: Fri, 13 Feb 2026 10:27:19 -0500
Subject: [PATCH] [libc++] Run all the microbenchmarks in run-benchmarks

Running all the benchmarks does not significantly increase
the total time, and it ensures that what we upload to LNT
corresponds exactly to what's in the test suite.
---
 libcxx/utils/ci/lnt/run-benchmarks | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/libcxx/utils/ci/lnt/run-benchmarks b/libcxx/utils/ci/lnt/run-benchmarks
index e2d1980f3f92a..8f9ff72ef3166 100755
--- a/libcxx/utils/ci/lnt/run-benchmarks
+++ b/libcxx/utils/ci/lnt/run-benchmarks
@@ -156,8 +156,6 @@ def main(argv):
             with open(build_dir / 'benchmarks.lnt', 'a') as f:
                 run([args.git_repo / 'libcxx/utils/consolidate-benchmarks', build_dir / 'spec'], stdout=f)
 
-        # TODO: For now, we run only a subset of the benchmarks because running the whole test suite is too slow.
-        #       Run the whole test suite once https://github.com/llvm/llvm-project/issues/173032 is resolved.
         if do_micro:
             logging.info(f'Running microbenchmarks from {args.test_suite_commit} against libc++ {args.benchmark_commit}')
             run([args.git_repo / 'libcxx/utils/test-at-commit',
@@ -170,8 +168,7 @@ def main(argv):
                             '--param', f'compiler={args.compiler}',
                             '--param', 'optimization=speed',
                             '--param', 'std=c++26',
-                            build_dir / 'micro/libcxx/test',
-                            '--filter', 'benchmarks/(algorithms|containers|iterators|locale|memory|streams|numeric|utility)'],
+                            build_dir / 'micro/libcxx/test/benchmarks'],
                             enforce_success=False)
             with open(build_dir / 'benchmarks.lnt', 'a') as f:
                 run([args.git_repo / 'libcxx/utils/consolidate-benchmarks', build_dir / 'micro'], stdout=f)



More information about the libcxx-commits mailing list