[llvm] [test-suite] Document the LLVM test-suite benchmark apps (PR #105843)
Sjoerd Meijer via llvm-commits
llvm-commits at lists.llvm.org
Fri Aug 30 07:17:51 PDT 2024
https://github.com/sjoerdmeijer updated https://github.com/llvm/llvm-project/pull/105843
>From aa4220e76da6e64c958234ff75ab408631543f00 Mon Sep 17 00:00:00 2001
From: Sjoerd Meijer <smeijer at nvidia.com>
Date: Fri, 23 Aug 2024 07:41:47 -0700
Subject: [PATCH] [test-suite] Document the LLVM test-suite benchmark apps
There is no documentation or description of the different apps in the
LLVM benchmark test-suite and this is a first attempt to document this.
---
llvm/docs/TestSuiteGuide.md | 38 +++++++++++++++++++++++++++++++++++++
1 file changed, 38 insertions(+)
diff --git a/llvm/docs/TestSuiteGuide.md b/llvm/docs/TestSuiteGuide.md
index 9d43e1a345ffea..efdf3ff3607789 100644
--- a/llvm/docs/TestSuiteGuide.md
+++ b/llvm/docs/TestSuiteGuide.md
@@ -135,6 +135,44 @@ Every program can work as a correctness test. Some programs are unsuitable for
performance measurements. Setting the `TEST_SUITE_BENCHMARKING_ONLY` CMake
option to `ON` will disable them.
+The MultiSource benchmarks consist of the following apps and benchmarks:
+
+| MultiSource | Language | Application Area | Remark |
+|----------------------|-----------|-------------------------------|----------------------|
+| 7zip | C/C++ | Compression/Decompression | |
+| ASCI_Purple | C | SMG2000 benchmark and solver | Memory intensive app |
+| ASC_Sequoia | C | Simulation and solver | |
+| BitBench | C | uudecode/uuencode utility | Bit Stream benchmark for functional compilers |
+| Bullet | C++ | Bullet 2.75 physics engine | |
+| DOE-ProxyApps-C++ | C++ | HPC/scientific apps | Small applications, representative of our larger DOE workloads |
+| DOE-ProxyApps-C | C | HPC/scientific apps | " |
+| Fhourstones | C | Game/solver | Integer benchmark that efficiently solves positions in the game of Connect-4 |
+| Fhourstones-3.1 | C | Game/solver | " |
+| FreeBench | C | Benchmark suite | Raytracer, four in a row, neural network, file compressor, Fast Fourier/Cosine/Sine Transform |
+| llubenchmark | C | Linked-list micro-benchmark | |
+| mafft | C | Bioinformatics | A multiple sequence alignment program |
+| MallocBench | C | Benchmark suite | cfrac, espresso, gawk, gs, make, p2c, perl |
+| McCat | C | Benchmark suite | Quicksort, bubblesort, eigenvalues |
+| mediabench | C | Benchmark suite | adpcm, g721, gsm, jpeg, mpeg2 |
+| MiBench | C | Embedded benchmark suite | Automotive, consumer, office, security, telecom apps |
+| nbench | C | | BYTE Magazine's BYTEmark benchmark program |
+| NPB-serial | C | Parallel computing | Serial version of the NPB IS code |
+| Olden | C | Data Structures | SGI version of the Olden benchmark |
+| OptimizerEval | C | Solver | Preston Brigg's optimizer evaluation framework |
+| PAQ8p | C++ | Data compression | |
+| Prolangs-C++ | C++ | Benchmark suite | city, employ, life, NP, ocean, primes, simul, vcirc |
+| Prolangs-C | C | Benchmark suite | agrep, archie-client, bison, gnugo, unix-smail |
+| Ptrdist | C | Pointer-Intensive Benchmark Suite | |
+| Rodinia | C | Scientific apps | backprop, pathfinder, srad |
+| SciMark2-C | C | Scientific apps | FFT, LU, Montecarlo, sparse matmul |
+| sim | C | Dynamic programming | A Time-Efficient, Linear-Space Local Similarity Algorithm |
+| tramp3d-v4 | C++ | Numerical analysis | Template-intensive numerical program based on FreePOOMA |
+| Trimaran | C | Encryption | 3des, md5, crc |
+| TSVC | C | Vectorization benchmark | Test Suite for Vectorizing Compilers (TSVC) |
+| VersaBench | C | Benchmark suite | 8b10b, beamformer, bmm, dbms, ecbdes |
+
+All MultiSource applications are suitable for performance measurements
+and will run when CMake option `TEST_SUITE_BENCHMARKING_ONLY` is set.
Configuration
-------------
More information about the llvm-commits
mailing list