[llvm] [test-suite] Document the LLVM test-suite benchmark apps (PR #105843)
Sjoerd Meijer via llvm-commits
llvm-commits at lists.llvm.org
Fri Aug 23 08:23:30 PDT 2024
https://github.com/sjoerdmeijer created https://github.com/llvm/llvm-project/pull/105843
There is no documentation or description of the different apps in the LLVM benchmark test-suite and this is a first attempt to document this for the MultiSource apps.
>From 46d2ee2eb3664fe1bd405bb80be618ab2c2d3074 Mon Sep 17 00:00:00 2001
From: Sjoerd Meijer <smeijer at nvidia.com>
Date: Fri, 23 Aug 2024 07:41:47 -0700
Subject: [PATCH] Document the LLVM test-suite benchmark apps
There is no documentation or description of the different apps in the
LLVM benchmark test-suite and this is a first attempt to document this
for the MultiSource apps.
---
llvm/docs/TestSuiteGuide.md | 35 +++++++++++++++++++++++++++++++++++
1 file changed, 35 insertions(+)
diff --git a/llvm/docs/TestSuiteGuide.md b/llvm/docs/TestSuiteGuide.md
index 9d43e1a345ffea..01678990cddd14 100644
--- a/llvm/docs/TestSuiteGuide.md
+++ b/llvm/docs/TestSuiteGuide.md
@@ -135,6 +135,41 @@ Every program can work as a correctness test. Some programs are unsuitable for
performance measurements. Setting the `TEST_SUITE_BENCHMARKING_ONLY` CMake
option to `ON` will disable them.
+The MultiSource benchmarks consist of the following apps and benchmarks:
+
+| MultiSource | Language | Application Area | Remark |
+|----------------------|-----------|-------------------------------|----------------------|
+| 7zip | C/C++ | Compression/Decompression | |
+| ASCI_Purple | C | SMG2000 benchmark and solver | Memory intensive app |
+| ASC_Sequoia | C | Simulation and solver | |
+| BitBench | C | uudecode/uuencode utility | Bit Stream benchmark for functional compilers |
+| Bullet | C++ | Bullet 2.75 physics engine | |
+| DOE-ProxyApps-C++ | C++ | HPC/scientific apps | Small applications, representative of our larger DOE workloads |
+| DOE-ProxyApps-C | C | HPC/scientific apps | " |
+| Fhourstones | C | Game/solver | Integer benchmark that efficiently solves positions in the game of Connect-4 |
+| Fhourstones-3.1 | C | Game/solver | " |
+| FreeBench | C | Benchmark suite | Raytracer, four in a row, neural network, file compressor, Fast Fourier/Cosine/Sine Transform |
+| llubenchmark | C | Linked-list micro-benchmark | |
+| mafft | C | Bioinformatics | A multiple sequence alignment program |
+| MallocBench | C | Benchmark suite | cfrac, espresso, gawk, gs, make, p2c, perl |
+| McCat | C | Benchmark suite | Quicksort, bubblesort, eigenvalues |
+| mediabench | C | Benchmark suite | adpcm, g721, gsm, jpeg, mpeg2 |
+| MiBench | C | Embedded benchmark suite | Automotive, consumer, office, security, telecom apps |
+| nbench | C | | BYTE Magazine's BYTEmark benchmark program |
+| NPB-serial | C | Parallel computing | Serial version of the NPB IS code |
+| Olden | C | Data Structures | SGI version of the Olden benchmark |
+| OptimizerEval | C | Solver | Preston Brigg's optimizer evaluation framework |
+| PAQ8p | C++ | Data compression | |
+| Prolangs-C++ | C++ | Benchmark suite | city, deriv1, deriv2, employ, family, fsm, garage, life, NP, objects, ocean, office, primes, shapes, simul, trees, vcirc |
+| Prolangs-C | C | Benchmark suite | agrep, allroots, archie-client, assembler, bison, cdecl, compiler, fixoutput, football, gnugo, loader, plot2fig, simulator, TimberWolfMC, unix-smail, unix-tbl |
+| Ptrdist | C | Pointer-Intensive Benchmark Suite | |
+| Rodinia | C | Scientific apps | backprop, pathfinder, srad |
+| SciMark2-C | C | Scientific apps | FFT, LU, Montecarlo, sparse matmul |
+| sim | C | Dynamic programming | A Time-Efficient, Linear-Space Local Similarity Algorithm |
+| tramp3d-v4 | C++ | Numerical analysis | Template-intensive numerical program based on FreePOOMA |
+| Trimaran | C | Encryption | 3des, md5, crc |
+| TSVC | C | Vectorization benchmark | Test Suite for Vectorizing Compilers (TSVC) |
+| VersaBench | C | Benchmark suite | 8b10b, beamformer, bmm, dbms, ecbdes |
Configuration
-------------
More information about the llvm-commits
mailing list